Kernel die after excuting compute function:

[amjadhz]

Hi all,

I am using Record linkage for my data and I have already chosen a small amount of the big data I kve like 20 rows only, Index it and block it based on 2 features.
Then use the compare function to compare the pairs that were created during indexing.
after that, I use compute function just like how the documentation says. It was working well, but out of a sudden, I have this error. I have tried a lot to solve it. but I could not, All libraries and extensions I have been installed well. I restart the kernel and the code work well until it goes to the cell where compute function will execute, and be crushed again.
I am using Jupiter notebook on vs code.

So do you have any idea on how to solve this issue?

[amjadhz]

My mistake here is that I am blocking based on a feature that has 400K records which creates billions of pairs, that process uses all the memory I have and make the kernel die.