Hello there, I have corpus dictionary with 5.5 MB filesize as .txt file, when i monitor my code memory usage using debug mode, the memory usage spiked up to 1+GB memory. You can see the graph here :
Is there any way to optimize this? i already tried to load dictionary as compressed pickle or pickle but i think the dictionary is not loaded because it's not detecting any typo on my text.
Hello there, I have corpus dictionary with 5.5 MB filesize as .txt file, when i monitor my code memory usage using debug mode, the memory usage spiked up to 1+GB memory. You can see the graph here :
Is there any way to optimize this? i already tried to load dictionary as compressed pickle or pickle but i think the dictionary is not loaded because it's not detecting any typo on my text.