Dramatically increased perfomance by implementing shared strings index. Uses not much memory, but speeds up a lot.
Uses 17mb for 80000 rows, and full traversal took 23sec instead of infinite on 1 second by row