speed up on-disk hash table creation by not flushing to disk completely until the end of the program