Much smarter synchronization among the processes in the ngram generator. Compensates for files of differing sizes.
Little changes in generate ngrams
Making it easier not to lose track of the various datasets