Committing for an updates sake, their is huge memory issues with the ngram generation algorithms