unified the way the ngrams are extracted and the way a text is parsed