- creating inverse index gets tokens instead of ngrams
- specialize ngram creation for 1grams
- optimize stemmer for handling substrings