stemming, ngram-patterns, duplicate removal