all tokens are first transformed into singular form, then stemmed and finally autocorrected