Tokenizing and stemming all the input files in a directory. Based on some feature selection methods.