User can provide tokenize function

The user can now provide a different tokenize function. Eg: tokenize and
remove stopwords