tokenizer for preparing lda data sets

This is a simple tokenizer that can be used to preprocess data set for lda.