token_classifier_new.py is refactoreda little bit.  This version allows the classifier to extract part-of-speech as a feature.