Optimized preprocessing training data, added lexicon as safety net