use tokenizer and preprocessor in the classifier