tokenizer class now identifies pos