Separation of concerns for Tokenizer