Tokenizer: Refactor for flexibility.