Tokenizer seems to work and test correctly.