Added tokenizer unit test