Added some tokenizer tests.