Added a test for tokenization.