Pass unit test on tokenization.