adding tests for tokenizer