better unittests for tokenizer