simplify tokenizer dictionary creation