Made the tokenizer tests compile.