Added tokenizer flag.