fixed useflag tokenizer