Fixed tokenizer can be used by main