making mutually exclusive options for the tokenizer