the tokenizer has been available