make tokenizer abortable