added in error handling for tokenizer