tokenizer is now working
tokenizer now working as expected