Updated tokenizer to filter special characters.