added the comments support in the tokenizer