gave gettok function the ability to recognize comments