bug fix in token parser. was erroneously lexing after parsing an empty token.