Retested lexer. Fixed bug where comment size was incorrectly added to token span. Comments are now also a token.