Lexer now supports new tokens.