update lexer for the change of token table