full lexeme analysis without errors