Performs more work on AST parser and lexer.