Refactored so lex assigns token to tree leaf.