Cleanup leftover memory from the lexer