Before revision:  Instead, we first train a backward-looking agent with a simple relaxed goal . We then augment the state representation of the puzzle with straightforward hint features that are extracted from the behavior of that agent.
After revision:  Instead, we first train a backward-looking agent with a simple relaxed goal , and then augment the state representation of the puzzle with straightforward hint features that are extracted from the behavior of that agent.