Before revision:  Humans can update the action-value function only with the verbal description as if they experience states, actions, and corresponding rewards sequences first hand .
After revision:  Humans can update the action-value function only with the verbal description as if they experience states, actions, and corresponding rewards sequences firsthand .