Before revision:  In this paper, we design and investigate a generative language-grounded policy which computes the distribution over all possible instructions  given action and the transition history.
After revision:  In this paper, we design and investigate a generative language-grounded policy which computes the distribution over all possible instructions i.e. all possible sequences of vocabulary tokens given action and the transition history.