Before revision:  We evaluate our method on the suite of OpenAI gym tasks, achieving or outperforming state of the art in every environment tested.
After revision:  Taken together, these components define GRAC, a novel self-guided and self-regularized actor critic algorithm. We evaluate GRAC on the suite of OpenAI gym tasks, achieving or outperforming state of the art in every environment tested.