Towards Generalization and Simplicity in Continuous Control
Q-Prop: Sample-Efficient Policy Gradient with An Off-Policy Critic