A CTION-DEPENDENT C ONTROL V ARIATES FOR P OL-ICY O PTIMIZATION VIA S TEIN ’ S I DENTITY
The Optimal Reward Baseline for Gradient-Based Reinforcement Learning