A CTION-DEPENDENT C ONTROL V ARIATES FOR P OL-ICY O PTIMIZATION VIA S TEIN ’ S I DENTITY
a natural policy gradient .