Convergent Actor-Critic Algorithms Under Off-Policy Training and Function Approximation
On a connection between importance sampling and the likelihood ratio policy gradient