Stochastic Primal-Dual Methods and Sample Complexity of Reinforcement Learning
Acceleration of Stochastic Approximation by Averaging