Stochastic Primal-Dual Methods and Sample Complexity of Reinforcement Learning
Sample Complexity of Episodic Fixed-Horizon Reinforcement Learning