Beyond the One Step Greedy Approach in Reinforcement Learning
Reinforcement Learning in Finite MDPs: PAC Analysis