A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes
Finite-sample convergence rates for Q-learning and indirect algorithms