PAC bounds for multi-armed bandit and Markov decision processes
Asynchronous Stochastic Approximation and Q-Learning