The Sample Complexity of Exploration in the Multi-Armed Bandit Problem
PAC bounds for multi-armed bandit and Markov decision processes