Optimistic linear programming gives logarithmic regret for irreducible MDPs
Finite-time Analysis of the Multiarmed Bandit Problem