Exploration-exploitation trade-off using variance estimates in multi-armed bandits
Finite-time Analysis of the Multiarmed Bandit Problem