lil' UCB : An Optimal Exploration Algorithm for Multi-Armed Bandits
Pure exploration in multi-armed bandits problems