Sparse Dueling Bandits
lil' UCB : An Optimal Exploration Algorithm for Multi-Armed Bandits