Value-Difference based Exploration: Adaptive Control between epsilon-Greedy and Softmax
Multi-armed bandit algorithms and empirical evaluation