Value Directed Exploration in Multi-Armed Bandits with Structured Priors
Thompson Sampling is Asymptotically Optimal in General Environments