A modern Bayesian look at the multi-armed bandit
Bayesian Experimental Design: A Review