Taming Non-stationary Bandits: A Bayesian Approach
Thompson Sampling is Asymptotically Optimal in General Environments