The Uncertainty Bellman Equation and Exploration
Why is Posterior Sampling Better than Optimism for Reinforcement Learning