PAC-optimal, Non-parametric Algorithms and Bounds for Exploration in Concurrent MDPs with Delayed Updates
A theoretical analysis of Model-Based Interval Estimation