Before revision: We study the statistical limits of uniform convergence for offline policy evaluation (OPE) problems (uniform OPE for short) with model-based methods under episodic MDPsetting .
After revision: We study the statistical limits of uniform convergence for offline policy evaluation (OPE) problems (uniform OPE for short) with model-based methods (for finite horizon MDP) and provides a unified view towards optimal learning for several well-motivated offline tasks .