Before revision:  We also characterize the statistical regret from using our estimated policy rule . To do this, we show that a Partial Differential Equation (PDE) characterizes the evolution of the value function under each policy .
After revision:  We also characterize the statistical regret from using our estimated policy rule by casting the evolution of the value function under each policy .