Before revision:  We also prove corresponding dynamic programming equations.
After revision:  We also derive the corresponding dynamic programming equations.