Complete definiton MDP
New value iteration stub