make copy of valueiteration to modify into policyiteration