Bellman equation for qomdps

Actually no different than bellman for mdp but good to work out