added discrete MDP support code