Rmax now stores the initial state.  RmaxWithShaping uses the initial state for initializing q values