Fix outputs on dp_markov