A Markov implementation