Emulator for Markov algorithm