Markov algorithm interpreter