Markov dictionary implementation.