Add initial markov stuff.