beginnings of Markov model