Markov models for cs151, Fall 2012.