Final version of Markov chains paper.