Answering Vaz's Markov Chain question