Title: Computations with Markov Chains