Title: Numerical Methods in Markov Chain Modeling