Title: Markov Models and Optimization