Title: Markov Processes for Stochastic Modeling