Markov chain
Discrete-time Markov chain.