what is a markov chain used for
The first financial model to use a Markov chain was from Prasad et al. in 1974. Another was the regime-switching model of James D. Hamilton (1989), in which a Markov chain is used to model switches between periods of high volatility and low volatility of asset returns.