Before revision:  Finally, we provide a numerical analysis for a simple example with a two-state Markov chain.
After revision:  Finally, we provide a numerical analysis for a toy example with a two-state Markov chain.