markov chain: adding more inputs to the tests