added value fn solver in markov chain