Markov functions added.

Some modifications have been made to functions so the original notebook
with data has to be modified.