initial commit of markov chains