initial markov chain skeleton