Added \in definitions for initialized sets, in create markov algo