Markov chain basics.

Mostly definitions. Also, excluded .pdf files at the
suggestion of Stefan, to prevent wasting unnecessary space.