True markov solution calculation, gitignore.