Experiments with Markov chains and Markov Hidden Models

It's basically a few exercises from the "Probabilistic Robotics" book