Both synchronous algorithms are now functional and reasonably commented.
In addition, PuddleMDP is not usable (its code was simplified).

TODO: get the asynchronous versions to work.