GitHub repository: tanganke/emdp
Primary language: Python
Description: Easy MDPs and grid worlds with accessible transition dynamics to do exact calculations. https://anke-emdp.readthedocs.io/