amarack/python-rl — pull request #1 by pierrelux (2013-03-12 22:51:06+00:00)
Title: Add pinball environment and switch to CMake for CTiles

This patch provides support for the Pinball environment. The original source code is maintained at https://github.com/pierrelux/pypinball but has been successfully merged and tested within pyrl. A Sarsa-Lambda Fourier agent was used with the following settings (as suggested by Konidaris in his original experiment):

$ python pyrl/agents/sarsa_lambda.py --basis fourier \
--fourier_order 4 --epsilon 0.01 --gamma 1.0 --lambda 0.9 \
--alpha 0.001

The Makefile in CTiles was also uncompilable on Ubuntu 12.04 with gcc-4.7. CMake should provide a more generic and cross-platform solution.