Fixed bug with basic agent including replay_list instead of replay.
Cleaned up PEP8 compliancy problems.