GitHub PushEvent at 2014-06-12 17:08:49
Repository: jsoar
Actor: AlexNickels
Payload: {"shas":[["e59cda1de90def444927946ab733165fcf9e68b3","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Reviewed all the changes needed for the RL updates.\nAdded RL Update.txt with notes on what all the changes are.\nAdded RL Updates.xlsx which summarizes which revisions affect which files.\nUpdated the RL unit test files to set hrl-discount to false and look for the values\nthat result from this setting.\nThis is the parameter setting in the current CSoar, and the test works with it now.\nHowever, setting this parameter in the test should be removed when\nthe default parameter setting is updated.","Peter Lindes",false],["af0824141c2ce802866146d7dd84ce3770684158","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Moved ReinforcementLearningCommand from the commands package to the learning.rl package.","Peter Lindes",false],["e05c33ddab5f8de9a96ccdcc1856815b178d9f0f","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Modified ReinforcementLearningCommand to be set up using the standard provider pattern.\nRemoved it from StandardCommands.","Peter Lindes",false],["5dff3a56e0af28703103999fcbbc87f8aa471a0e","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Added code to do the plain rl command.\nMade an RLPrintHelper class so the calls look just like the ones\nused by epmem to the standard utils.PrintHelper, but the output\nformatting looks exactly like the current CSoar.\nIf CSoar is ever updated to use the standard formatting that epmem and smem use,\nit should be easy to throw away the RLPrintHelper and use the standard one.","Peter Lindes",false],["96ffa2ea1ddf107c5ae8498f2e148f31bc2dd804","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Made a major refactoring by creating the ReinforcementLearningParams class\nand rewriting it and the things that use it to conform closely to the way\nparams are handled in epmem.\nHave several parameters fully implemented, more are needed.\nBoth the JUnit test and some hand-run tests on the debugger work fine now.","Peter Lindes",false],["c4a97b055955f45ac4568a16efcc819372b8f508","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Implemented the rest of the non-Experimental parameters.\nAll these seem to work correctly and the unit test uses them and it works.\nThe printout copies that of CSoar exactly, including the Experimental properties.\nThe latter are not really implemented yet, so the printout for them is faked.\nThe temporal-discount parameter is implemented and works but it is not printed\nsince CSoar does not print it.","Peter Lindes",false],["36692ba4aa606dad382f727cd8bee127abbec61f","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Updated the notes in RL Update.txt.","Peter Lindes",false],["32f85edac805cf5fa0b3ac10885e0666556b961b","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Created the chunk-stop parameter and the code to set and print it.\nThe actual effect in the rete is not done yet.","Peter Lindes",false],["290eca26f076faff0c3a70b1112cd78be7e97c6f","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Got all the code changes for 12380 done.\nUpgraded both RLTests.java and ReinforcementLearningTest.java to look at\nthe current value of hrl-discount and use different expected values\nfor each possible case.\nStill need a unit test that tests that chunnk-stop actually works.","Peter Lindes",false],["efd2a124c285aa208587840ed8f6ee959e631c59","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Oops, needed to check in this test resource in its latest form as well.","Peter Lindes",false],["621499d993a213f5538c0fc0e1fe69efba8f7578","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Added unit tests to test that the chunk-stop parameter really works.","Peter Lindes",false],["2b73a571981c37c008cb0ff34c98fee9576befd2","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Complete the work for r12380.\nThis change makes independent versions of testRLUnit for each\npossible value of hrl-discount.","Peter Lindes",false],["2fae9ae39c55b69e0e8d2061de0780965a8e2cba","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Fixed bug r12630.\nRL.rl_tabulate_reward_value_for_goal now does not create a slot if none exists.\nAll the tests pass.","Peter Lindes",false],["a54b2f758e02f737ee624ad3c8dac1dd846c2348","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","Can't find the files needed for r12630.\nGoing on to the next.","Peter Lindes",false],["cbd96f0e1b9c36fd45daa7e08659f90b994b6cd8","427abc81a236f242605e9c6b1b6ee8b72d312fff@soartech.com","We are not going to work on r12639 for the forseeable future.","Peter Lindes",false],["eab31fb06e0f1dbeb4f5141ee530671542351cc1","07f476d702876bc5b98ef91d7a6af01ed9bb4e7b@soartech.com","Commented out the count epmem test.\n\nThis is becuase this test will fail currently because of a bug in CSoar and JSoar from r13908.  Once the bug is fixed this test will pass again.  The bug is that the test is expecting to get a graph match and it does not get a graph match anymore even though r13908 didn't touch any of the non-LTI stuff.","Alex Turner",false],["c1ac5377e6b614c250d9e9014aa07f5bc44d600d","07f476d702876bc5b98ef91d7a6af01ed9bb4e7b@soartech.com","Added process destroy in a finally block to try and force a child process to exit upon errors.","Alex Turner",false],["d1d97b65753f70569fcb07ccdb1766ec295cfd64","07f476d702876bc5b98ef91d7a6af01ed9bb4e7b@soartech.com","Cleaned up imports and some warnings.","Alex Turner",false],["8e968b475d0b2caa249365c24158cf66f511abb0","07f476d702876bc5b98ef91d7a6af01ed9bb4e7b@soartech.com","Added ability to specify multiple decisions per test.  Also change test results folder path style.","Alex Turner",false],["9a5a74d188bd1753d8801feb6738dc0db3d17f9d","07f476d702876bc5b98ef91d7a6af01ed9bb4e7b@soartech.com","Cleaned up trace.  Added more information about run progress.","Alex Turner",false]],"size":112,"ref":"refs/heads/smem","head":"fc205f393eb1f29b7934b9a5c41ba7f32f804ac0"}