commenting
more commenting
Adding the Data Files from a Few Runs ago

The new folder Experiments contains some test data I ran just to test
the robustness of the code, and to see how long it took to centralize on
a path to the goal in a different room (11,11). I'll post the data onto
the google doc.
updated Run Function

There is a bug in run(Domain d, State s) causing to run the exact same
way over and over again, instead of a more randomized version in the
other.
Bug Fixed

The Bug is fixed. Will generate some data real soon.
Run time error?

For some reason it keeps printing out the same exact results over and
over again. Is this because of the fact that all the nodes are
initialized to the same number? Or what?
Using OOMDPTB to do all the work
cleaned up data member naming
added the state object as a parameter to visualizer static/object
painters to provide more flexibility in painting mechanics
Cleaned up ObjectClass data member names (removed trailing '_').

Also added a new general purpose grid world domain that can have an
arbitrarily set map and can easily changed to use stochastic transition
dynamics. This will be useful as a "common" domain for the distributed
package. It also can effectively replace the FourRooms domain (to that
end, I added a special method that will set the map to the classic 4
rooms map).
Added State parser
Made a reasonably large change in which state hashing is now performed
by a stateHashTuple factory that is passed to the learning/planning
algorithm, rather than have it assume the previous attribute-wise state
hashing. This condenses the code a bit and also allows for flexibility
for different means of hashing states in the future, which might be
valuable if there is a mixture of different kinds of attributes.
cleaned up some code
restructured some code; also added an example of performing Q-learning
on the new GridWorld Domain (which is set ot use 4 Rooms) and then
visualizing the episode results. See file: examples.BasicBehavior
added some comments for clarity
lots of additional behavior examples (in the examples.BasicBehavior
class) and also cleaned up some constructors and fixed a couple of bugs
small changes and added universal (but verbose) StateParser class that
will work on any OO-MDP domain.
updated to make copy of the attribute list it is provided to make sure
domain attirbute lists can not be indirectly modfied
minor change
.