Beginning to work on the data from Asterix
Cascading can run from input from Asterix
True data from the expert on Asterix.
Ran Exp9 (CSI on asterix) with true data from the expert.
Learning a reward from Asterix Expert data with CSI. The gradient descent converges to 0.
New version of gradient descent for Exp9, way faster.
New Exp9 run, if action was never choosen, reward defaults to 0.
CSI ran on the 5 episode worth of data from the expert
Ready to run on a big, big file
CSI ran on the biggest chunk of data we could give it without choking
Highway transition probability matrix
Reward vector on the highway
Dynamic programming package
Correcting a matrix dimension misshap on the highway
Begginning to work on Exp10
Another go at implementing Relative Entropy
We now have some trajectories on the highway
Relative Entropy seems to work on the Highway
Relative Entropy does not seem to work on the inverted pendulum
Running RE on the mountain car with different parameters. No luck.