Forgot to remove a delted file module from __init__.py for experiments (fixed that). Also worked on vSGD. The method is so theoretically cool, but in practice its just not so great for RL (for general stochastic optimization it works great). Its hard to tell exactly what the deal is on why it underperforms. But, I added a little tweak and extra parameter (which is in the paper set as C = dim_of_features/10, but I found that larger values were needed for decent performance).