pluskid/Mocha.jl — pull request #5 by stokasto (2014-11-28 10:10:35+00:00)
Title: Momentum policy

This is a small change to allow for the Momentum to be specified by a policy (similar to the learning rate).
This is useful to reproduce some state of the art results (e.g. the dropout results on MNIST from Nitish Srivastavas paper as well as the results from the maxout paper).
I will open a pull request for example scripts to get these results seperately!