torch/optim — pull request #2 by fidlej (2013-08-18 20:12:01+00:00)
Title: Allowed to enable Nesterov momentum

I allowed to specify config.nesterov=true.
It will use Nesterov momentum, instead of the standard momentum.

The equations for Nesterov momentum can be seen in section 3.5 of "Advances in Optimizing Recurrent Networks".
http://arxiv.org/abs/1212.0901