npinto/asgd — Issue #12: Use η0 / (1 + λ η0 t)^0.75 by default instead of ...^2/3.
Author: npinto
Created: 2011-11-17 03:10:35+00:00
State: open

The learning rate has the form η0 / (1 + λ η0 t)^0.75 where λ is the regularization constant.

See:
http://leon.bottou.org/projects/sgd