npinto/asgd — Issue #9: ENH: warm-up period with exponential moving asgd and switch from sgd to to asgd when empirical loss gets higher
Author: npinto
Created: 2011-11-13 07:57:18+00:00
State: open

The idea is to boost the performance by "disabling" the averaging until it gets useful. start with exp_moving_asgd_step_size=1e-2 ?