JohnLangford/vowpal_wabbit — pull request #48 by stross (2012-08-17 21:51:30+00:00)
Title: Normalized Adaptive Updates

Here's the new code with the normalized adaptive updates. I added in the new default learning rates for exact_adaptive_norm and normalized_adaptive as well.

There are 2 new flags you can use for the new update rule:
--normalized_adaptive : tells vw to use the new update rule
--precompute_norm : when using --normalized_adaptive, this tells vw to do an additional pass before training just to precompute the norm of the inputs (i.e. the range of the features)