apache/incubator-spark — pull request #633 by dbtsai (2014-02-22 11:10:52+00:00)
Title: Initialized the regVal for first iteration in SGD optimizer

In runMiniBatchSGD, the regVal (for 1st iter) should be initialized
as sum of sqrt of weights if it's L2 update; for L1 update, the same logic is followed.

It maybe not be important here for SGD since the updater doesn't take the loss
as parameter to find the new weights. But it will give us the correct history of loss.
However, for LBFGS optimizer we implemented, the correct loss with regVal is crucial to
find the new weights.