This is the update equation but only for one example. In the implem https://github.com/scikit-learn/scikit-learn/pull/1954/files#L7R238 this is done on a mini-batch (to reduce variance, as in SGD).