Parallelized stochastic gradient descent
Online Convex Programming and Generalized Infinitesimal Gradient Ascent