Use AdaGrad (Duchi et al. 2010) for per-coordinate learning rates.