Convergence guarantees for RMSProp and ADAM in non-convex optimization and their comparison to Nesterov acceleration on autoencoders
Adaptive subgradient methods for online learning and stochastic optimization