A Sufficient Condition for Convergences of Adam and RMSProp
Convergence guarantees for RMSProp and ADAM in non-convex optimization and their comparison to Nesterov acceleration on autoencoders