確率的勾配降下法
1 2 Perla, Joseph (2013). Notes on AdaGrad. http://www.ark.cs.cmu.edu/cdyer/adagrad.pdf.
↑ John Duchi; Elad Hazan; Yoram Singer (2011). “Adaptive Subgradient Methods for Online Learning and Stochastic Optimization”. The Journal of Machine Learning Research 12: 2121-2159. http://jmlr.org/papers/v12/duchi11a.html.
↑ Tijmen Tieleman; G. Hinton (2012). Lecture 6.5 - rmsprop, COURSERA: Neural Networks for Machine Learning.
↑ Matthew D. Zeiler (2012). ADADELTA: An Adaptive Learning Rate Method. http://arxiv.org/abs/1212.5701.
↑ Jascha Sohl-Dickstein; Ben Poole; Surya Ganguli (2014). “Fast large-scale optimization by unifying stochastic gradient and quasi-Newton methods”. Proceedings of the 31 st International Conference on Machine Learning 32.