lisa-lab/pylearn2 — pull request #1026 by madisonmay (2014-07-15 23:29:03+00:00)
Title: RMSProp learning rule implementation

The implementation is based heavily on the AdaDelta learning rule. Tests still needed -- should hopefully be able to get around to that over the course of the next day.

Motivations for RMSProp are described by Geoffrey Hinton at the lecture slides below: http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf.