Assertion: neural network's parameter | /r/CapableOf | enjoy large gradients
Facets:
value: up to that point
type: TEMPORAL
Source sentences:
text: By dividing for each parameter according to that quantity, we effectively slow down the learning rate for those parameters which have enjoyed large gradients up to that point, and conversely, speed up learning for parameters with minor or sparse gradients.