Before revision:  We develop a dynamical mean-field theory (DMFT) of gating to understand the dynamical regimes produced by gating . Our gated RNN reduces to the classical RNNs in certain limits and is closely related to popular gated models in machine learning .
After revision:  We develop a dynamical mean-field theory (DMFT) to study the consequences of gating in RNNs .