we can show this under a few assumptions that are relatively mild such as the non zero learning rate as well as unique data points in the training data set and the reason why this is interesting is that it means that mammal has the inductive bias of optimization of precede procedures being embedded within it but without losing the expressive power of gradient descent or without losing the expressive power of deep recurrent neural networks ok great so let's go back to some of the motivation that we talked about a little bit with