learning I another thing you can do is automatically learn the inner and outer learning rates you can also optimize only a subset of parameters in the inner loop such as the last layer or affine transformations at each layer you could also try to decouple the the learning rate in the back term statistics that each gradient step to have fewer decoupled parameters that might cause instabilities and finally you could also introduced introduced additional context variables into the architecture to allow for multiplicative interactions between