Before revision: Predicting the dynamics of neural network parameters during training is one of the key challenges in building a theoretical foundation for deep learning.
After revision: Understanding the dynamics of neural network parameters during training is one of the key challenges in building a theoretical foundation for deep learning.