2 saddles in deep networks : background and motivation .
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks