Pre-training of Recurrent Neural Networks via Linear Autoencoders
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks