Activation Functions: Comparison of trends in Practice and Research for Deep Learning
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks