The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions
Stochastic Dropout : Activation-level Dropout to Learn Better Neural Language Models
Multi-level Residual Networks from Dynamical Systems View
Machine Learning: Deepest Learning as Statistical Data Assimilation Problems
Learning Strict Identity Mappings in Deep Residual Networks
Swapout: Learning an ensemble of deep architectures