Training Simplification and Model Simplification for Deep Learning : A Minimal Effort Back Propagation Method
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer