Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function
Authors: Wojciech Tarnowski, Piotr Warchoł, Stanisław Jastrzębski, Jacek Tabor, Maciej A. Nowak
Published in: The 22nd International Conference on Artificial Intelligence and Statistics, Wydawca:Proceedings of Machine Learning Research
Publication type: conference