Before revision:  In this work ,  we take a first step towards this goal by extending known properties of BatchNorm in randomly initialized deep neural networks (DNNs) to nine recently proposed normalization layers.
After revision:  In this work , we take a theoretical approach, generalizing the known beneficial mechanisms of BatchNorm to several recently proposed normalization layers.