Before revision:  Overall, our analysis reveals several general mechanisms that explain the success of normalization techniques in deep learning, providing us with a compass to systematically explore the vast design space of DNN normalization layers.
After revision:  Overall, our analysis reveals several general mechanisms that explain the success of normalization methods in deep learning, providing us with a compass to systematically explore the vast design space of DNN normalization layers.