Before revision:  Our primary findings follow : (i) Similar to BatchNorm, activations-based normalization layers can avoid exploding activations in ResNets  ;
After revision:  Our primary findings follow : (i) Similar to BatchNorm, activations-based normalization layers can avoid exploding activations in ResNets , but parametric layers require explicit remedies ;