Before revision:  In this paper, we focus on accelerating the BN layers among the non-convolutional layers, as BN has become a core design block of modern CNNs . A typical modern CNN has a large number of BN layers  . BN requires mean and variance calculations over each mini-batch during training.
After revision:  In this paper, we focus on accelerating the BN layers among the non-convolutional layers, as BN has become a core design block of modern Convolutional Neural Networks (CNNs) . A typical modern CNN has a large number of BN layers . BN requires mean and variance calculations over each mini-batch during training.