Before revision:  Using this regularizer , we were able to reduce mean class selectivity across units in convolutional neural networks by a factor of 2.5 with no impact on test accuracy, and reduce it nearly to zero with only a small (\sim2\%) change in test accuracy.
After revision:  Using this regularizer , we were able to reduce mean class selectivity across units in convolutional neural networks increased test accuracy by over 2\% in ResNet18 trained on Tiny ImageNet. In ResNet20 trained on CIFAR10 we could reduce class selectivity by a factor of 2.5 with no impact on test accuracy, and reduce it nearly to zero with only a small (\sim2\%) change in test accuracy.