# Activation-Based Pruning of Neural Networks
## Appendix A Singular-Value Minimization  
Figures 11-11 show the relative percentage change in singular values before and after each pruning cycle. Figure A4: Relative ratio of singular values at 32% pruning. Figure A7: Relative ratio of singular values at 64% pruning. * [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON] Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. _arXiv_**2016**, arXiv:1510.00149. * [PERSON] and [PERSON] (2014) [PERSON]; [PERSON] To prune, or not to prune: Exploring the efficacy of pruning for model compression. _arXiv_**2017**, arXiv:1710.01878. * [PERSON] (2014) [PERSON] A Tutorial on Principal Component Analysis. _arXiv_**2014**, arXiv:1404.1100. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON] Sparse low rank factorization for deep neural network compression. _Neurocomputing_**2020**, _398_, 185-196. [CrossRef]
* [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Learning Low-Rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Virtually, 14-19 June 2020. * [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON] Channel Pruning for Accelerating Very Deep Neural Networks. In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22-29 October 2017; pp. 1398-1406. [CrossRef]
* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON] GPU Kernels for Block-Sparse Weights. _arXiv_**2017**, arXiv:1711.09224. * [PERSON] et al. (2018) [PERSON] [PERSON]; [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON]; [PERSON] [PERSON]; [PERSON]; [PERSON] [PERSON] Efficient Neural Audio Synthesis. In Proceedings of the 35 th International Conference on Machine Learning, Stockholm, Sweden, 10-15 July 2018; [PERSON], [PERSON], Eds. ; Proceedings of Machine Learning Research; Volume 80, pp. 2410-2419. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON] Stabilizing the Lottery Ticket Hypothesis. _arXiv_**2020**, arXiv:1903.01611. * [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] NISP: Pruning Networks Using Neuron Importance Score Propagation. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18-23 June 2018; pp. 9194-9203. [CrossRef]
* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON] Variational Dropout Sparsifies Deep Neural Networks. In Proceedings of the 34 th International Conference on Machine Learning, Sydney, NSW, Australia, 6-11 August 2017; [PERSON], [PERSON], Eds. ; Proceedings of Machine Learning Research; Volume 70, pp. 2498-2507. * [PERSON] and [PERSON] (2017) [PERSON]; [PERSON] Diversity Networks: Neural Network Compression Using Determinantal Point Processes. _arXiv_**2017**, arXiv:1511.05077. * [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON] SNIP: Single-Shot Network Pruning Based on Connection Sensitivity. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6-9 May 2019. * [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Rethinking the Value of Network Pruning. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6-9 May 2019. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON] Growing Efficient Deep Networks by Structured Continuous Sparsification. _arXiv_**2020**, arXiv:2007.15353. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON] Picking Winning Tickets Before Training by Preserving Gradient Flow. _arXiv_**2020**, arXiv:2002.07376. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON] Pruning neural networks without any data by iteratively conserving synaptic flow.