[20] Song Han, Jeff Pool, John Tran, and William Dally. Learning both Weights and Connections for Efficient Neural Networks. Advances in Neural Information Processing Systems, 28, 2015. URL: https://arxiv.org/abs/1506.02626.
[21] Babak Hassibi, David G Stork, and Gregory J Wolff. Optimal Brain Surgeon and General Network Pruning. In IEEE international conference on neural networks, pages 293-299. IEEE, 1993. URL: https://authors.library.caltech.edu/54981/.
[22] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770-778, 2016. URL: https://arxiv.org/abs/1512.03385.
[23] Torsten Hoefler, Dan Alistarh, Tal Ben-Nun, Nikoli Dryden, and Alexandra Peste. Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks. Journal of Machine Learning Research, 22(241):1-124, 2021. URL: https://arxiv.org/abs/2102.00554.
[24] Sara Hooker. The Hardware Lottery. Communications of the ACM, 64(12):58-65, 2021. URL: https://dl.acm.org/doi/10.1145/3467017.
[25] Steven A Janowsky. Pruning versus clipping in neural networks. Physical Review A, 39(12):6600, 1989. URL: https://journals.acs.org/pra/abstract/10.1103/PhysRevA.39.6600.
[26] John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, et al. Highly accurate protein structure prediction with AlphaFold. Nature, 596(7873):583-589, 2021. URL: https://pubmed.ncbi.nlm.nih.gov/34265844/.
[27] Alex Krizhevsky, Geoffrey Hinton, et al. Learning Multiple Layers of Features from Tiny Images. 2009. URL: https://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf.
[28] Abhisek Kundu, Naveen K Mellempudi, Dharma Teja Vooturi, Bharat Kaul, and Pradeep Dubey. Autosparse: Towards automated sparse training of deep neural networks. arXiv preprint arXiv:2304.06941, 2023.
[29] Ya Le and Xuan Yang. Tiny imagenet visual recognition challenge. CS 231N, 7(7):3, 2015.
[30] Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
[31] Yann LeCun, John Denker, and Sara Solla. Optimal Brain Damage. Advances in Neural Information Processing Systems, 2, 1989. URL: https://papers.nips.cc/paper/1989/ hash/6c9882bbac1c7093bd25041881277658-Abstract.html.
[32] Namhoon Lee, Thalaiyasingam Ajanthan, and Philip Torr. SNIP: Single-shot Network Pruning based on Connection Sensitivity. International Conference on Learning Representations, 2019. URL: https://arxiv.org/abs/1810.02340.
[33] Hao Li, Asim Kadav, Igor Durdanovic, Hanan Samet, and Hans Peter Graf. Pruning Filters for Efficient ConvNets. International Conference on Learning Representations, 2017. URL: https://arxiv.org/abs/1608.08710.
[34] Shiwei Liu, Tianlong Chen, Xiaohan Chen, Li Shen, Decebal Constantin Mocanu, Zhangyang Wang, and Mykola Pechenizkiy. The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training. International Conference on Learning Representations, 2022. URL: https://arxiv.org/abs/2202.02643.
[35] Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, Ajay Jaiswal, and Zhangyang Wang. Sparsity may cry: Let us fail (current) sparse neural networks together! ICLR 2023, 2023.