[108] K. Soomro, A. R. Zamir, and M. Shah, "Ucf101: A dataset of 101 human actions classes from videos in the wild," arXiv preprint arXiv:1212.0402, 2012. 7
[109] L. Bossard, M. Guillaumin, and L. V. Gool, "Food-101-mining discriminative components with random forests," in European conference on computer vision. Springer, 2014, pp. 446-461. 7
[110] J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, "Sun database: Large-scale scene recognition from abbey to zoo," in 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, 2010, pp. 3485-3492. 7
[111] A. Krizhevsky, G. Hinton et al., “Learning multiple layers of features from tiny images,” cs.utoronto.ca, 2009. 7
[112] A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al., "An image is worth 16x16 words: Transformers for image recognition at scale," arXiv preprint arXiv:2010.11929, 2020. 7, 10, 18
[113] J. Frankle and M. Carbin, “The lottery ticket hypothesis: Finding sparse, trainable neural networks,” arXiv preprint arXiv:1803.03635, 2018. 7
[114] T. Chen, J. Frankle, S. Chang, S. Liu, Y. Zhang, Z. Wang, and M. Carbin, “The lottery ticket hypothesis for pre-trained bert networks,” Advances in neural information processing systems, vol. 33, pp. 15 834–15 846, 2020.
[115] Y. Zhang, Y. Yao, P. Ram, P. Zhao, T. Chen, M. Hong, Y. Wang, and S. Liu, “Advancing model pruning via bi-level optimization,” arXiv preprint arXiv:2210.04092, 2022. 7
[116] A. Madry, A. Makelov, L. Schmidt, D. Tsipras, and A. Vladu, "Towards deep learning models resistant to adversarial attacks," arXiv preprint arXiv:1706.06083, 2017. 9
[117] H. Fan, B. Xiong, K. Mangalam, Y. Li, Z. Yan, J. Malik, and C. Feichtenhofer, “Multiscale vision transformers,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 6824–6835. 19
[118] D. Hendrycks and T. Dietterich, “Benchmarking neural network robustness to common校核校核和校核校核的逆序关系” arXiv preprint arXiv:1903.12261, 2019. 21
[119] X. Zhai, J. Puigcerver, A. Kolesnikov, P. Ruyssen, C. Riquelme, M. Lucic, J. Djolonga, A. S. Pinto, M. Neumann, A. Dosovitskiy et al., "A large-scale study of representation learning with the visual task adaptation benchmark," arXiv preprint arXiv:1910.04867, 2019. 22
[120] N. S. Keskar, D. Mudigere, J. Nocedal, M. Smelyanskiy, and P. T. P. Tang, "On large-batch training for deep learning: Generalization gap and sharp minima," arXiv preprint arXiv:1609.04836, 2016. 22
[121] D. Bisla, J. Wang, and A. Choromanska, "Low-pass filtering sgd for recovering flat optima in the deep learning optimization landscape," in International Conference on Artificial Intelligence and Statistics. PMLR, 2022, pp. 8299-8339. 22
[122] W. J. Maddox, G. Benton, and A. G. Wilson, "Rethinking parameter counting in deep models: Effective dimensionality revisited," arXiv preprint arXiv:2003.02139, 2020. 22
[123] T. Liang, T. Poggio, A. Rakhlin, and J. Stokes, “Fisher-rao metric, geometry, and complexity of neural networks,” in The 22nd international conference on artificial intelligence and statistics. PMLR, 2019, pp. 888–896. 22
[124] L. Van der Maaten and G. Hinton, "Visualizing data using t-sne." Journal of machine learning research, vol. 9, no. 11, 2008. 23