[1] M. Abbas, Q. Xiao, L. Chen, P.-Y. Chen, and T. Chen. Sharp-MAML: Sharpness-aware model-agnostic meta learning. ICML, 2022.
[2] M. Andriushchenko and N. Flammarion. Towards understanding sharpness-aware minimization. ICML, 2022.
[3] M. Andriushchenko, D. Bahri, H. Mobahi, and N. Flamarion. Sharpness-aware minimization leads to low-rank features. NeurIPS, 2023.
[4] M. Andriushchenko, F. Croce, M. Müller, M. Hein, and N. Flamarion. A modern look at the relationship between sharpness and generalization. preprint arXiv:2302.07011, 2023.
[5] S. Arora, Z. Li, and K. Lyu. Theoretical analysis of auto rate-tuning by Batch Normalization. ICLR, 2019.
[6] J. L. Ba, J. R. Kiros, and G. E. Hinton. Layer Normalization. Advances in NeurIPS Deep Learning Symposium, 2016.
[7] D. Bahri, H. Mobahi, and Y. Tay. Sharpness-aware minimization improves language model generalization. ACL, 2022.
[8] K. Behdin, Q. Song, A. Gupta, A. Acharya, D. Durfee, B. Ocejo, S. Keerthi, and R. Mazumder. mSAM: Micro-batch-averaged sharpness-aware minimization. preprint arXiv:2302.09693, 2023.
[9] P. Benz, C. Zhang, and I. S. Kweon. Batch normalization increases adversarial vulnerability and decreases adversarial transferability: A non-robust feature perspective. ICCV, 2021.
[10] J. Bjorck, C. Gomes, B. Selman, and K. Q. Weinberger. Understanding batch normalization. NeurIPS, 2018.
[11] A. Brock, S. De, S. L. Smith, and K. Simonyan. High-performance large-scale image recognition without normalization. ICML, 2021.
[12] B. Chen, P. Li, B. Li, C. Lin, C. Li, M. Sun, J. Yan, and W. Ouyang. BN-NAS: Neural architecture search with Batch Normalization. ICCV, 2021.
[13] M. X. Chen, O. First, A. Bapna, M. Johnson, W. Macherey, G. Foster, L. Jones, M. Schuster, N. Shazeer, N. Parmar, A. Vaswani, J. Uszkoreit, L. Kaiser, Z. Chen, Y. Wu, and M. Hughes. The best of both worlds: Combining recent advances in neural machine translation. ACL, 2018.
[14] X. Chen, C.-J. Hsieh, and B. Gong. When Vision Transformers outperform ResNets without pre-training or strong data augmentations. *ICLR*, 2022.
[15] X. Chen, C. Liang, D. Huang, E. Real, K. Wang, Y. Liu, H. Pham, X. Dong, T. Luong, C.-J. Hsieh, Y. Lu, and Q. V. Le. Symbolic discovery of optimization algorithms. arXiv:2302.06675, 2023.
[16] F. Croce and M. Hein. Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. ICML, 2020.
[17] N. Dimitriou and O. Arandjelovic. A new look at ghost normalization. preprint arXiv: 2007.08554, 2020.
[18] L. Dinh, R. Pascanu, S. Bengio, and Y. Bengio. Sharp minima can generalize for deep nets. ICML, 2017.
[19] A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby. An image is worth 16x16 words: Transformers for image recognition at scale. ICLR, 2021.
[20] J. Du, H. Yan, J. Feng, J. T. Zhou, L. Zhen, R. S. M. Goh, and V. Tan. Efficient sharpness-aware minimization for improved training of neural networks. *ICLR*, 2022.
[21] G. K. Dziugaite and D. M. Roy. Computing nonvacuous generalization bounds for deep (stochastic) neural networks with many more parameters than training data. Uncertainty in AI, 2017.
[22] G. K. Dziugaite, A. Drouin, B. Neal, N. Rajkumar, E. Caballero, L. Wang, I. Mitliagkas, and D. M. Roy. In search of robust measures of generalization. NeurIPS, 2020.