[Karl Hajjar and Lenaic Chizat, On the symmetries in the dynamics of wide two-layer neural networks, arXiv preprint arXiv:2211.08771 (2022).]
[HTFF09] Trevor Hastie, Robert Tibshirani, Jerome H Friedman, and Jerome H Friedman, The elements of statistical learning: data mining, inference, and prediction, vol. 2, Springer, 2009.
[IS15] Sergey Ioffe and Christian Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, International conference on machine learning, pmlr, 2015, pp. 448-456.
[JGH18] Arthur Jacot, Franck Gabriel, and Clement Hongler, Neural Tangent Kernel: Convergence and Generalization in Neural Networks, Advances in Neural Information Processing Systems, 2018.
[Iain M Johnstone, On the distribution of the largest eigenvalue in principal components analysis, The Annals of statistics 29 (2001), no. 2, 295-327.]
[WJHT13] Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani, An introduction to statistical learning, vol. 112, Springer, 2013.
[KKSK11] Sham M Kakade, Varun Kanade, Ohad Shamir, and Adam Kalai, Efficient learning of generalized linear and single index models with isotonic regression, Advances in Neural Information Processing Systems 24 (2011).
[LD89] Ker-Chau Li and Naihua Duan, Regression Analysis Under Link Violation, The Annals of Statistics (1989).
[LMZ20] Yuanzhi Li, Tengyu Ma, and Hongyang R Zhang, Learning over-parametrized two-layer neural networks beyond NTK, Conference on Learning Theory, 2020.
$\left[\mathrm{MHD}^{+}23\right]$  Arvind Mahankali, Jeff Z Haochen, Kefan Dong, Margalit Glasgow, and Tengyu Ma, Beyond ntk with vanilla gradient descent: A mean-field analysis of neural networks with polynomial width, samples, and time, arXiv preprint arXiv:2306.16361 (2023).
$\left[\mathrm{MHPG}^{+}23\right]$  Alireza Mousavi-Hosseini, Sejun Park, Manuela Girotti, Ioannis Mitliagkas, and Murat A Erdogdu, Neural networks efficiently learn low-dimensional representations with SGD, The Eleventh International Conference on Learning Representations, 2023.
[MMM19] Song Mei, Theodor Misiakiewicz, and Andrea Montanari, Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit, Conference on Learning Theory, 2019.
[MMN18] Song Mei, Andrea Montanari, and Phan-Minh Nguyen, A mean field view of the landscape of two-layer neural networks, Proceedings of the National Academy of Sciences 115 (2018), no. 33, E7665-E7671.
[NWS22] Atsushi Nitanda, Denny Wu, and Taiji Suzuki, Convex analysis of the mean field Langevin dynamics, International Conference on Artificial Intelligence and Statistics, PMLR, 2022, pp. 9741-9757.
[O'D14] Ryan O'Donnell, Analysis of boolean functions, Cambridge University Press, 2014.
[PSE22] Sejun Park, Umut Simsekli, and Murat A. Erdogdu, Generalization Bounds for Stochastic Gradient Descent via Localized  $\varepsilon$ -Covers, arXiv preprint arXiv:2209.08951 (2022).
[Rey20] Lev Reyzin, Statistical queries and statistical algorithms: Foundations and applications, arXiv preprint arXiv:2004.00557 (2020).
[RGKZ21] Maria Refinetti, Sebastian Goldt, Florent Krzakala, and Lenka Zdeborova, Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed, International Conference on Machine Learning, 2021.