[27] Hugo Cui, Florent Krzakala, and Lenka Zdeborova. Bayes-optimal learning of deep random networks of extensive-width. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett, editors, Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 6468-6521. PMLR, 23-29 Jul 2023. URL https://proceedings.mlr.press/v202/cui23b.html.
[28] Yasaman Bahri, Ethan Dyer, Jared Kaplan, Jaehoon Lee, and Utkarsh Sharma. Explaining neural scaling laws. arXiv, 2021. doi:10.48550/ARXIV.2102.06701. URL https://arxiv.org/abs/2102.06701.
[29] Marc Mézard, Giorgio Parisi, and Miguel Angel Virasoro. Spin Glass Theory and Beyond: An Introduction to the Replica Method and Its Applications. World Scientific Publishing Company, 1987. doi:https://doi.org/10.1142/0271.
[30] Jacob A. Zavatone-Veth and Cengiz Pehlevan. Replica method for eigenvalues of real Wishart product matrices. SciPost Physics Core, 6:026, 2023. doi:10.21468/SciPostPhysCore.6.2.026. URL https://scipost.org/10.21468/SciPostPhysCore.6.2.026.
[31] A. Caponnetto and E. De Vito. Optimal rates for the regularized least-squares algorithm. Foundations of Computational Mathematics, 7(3):331-368, 07 2007. ISSN 1615-3383. doi:10.1007/s10208-006-0196-8. URL https://doi.org/10.1007/s10208-006-0196-8.
[32] Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. Scaling laws for neural language models. arXiv, 2020. doi:10.48550/ARXIV.2001.08361. URL https://arxiv.org/abs/2001.08361.
[33] Andreas Engel and Christian van den Broeck. Statistical Mechanics of Learning. Cambridge University Press, 2001. doi:https://doi.org/10.1017/CBO9781139164542.
[34] Qianyi Li and Haim Sompolinsky. Statistical mechanics of deep linear neural networks: The backpropagating kernel renormalization. Physical Review X, 11:031059, 09 2021. doi:10.1103/PhysRevX.11.031059.
[35] Adityanarayanan Radhakrishnan, Daniel Beaglehole, Parthe Pandit, and Mikhail Belkin. Feature learning in neural networks and kernel machines that recursively learn features. arXiv, 2022. doi:10.48550/ARXIV.2212.13881. URL https://arxiv.org/abs/2212.13881.
[36] Haozhe Shan and Haim Sompolinsky. Minimum perturbation theory of deep perceptual learning. Physical Review E, 106:064406, Dec 2022. doi:10.1103/PhysRevE.106.064406. URL https://link.aps.org/doi/10.1103/PhysRevE.106.064406.
[37] Boris Hanin and Alexander Zlokapa. Bayesian interpolation with deep linear networks. Proceedings of the National Academy of Sciences, 120(23):e2301345120, 2023. doi:10.1073/pnas.2301345120. URL https://www.pnas.org/doi/abs/10.1073/pnas.2301345120.
[38] Zdzisław Burda, Jerzy Jurkiewicz, and Bartlomiej Waclaw. Spectral moments of correlated Wishart matrices. Physical Review E, 71:026111, Feb 2005. doi:10.1103/PhysRevE.71.026111. URL https://link.aps.org/doi/10.1103/PhysRevE.71.026111.
[39] Biraj Pandey, Marius Pachitariu, Bingni W. Brunton, and Kameron Decker Harris. Structured random receptive fields enable informative sensory encodings. PLOS Computational Biology, 18(10):1-28, 10 2022. doi:10.1371/journal.pcbi.1010484. URL https://doi.org/10.1371/journal.pcbi.1010484.
[40] Francis Bach. High-dimensional analysis of double descent for linear regression with random projections. arXiv, 2023. doi:https://doi.org/10.48550/arXiv.2303.01372.
[41] Jean Barbier, Dmitry Panchenko, and Manuel Sáenz. Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures. Information and Inference: A Journal of the IMA, 12 2021. ISSN 2049-8772. doi:10.1093/imaiai/iaab027. URL https://doi.org/10.1093/imaiai/iaab027. iaab027.