[1] Mikhail Belkin, Daniel Hsu, Siyuan Ma, and Soumik Mandal. Reconciling modern machine-learning practice and the classical bias-variance trade-off. Proceedings of the National Academy of Sciences, 116(32):15849-15854, 2019. doi:https://doi.org/10.1073/pnas.1903070116.
[2] Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understanding deep learning (still) requires rethinking generalization. Communications of the ACM, 64(3): 107-115, 2021. doi:10.1145/3446776.
[3] Song Mei and Andrea Montanari. The generalization error of random features regression: Precise asymptotics and the double descent curve. Communications on Pure and Applied Mathematics, 75, 2019. doi:10.1002/cpa.22008.
[4] Peter L. Bartlett, Philip M. Long, Gábor Lugosi, and Alexander Tsigler. Benign overfitting in linear regression. Proceedings of the National Academy of Sciences, 117(48):30063-30070, 2020. doi:10.1073/pnas.1907378117. URL https://www.pnas.org/doi/abs/10.1073/pnas.1907378117.
[5] Trevor Hastie, Andrea Montanari, Saharon Rosset, and Ryan J. Tibshirani. Surprises in high-dimensional ridgeless least squares interpolation. The Annals of Statistics, 50(2):949 - 986, 2022. doi:10.1214/21-AOS2133. URL https://doi.org/10.1214/21-AOS2133.
[6] Tengyuan Liang and Alexander Rakhlin. Just interpolate: Kernel "Ridgeless" regression can generalize. The Annals of Statistics, 48(3):1329 - 1347, 2020. doi:10.1214/19-AOS1849. URL https://doi.org/10.1214/19-AOS1849.
[7] Hong Hu and Yue M. Lu. Universality laws for high-dimensional learning with random features. IEEE Transactions on Information Theory, 69(3):1932-1964, 2023. doi:10.1109/TIT.2022.3217698.
[8] Stéphane d'Ascoli, Maria Refinetti, Giulio Biroli, and Florent Krzakala. Double trouble in double descent: Bias and variance(s) in the lazy regime. In International Conference on Machine Learning, pages 2280-2290. PMLR, 2020. URL https://proceedings.mlr.press/v119/d-ascoli20a.html.
[9] Stéphane d'Ascoli, Levent Sagun, and Giulio Biroli. Triple descent and the two kinds of overfitting: where & why do they appear? In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 3058-3069. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/file/1fd09c5f59a8ff35d499c0ee25a1d47e-Paper.pdf.
[10] Ben Adlam and Jeffrey Pennington. The neural tangent kernel in high dimensions: Triple descent and a multi-scale theory of generalization. In International Conference on Machine Learning, pages 74-84. PMLR, 2020. URL https://proceedings.mlr.press/v119/adlam20a.html.
[11] Ben Adlam and Jeffrey Pennington. Understanding double descent requires a fine-grained bias-variance decomposition. In Advances in Neural Information Processing Systems, volume 33, pages 11022-11032, 2020. URL https://proceedings.neurips.cc/paper/2020/bit/7d420e2b2939762031eed0447a9be19f-Abstract.html.
[12] Gabriel Mel and Jeffrey Pennington. Anisotropic random feature regression in high dimensions. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=JfaWawZ8BmX.
[13] Jacob A. Zavatone-Veth, William L. Tong, and Cengiz Pehlevan. Contrasting random and learned features in deep Bayesian linear regression. Physical Review E, 105:064118, Jun 2022. doi:10.1103/PhysRevE.105.064118. URL https://link.aps.org/doi/10.1103/PhysRevE.105.064118.
[14] Jason W. Rocks and Pankaj Mehta. Memorizing without overfitting: Bias, variance, and interpolation in overparameterized models. Physical Review Research, 4:013201, Mar 2022. doi:10.1103/PhysRevResearch.4.013201. URL https://link.aps.org/doi/10.1103/PhysRevResearch.4.013201.