[21] J. Lee, Y. Bahri, R. Novak, S. S. Schoenholz, J. Pennington, and J. Sohl-Dickstein. "Deep Neural Networks as Gaussian Processes". ICLR. 2018.
[22] A. G. d. G. Matthews, M. Rowland, J. Hron, R. E. Turner, and Z. Ghahramani. Gaussian process behaviour in wide deep neural networks. 2018. arXiv: 1804.11271.
[23] J. Hron, Y. Bahri, J. Sohl-Dickstein, and R. Novak. "Infinite attention: NNGP and NTK for deep attention networks". International Conference on Machine Learning. PMLR. 2020, pp. 4376-4386.
[24] A. Jacot, F. Gabriel, and C. Hongler. "Neural tangent kernel: Convergence and generalization in neural networks". Advances in Information Processing Systems (NeurIPS). 2018. arXiv: 1806.07572.
[25] G. Yang and E. J. Hu. Feature learning in infinite-width neural networks. 2020. arXiv: 2011. 14522.
[26] J. Sirignano and K. Spiliopoulos. “Mean field analysis of neural networks: A law of large numbers”. In: SIAM Journal on Applied Mathematics 80.2 (2020), pp. 725–752.
[27] S. Mei, A. Montanari, and P.-M. Nguyen. "A mean field view of the landscape of two-layer neural networks". In: Proceedings of the National Academy of Sciences 115.33 (2018), E7665-E7671.
[28] L. Chizat and F. Bach. "On the global convergence of gradient descent for over-parameterized models using optimal transport". In: Advances in Neural Information Processing Systems 31 (2018).
[29] G. M. Rotskoff and E. Vanden-Eijnden. Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach. 2018. arXiv: 1805.00915.
[30] S. Yaida. “Non-Gaussian processes and neural networks at finite widths”. Mathematical and Scientific Machine Learning. PMLR. 2020, pp. 165–192.
[31] E. Dyer and G. Gur-Ari. "Asymptotics of wide networks from feynman diagrams". In: arXiv preprint arXiv:1909.11304 (2019).
[32] D. A. Roberts, S. Yaida, and B. Hanin. The principles of deep learning theory. Cambridge University Press, 2022.
[33] J. Zavatone-Veth and C. Pehlevan. "Exact marginal prior distributions of finite Bayesian neural networks". In: Advances in Neural Information Processing Systems 34 (2021).
[34] J. Zavatone-Veth, A. Canatar, B. Ruben, and C. Pehlevan. "Asymptotics of representation learning in finite Bayesian neural networks". In: Advances in Neural Information Processing Systems 34 (2021), pp. 24765-24777.
[35] B. Hanin. Correlation Functions in Random Fully Connected Neural Networks at Finite Width. 2022. arXiv: 2204.01058.
[36] E. Dinan, S. Yaida, and S. Zhang. *Effective Theory of Transformers at Initialization*. 2023. arXiv: 2304.02034.
[37] B. Hanin and M. Nica. “Products of many large random matrices and gradients in deep neural networks”. In: Communications in Mathematical Physics (2019), pp. 1–36.
[38] B. Hanin and M. Nica. Finite depth and width corrections to the neural tangent kernel. 2019. arXiv: 1909.05989.
[39] Z. Hu and H. Huang. "On the Random Conjugate Kernel and Neural Tangent Kernel". International Conference on Machine Learning. PMLR. 2021, pp. 4359-4368.
[40] M. B. Li, M. Nica, and D. Roy. "The future is log-Gaussian: ResNets and their infinite-depth-and-width limit at initialization". In: Advances in Neural Information Processing Systems 34 (2021), pp. 7852-7864.
[41] L. Noci, G. Bachmann, K. Roth, S. Nowozin, and T. Hofmann. "Precise characterization of the prior predictive distribution of deep ReLU networks". In: Advances in Neural Information Processing Systems 34 (2021).
[42] B. Hanin and G. Paouris. "Non-asymptotic results for singular values of Gaussian matrix products". In: Geometric and Functional Analysis 31.2 (2021), pp. 268-324.
[43] G. Akemann, Z. Burda, and M. Kieburg. "From integrable to chaotic systems: Universal local statistics of Lyapunov exponents". In: Europhysics Letters 126.4 (2019), p. 40001.
[44] J. Ipsen. "Lyapunov exponents for products of rectangular real, complex and quaternionic Ginibre matrices". In: Journal of Physics A: Mathematical and Theoretical 48.15 (2015), p. 155204.