[5] E. Gardner. The space of interactions in neural network models. *Journal of Physics A*, 21(1):257, 1988.

[6] E. Gardner and B. Derrida. Optimal storage properties of neural network models. *Journal of Physics A*, 21(1):271, 1988.

[7] M. Mézard. The space of interactions in neural networks: Gardner's computation with the cavity method. *Journal of Physics A*, 22(12):2181, 1989.

[8] H. S. Seung, H. Sompolinsky, and N. Tishby. Statistical mechanics of learning from examples. *Physical Review A*, 45(8):6056, 1992.

[9] A. Engel and C. Van den Broeck. *Statistical Mechanics of Learning*. Cambridge University Press, 2001.

[10] T. Tanaka. A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors. *IEEE Transactions on Information Theory*, 48(11):2888–2910, 2002.

[11] S. Rangan, V. Goyal, and A. K. Fletcher. Asymptotic analysis of MAP estimation via the replica method and compressed sensing. In *Advances in Neural Information Processing Systems (NIPS)*, 2009.

[12] Y. Kabashima, T. Wadayama, and T. Tanaka. A typical reconstruction limit for compressed sensing based on Lp-norm minimization. *Journal of Statistical Mechanics: Theory and Experiment*, 2009(09):L09003, 2009.

[13] S. Ganguli and H. Sompolinsky. Statistical Mechanics of Compressed Sensing. *Physical Review Letters*, 104(18):188701, 2010.

[14] F. Krzakala, M. Mézard, F. Sausset, Y. F. Sun, and L. Zdeborová. Statistical-physics-based reconstruction in compressed sensing. *Physical Review X*, 2(2):021005, 2012.

[15] L. Zdeborová and F. Krzakala. Statistical physics of inference: thresholds and algorithms. *Advances in Physics*, 65(5):453–552, 2016.

[16] E. Marinari, G. Parisi, and F. Ritort. Replica field theory for deterministic models. II. A non-random spin glass with glassy behaviour. *Journal of Physics A*, 27(23):7647, 1994.

[17] G. Parisi and M. Potters. Mean-field equations for spin models with orthogonal interaction matrices. *Journal of Physics A*, 28(18):5267, 1995.

[18] M. Opper and O. Winther. Tractable Approximations for Probabilistic Models: The Adaptive Thouless-Anderson-Palmer Mean Field Approach. *Physical Review Letters*, 86(17):3695, 2001.

[19] R. Cherrier, D. S. Dean, and A. Lefèvre. Role of the interaction matrix in mean-field spin glass models. *Physical Review E*, 67(4):046112, 2003.

[20] K. Takeda, S. Uda, and Y. Kabashima. Analysis of CDMA systems that are characterized by eigenvalue spectrum. *Europhysics Letters*, 76(6):1193, 2006.

[21] R. R. Müller, D. Guo, and A. L. Moustakas. Vector Precoding for Wireless MIMO Systems and its Replica Analysis. *IEEE Journal on Selected Areas in Communications*, 26(3):530–540, 2008.
[22] Y. Kabashima. Inference from correlated patterns: a unified theory for perceptron learning and linear vector channels. *Journal of Physics: Conference Series*, 95(1):012001, 2008.

[23] T. Shinzato and Y. Kabashima. Perceptron capacity revisited: classification ability for correlated patterns. *Journal of Physics A*, 41(32):324013, 2008.

[24] T. Shinzato and Y. Kabashima. Learning from correlated patterns by simple perceptrons. *Journal of Physics A*, 42(1):015005, 2009.

[25] A. M. Tulino, G. Caire, S. Verdú, and S. Shamai (Shitz). Support Recovery With Sparsely Sampled Free Random Matrices. *IEEE Transactions on Information Theory*, 59(7):4243–4271, 2013.

[26] Y. Kabashima and M. Vehkaperä. Signal recovery using expectation consistent approximation for linear observations. In *IEEE International Symposium on Information Theory (ISIT)*, 2014.

[27] A. Manoel, F. Krzakala, M. Mézard, and L. Zdeborová. Multi-layer generalized linear estimation. In *IEEE International Symposium on Information Theory (ISIT)*, 2017.

[28] A. K. Fletcher and S. Rangan. Inference in Deep Networks in High Dimensions. arXiv:1706.06549, 2017.

[29] G. Reeves. Additivity of Information in Multilayer Networks via Additive Gaussian Noise Transforms. In *55th Annual Allerton Conference on Communication, Control, and Computing*, 2017.

[30] M. Talagrand. *Spin Glasses: A Challenge for Mathematicians: Cavity and Mean Field Models*. Springer Science & Business Media, 2003.

[31] D. Panchenko. *The Sherrington-Kirkpatrick model*. Springer Science & Business Media, 2013.

[32] J. Barbier, M. Dia, N. Macris, F. Krzakala, T. Lesieur, and L. Zdeborová. Mutual Information for Symmetric Rank-one Matrix Estimation: A Proof of the Replica Formula. In *Advances in Neural Information Processing Systems (NIPS)*, 2016.

[33] M. Lelarge and L. Miolane. Fundamental limits of symmetric low-rank matrix estimation. arXiv:1611.03888, 2016.

[34] G. Reeves and H. D. Pfister. The replica-symmetric prediction for compressed sensing with Gaussian matrices is exact. In *IEEE International Symposium on Information Theory (ISIT)*, 2016.

[35] J. Barbier, F. Krzakala, N. Macris, L. Miolane, and L. Zdeborová. Phase Transitions, Optimal Errors and Optimality of Message-Passing in Generalized Linear Models. arXiv:1708.03395, 2017.

[36] A. M. Tulino and S. Verdú. *Random Matrix Theory and Wireless Communications*. Now Publishers Inc, 2004.

[37] J. Barbier, N. Macris, A. Maillard, and F. Krzakala. The Mutual Information in Random Linear Estimation Beyond i.i.d. Matrices. In *IEEE International Symposium on Information Theory (ISIT)*, 2018.
[38] J. Barbier and N. Macris. The stochastic interpolation method: a simple scheme to prove replica formulas in Bayesian inference. arXiv:1705.02780, 2017.

[39] R. Shwartz-Ziv and N. Tishby. Opening the Black Box of Deep Neural Networks via Information. arXiv:1703.00810, 2017.

[40] S. Boucheron, G. Lugosi, and P. Massart. *Concentration inequalities: A nonasymptotic theory of independence*. Oxford University Press, 2013.