Y. Polyanskiy and Y. Wu. Information Theory: From Coding to Learning. Cambridge University Press, 2022. Book draft.
Ben Poole, Sherjil Ozair, Aaron Van Den Oord, Alex Alemi, and George Tucker. On variational bounds of mutual information. In International Conference on Machine Learning, pages 5171-5180. PMLR, 2019.
Ruggero Ragonesi, Riccardo Volpi, Jacopo Cavazza, and Vittorio Murino. Learning unbiased representations via mutual information backpropagation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2729-2738, 2021.
Jangir Selimkhanov, Brooks Taylor, Jason Yao, Anna Pilko, John Albeck, Alexander Hoffmann, Lev Tsimring, and Roy Wollman. Accurate information transmission through dynamic biochemical signaling networks. Science, 346(6215):1370-1373, 2014.
Bernard W Silverman. Density estimation for statistics and data analysis. Routledge, 2018.
Victor Solo. On causality and mutual information. In 2008 47th IEEE Conference on Decision and Control, pages 4939-4944. IEEE, 2008.
Jiaming Song and Stefano Ermon. Understanding the limitations of variational mutual information estimators. In International Conference on Learning Representations, 2020.
Joe Suzuki. An estimator of mutual information and its application to independence testing. Entropy, 18(4):109, 2016.
Nassim Nicholas Taleb. Statistical consequences of fat tails: Real world preasymptotics, epistemology, and applications, 2020. URL https://arxiv.org/abs/2001.10488.
Michael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly, and Mario Lucic. On mutual information maximization for representation learning. In International Conference on Learning Representations, 2020.
Shinsuke Uda. Application of information theory in systems biology. Biophysical Reviews, 12 (2):377-384, Apr 2020. ISSN 1867-2469. doi: 10.1007/s12551-020-00665-w. URL https://doi.org/10.1007/s12551-020-00665-w.
Gregory Valiant and Paul Valiant. Estimating the unseen: an  $n / \log (n)$ -sample estimator for entropy and support size, shown optimal via new clts. In Proceedings of the annual ACM symposium on Theory of computing (STOC), pages 685-694, 2011.
Martin Vejmelka and Kateřina Hlaváčková-Schindler. Mutual information estimation in higher dimensions: A speed-up of a k-nearest neighbor based estimator. In International Conference on Adaptive and Natural Computing Algorithms, pages 790-797. Springer, 2007.
Nguyen Xuan Vinh, Jeffrey Chan, and James Bailey. Reconsidering mutual information based feature selection: A statistical significance view. In Proceedings of the AAAI Conference on Artificial Intelligence, 2014.
Julius Von Kugelgen, Yash Sharma, Luigi Gresele, Wieland Brendel, Bernhard Scholkopf, Michel Besserve, and Francesco Locatello. Self-supervised learning with data augmentations provably isolates content from style. Advances in neural information processing systems, 34:16451-16467, 2021.
Quanhan Xi and Benjamin Bloem-Reddy. Indeterminacy in latent variable models: Characterization and strong identifiability. arXiv preprint arXiv:2206.00801, 2022.
Alexander L. Young, Willem van den Boom, Rebecca A. Schroeder, Vijay Krishnamoorthy, Karthik Raghunathan, Hau-Tieng Wu, and David B. Dunson. Mutual information: Measuring nonlinear dependence in longitudinal epidemiological data. PLOS ONE, 18(4):1-16, 04 2023. doi: 10.1371/journal.pone.0284904. URL https://doi.org/10.1371/journal.pone.0284904.
Yifan Zhang, Bingyi Kang, Bryan Hooi, Shuicheng Yan, and Jiashi Feng. Deep long-tailed learning: A survey, 2021. URL https://arxiv.org/abs/2110.04596.