[41] Ben Poole, Sherjil Ozair, Aäron van den Oord, Alexander A. Alemi, and George Tucker. On variational bounds of mutual information. In ICML, volume 97 of Proceedings of Machine Learning Research, pages 5171-5180. PMLR, 2019.
[42] Jiaming Song and Stefano Ermon. Understanding the limitations of variational mutual information estimators. In ICLR. OpenReview.net, 2020.
[43] Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Han Zhao, Louis-Philippe Morency, and Ruslan Salakhutdinov. Self-supervised representation learning with relative predictive coding. In ICLR. OpenReview.net, 2021.
[44] Qing Guo, Junya Chen, Dong Wang, Yuewei Yang, Xinwei Deng, Jing Huang, Lawrence Carin, Fan Li, and Chenyang Tao. Tight mutual information estimation with contrastive fenchel-legendre optimization. In NeurIPS, 2022.
[45] Chun-Hsiao Yeh, Cheng-Yao Hong, Yen-Chi Hsu, Tyng-Luh Liu, Yubei Chen, and Yann LeCun. Decoupled contrastive learning. In ECCV (26), volume 13686 of Lecture Notes in Computer Science, pages 668-684. Springer, 2022.
[46] Louis Faury, Ugo Tanielian, Elvis Dohmatob, Elena Smirnova, and Flavian Vasile. Distributionally robust counterfactual risk minimization. In AAAI, pages 3850-3857. AAAI Press, 2020.
[47] Jun-ya Gotoh, Michael Jong Kim, and Andrew E. B. Lim. Robust empirical optimization is almost the same as mean-variance optimization. Oper. Res. Lett., 46(4):448–452, 2018.
[48] Jaeho Lee, Sejun Park, and Jinwoo Shin. Learning bounds for risk-sensitive learning. In NeurIPS, 2020.
[49] Sever S Dragomir, V Gluscevic, and Charles Edward Miller Pearce. Csiszár f-divergence, Ostrowski's inequality and mutual information. Nonlinear Analysis-Theory Methods and Applications, 47(4):2375-2386, 2001.
[50] Kyungmin Lee and Jinwoo Shin. Rényi: Contrastive representation learning with skew rényi divergence. In NeurIPS, 2022.
[51] Avraham Ruderman, Mark D. Reid, Dario García-García, and James Petterson. Tighter variational representations of f-divergences via restriction to probability measures. In ICML. icml.cc / Omnipress, 2012.
[52] Tiffany Tianhui Cai, Jonathan Frankle, David J. Schwab, and Ari S. Morcos. Are all negatives created equal in contrastive instance discrimination? CoRR, abs/2010.06682, 2020.
[53] Christopher Morris, Nils M. Kriege, Franka Bause, Kristian Kersting, Petra Mutzel, and Marion Neumann. Tudataset: A collection of benchmark datasets for learning with graphs. CoRR, abs/2007.08663, 2020.
[54] XuanLong Nguyen, Martin J. Wainwright, and Michael I. Jordan. Estimating divergence functionals and the likelihood ratio by convex risk minimization. IEEE Trans. Inf. Theory, 56(11):5847-5861, 2010.
[55] Jean-Baptiste Hiriart-Urruty and Claude Lemaréchal. Fundamentals of convex analysis. Springer Science & Business Media, 2004.
[56] Aharon Ben-Tal and Marc Teboulle. An old-new concept of convex risk measures: the optimized certainty equivalent. Mathematical Finance, 17(3):449-476, 2007.
[57] Stephen P Boyd and Lieven Vandenberghe. Convex optimization. Cambridge university press, 2004.
[58] Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar. Foundations of machine learning. 2018.
[59] Aharon Ben-Tal and Marc Teboulle. Expected utility, penalty functions, and duality in stochastic nonlinear programming. Management Science, 32(11):1445-1466, 1986.