V. Koltchinskii and D. Panchenko. Empirical Margin Distributions and Bounding the Generalization Error of Combined Classifiers. The Annals of Statistics, 30(1):1-50, 2002. doi: 10.1214/aos/1015362183.
Christos N. Mavridis, Nilesh Suriyarachchi, and John S. Baras. Maximum-Entropy Progressive State Aggregation for Reinforcement Learning. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 5144–5149, Austin, TX, USA, December 2021. IEEE. ISBN 978-1-66543-659-5. doi: 10.1109/CDC45484.2021.9682927.
Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar. Foundations of machine learning. Adaptive computation and machine learning. The MIT Press, Cambridge, Massachusetts, second edition edition, 2018. ISBN 978-0-262-03940-6.
Ofir Nachum, Yinlam Chow, Bo Dai, and Lihong Li. DualDICE: Behavior-Agnostic Estimation of Discounted Stationary Distribution Corrections, November 2019. URL http://arxiv.org/abs/1906.04733. arXiv:1906.04733 [cs, stat].
Martin L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. USA, 1st edition, 1994. ISBN 0471619779.
Mark Rowland, Robert Dadashi, Saurabh Kumar, Rémi Munos, Marc G. Bellemare, and Will Dabney. Statistics and Samples in Distributional Reinforcement Learning. 2019. doi: 10.48550/ARXIV.1902.08102.
Mark Rowland, Shayegan Omidshafiei, Daniel Hennes, Will Dabney, Andrew Jaegle, Paul Muller, Julien Pérolat, and Karl Tuyls. Temporal Difference and Return Optimism in Cooperative Multi-Agent Reinforcement Learning. page 9, 2021.
Mark Rowland, Rémi Munos, Mohammad Gheshlaghi Azar, Yunhao Tang, Georg Ostrovski, Anna Harutyunyan, Karl Tuyls, Marc G. Bellemare, and Will Dabney. An Analysis of Quantile Temporal-Difference Learning, January 2023. arXiv:2301.04462 [cs, stat].
Satinder Singh, Tommi Jaakkola, and Michael Jordan. Reinforcement Learning with Soft State Aggregation. In Advances in Neural Information Processing Systems, volume 7. MIT Press, 1994.
Tobias Sutter, David Sutter, Peyman Mohajerin Esfahani, and John Lygeros. Generalized maximum entropy estimation. 2017. doi: 10.48550/ARXIV.1708.07311.
Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, 2018.
Csaba Szepesvári. Algorithms for Reinforcement Learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 4(1):1-103, January 2010. ISSN 1939-4608, 1939-4616.
Aad W. van der Vaart and Jon A. Wellner. Weak Convergence and Empirical Processes. Springer Series in Statistics. Springer New York, New York, NY, 1996. ISBN 978-1-4757-2547-6 978-1-4757-2545-2. doi: 10.1007/978-1-4757-2545-2.
Benjamin Van Roy. Performance Loss Bounds for Approximate Value Iteration with State Aggregation. Mathematics of Operations Research, 31(2):234-244, May 2006. ISSN 0364-765X, 1526-5471. doi: 10.1287/moor.1060.0188.
V. Vapnik. Principles of Risk Minimization for Learning Theory. In Advances in Neural Information Processing Systems, volume 4. Morgan-Kaufmann, 1991.
Martin J. Wainwright and Michael I. Jordan. Graphical Models, Exponential Families, and Variational Inference. Foundations and Trends in Machine Learning, 1:1-305, 2007. ISSN 1935-8237, 1935-8245. doi: 10.1561/2200000001.
Shaojun Wang, Russell Greiner, and Shaomin Wang. Consistency and Generalization Bounds for Maximum Entropy Density Estimation. Entropy, 15(12):5439-5463, December 2013. ISSN 1099-4300. doi: 10.3390/e15125439.
Bin Yu. Rates of Convergence for Empirical Processes of Stationary Mixing Sequences. The Annals of Probability, 22(1):94-116, 1994. ISSN 0091-1798. Publisher: Institute of Mathematical Statistics.