A. Cousin, S. Crépey, O. Guéant, D. Hobson, M. Jeanblanc, J. Lasry, J. Laurent, P. Lions, P. Tankov, and O. Guéant. Mean field games and applications. Paris-Princeton lectures on mathematical finance 2010, pages 205-266, 2011.
K. Cui and H. Koeppl. Approximately solving mean field games via entropy-regularized deep reinforcement learning. In International Conference on Artificial Intelligence and Statistics, pages 1909–1917. PMLR, 2021a.
Kai Cui and Heinz Koeppl. Learning graphon mean field games and approximate nash equilibria. In International Conference on Learning Representations, 2021b.
C. Fabian, . Cui, and H. Koeppl. Learning sparse graphon mean field games. arXiv preprint arXiv:2209.03880, 2022.
M. Geist, B. Scherrer, and O. Pietquin. A theory of regularized markov decision processes. In International Conference on Machine Learning, pages 2160-2169. PMLR, 2019.
M. Geist, J. Perolat, M. Laurière, R. Elie, S. Perrin, O. Bachem, R. Munos, and O. Pietquin. Concave utility reinforcement learning: the mean-field game viewpoint. arXiv preprint arXiv:2106.03787, 2021.
A. H. Guide. Infinite dimensional analysis. Springer, 2006.
L. Györfi, M. Kohler, A. Krzyzak, and H. Walk. A distribution-free theory of nonparametric regression, volume 1. Springer, 2002.
K. Hinderer. Foundations of non-stationary dynamic programming with discrete time parameter, 1970.
M. Huang, R. P. Malhamé, and P. E. Caines. Large population stochastic dynamic games: closed-loop mckean-vlasov systems and the nash certainty equivalence principle. 2006.
H.-J. Langen. Convergence of dynamic programming models. Mathematics of Operations Research, 6(4):493-512, 1981.
J. Lasry and P. Lions. Mean field games. Japanese journal of mathematics, 2(1):229-260, 2007.
R. Lowe, Y. I. Wu, A. Tamar, J. Harb, OpenAI Pieter A., and I. Mordatch. Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in neural information processing systems, 30, 2017.
I. Mordatch and P. Abbeel. Emergence of grounded compositional language in multi-agent populations. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.
Francesca Parise and Asuman Ozdaglar. Graphon games. In Proceedings of the 2019 ACM Conference on Economics and Computation, pages 457-458, 2019.
J. Perolat, S. Perrin, R. Elie, M. Laurière, G. Piliouras, M. Geist, K. Tuyls, and O. Pietquin. Scaling up mean field games with online mirror descent. arXiv preprint arXiv:2103.00623, 2021.
S. Perrin, J. Pérolat, M. Laurière, M. Geist, R. Elie, and O. Pietquin. Fictitious play for mean field games: Continuous time analysis and applications. Advances in Neural Information Processing Systems, 33:13199-13213, 2020.
L. Shani, Y. Efroni, and S. Mannor. Adaptive trust region policy optimization: Global convergence and faster rates for regularized mdps. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 5668-5675, 2020.
E. Sonu, Y. Chen, and P. Doshi. Decision-theoretic planning under anonymity in agent populations. Journal of Artificial Intelligence Research, 59:725-770, 2017.
M. Uehara, C. Shi, and N. Kallus. A review of off-policy evaluation in reinforcement learning. arXiv preprint arXiv:2212.06355, 2022.