[20] Lv Chen and Yang Shen. On a new paradigm of optimal reinsurance: a stochastic stackelberg differential game between an insurer and a reinsurer. ASTIN Bulletin: The Journal of the IAA, 48(2):905–960, 2018. 16
[21] Mo Chen, Zhengyuan Zhou, and Claire J Tomlin. Multiplayer reach-avoid games via low dimensional solutions and maximum matching. In 2014 American control conference, pages 1444–1449. IEEE, 2014. 8
[22] Stefan Czerwik. Functional equations and inequalities in several variables. World Scientific, 2002. 3, 4
[23] John M. Danskin. The theory of max-min, with applications. SIAM Journal on Applied Mathematics, 14(4):641-664, 1966. ISSN 00361399. URL http://www.jstor.org/stable/2946123.4
[24] Constantinos Daskalakis, Dylan J Foster, and Noah Golowich. Independent policy gradient methods for competitive reinforcement learning. Advances in neural information processing systems, 33:5527-5540, 2020. 1, 7
[25] Victor DeMiguel and Huifu Xu. A stochastic multiple-leader stackelberg model: analysis, computation, and application. Operations Research, 57(5):1220-1235, 2009. 16
[26] Maryam Fazel, Rong Ge, Sham Kakade, and Mehran Mesbahi. Global convergence of policy gradient methods for the linear quadratic regulator. In International conference on machine learning, pages 1467-1476. PMLR, 2018. 24
[27] Anthony V Fiasco and Jerzy Kyparisis. Convexity and concavity properties of the optimal value function in parametric nonlinear programming. Journal of optimization theory and applications, 48(1):95-126, 1986. 19, 25
[28] Arlington M Fink. Equilibrium in a stochastic  $n$ -person game. Journal of science of the hiroshima university, series ai (mathematics), 28(1):89-93, 1964. 1
[29] Jaime F. Fisac, Mo Chen, Claire J. Tomlin, and S. Shankar Sastry. Reach-avoid problems with time-varying dynamics, targets and constraints. In Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control, HSCC '15, page 11-20, New York, NY, USA, 2015. Association for Computing Machinery. ISBN 9781450334334. doi: 10.1145/2728606.2728612. URL https://doi.org/10.1145/2728606.2728612. 2, 8, 9
[30] James Flynn. Lion and man: the general case. SIAM Journal on Control, 12(4):581-597, 1974. 8
[31] David Fridovich-Keil, Ellis Ratner, Lasse Peters, Anca D Dragan, and Claire J Tomlin. Efficient iterative linear-quadratic approximations for nonlinear multi-player general-sum differential games. In 2020 IEEE international conference on robotics and automation (ICRA), pages 1475–1481. IEEE, 2020. 1
[32] Yan Gao, John Lygeros, and Marc Quincampoix. On the reachability problem for uncertain hybrid systems. IEEE Transactions on Automatic Control, 52(9):1572-1586, 2007. 8
[33] Denizalp Goktas and Amy Greenwald. Convex-concave min-max stackelberg games. Advances in Neural Information Processing Systems, 34, 2021. 2, 3, 4, 5, 6, 16, 20
[34] Denizalp Goktas and Amy Greenwald. Robust no-regret learning in min-max Stackelberg games, 2022. 16
[35] Denizalp Goktas and Amy Greenwald. Gradient descent ascent in min-max stackelberg games. arXiv preprint arXiv:2208.09690, 2022. 5
[36] Denizalp Goktas, Sadie Zhao, and Amy Greenwald. Zero-sum stochastic stackelberg games. Advances in Neural Information Processing Systems, 35:11658-11672, 2022. 1, 2, 7, 16
[37] Xiuli He, Ashutosh Prasad, and Suresh P Sethi. Cooperative advertising and pricing in a dynamic stochastic supply chain: Feedback stackelberg strategies. In PICMET'08-2008 Portland International Conference on Management of Engineering and Technology, pages 1634-1649. IEEE, 2008. 16
[38] Rufus Isaacs. Differential Games I: Introduction. RAND Corporation, Santa Monica, CA, 1954. 10