[21] I. Fatkhullin and B. Polyak. Optimizing static linear feedback: Gradient method. SIAM Journal on Control and Optimization, 59(5):3887-3911, 2021.
[22] M. Fazel, R. Ge, S. Kakade, and M. Mesbahi. Global convergence of policy gradient methods for the linear quadratic regulator. In Proceedings of the 35th International Conference on Machine Learning, volume 80, pages 1467-1476, 2018.
[23] F. Fonte, S. Ricci, and P. Mantegazza. Gust load alleviation for a regional aircraft through a static output feedback. Journal of Aircraft, 52(5):1559-1574, 2015.
[24] L. Furieri, Y. Zheng, and M. Kamgarpour. Learning the globally optimal distributed LQ regulator. In Learning for Dynamics and Control, pages 287-297, 2020.
[25] J. Gadewadikar, F. Lewis, K. Subbarao, K. Peng, and B. Chen. H-infinity static output-feedback control for rotorcraft. Journal of Intelligent and Robotic Systems, 54:629-646, 2009.
[26] P. Gahinet and P. Apkarian. A linear matrix inequality approach to  $H_{\infty}$  control. International Journal of Robust and Nonlinear Control, 4:421-448, 1994.
[27] S. Ghadimi and G. Lan. Stochastic first-and zeroth-order methods for nonconvex stochastic programming. SIAM Journal on Optimization, 23(4):2341-2368, 2013.
[28] A. Goldstein. Optimization of lipschitz continuous functions. Mathematical Programming, 13(1):14-22, 1977.
[29] G. Golub and C. Van Loan. Matrix computations. JHU press, 2013.
[30] B. Gravell, P. M. Esfahani, and T. Summers. Learning optimal controllers for linear systems with multiplicative noise via policy gradient. IEEE Transactions on Automatic Control, 66(11):5283-5298, 2020.
[31] S. Gumussoy, D. Henrion, M. Millstone, and M. L. Overton. Multiobjective robust control with HIFOO 2.0. IFAC Proceedings Volumes, 42(6):144-149, 2009.
[32] X. Guo and B. Hu. Global convergence of direct policy search for state-feedback  $\mathcal{H}_{\infty}$  robust control: A revisit of nonsmooth synthesis with goldstein subdifferential. In Conference on Neural Information Processing Systems, 2022.
[33] B. Hambly, R. Xu, and H. Yang. Policy gradient methods for the noisy linear quadratic regulator over a finite horizon. SIAM Journal on Control and Optimization, 59(5):3359-3391, 2021.
[34] K. Hengster-Movric, F. Lewis, and M. Sebek. Distributed static output-feedback control for state synchronization in networks of identical lti systems. Automatica, 53:282-290, 2015.
[35] B. Hu, K. Zhang, N. Li, M. Mesbahi, M. Fazel, and T. Basar. Towards a theoretical foundation of policy optimization for learning control policies. arXiv preprint arXiv:2210.04810, 2022.
[36] B. Hu and Y. Zheng. Connectivity of the feasible and sublevel sets of dynamic output feedback control with robustness constraints. IEEE Control Systems Letters, 7:442-447, 2022.
[37] J. P. Jansch-Porto, B. Hu, and G. Dullerud. Policy learning of MDPs with mixed continuous/discrete variables: A case study on model-free control of Markovian jump systems. In Learning for Dynamics and Control, pages 947-957, 2020.
[38] J. P. Jansch-Porto, B. Hu, and G. Dullerud. Policy optimization for Markovian jump linear quadratic control: Gradient-based methods and global convergence. IEEE Transactions on Automatic Control, 2020.
[39] J. P. Jansch-Porto, B. Hu, and G. E. Dullerud. Convergence guarantees of policy optimization methods for Markovian jump linear systems. In American Control Conference, pages 2882–2887, 2020.
[40] K. C. Kiwiel. Convergence of the gradient sampling algorithm for nonsmooth nonconvex optimization. SIAM Journal on Optimization, 18(2):379-388, 2007.
[41] F. Leibfritz and W. Lipinski. COMPleib 1.0-user manual and quick reference, 2004.
[42] W. Levine and M. Athans. On the determination of the optimal constant output feedback gains for linear multivariable systems. IEEE Transactions on Automatic control, 15(1):44-48, 1970.