J. Lee and R. S. Sutton. Policy iterations for reinforcement learning problems in continuous time and space — fundamental theory and methods. *Automatica*, 126, 2021.
F. L. Lewis, D. Vrabie, and K. G. Vamvoudakis. Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers. IEEE Control Systems Magazine, 32(6):76-105, 2012. doi: 10.1109/MCS.2012.2214134.
A. Lindquist. Linear stochastic systems. SIAM Review, 32(2):325-328, 1990. doi: 10.1137/1032067.
M. Lutter, S. Mannor, J. Peters, D. Fox, and A. Garg. Value iteration in continuous actions, states and time. In Proceedings of the International Conference on Machine Learning, 2021.
M. Lutter, B. Belousov, S. Mannor, D. Fox, A. Garg, and J. Peters. Continuous-time fitted value iteration for robust policies. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
A. M. Metelli, F. Mazzolini, L. Bisi, L. Sabbioni, and M. Restelli. Control frequency adaptation via action persistence in batch reinforcement learning. In Proceedings of the International Conference on Machine Learning, 2020.
F. Mezzadri. How to generate random matrices from the classical compact groups. arXiv preprint math-ph/0609050, 2006.
R. Munos. Policy gradient in continuous time. Journal of Machine Learning Research, 7, 2006.
R. Munos and P. Bourgine. Reinforcement learning for continuous stochastic control problems. Advances in neural information processing systems, 10, 1997.
S. Park, J. Kim, and G. Kim. Time discretization-invariant safe action repetition for policy gradient methods. Advances in Neural Information Processing Systems, 34, 2021.
S. Sharma, A. S. Lakshminarayanan, and B. Ravindran. Learning to repeat: Fine grained action repetition for deep reinforcement learning. In Proceedings of the International Conference on Learning Representations, 2017.
S. R. Sinclair, S. Banerjee, and C. L. Yu. Adaptive discretization for episodic reinforcement learning in metric spaces. In Proceedings of the ACM Conference on Measurement and Analysis of Computing Systems, 2019.
R. S. Sutton, D. Precup, and S. Singh. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112:181-211, 1999.
C. Tallec, L. Blier, and Y. Ollivier. Making deep Q-learning methods robust to time discretization. In International Conference on Machine Learning (ICML), number 97, pages 6096-6104, 2019.
E. Todorov, T. Erez, and Y. Tassa. Mujoco: A physics engine for model-based control. In 2012 IEEE/RSJ international conference on intelligent robots and systems. IEEE, 2012.
S. Tu and B. Recht. Least-squares temporal difference learning for the linear quadratic regulator. In International Conference on Machine Learning, pages 5005-5014. PMLR, 2018.
S. Tu and B. Recht. The gap between model-based and model-free methods on the linear quadratic regulator: An asymptotic viewpoint. In Conference on Learning Theory, pages 3036-3083. PMLR, 2019.
P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wilson, K. J. Millman, N. Mayorov, A. R. J. Nelson, E. Jones, R. Kern, E. Larson, C. J. Carey, I. Polat, Y. Feng, E. W. Moore, J. VanderPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Henriksen, E. A. Quintero, C. R. Harris, A. M. Archibald, A. H. Ribeiro, F. Pedregosa, P. van Mulbregt, and SciPy 1.0 Contributors. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17: 261-272, 2020. doi: 10.1038/s41592-019-0686-2.
H. Wang, T. Zariphopoulou, and X. Y. Zhou. Reinforcement learning in continuous time and space: A stochastic control approach. Journal of Machine Learning Research, 21(198):1-34, 2020.
C. Yildiz, M. Heinonen, and H. Lähdesmäki. Continuous-time model-based reinforcement learning. In International Conference on Machine Learning, pages 12009-12018. PMLR, 2021.