[15] Herke Van Hoof, Gerhard Neumann, and Jan Peters. Non-parametric policy search with limited information loss. Journal of Machine Learning Research, 2017.
[16] Abbas Abdelmaleki, Jost Tobias Springenberg, Yuval Tassa, Remi Munos, Nicolas Heess, and Martin Riedmiller. Maximum a Posteriori policy optimisation. In International Conference on Learning Representations, 2018.
[17] Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International Conference on Machine Learning, 2018.
[18] Matthew Fellows, Anuj Mahajan, Tim GJ Rudner, and Shimon Whiteson. VIREL: A variational inference framework for reinforcement learning. Advances in Neural Information Processing Systems, 2019.
[19] Joan Bas-Serrano, Sebastian Curi, Andreas Krause, and Gergely Neu. Logistic  $Q$ -learning. In International Conference on Artificial Intelligence and Statistics, 2021.
[20] Matteo Pirotta and Marcello Restelli. Inverse reinforcement learning through policy gradient minimization. In Proceedings of the AAAI Conference on Artificial Intelligence, 2016.
[21] Giorgia Ramponi, Gianluca Drappo, and Marcello Restelli. Inverse reinforcement learning from a gradient-based learner. In Advances in Neural Information Processing Systems, 2020.
[22] Yi-Feng Zhang, Fan-Ming Luo, and Yang Yu. Improve generated adversarial imitation learning with reward variance regularization. Machine Learning, 2022.
[23] Siddharth Reddy, Anca D Dragan, and Sergey Levine. SQL: Imitation learning via reinforcement learning with sparse rewards. In International Conference on Learning Representations, 2019.
[24] Kiante Brantley, Wen Sun, and Mikael Henaff. Disagreement-regularized imitation learning. In International Conference on Learning Representations, 2020.
[25] Nived Rajaraman, Lin Yang, Jiantao Jiao, and Kannan Ramchandran. Toward the fundamental limits of imitation learning. Advances in Neural Information Processing Systems, 2020.
[26] Stuart Russell. Learning agents for uncertain environments. In Conference on Computational Learning Theory, 1998.
[27] Umar Syed and Robert E. Schapire. A game-theoretic approach to apprenticeship learning. In Advances in Neural Information Processing Systems, 2007.
[28] Umar Syed, M. Bowling, and R.E. Schapire. Apprenticeship learning using linear programming. In International Conference on Machine Learning, 2008.
[29] Tian Xu, Ziniu Li, and Yang Yu. Error bounds of imitating policies and environments. Advances in Neural Information Processing Systems, 2020.
[30] Brian D Ziebart. Modeling purposeful adaptive behavior with the principle of maximum causal entropy. Carnegie Mellon University, 2010.
[31] Edwin T Jaynes. On the rationale of maximum-entropy methods. Proceedings of the IEEE, 1982.
[32] Joseph Marino, Alexandre Piché, Alessandro Davide Ialongo, and Yisong Yue. Iterative amortized policy optimization. In Advances in Neural Information Processing Systems, 2021.
[33] David Barber. Bayesian reasoning and machine learning. Cambridge University Press, 2012.
[34] Konrad Rawlik, Marc Toussaint, and Sethu Vijayakumar. On stochastic optimal control and reinforcement learning by approximate inference. In Robotics: Science and Systems, 2013.
[35] Joe Watson and Jan Peters. Inferring smooth control: Monte Carlo posterior policy iteration with Gaussian processes. In Conference on Robot Learning, 2022.