[35] Jiang, Z., J. Gao, J. Chen. Unsupervised skill discovery via recurrent skill training. In Advances in Neural Information Processing Systems, vol. 35, pages 39034-39046. Curran Associates, Inc., 2022.
[36] Kumar, S., A. Kumar, S. Levine, et al. One solution is not all you need: Few-shot extrapolation via structured maxent rl. Advances in Neural Information Processing Systems, 33:8198-8210, 2020.
[37] Zhou, Z., W. Fu, B. Zhang, et al. Continuously discovering novel strategies via reward-switching policy optimization. arXiv preprint arXiv:2204.02246, 2022.
[38] Sun, H., Z. Peng, B. Dai, et al. Novel policy seeking with constrained optimization. arXiv preprint arXiv:2005.10696, 2020.
[39] Masood, M., F. Doshi-Velez. Diversity-inducing policy gradient: Using maximum mean discrepancy to find a set of diverse policies. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, pages 5923-5929. International Joint Conferences on Artificial Intelligence Organization, 2019.
[40] Fontaine, M., S. Nikolaidis. Differentiable quality diversity. In Advances in Neural Information Processing Systems, vol. 34, pages 10040-10052. Curran Associates, Inc., 2021.
[41] Parker-Holder, J., A. Pacchiano, K. M. Choromanski, et al. Effective diversity in population based reinforcement learning. Advances in Neural Information Processing Systems, 33:18050-18062, 2020.
[42] Li, C., C. Gong, Q. He, et al. Centralized cooperative exploration policy for continuous control tasks. In Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, pages 2454-2456. 2023.
[43] Haarnoja, T., H. Tang, P. Abbeel, et al. Reinforcement learning with deep energy-based policies. In Proceedings of the 34th International Conference on Machine Learning, vol. 70 of ICML'17, page 1352-1361. JMLR.org, 2017.
[44] Gong, C., Z. Yang, Y. Bai, et al. Curiosity-driven and victim-aware adversarial policies. In Proceedings of the 38th Annual Computer Security Applications Conference, ACSAC '22, page 186-200. Association for Computing Machinery, 2022.
[45] Silver, D., G. Lever, N. Heess, et al. Deterministic policy gradient algorithms. In Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32, ICML'14, page I-387-I-395. JMLR.org, 2014.
[46] Sutton, R. S. Learning to predict by the methods of temporal differences. Machine Learning, 3(1):9-44, 1988.
[47] Bellman, R. Dynamic programming. Science, 153(3731):34-37, 1966.
[48] Kuznetsov, A., P. Shvechikov, A. Grishin, et al. Controlling overestimation bias with truncated mixture of continuous distributional quantile critics. In the International Conference on Machine Learning (ICML), pages 5556-5566. PMLR, 2020.
[49] Liu, H., P. Abbeel. Aps: Active pretraining with successor features. In International Conference on Machine Learning, pages 6736-6747. PMLR, 2021.
[50] Anschel, O., N. Baram, N. Shimkin. Averaged-dqn: Variance reduction and stabilization for deep reinforcement learning. In International conference on machine learning, pages 176-185. PMLR, 2017.
[51] Zhao, Y., Q. Ye, W. Wu, et al. Generative prompt model for weakly supervised object localization. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 6351-6361. 2023.
[52] Kingma, D. P., J. Ba. Adam: A method for stochastic optimization. In ICLR (Poster). 2015.
[53] Wang, Y., K. Dong, X. Chen, et al. Q-learning with ucb exploration is sample efficient for infinite-horizon mdp. In International Conference on Learning Representations.
[54] David, H. A., H. N. Nagaraja. Order statistics. John Wiley & Sons, 2004.