[22] A. Oroojlooy and D. Hajinezhad, “A review of cooperative multi-agent deep reinforcement learning,” Applied Intelligence, 2022.
[23] J. Zhao, Y. Zhang, X. Hu, W. Wang, W. Zhou, J. Hao, J. Zhu, and H. Li, “Revisiting qmix: Discriminative credit assignment by gradient entropy regularization,” arXiv preprint arXiv:2202.04427, 2022.
[24] F. A. Oliehoek, M. T. Span, and N. Vlassis, "Optimal and approximate q-value functions for decentralized pomdpds," Journal of Artificial Intelligence Research, 2008.
[25] L. Kraemer and B. Banerjee, "Multi-agent reinforcement learning as a rehearsal for decentralized planning," Neurocomputing, 2016.
[26] J. Zhao, X. Hu, M. Yang, W. Zhou, J. Zhu, and H. Li, "Ctds: Centralized teacher with decentralized student for multi-agent reinforcement learning," IEEE Transactions on Games (CoG), 2022.
[27] M. Hausknecht and P. Stone, “Deep recurrent q-learning for partially observable mdps,” arXiv preprint arXiv:1507.06527, 2015.
[28] T. Schaul, J. Quan, I. Antonoglou, and D. Silver, “Prioritized experience replay,” in International Conference on Learning Representations (ICLR), 2016.
[29] M. Samvelyan, T. Rashid, C. S. de Witt, G. Farquhar, N. Nardelli, T. G. J. Rudner, C.-M. Hung, P. H. S. Torr, J. Foerster, and S. Whiteson, "The StarCraft Multi-Agent Challenge," CoRR, 2019.
[30] K. Kurach, A. Raichuk, P. Stanczyk, M. Zajac, O. Bachem, L. Espeholt, C. Riquelme, D. Vincent, M. Michalski, O. Bousquet, et al., "Google research football: A novel reinforcement learning environment," in AAAI Conference on Artificial Intelligence (AAAI), 2020.
[31] B. Peng, T. Rashid, C. Schroeder de Witt, P.-A. Kamienny, P. Torr, W. Böhmer, and S. Whiteson, "Facmac: Factored multi-agent centralised policy gradients," Advances in Neural Information Processing Systems (NeurIPS), 2021.
[32] F. A. Oliehoek and C. Amato, A concise introduction to decentralized POMDPs. Springer, 2016.
[33] V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al., "Human-level control through deep reinforcement learning," Nature, 2015.
[34] L.-J. Lin, "Self-improving reactive agents based on reinforcement learning, planning and teaching," Machine Learning, 1992.
[35] H. Van Hasselt, A. Guez, and D. Silver, “Deep reinforcement learning with double q-learning,” in AAAI Conference on Artificial Intelligence (AAAI), 2016.
[36] S. L. Smith, P.-J. Kindermans, C. Ying, and Q. V. Le, “Don’t decay the learning rate, increase the batch size,” in International Conference on Learning Representations (ICLR), 2018.
[37] J. Jeon, W. Kim, W. Jung, and Y. Sung, "Maser: Multi-agent reinforcement learning with subgoals generated from experience replay buffer," in International Conference on Machine Learning (ICML), PMLR, 2022.
[38] S. Fujimoto, D. Meger, and D. Precup, "An equivalence between loss functions and non-uniform sampling in experience replay," Advances in Neural Information Processing Systems (NeurIPS), 2020.
[39] P. Weber, D. Walchli, M. Zeqiri, and P. Koumoutsakos, “Remember and forget experience replay for multi-agent reinforcement learning,” arXiv preprint arXiv:2203.13319, 2022.
[40] S. Fan, G. Song, B. Yang, and X. Jiang, “Prioritized experience replay in multi-actor-attention-critic for reinforcement learning,” in Journal of Physics: Conference Series, 2020.