# Multi-Agent Deep-Q Network-Based Cache Replacement Policy for Content Delivery Networks
## Abbreviations
In Proceedings of the 2016 15 th IEEE International Conference on Machine Learning and Applications (ICMLA), Anaheim, CA, USA, 18-20 December 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 547-552. * (19) [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Q-Learning-Based Content Caching with Update Strategy for Fog Radio Access Networks. _IEEE Access_**2019**, \(7\), 97505-97514. [CrossRef]
* (20) [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning for Web Crawling. In Proceedings of the 2021 Seventh Indian Control Conference (ICC), Mumbai, India, 20-22 December 2021; pp. 201-206. [CrossRef]
* (21) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning: A Survey. _IEEE Trans. Neural Netw. Learn. Syst._**2022**, _35_, 5064-5078. [CrossRef] [PubMed]
* (22) [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning: A Brief Survey. _IEEE Signal Process. Mag._**2017**, _34_, 26-38. [CrossRef]
* (23) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning-Based Content Migration for Edge Content Delivery Networks With Vehicular Nodes. _IEEE Trans. Netw. Serv. Manag._**2021**, _18_, 3415-3431. [CrossRef]
* (24) [PERSON]; [PERSON]; [PERSON] Caca: Learning-Based Content-Aware Cache Admission for Video Content in Edge Caching. In Proceedings of the 27 th ACM International Conference on Multimedia, Nice, France, 21-25 October 2019; pp. 456-464. * (25) [PERSON] RLcache: Automated Cache Management Using Reinforcement Learning. _arXiv_**2019**, arXiv:1909.13839. * (26) [PERSON]; [PERSON]; [PERSON] Efficient Analysis of Caching Strategies under Dynamic Content Popularity. In Proceedings of the 2015 IEEE conference on computer communications (INFOCOM), Hong Kong, China, 26 April-1 May 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 2263-2271. * (27) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Hierarchical Edge Caching in Device-to-Device Aided Mobile Networks: Modeling, Optimization, and Design. _IEEE J. Sel. Areas Commun._**2018**, _36_, 1768-1785. [CrossRef]
* (28) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Q-Learning Based Edge Caching Optimization for D2D Enabled Hierarchical Wireless Networks. In Proceedings of the 2018 IEEE 15 th International Conference on Mobile Ad Hoc and Sensor Systems (MASS), Chengdu, China, 9-12 October 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 55-63. * (29) [PERSON]; [PERSON]; [PERSON]; [PERSON] Applications of Multi-Agent Deep Reinforcement Learning: Models and Algorithms. _Appl. Sci._**2021**, _11_, 10870. [CrossRef]
* (30) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Cooperative Deep Q-Learning with Q-Value Transfer for Multi-Intersection Signal Control. _IEEE Access_**2019**, \(7\), 40797-40809. [CrossRef]  
**Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.