# Multi-Agent Deep-Q Network-Based Cache Replacement Policy for Content Delivery Networks
## Abbreviations  
* (1) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks. In Proceedings of the 2014 IEEE International Conference on Communications (ICC), Sydney, NSW, Australia, 10-14 June 2014; pp. 2648-2653. [CrossRef]
* (2) [PERSON]; [PERSON]; [PERSON] Content Delivery Networks--Q-Learning Approach for Optimization of the Network Cost and the Cache Hit Ratio. In Proceedings of the IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), London, ON, Canada, 30 August-2 September 2020; pp. 1-5. [CrossRef]
* (3) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Understanding Performance of Edge Content Caching for Mobile Video Streaming. _IEEE J. Sel. Areas Commun._**2017**, _35_, 1076-1089. [CrossRef]
* (4) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Caching in Information-Centric Networking: Strategies, Challenges, and Future Research Directions. _IEEE Commun. Surv. Tutorials_**2017**, _20_, 1443-1474. [CrossRef]
* (5) [PERSON]; [PERSON]; [PERSON] Dynamic cache Management in Content Delivery Networks. _Comput. Netw._**2021**, _187_, 107822. [CrossRef]
* (6) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Applying Machine Learning Techniques for Caching in Next-Generation Edge Networks: A Comprehensive Survey. _J. Netw. Comput. Appl._**2021**, _181_, 103005. [CrossRef]
* (7) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications, Toronto, ON, Canada, 6-9 July 2020; IEEE. Piscataway, NJ, USA, 2020; pp. 2499-2508. * (8) [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning with Double Q-Learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA, 12-17 February 2016; Volume 30. * (9) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Applications of Deep Reinforcement Learning in Communications and Networking: A Survey. _IEEE Commun. Surv. Tutorials_**2019**, _21_, 3133-3174. [CrossRef]
* (10) [PERSON]; [PERSON]; [PERSON] End-User Mapping: Next Generation Request Routing for Content Delivery. _ACM SIGCOMM Comput. Commun. Rev._**2015**, _45_, 167-181. [CrossRef]
* (11) [PERSON]; [PERSON]; [PERSON]; [PERSON] [PERSON] RL-Cache: Learning-Based Cache Admission for Content Delivery. In Proceedings of the 2019 Workshop on Network Meets AI & ML, Beijing, China, 23 August 2019; pp. 57-63. * (12) [PERSON]; [PERSON]; [PERSON] A Survey of Caching Techniques in Cellular Networks: Research Issues and Challenges in Content Placement and Delivery Strategies. _IEEE Commun. Surv. Tutorials_**2018**, _20_, 1710-1732. [CrossRef]* (13) [PERSON]; [PERSON] [PERSON] A Survey of Web Cache Replacement Strategies. _ACM Comput. Surv. (CSUR)_**2003**, _35_, 374-398. [CrossRef]
* (14) [PERSON]; [PERSON] Time Aware Least Recent Used (TLRU) Cache Management Policy in ICN. In Proceedings of the 16 th International Conference on Advanced Communication Technology, Pyeongchang, Republic of Korea, 16-19 February 2014; IEEE: Piscataway, NJ, USA, 2014; pp. 528-532. * (15) [PERSON]; [PERSON] Octopus: A cooperative hierarchical caching strategy for cloud radio access networks. In Proceedings of the 2016 IEEE 13 th International Conference on Mobile Ad Hoc and Sensor Systems (MASS), Brasilia, Brazil, 10-13 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 154-162. * (16) [PERSON] Web cache replacement policies: A pragmatic approach. _IEEE Netw._**2006**, _20_, 28-34. [CrossRef]
* (17) [PERSON]; [PERSON]; [PERSON] A Deep Reinforcement Learning-Based Framework for Content Caching. In Proceedings of the 2018 52 nd Annual Conference on Information Sciences and Systems (CISS), Princeton, NJ, USA, 21-23 March 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1-6. * (18) [PERSON]; [PERSON]; [PERSON]; [PERSON]. Efficient Content Replacement in Wireless Content Delivery Network with Cooperative Caching.