# The Deep Deterministic Policy Gradient Algorithm Based on RIS Technology in a Coal Mine Tunnel
## 3 Deep Reinforcement Learning Based Optimization
### DDPG Algorithm Elements and Processes
[CrossRef]
* (9) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Designing reconfigurable intelligent surfaces for wireless communication: A review. _J. Huazhong Univ. of Sci. and Technol. (Nat. Sci. Ed. )_**2023**, _51_, 1-32. * (10) [PERSON] _Ray Tracing Based Channel Modeling for RIS Empowered Indoor Wireless Communication Scenarios_; Shandong University: Shandong, China, 2023. * (11) [PERSON] _Channel Estimation and Passive Beamforming for Reconfigurable Intelligent Surface-Assisted Communications_; University of Electronic Science and Technology of China: Chengdu, China, 2022. * (12) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Weighted sum rate optimization for intelligent reflecting surface-aided wireless network. _J. Natl. Univ. Def. Technol._**2023**, _45_, 56-63. * (13) [PERSON]; [PERSON]; [PERSON] Deep reinforcement learning for 5G networks: Joint beamforming, power control, and interference coordination. _IEEE Trans. Commun._**2019**, _68_, 1581-1592. [CrossRef]
* (14) [PERSON]; [PERSON] DDPG learning for aerial RIS-assisted MU-MISO communications. In Proceedings of the 2022 IEEE 33 rd Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Kyoto, Japan, 12-15 September 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 701-706. * (15) [PERSON]; [PERSON]; [PERSON] Application and Design of LSTM in Coal Mine Gas Prediction and Early Warning System. _J. Xi'an Univ. Sci. Technol._**2018**, _38_, 1027-1035. * (16) [PERSON]; [PERSON]; [PERSON]; [PERSON] Application of deep learning in microseismic detection of hydraulic fracturing in coal mine. _J. Xi'an Univ. Sci. Technol._**2023**, _43_, 686-696. * (17) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Multi-agent Reinforcement Learning-based Joint Precoding and Phase Shift Optimization for RIS-aided Cell-Free Massive MIMO Systems. _IEEE Trans. Veh. Technol._**2024**, _73_, 14015-14020. [CrossRef]
* (18) [PERSON]; [PERSON]; [PERSON] Anti-jamming RIS communications using DQN-based algorithm. _IEEE Access_**2022**, _10_, 28422-28433. [CrossRef]* _[PERSON] et al. (2021)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] DQN based downlink-beamforming for millimeter wave MISO system in mobile environment. _J. South-Cent. Univ. Natl. (Nat. Sci. Ed. )_**2021**, _40_, 278-285. * [PERSON] (2021) [PERSON] Reinforcement learning with deep deterministic policy gradient. In Proceedings of the 2021 International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA), Xi'an, China, 28-30 May 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 82-85. * _[PERSON] et al. (2021)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] A multi-agent reinforcement learning algorithm based on improved DDPG in Actor-Critic framework. _Control. Decis._**2021**, _36_, 75-82. * _[PERSON] et al. (2020)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep deterministic policy gradient (DDPG)-based resource allocation scheme for NOMA vehicular communications. _IEEE Access_**2020**, \(8\), 18797-18807. [CrossRef]
* _[PERSON] et al. (2020)_ [PERSON]; [PERSON]; [PERSON] Reconfigurable intelligent surface assisted multiuser MISO systems exploiting deep reinforcement learning. _IEEE J. Sel. Areas Commun._**2020**, _38_, 1839-1850. [CrossRef]
* _[PERSON] et al. (2023)_ [PERSON]; [PERSON]; [PERSON] Deep reinforcement learning based joint downlink beamforming and RIS configuration in RIS-aided MU-MISO systems under hardware impairments and imperfect CSI. In Proceedings of the 2023 IEEE International Conference on Communications Workshops (ICC Workshops), Rome, Italy, 28 May-1 June 2023; IEEE: Piscataway, NJ, USA, 2023; pp. 66-72. * _[PERSON] et al. (2024)_ [PERSON]; [PERSON]; [PERSON] Research on beamforming algorithms incoporating reconfigurable intelligent surface and deep reinforcement learning. _J. Chin. Comput. Syst._**2024**, _45_, 1311-1317. * _[PERSON] et al. (2020)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Intelligent reflecting surface: Practical phase shift model and beamforming optimization. _IEEE Trans.