## 3 Preliminaries: Network Model and Problem Definition
### TOMAC-PPO Algorithm Process
* [9] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Decentralized Service Request Dispatching for Edge Computing Systems. _Chin. J. Comput._**2023**, _46_, 987-1002. * [10] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] TCDA: Truthful combinatorial double auctions for mobile edge computing in industrial internet of things. _IEEE Trans. Mob. Comput._**2021**, _21_, 4125-4138. [CrossRef]
* [11] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Joint user scheduling and computing resource allocation optimization in asynchronous mobile edge computing networks. _IEEE Trans. Commun._**2024**, _72_, 3378-3392. [CrossRef]
* [12] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Task offloading in multiple-services mobile edge computing: A deep reinforcement learning algorithm. _Comput. Commun._**2023**, _202_, 1-12. [CrossRef]
* [13] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Task offloading mechanism based on federated reinforcement learning in mobile edge computing. _Digit. Commun. Netw._**2023**, \(9\), 492-504. [CrossRef]
* [14] [PERSON]; [PERSON]; [PERSON] Path Planning for Cellular-Connected UAV: A DRL Solution with Quantum-Inspired Experience Replay. _IEEE Trans. Wirel. Commun._**2022**, _21_, 7897-7912. [CrossRef]
* [15] [PERSON]; [PERSON] Radio Resource Management for Cellular-Connected UAV: A Learning Approach. _IEEE Trans. Commun._**2023**, _71_, 2784-2800. [CrossRef]
* [16] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Multi-user edge computing task offloading scheduling and resource allocation based on deep reinforcement learning. _Chin. J. Comput._**2022**, _45_, 812-824. (In Chinese)
* [17] [PERSON]; [PERSON]; [PERSON]; [PERSON] Dynamic scheduling for stochastic edge-cloud computing environments using A3C learning and residual recurrent neural networks. _IEEE Trans. Mob. Comput._**2020**, _21_, 940-954. [CrossRef]* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON] Multi-agent reinforcement learning: A selective overview of theories and algorithms. In _Handbook of Reinforcement Learning and Control_; Springer: New York, NY, USA, 2021; pp. 321-384. * [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Computation offloading strategy in multi-agent cooperation scenario based on reinforcement learning with value-decomposition. _J. Commun._**2021**, 42, 1-15. (In Chinese)
* [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Multiagent deep reinforcement learning for joint multichannel access and task offloading of mobile-edge computing in industry 4.0. _IEEE Internet Things J._**2020**, 7, 6201-6213. [CrossRef]
* [PERSON] and [PERSON] (2019) [PERSON]; [PERSON]; [PERSON] Truly proximal policy optimization. In Proceedings of the 35 th Uncertainty in Artificial Intelligence Conference (UAI), Tel Aviv, Israel, 23-25 July 2019; PMLR: New York, NY, USA, 2020; Volume 115, pp. 113-122. * [PERSON] et al. (2015) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Trust region policy optimization. In Proceedings of the 32 nd International Conference on Machine Learning (ICML), Lille, France, 6-11 July 2015; PMLR: New York, NY, USA, 2015; Volume 37, pp. 1889-1897. * [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Proximal policy optimization algorithms. _arXiv_**2017**, arXiv:1707.06347. [CrossRef]
* [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Asynchronous methods for deep reinforcement learning. In Proceedings of the 33 rd International Conference on Machine Learning (ICML), New York City, NY, USA, 19-24 June 2016; PMLR: New York, NY, USA, 2016; Volume 48, pp. 1928-1937. **Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.