## 4 Proposed DQN-Based Offloading Decision Algorithm
### DQN-Based Offloading and Compression Decision
**Author Contributions:** [PERSON], [PERSON], and [PERSON] were the main researchers who initiated and organized research reported in the paper, and all authors including [PERSON], [PERSON], and [PERSON] were responsible for analyzing the simulation results and writing the paper. [PERSON] provided more realistic network setting and its related most suitable algorithm modification. All authors have read and agreed to the published version of the manuscript. **Funding:** This research was supported by the Chung-Ang University Graduate Research Scholarship in 2019 (for [PERSON]) and the National Research Foundation of Korea (2019M3E4A1080391). **Acknowledgments:** [PERSON], [PERSON], and [PERSON] are the corresponding authors of this paper. **Conflicts of Interest:** The authors declare no conflict of interest. Figure 7: Performance evaluation results (Proposed DQN-based vs. Greedy): Average delays (**left**) and performance gap (**right**). ## References

* [PERSON] and [PERSON] (2014) [PERSON]; [PERSON] Fast Millimeter-Wave Beam Training with Receive Beamforming. _J. Commun. Netw._**2014**, _16_, 512-522. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON] Interference-Aware Adaptive Beam Alignment for Hyper-Dense IEEE 802.11 ax Internet-of-Things Networks. _Sensors_**2018**, _18_, 3364. [CrossRef] [PubMed]
* [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON] Quality-Aware Streaming and Scheduling for Device-to-Device Video Delivery. _IEEE/ACM Trans. Netw._**2016**, _24_, 2319-2331. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] SGCO: Stabilized Green Crosshaul Orchestration for Dense IoT Offloading Services. _IEEE J. Sel. Areas Commun._**2018**, _36_, 2538-2548. [CrossRef]
* [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON]; [PERSON] Markov Decision Policies for Dynamic Video Delivery in Wireless Caching Networks. _IEEE Trans. Wirel. Commun._**2019**, _18_, 5705-5718. [CrossRef]
* [PERSON] and [PERSON] (2019) [PERSON]; [PERSON] Multi-Agent Deep Reinforcement Learning for Cooperative Connected Vehicles. In Proceedings of the IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA, 9-13 December 2019. * [PERSON] and [PERSON] (2019) [PERSON]; [PERSON] Optimal Trajectory Learning for UAV-BS Video Provisioning System: A Deep Reinforcement Learning Approach. In Proceedings of the IEEE International Conference on Information Networking (ICOIN), Kuala Lumpur, Malaysia, 9-11 January 2019. * [PERSON] (2018) [PERSON] Multi-Objective Decision-Making for Mobile Cloud Offloading: A Survey. _IEEE Access_**2018**, \(6\), 3962-3976. [CrossRef]
* [PERSON] and [PERSON] (2020) [PERSON]; [PERSON]; [PERSON] Energy-Efficient Decision Making for Mobile Cloud Offloading. _IEEE Trans. Cloud Comput._**2020**, _2020_, 1-15. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON] Dynamic Computation Offloading Scheme for Drone-based Surveillance Systems. _Sensors_**2018**, _18_, 2982. [CrossRef]
* [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning-based Joint Task Offloading and Bandwidth Allocation for Multi-User Mobile Edge Computing. _Digit. Commun. Netw._**2019**, \(5\), 10-17. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON] Mobile Cloud Computing for Computation Offloading: Issues and Challenges. _Appl. Comput. Inform._**2018**, _14_, 1-16. [CrossRef]
* [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Joint Offloading and Streaming in Mobile Edges: A Deep Reinforcement Learning Approach. In Proceedings of the IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS), Singapore, 28-30 August 2019. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON] Cooperative Management for PV/ESS-Enabled Electric-Vehicle Charging Stations: A Multi-Agent Deep Reinforcement Learning Approach. _IEEE Trans. Ind. Inform._**2020**, _16_, 3493-3503. [CrossRef]
* [PERSON] et al.