## 4 Problem Equation
### A3C Algorithm
(2018) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Multi-Resource Coordinate Scheduling for Earth Observation in Space Information Networks. _IEEE J. Sel. Areas Commun._**2018**, _36_, 268-279. [CrossRef]
* National Natural Science Foundation (2016) National Natural Science Foundation. The Program Guidance of the Basic Theory and Key Technology Research of Space Information Network in 2016. Available online: [[http://www.nsfc.gov.cn/publish/portal0/tab38/info51946.htm](http://www.nsfc.gov.cn/publish/portal0/tab38/info51946.htm)]([http://www.nsfc.gov.cn/publish/portal0/tab38/info51946.htm](http://www.nsfc.gov.cn/publish/portal0/tab38/info51946.htm)) (accessed on 25 March 2016). * [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Virtual multi-beamforming for distributed satellite clusters in space information networks. _IEEE Wirel. Commun._**2016**, _23_, 95-101. [CrossRef]
* [PERSON] et al. (2015) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] On construction of China's space information network. _Wuhan Univ. Inf. Sci. Ed._**2015**, _40_, 711-715. [CrossRef]

Figure 11: The relationship between the unit charging price for using computing resources and the expected benefit of unit resources. * [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON] When big data meets software-defined networking: SDN for big data and big data for SDN. _IEEE Netw._**2016**, _30_, 58-65. [CrossRef]
* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON] SAT-FLOW: Multi-Strategy Flow Table Management for Software Defined Satellite Networks. _IEEE Access_**2017**, \(5\), 14952-14965. [CrossRef]
* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON]; [PERSON] Towards SDN/NFV-enabled satellite networks. _Telecommun. Syst._**2017**, _66_, 1-14. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] A Survey on Deep Reinforcement Learning. _Chin. J. Comp._**2018**, \(1\), 1-27. [CrossRef]
* [PERSON] et al. (2015) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; et al. Human-level control through deep reinforcement learning. _Nature_**2015**, _518_, 529-533. [CrossRef]
* [PERSON] and [PERSON] (2008) [PERSON]; [PERSON] Performance Characterization of Space Communications and Navigation (SCAN) Network by Simulation. In Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA, 1-8 March 2008; pp. 1-9. [CrossRef]
* [PERSON] et al. (2012) [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON] Transformational Satellite Communications System (TSAT) lessons learned: Perspectives from TSAT program leaders. In Proceedings of the 2012 IEEE Military Communications Conference, Orlando, FL, USA, 29 October-1 November 2012; pp. 1-6. [CrossRef]
* [PERSON] et al. (2009) [PERSON] [PERSON]; [PERSON]; [PERSON] Regulatory environment for the successful ISICOM development. In Proceedings of the 2009 International Workshop on Satellite and Space Communications, Tuscany, Italy, 9-11 September 2009; pp. 109-112. [CrossRef]
* [PERSON] et al. (2008) [PERSON] [PERSON]; [PERSON]; [PERSON]; [PERSON] Wideband Global SATCOM (WGS) earth terminal interoperability demonstrations. In Proceedings of the 2012 IEEE Military Communications Conference, San Diego, CA, USA, 16-19 November 2008; pp. 1-6. [CrossRef]
* [PERSON] et al. (2012) [PERSON]; [PERSON]; [PERSON]; [PERSON] IP networking over the AEHF MILSATCOM system. In Proceedings of the 2012 IEEE Military Communications Conference, Orlando, FL, USA, 29 October-1 November 2012; pp. 1-6. [CrossRef]
* [PERSON] and [PERSON] (1995) [PERSON]; [PERSON] Heuristic scheduling of the DRS communication system. _Eng. Appl. Artif. Intell._**1995**, \(8\), 147-156. [CrossRef]
* [PERSON] et al. (2003) [PERSON]; [PERSON]; [PERSON] Algorithms for parallel machine scheduling: A case study of the tracking and data relay satellite system. _J. Oper. Res. Soc._**2003**, _54_, 806-821.