## 2 LEO Satellite Networks Model
### Two-Hops State Aware Updating
In Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, Hong Kong, China, 12-14 November 2007; pp. 1041-1044. * [PERSON] and [PERSON] (1998) [PERSON]; [PERSON] Load balancing problems for multiclass jobs in distributed/parallel computer systems. _IEEE Trans. Comput_**1998**, _47_, 322-332. [CrossRef]
* [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON]; [PERSON] Mobility prediction based joint stable routing and channel assignment for mobile ad hoc cognitive networks. _IEEE Trans. Parallel Distrib. Syst._**2016**, _27_, 789-802. [CrossRef]

Figure 4.3 The average queue occupancy for each satellite. * _[PERSON] et al. (1997)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] _Optimal Load Balancing in Distributed Computer Systems_; Springer: London, UK, 1997. * _[PERSON] et al. (2008)_ [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Explicit load balancing technique for NGEO satellite IP networks with on-board processing capabilities. _IEEE-ACM Trans. Netw._**2008**, _17_, 281-293. [CrossRef]
* _[PERSON] et al. (2014)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] TLR: A traffic-light-based intelligent routing strategy for NGEO satellite IP networks. _IEEE Trans. Wirel. Commun._**2014**, _13_, 3380-3393. [CrossRef]
* _[PERSON] et al. (2017)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] A state-aware and load-balanced routing model for LEO satellite networks. In Proceedings of the 2017 IEEE Global Communications Conference, Singapore, 4-8 December 2017; pp. 1-6. * _[PERSON] et al. (2018)_ [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Distributed Routing Strategy based on Machine Learning for LEO Satellite Network. _Wirel. Commun. Mob. Comput._**2018**, 1-10. [CrossRef]
* _[PERSON] et al. (2018)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Multisource Transfer Double DQN Based on Actor Learning. _IEEE Trans. Neural Netw. Learn. Syst._**2018**, _29_, 2227-2238. [CrossRef] [PubMed]
* _[PERSON] et al. (2019)_ [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic. _IEEE Access_**2019**, \(7\), 37109-37120. [CrossRef]
* _[PERSON] et al. (2019)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Optimal Energy Routing Design in Energy Internet with Multiple Energy Routing Centers Using Artificial Neural Network-Based Reinforcement Learning Method. _Appl. Sci._**2019**, \(9\), 520. [CrossRef]
* _[PERSON] et al. (2015)_ [PERSON]; [PERSON]; [PERSON]. Application of reinforcement learning to routing in distributed wireless networks: A review. _Artif. Intell. Rev._**2015**, _43_, 381-416. [CrossRef]
* _[PERSON] et al. (2016)_ [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] The deep learning vision for heterogeneous network traffic control: Proposal, challenges, and future perspective. _IEEE Wirel. Commun._**2016**, _24_, 146-153. [CrossRef]
* _[PERSON] et al. (2015)_ [PERSON] [PERSON]; [PERSON]; [PERSON] Deep reinforcement learning with double q-learning. _Comput. Sci._**2015**, arXiv:1509.06461. * _[PERSON] et al. (2015)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Complexity of routing in store-and-forward LEO satellite networks. _IEEE Commun. Lett_**2015**, _20_, 89-92. [CrossRef]
* _[PERSON] et al. (2017)_ [PERSON]; [PERSON]; [PERSON]; [PERSON] Collaborative data downloading by using inter-satellite links in LEO satellite networks. _IEEE Trans. Wirel. Commun._**2017**, _16_, 1523-1532. [CrossRef]
* _[PERSON] et al. (2013)_ [PERSON]; [PERSON]; [PERSON] Virtual topology for LEO satellite networks based on earth-fixed footprint mode. _IEEE Commun. Lett._**2013**, _17_, 357-360. [CrossRef]
* _[PERSON] (2000)_ [PERSON]; [PERSON] Internet traffic engineering by optimizing OSPF weights. In Proceedings of the 2000 IEEE Infocom, Tel Aviv, Israel, 26-30 March 2000; pp. 519-528. * _[PERSON] et al. (2018)_ [PERSON]; [PERSON]; [PERSON] Multipath Cooperative Routing with Efficient Acknowledgement for LEO Satellite Networks. _IEEE. Trans. Mob. Comput._**2018**, _18_, 179-192. [CrossRef]