## 4 Proposed Antenna Codebook and MAB Approach
### Proposed Nested Two-Stage MAB Approach
#### 4.2.1 Proposed Nested Two-Stage TS Algorithm
(2019) [PERSON]; [PERSON]; [PERSON] An efficient paradigm for multiband WiGig D2D networks. _IEEE Access_**2019**, \(7\), 70032-70045. [CrossRef]
* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON]; [PERSON] Millimeter-Wave Communications: Physical Channel Models, Design Considerations, Antenna Constructions, and Link-Budget. _IEEE Commun. Surv. Tutor._**2017**, _20_, 870-913. [CrossRef]
* [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON] Location-based millimeter wave multi-level beamforming using compressive sensing. _IEEE Commun. Lett._**2018**, _22_, 185-188. [CrossRef]
* [PERSON] et al. (2014) [PERSON]; [PERSON]; [PERSON]; [PERSON]. 'Channel estimation and hybrid precoding for millimeter wave cellular systems. _IEEE J. Sel. Top. Signal Process._**2014**, \(8\), 831-846. [CrossRef]
* [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON] Adaptive location-based millimetre wave beamforming using compressive sensing-based channel estimation. _IET Commun._**2019**, _13_, 1287-1296. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Leveraging Machine Learning for Millimeter Wave Beamforming in Beyond 5G Networks. _IEEE Syst. J._**2021**, 1-2. [CrossRef]
* _Specifications for High Rate Wireless Personal Area Networks (WPANs) Amendment 2: Millimeter-Wave-Based Alternative Physical Layer Extension_; IEEE 802.15.3c Standard; IEEE: Piscataway, NJ, USA, 2009. * [PERSON] et al. (2009) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; et al. Beamforming Codebook Design and Performance Evaluation for 60 GHz Wideband WPANs. In Proceedings of the IEEE Vehicular Technology Conference Fall, Anchorage, AK, USA, 20-23 September 2009; pp. 1-6. * [PERSON] et al. (2002) [PERSON]; [PERSON] [PERSON]; [PERSON] Finite-time analysis of the multiarmed bandit problem. _Mach. Learn._**2002**, _47_, 235-256. [CrossRef]
* [PERSON] et al. (2009) [PERSON]; [PERSON]; [PERSON] Exploration-exploitation tradeoff using variance estimates in multi-armed bandits. _Theor. Comp. Sci._**2009**, _410_, 1876-1902. [CrossRef]
* [PERSON] and [PERSON] (2013) [PERSON]; [PERSON] Further optimal regret bounds for thompson sampling. In Proceedings of the Sixteenth International Conference on Artificial Intelligence and Statistics (AISTATS), Scottsdale, AZ, USA, 29 April-1 May 2013. * [PERSON] and [PERSON] (2019) [PERSON] [PERSON]; [PERSON]; [PERSON] A comparison between UCB and UCB-tuned as selection policies in GGP. _J. Intell. Fuzzy Syst._**2019**, _36_, 5073-5079. [CrossRef]* [PERSON] et al. (2019) [PERSON]; [PERSON] [PERSON]; [PERSON] [PERSON]; [PERSON]; [PERSON]; [PERSON] Wireless Communications Through Reconfigurable Intelligent Surfaces. _IEEE Access_**2019**, \(7\), 116753-116773. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON] Reconfigurable Intelligent Surface Aided Constant-Envelope Wireless Power Transfer. _IEEE Trans. Signal Process._**2021**, _69_, 1347-1361. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Energy Efficient Reconfigurable Intelligent Surface Enabled Mobile Edge Computing Networks With NOMA. _IEEE Trans. Cogn. Commun. Netw._**2021**, \(7\), 427-440. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] A Novel Design of RIS for Enhancing the Physical Layer Security for RIS-aided NOMA Networks. _IEEE Wirel. Commun. Lett._**2021**, _10_, 2398-2401. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON] Reconfigurable Intelligent Surfaces-Aided Physical Layer Security Enhancement in D2D Underlay Communications. _IEEE Commun. Lett._**2021**, _25_, 1443-1447. [CrossRef]
* [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON] Secrecy Performance Analysis of IRS-Aided UAV Relay System. _IEEE Wirel. Commun. Lett._**2021**, _10_, 2693-2697. [CrossRef]
* [PERSON] and [PERSON] (2021) [PERSON]; [PERSON] Energy Efficiency Maximization for IRS-Aided WPCNs. _IEEE Wirel. Commun. Lett._**2021**, _10_, 2304-2308. [CrossRef]
* [PERSON] et al.