2021.

[175] Yu Weng, Tianbao Zhou, Yujie Li, and Xiaoyu Qiu. Nas-unet: Neural architecture search for medical image segmentation. *IEEE Access*, 7:44247-44257, 2019.

[176] Colin White, Willie Neiswanger, and Yash Savani. Bananas: Bayesian optimization with neural architectures for neural architecture search. In *Proceedings of the AAAI conference on artificial intelligence*, volume 35, pages 10293-10301, 2021.

[177] Colin White, Arber Zela, Robin Ru, Yang Liu, and Frank Hutter. How powerful are performance predictors in neural architecture search? *Advances in Neural Information Processing Systems*, 34:28454-28469, 2021.

[178] Martin Wistuba, Ambrish Rawat, and Tejaswini Pedapati. A survey on neural architecture search. arXiv preprint arXiv:1905.01392, 2019.

[179] Ken CL Wong and Mehdi Moradi. Segnas3d: Network architecture search with derivative-free global optimization for 3d image segmentation. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 393-401. Springer, 2019.

[180] Anqi Xiao, Biluo Shen, Xiaojing Shi, Zhe Zhang, Zeyu Zhang, Jie Tian, Nan Ji, and Zhenhua Hu. Intraoperative glioma grading using neural architecture search and multi-modal imaging. *IEEE Transactions on medical imaging*, 41(10):2570-2581, 2022.

[181] Yao Xiao, Yahui Qiu, and Xiaofan Li. A survey on one-shot neural architecture search. In *IOP Conference Series: Materials Science and Engineering*, volume 750, page 012223. IOP Publishing, 2020.

[182] Ju Xu, Mengzhang Li, and Zhanxing Zhu. Automatic data augmentation for 3d medical image segmentation. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 378-387. Springer, 2020.

[183] Shuying Xu and Hongyan Quan. Ect-nas: Searching efficient cnn-transformers architecture for medical image segmentation. In *2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)*, pages 1601-1604. IEEE, 2021.

[184] Zhenghua Xu, Shengxin Wang, Gang Xu, Yunxin Liu, Miao Yu, Hongwei Zhang, Thomas Lukasiewicz, and Junhua Gu. Automatic data augmentation for medical image segmentation using adaptive sequence-length based deep reinforcement learning. *Computers in Biology and Medicine*, 169:107877, 2024.

[185] Zhimin Xu, Si Zuo, Edmund Y Lam, Byoungho Lee, and Ni Chen. Autosegnet: An automated neural network for image segmentation. *IEEE Access*, 8:92452-92461, 2020.

[186] Jiangpeng Yan, Shou Chen, Yongbing Zhang, and Xiu Li. Neural architecture search for compressed sensing magnetic resonance image reconstruction. *Computerized Medical Imaging and Graphics*, 85:101784, 2020.

[187] Jin Yan, Huilin Liu, and Ullah Kifayat. Evolutionary multiobjective neural architecture search for organ medical image classification. In *2022 18th International Conference on Computational Intelligence and Security (CIS)*, pages 461-464. IEEE, 2022.

[188] Xingang Yan, Weiwen Jiang, Yiyu Shi, and Cheng Zhuo. Ms-nas: Multi-scale neural architecture search for medical image segmentation. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 388-397. Springer, 2020.

[189] Dong Yang, Andriy Myronenko, Xiaosong Wang, Ziyue Xu, Holger R Roth, and Daguang Xu. T-automl: Automated machine learning for lesion segmentation using transformers in 3d medical imaging. In *Proceedings of the IEEE/CVF International Conference on Computer Vision*, pages 3962-3974, 2021.

[190] Dong Yang, Holger Roth, Ziyue Xu, Fausto Milletari, Ling Zhang, and Daguang Xu. Searching learning strategy with reinforcement learning for 3d medical image segmentation. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 3-11. Springer, 2019.

[191] Dong Yang, Ziyue Xu, Yufan He, Vishwesh Nath, Wenqi Li, Andriy Myronenko, Ali Hatamizadeh, Can Zhao, Holger R Roth, and Daguang Xu. Dast: Differentiable architecture search with transformer for 3d medical image segmentation. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 747-756. Springer, 2023.

[192] Jiancheng Yang, Rui Shi, and Bingbing Ni. Medmnist classification decathlon: A lightweight automl benchmark for medical image analysis. In *2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)*, pages 191-195. IEEE, 2021.

[193] Lei Yang et al. A 3d prediction model for benign or malignant of pulmonary nodules based on neural architecture search. *Signal, Image and Video Processing*, pages 1-10, 2023.

[194] Xin Yang, Yuhao Huang, Ruobing Huang, Haoran Dou, Rui Li, Jikuan Qian, Xiaojiong Huang, Wenlong Shi, Chaoyu Chen, Yuanji Zhang, et al. Searching collaborative agents for multi-plane localization in 3d ultrasound. *Medical Image Analysis*, 72:102119, 2021.

[195] Xin-She Yang. Nature-inspired metaheuristic algorithms. Luniver press, 2010.

[196] Yi Yang et al. Multi-label neural architecture search for chest radiography image classification. *Multimedia Systems*, 30(1):1-22, 2024.

[197] Yi Yang, Jiaxuan Wei, Zhixuan Yu, and Ruisheng Zhang. A trustworthy neural architecture search framework for pneumonia image classification utilizing blockchain technology. *The Journal of Supercomputing*, pages 1-34, 2023.

[198] Xin Yao and Yong Liu. Towards designing artificial neural networks by evolution. *Applied Mathematics and Computation*, 91(1):83-90, 1998.

[199] Shaozhuang Ye, Tuo Wang, Mingyue Ding, and Xuming Zhang. F-darts: Foveated differentiable architecture search based multimodal medical image fusion. *IEEE Transactions on Medical Imaging*, 2023.

[200] Weiqin Ying et al. Efficient multi-objective evolutionary neural architecture search for u-nets with diamond atrous convolution and transformer for medical image segmentation. *Applied Soft Computing*, 148:110869, 2023.

[201] Caiyang Yu et al. Eu-net: Automatic u-net neural architecture search with differential evolutionary algorithm for medical image segmentation. *Computers in Biology and Medicine*, 167:107579, 2023.

[202] Caiyang Yu, Xianggen Liu, Chenwei Tang, Wentao Feng, and Jiancheng Lv. Gpt-nas: Neural architecture search with the generative pre-trained model. arXiv preprint arXiv:2305.05351, 2023.

[203] Qihang Yu, Dong Yang, Holger Roth, Yutong Bai, Yixiao Zhang, Alan L Yuille, and Daguang Xu. C2fnas: Coarse-to-fine neural architecture search for 3d medical image segmentation. In *Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition*, pages 4126-4135, 2020.

[204] Zhihong Yu, Feifei Lee, and Qiu Chen. Hct-net: hybrid cnn-transformer model based on a neural architecture search network for medical image segmentation. *Applied Intelligence*, pages 1-17, 2023.

[205] Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, and Guoying Zhao. Autohr: A strong end-to-end baseline for remote heart rate measurement with neural searching. *IEEE Signal Processing Letters*, 27:1245-1249, 2020.

[206] Arber Zela, Thomas Elsken, Tonmoy Saikia, Yassine Marrakchi, Thomas Brox, and Frank Hutter. Understanding and robustifying differentiable architecture search. arXiv preprint arXiv:1909.09656, 2019.

[207] Yan Zeng and Jinmiao Zhang. A machine learning model for detecting invasive ductal carcinoma with google cloud automl vision. *Computers in Biology and Medicine*, 122:103861, 2020.

[208] Jianwei Zhang, Lei Zhang, and Dong Li. A unified search framework for data augmentation and neural architecture on small-scale image datasets. *IEEE Transactions on Cognitive and Developmental Systems*, 2023.

[209] Jianwei Zhang, Lei Zhang, Yan Wang, Junyou Wang, Xin Wei, and Wenjie Liu. An efficient multi-objective evolutionary zero-shot neural architecture search framework for image classification.
*International Journal of Neural Systems*, 33(05):2350016, 2023.

[210] Miao Zhang, Huiqi Li, Juan Lyu, Sai Ho Ling, and Steven Su. Multi-level cnn for lung nodule classification with gaussian process assisted hyperparameter optimization. *arXiv preprint arXiv:1901.00276*, 2019.

[211] Miao Zhang, Huiqi Li, Shirui Pan, Juan Lyu, Steve Ling, and Steven Su. Convolutional neural networks-based lung nodule classification: A surrogate-assisted evolutionary algorithm for hyperparameter optimization. *IEEE Transactions on Evolutionary Computation*, 25(5):869-882, 2021.

[212] Wei Zhang, Lin Zhao, Qing Li, Shijie Zhao, Qinglin Dong, Xi Jiang, Tuo Zhang, and Tianming Liu. Identify hierarchical structures from task-based fmri data via hybrid spatiotemporal neural architecture search net. In *International Conference on Medical Image Computing and Computer-Assisted Intervention*, pages 745-753. Springer, 2019.

[213] Amy Zhao, Guha Balakrishnan, Fredo Durand, John V Guttag, and Adrian V Dalca. Data augmentation using learned transformations for one-shot medical image segmentation. In *Proceedings of the IEEE/CVF conference on computer vision and pattern recognition*, pages 8543-8553, 2019.

[214] Ruiqi Zheng, Liang Qu, Bin Cui, Yuhui Shi, and Hongzhi Yin. Automatic for deep recommender systems: A survey. *ACM Transactions on Information Systems*, 2023.

[215] S Kevin Zhou, Hoang Ngan Le, Khoa Luu, Hien V Nguyen, and Nicholas Ayache. Deep reinforcement learning in medical imaging: A literature review. *Medical image analysis*, 73:102193, 2021.

[216] Xun Zhou, A Kai Qin, Yanan Sun, and Kay Chen Tan. A survey of advances in evolutionary neural architecture search. In *2021 IEEE Congress on Evolutionary Computation (CEC)*, pages 950-957. IEEE, 2021.

[217] Yao Zhou, Gary G Yen, and Zhang Yi. Evolutionary compression of deep neural networks for biomedical image segmentation. *IEEE transactions on neural networks and learning systems*, 31(8):2916-2929, 2019.

[218] Yao Zhou, Xianglei Yuan, Xiaozhi Zhang, Wei Liu, Yu Wu, Gary G Yen, Bing Hu, and Zhang Yi. Evolutionary neural architecture search for automatic esophageal lesion identification and segmentation. *IEEE Transactions on Artificial Intelligence*, 2021.

[219] Zongwei Zhou, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh, and Jianming Liang. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. *IEEE transactions on medical imaging*, 39(6):1856-1867, 2019.

[220] Zhuotun Zhu, Chenxi Liu, Dong Yang, Alan Yuille, and Daguang Xu. V-nas: Neural architecture search for volumetric medical image segmentation. In *2019 International conference on 3d vision (3DV)*, pages 240-248. IEEE, 2019.

[221] Barret Zoph and Quoc V Le. Neural architecture search with reinforcement learning. *arXiv preprint arXiv:1611.01578*, 2016.
<table><caption>Table 10</caption><thead><tr><th></th><th>Combined Neural Architecture Search+HPO</th><th>Neural Architecture Search</th><th>Hyperparameter Optimization</th><th>Automatic data Augmentation</th><th>Pruning</th><th>AutoML Benchmark</th><th>Model Selection</th><th>Feasability Study</th><th>AutoML Tools used</th><th>Automatic Explainable AI</th><th>Network Architecture Adoption</th></tr></thead><tbody><tr><td>AutoML approach</td><td></td><td></td><td></td><td></td><td></td><td>[192]<br>[11]</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Multi-Objective/Single-Objective<br>Evolutionary Algorithm</td><td>[24]<br>[96]</td><td>[149] [212][18]<br>[39][109][187]<br>[95][110] [137] [25]<br>[49] [72] [67] [38] [64]<br>[64] [112] [102] [163]<br>[36] [217] [44][44]<br>[218] [92] [63] [125]<br>[108] [37] [103]</td><td>[14]<br>[211]<br>[123]<br>[105]<br>[59]<br>[15]</td><td></td><td>[51]<br>[52]</td><td></td><td></td><td></td><td>[82]</td><td>[157]</td><td></td></tr><tr><td>Particle Swarm Optimization</td><td>[136]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Differentiable/Gradient based Approaches</td><td>[70]</td><td>[197] [175][204][180]<br>[148][199] [119]<br>[220] [89] [186] [61]<br>[205] [168] [131]<br>[188] [57] [31] [83]<br>[74][169][135] [165]<br>[152] [94] [43][183]<br>[77] [108]</td><td></td><td>[165]</td><td></td><td></td><td></td><td></td><td></td><td></td><td>[84]</td></tr><tr><td>Genetic Algorithm (GA)</td><td></td><td>[33] [66] [7]<br>[101][76][117] [174]<br>[115][134]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Local Search Hill Climbing Algorithm</td><td></td><td>[141] [23] [93] [92]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Evolutionary Algorithm based on<br>topology similarity</td><td></td><td>[203]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>synchronous search strategy</td><td></td><td>[107]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Random Sampling approach</td><td></td><td>[71]</td><td></td><td></td><td></td><td></td><td>[17]</td><td></td><td></td><td></td><td></td></tr><tr><td>Progressive evolutionary search</td><td></td><td>[170]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Grid Search and Bayesian optimization</td><td></td><td>[98] [22] [162]</td><td></td><td>[142]<br>[210]<br>[12]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>HyperNetworks (Gradient based optimization)</td><td></td><td>[75]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Google Cloud AutoML</td><td></td><td>[48]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>[167]<br>[90]</td><td></td></tr><tr><td>Meta-Assistant Network (MAN)</td><td>[129]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Auto ScikitLearn, AutoKERAS</td><td></td><td>[113]</td><td></td><td></td><td></td><td></td><td></td><td></td><td>[192]</td><td></td><td></td></tr><tr><td>One-Shot Learning</td><td></td><td></td><td></td><td>[213]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Adversarial Approach (GAN)</td><td></td><td></td><td></td><td>[29]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>regularized adversarial training<br>(MIN-MAX) Game theory approach</td><td></td><td></td><td></td><td>[55]</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>

Categorization of optimization search strategies used to solve different AutoML problems