U.S. flag

An official website of the United States government

Here’s how you know
Here’s how you know

**Official websites use .gov**
A **.gov** website belongs to an official government organization in the United States.

**Secure .gov websites use HTTPS**
A **lock** ( A locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Search Query:
			MAIN MENU

																				
              Health Topics
								All Health Topics A-Z
					
													
		

		Asthma


				

															Heart-Healthy Living


				

															High Blood Pressure


				

															Sickle Cell Disease


				

															Sleep Apnea


				

															Information & Resources on COVID-19
																				
              Health Education
								Education Programs and Initiatives
					
													
		

		The Heart Truth®


				

															Learn More Breathe Better®


				

															Blood Diseases and Disorders Education Program


				

															Publications and Resources
																				
              The Science
								Research Focus Areas
					
													
		

		Blood Disorders and Blood Safety


				

															Sleep Science and Sleep Disorders


				

															Lung Diseases


				

															Health Disparities and Inequities


				

															Heart and Vascular Diseases


				

															Precision Medicine Activities


				

															Obesity, Nutrition, and Physical Activity


				

															Population and Epidemiology Studies


				

															Women’s Health


				

															Research Topics


				

															Clinical Trials


				

															All Science A-Z
																				
              Grants and Training
								Grants and Training Home


				

															Policies and Guidelines


				

															Funding Opportunities and Contacts


				

															Training and Career Development
																				
              News and Events
								News and Events Home
					
													
		

		Email Alerts


				

															All News
					
													
		

		NHLBI News


				

															NHLBI in the Press


				

															Research Features


				

															All Events
					
													
		

		Past Events


				

															Upcoming Events
																				
              About NHLBI
								About NHLBI Home
					
													
		

		Mission and Strategic Vision


				

															Leadership


				

															Divisions, Offices and Centers


				

															Advisory Committees


				

															Budget and Legislative Information


				

															Jobs and Working at the NHLBI


				

															Contact and FAQs


				

															NIH Sleep Research Plan
						
						HOME
		Search Text: < Back To Home/Imaging and Biomedicine AI
  Imaging and Biomedicine AI
    
    On This Page
    
          Hui Xue head shot
  Hui Xue, PhD
          Director, Imaging and Biomedicine AI Program
          Email
      Meet the Team
            Contact us
  Senior Investigator Research Interests
            
  Research Interests
              Artificial intelligence technology and system to advance multi-modality clinical and biomedical imaging.Understand the mechanism for how the deep learning models work in imaging and study the algorithms to maximize the nonlinear performance boost.Novel deep learning models and training methods to build the imaging foundation model and apply them to advance multiple biomedical imaging modalities.Imaging reconstruction methods using the deep learning.Novel analysis method to enable zero or few-shot automated quantification of large clinical and biomedical datasets, using foundation model and self-supervised learning.Build and deploy deep learning systems to assemble data flywheels.
  Example projects

            AI global networkglobal map with points on different hospitals that use the AI applications they developed.AI applications developed by me had been globally deployed to 70 hospitals (May 2022) and used daily on clinical patients (~50K patients annual). To achieve this scale of deployed AI, a software stack was developed to support all steps of applied AI development, from product definition, data collection, model training and management, testing and deployment to end-user.Deep Learning based Cardiac Perfusion Quantification – “AI Doctor”An image of a heart scan with text below saying "An AI doctor is analysing heart scans in dozens of hospitals"Cardiac disease is a leading cause of death worldwide. I developed a novel AI application to direct measure blood supply in the myocardium and reported analysis and disease prediction on the MR scanners. This AI application is fully automated, thanks to robustness provided by deep learning and big data. This technique is deployed worldwide through our AI global network and used daily on patients.This application was featured in many media news. On the left is the news reported on ***NewScientist***, “An AI doctor is analysing heart scans in dozens of hospitals.”Read more: https://www.newscientist.com/article/2224403-an-ai-doctor-is-analysing-heart-scans-in-dozens-of-hospitals/#ixzz6VfVSiMrHDistributed MR Imaging AI on Azure CloudImage of cloud computing process. From left to right, Scanner, then Raw signal and images measurements reports. THen SSH jump server. Then move to vnet where there is an image of a cloud with VM1 and VM2 inside. Lastly move over to box icon with text reading "Storage account shared by all pods."Cloud computing is the key to clinically deploy advanced imaging computing and AI models to enable fast and robust MR imaging. Based on Gadgetron, a motion correction, non-linear compress sensing reconstruction was developed to run on the Azure cloud. By parallelizing the computation over multiple nodes, 10x speedup is achieved to reconstruct the entire dataset to cover the heart in 1min. After the reconstruction, the automated image analysis was achieved by deploying AI models to segment and quantify the cardiac contractibility. This application is deployed to two data centers, serving 10 hospitals in both Europe and North America and running every day to help clinicians and patients.Microscopy Imaging AI using TransformerImage of Microscopy Imaging AI using Transformer process. Begins with Transformer Backbone, then moves to Fine-tuning, then to A modiel adapted to new experiment then lastly Inference.Due to the large variation in microscopy types, vendors, experimental setups and cell/organelles, microscopy AI typically requires time-consuming training separate models for every experiment. To improve generalization, enable fast training adaptation and to reuse accumulated data, the conventional transformer architecture was modified to efficiently process large-format microscopy images. A backbone model built with this modified transformer module was developed to enhance the microscopy images and show strong ability to be adapted to new experiments.Deep Super ImagingImage of Deep imaging process. An image of a transparent cube with Physics listed at the top. In the middle the text in a box reading "Information from previous scans" with a right angle behind it.Current clinical and biomedical imaging (e.g. MRI, CT, light microscopy etc.) is built on top of imaging physics and signal processing algorithms. One example is the MRI where pulse sequences (physics) and parallel imaging (signal processing) are used together to achieve required tissue contrast, resolution and SNR. While this scheme is well established, it only uses the data or information acquired in this current scan. With deep learning, it is possible to significantly boost imaging efficiency by  training models on large datasets previously acquired to help the current scan. This scheme adds a new axis and great potential to achieve superb imaging efficiency. The MRI LGE images on the right is reconstructed with deep learning models trained with ~200K prior scans. Learning based imaging is clearly superior to the current linear imaging technique on the left.
Featured Publications
                Automated In-Line Artificial Intelligence Measured Global Longitudinal Shortening and Mitral Annular Plane Systolic Excursion: Reproducibility and Prognostic Significance.
            Authors:Hui Xue, J. Artico, R. Davies, R. Adam, A. Shetye, J. Augusto, A. Bhuva, F. Fröjdh, T. Wong, M. Fukui, J. Cavalcante, T. Treibel, C. Manisty, M. Fontana, M. Ugander, J. Moon, E. Schelbert, P. Kellman.
                                                                                                                        
            Journal of the American Heart Association
      
                2022 Feb 15;11(4):e023849
        Read Publication
                      Automated in-line myocardial segmentation of joint T1 and T2 mapping using deep learning.
            Authors:James Howard, Kelvin Chow, Liza Chacko, Mariana Fontana, Graham Cole, Peter Kellman, Hui Xue.
                                                                                                                        
            Radiology: Artificial Intelligence
      
                2022 Jan 01;5(1):
        Read Publication
                      Automated Inline Analysis of Myocardial Perfusion MRI with Deep Learning.
            Authors:H. Xue, R. Davies, L. Brown, K. Knott, T. Kotecha, M. Fontana, S. Plein, J. Moon, P. Kellman.
                                                                                                                        
            Radiology. Artificial intelligence
      
                2020 Oct 21;2(6):e200009
        Read Publication
                      Landmark Detection in Cardiac MRI by Using a Convolutional Neural Network.
            Authors:H. Xue, J. Artico, M. Fontana, J. Moon, R. Davies, P. Kellman.
                                                                                                                        
            Radiology. Artificial intelligence
      
                2021 Jul 14;3(5):e200197
        Read Publication
                      Automated detection of left ventricle in arterial input function images for inline perfusion mapping using deep learning: A study of 15,000 patients.
            Authors:H. Xue, E. Tseng, K. Knott, T. Kotecha, L. Brown, S. Plein, M. Fontana, J. Moon, P. Kellman.
                                                                                                                        
            Magnetic resonance in medicine
      
                2020 May 07;84(5):2788-2800
        Read Publication
  Meet the Team

    Hui Xue head shot

            Hui Xue, PhD
                Director, Imaging and Biomedicine AI Program
                Dr. Xue is an active researcher and developer in deep learning for vision, imaging and biomedicine applications. AI solutions he developed are deployed to more than 70 hospitals globally to help clinicians and patients. His research focuses on developing novel AI technique to enable new biomedical research. He is currently leading the Imaging AI program at the National Heart, Lung and Blood Institute, NIH, to develop cutting-edge full-stack solutions from multiple modalitiesHe earned his PhD from Imperial College London in 2008 and got the MSc in Biomedical Engineering and BSc in ECE from Xi’an JiaoTong University, China in 2003 and 2001. From 2008 to 2013, he worked as a research scientist in Siemens Corporate Research, Princeton, USA. He had authored over 100 scientific publications and holds 15 US patents.For his contribution, he was co-awarded the Orloff Innovations Award in 2016 and 2020 by the Division of Intramural Research, NHLBI, for developing high performance image reconstruction software and for developing and deploying AI cardiac perfusion quantification. He is a Fellow of the Society for Cardiovascular Magnetic Resonance (FSCMR) and serving as editors and regular reviewers for several research journals.
  Sarah Hooper
    
            Sarah Hooper, PhD
        

    Staff Scientist

        sarah.hooper2@nih.gov
            Azaan Rehman
    
            Azaan Rehman, BSc
        

    Deep learning developer

        azaan.rehman@nih.gov Back To Top Link
  

        

        Back to top
  Web Policies & Notices
  

        

              Accessibility
                      No FEAR Act Data
                      Privacy Policy
                      Freedom of Information Act (FOIA)
                      HHS Vulnerability Disclosure
    
          Related Government Websites
  

        

              Health and Human Services
                      National Institutes of Health
                      Office of the Inspector General
                      USA.gov
    
          Stay Connected
    
      
            chat bubblesLive ChatLive Chat with us, Monday through Friday, 8:30 a.m. to 5:00 p.m. EST.envelopeGet Email AlertsReceive automatic alerts about NHLBI related news and highlights from across the Institute.
  Footer Bottom
  

        



Contact Us
                            Site Index
                            Jobs