AI Predictive Uncertainty: A Step Forward

HomeRadiologyVol. 308, No. 3 PreviousNext Reviews and CommentaryEditorialAI Predictive Uncertainty: A Step ForwardPaul S. Babyn Paul S. Babyn Author AffiliationsFrom the Department of Medical Imaging, University of Saskatchewan, Royal University Hospital, 103 Hospital Dr, Saskatoon, SK, Canada S7N 0W8.Address correspondence to the author (email: [email protected]).Paul S. Babyn Published Online:Sep 19 2023https://doi.org/10.1148/radiol.232144MoreSectionsFull textPDF ToolsAdd to favoritesCiteTrack CitationsPermissionsReprints ShareShare onFacebookTwitterLinked In References1. Ma S, Lei Y, Wang X, et al. Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Hamburg, Germany: ACM, 2023; 1–9. Google Scholar2. Krupinski EA. Evaluating AI Clinically-It’s Not Just ROC AUC! Radiology 2021;298(1):47–48. Link, Google Scholar3. Agarwal N, Moehring A, Rajpurkar P, Salz T. Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology. Published July 2023. Accessed July 22, 2023. Google Scholar4. Faghani S, Moassefi M, Rouzrokh P, et al. Quantifying Uncertainty in Deep Learning of Radiologic Images. Radiology 2023;308(2):e222217. Link, Google Scholar5. McCrindle B, Zukotynski K, Doyle TE, Noseworthy MD. A Radiology-focused Review of Predictive Uncertainty for AI Interpretability in Computer-assisted Segmentation. Radiol Artif Intell 2021;3(6):e210031. Link, Google Scholar6. Zou K, Chen Z, Yuan X, Shen X, Wang M, Fu H. A Review of Uncertainty Estimation and Its Application in Medical Imaging. arXiv 2302.08119 [preprint] https://arxiv.org/abs/2302.08119. Updated May 15, 2023. Accessed August 31, 2023. Google Scholar7. Leibig C, Allken V, Ayhan MS, Berens P, Wahl S. Leveraging uncertainty information from deep neural networks for disease detection. Sci Rep 2017;7(1):17816. Crossref, Medline, Google Scholar8. Alves N, Bosma JS, Venkadesh KV, et al. Prediction variability to identify reduced AI performance in cancer diagnosis at MRI and CT. Radiology 2023;308(3):e230275. Google Scholar9. Valen J, Balki I, Mendez M, et al. Quantifying uncertainty in machine learning classifiers for medical imaging. Int J CARS 2022;17(4):711–718. Crossref, Google Scholar10. Schemmer M, Kuehl N, Benz C, Bartos A, Satzger G. Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations. In: Proceedings of the 28th International Conference on Intelligent User Interfaces. Sydney NSW Australia: ACM, 2023; 410–22. Google ScholarArticle HistoryReceived: Aug 15 2023Revision requested: Aug 18 2023Revision received: Aug 18 2023Accepted: Aug 21 2023Published online: Sept 19 2023 FiguresReferencesRelatedDetailsRecommended Articles Prediction Variability to Identify Reduced AI Performance in Cancer Diagnosis at MRI and CTRadiology2023Volume: 308Issue: 3Current Applications and Future Impact of Machine Learning in RadiologyRadiology2018Volume: 288Issue: 2pp. 318-328The Potential for Deep Learning Reconstruction to Improve the Quality of T2-weighted Prostate MRIRadiology2023Volume: 308Issue: 3A Grading System for Extraprostatic Extension of Prostate Cancer That We Can All Agree Upon?Radiology: Imaging Cancer2020Volume: 2Issue: 1Defining Diagnostic Criteria for Prostatic Ductal Adenocarcinoma at Multiparametric MRIRadiology2022Volume: 303Issue: 1pp. 110-118See More RSNA Education Exhibits Outsmarting AI: What Role Can The Radiologist Play In The Making And Deployment Of Artificial Intelligence ApplicationsDigital Posters2021Prostate Cancer: What We Already Know About What Is on the HorizonDigital Posters2020Imaging Transgender Patients: A New Normal - Cancers, Screening, and Imaging of Other Neoplastic ConditionsDigital Posters2019 RSNA Case Collection Anterior transition zone prostate adenocarcinomaRSNA Case Collection2020Hydrogel infiltration into rectal wallRSNA Case Collection2020Peripheral Zone Prostate Cancer with PseudocapsuleRSNA Case Collection2022 Vol. 308, No. 3 Metrics Altmetric Score PDF download