Chess Lessons: Harnessing Collective Human Intelligence and Imitation Learning to Support Clinical Decisions
Authors: Gary E. Weissman, Lyle H. Ungar, Scott D. Halpern
Journal: Annals of Internal Medicine (2023)

Ideas and OpinionsFebruary 2023Chess Lessons: Harnessing Collective Human Intelligence and Imitation Learning to Support Clinical DecisionsGary E. Weissman, MD, MSHP, Lyle H. Ungar, PhD, and Scott D. Halpern, MD, PhDGary E. Weissman, MD, MSHPPalliative and Advanced Illness Research (PAIR) Center, and Pulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania (G.E.W., S.D.H.)Search for more papers by this author, Lyle H. Ungar, PhDDepartment of Computer and Information Science and Department of Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania (L.H.U.).Search for more papers by this author, and Scott D. Halpern, MD, PhDPalliative and Advanced Illness Research (PAIR) Center, and Pulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania (G.E.W., S.D.H.)Search for more papers by this authorAuthor, Article, and Disclosure Informationhttps://doi.org/10.7326/M22-2998 SectionsAboutFull TextPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail Over the past 20 years, chess-playing artificial intelligence (AI) systems have far surpassed human performance. One reason for their success is that the rules of chess are well defined, thereby allowing AI-based chess systems to learn easily which strategies optimize outcomes.In contrast, AI systems in health care have been considerably less successful. A primary challenge to developing AI clinical decision support systems (CDSSs) that offer meaningful guidance is the uncertainty inherent in the practice of medicine. Many syndromes cannot be definitively diagnosed and even expert clinicians frequently disagree (1). This uncertainty also propagates into treatment decisions that are often ...References1. Maslove DM, Tang B, Shankar-Hari M, et al. Redefining critical illness. Nat Med. 2022;28:1141-8. [PMID: 35715504] doi:10.1038/s41591-022-01843-x CrossrefMedlineGoogle Scholar2. Chen JH, Dhaliwal G, Yang D. Decoding artificial intelligence to achieve diagnostic excellence: learning from experts, examples, and experience. JAMA. 2022;328:709-10. [PMID: 35913752] doi:10.1001/jama.2022.13735 CrossrefMedlineGoogle Scholar3. McIlroy-Young R, Sen S, Kleinberg J, et al. Aligning superhuman AI with human behavior: chess as a model system [Abstract]. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual, 23 August 2020. Accessed at http://arxiv.org/abs/2006.01855 on 9 February 2021. Google Scholar4. Surowiecki J. The Wisdom of Crowds. Anchor Books; 2005. Google Scholar5. Kurvers RH, Herzog SM, Hertwig R, et al. Boosting medical diagnostics by pooling independent judgments. Proc Natl Acad Sci U S A. 2016;113:8777-82. [PMID: 27432950] doi:10.1073/pnas.1601827113 CrossrefMedlineGoogle Scholar6. Wolf M, Krause J, Carney PA, et al. Collective intelligence meets medical decision-making: the collective outperforms the best radiologist. PLoS One. 2015;10:e0134269. [PMID: 26267331] doi:10.1371/journal.pone.0134269 CrossrefMedlineGoogle Scholar7. Singh H, Giardina TD, Meyer AN, et al. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med. 2013;173:418-25. [PMID: 23440149] doi:10.1001/jamainternmed.2013.2777 CrossrefMedlineGoogle Scholar8. Okafor N, Payne VL, Chathampally Y, et al. Using voluntary reports from physicians to learn from diagnostic errors in emergency medicine. Emerg Med J. 2016;33:245-52. [PMID: 26531860] doi:10.1136/emermed-2014-204604 CrossrefMedlineGoogle Scholar9. Halpern NA, Tan KS. United States resource availability for COVID-19. Society of Critical Care Medicine: Critical Connections Blog; March 2020. Accessed at https://sccm.org/Blog/March-2020/United-States-Resource-Availability-for-COVID-19 on 28 July 2022. Google Scholar Author, Article, and Disclosure InformationAuthors: Gary E. Weissman, MD, MSHP; Lyle H. Ungar, PhD; Scott D. Halpern, MD, PhDAffiliations: Palliative and Advanced Illness Research (PAIR) Center, and Pulmonary, Allergy, and Critical Care Division, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania (G.E.W., S.D.H.)Department of Computer and Information Science and Department of Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania (L.H.U.).Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M22-2998.Corresponding Author: Gary E. Weissman, MD, MSHP, Palliative and Advanced Illness Research (PAIR) Center, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104; e-mail, gary.[email protected]upenn.edu.Author Contributions: Conception and design: G.E. Weissman, S.D. Halpern.Drafting of the article: G.E. Weissman, L.H. Ungar.Critical revision of the article for important intellectual content: G.E. Weissman, S.D. Halpern.Final approval of the article: G.E. Weissman, L.H. Ungar, S.D. Halpern.Administrative, technical, or logistic support: G.E. Weissman.This article was published at Annals.org on 31 January 2023. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetails Metrics February 2023Volume 176, Issue 2Page: 274-275KeywordsArtificial intelligenceBehaviorClinical decision support systemsElectronic medical recordsPrognosisRandomized trialsRespiratory failureVentilators ePublished: 31 January 2023 Issue Published: February 2023 Copyright & PermissionsCopyright © 2023 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...