Clinical trial NCT06935253: Large Language Models To Improve the Quality of Care of Cardiology Patients
Official title: Towards Bridging Generalists to Subspecialists With Large Language Models
Study type: INTERVENTIONAL
Overall status: RECRUITING
Phase: NA
Conditions: Hypertrophic Cardiomyopathy (HCM)
Cardiomyopathy
Genetic Disease
Cardiology
Keywords: Large language models
Cardiology
Lead sponsor: Stanford University
Sponsor class: OTHER
Collaborators: name: Google LLC.
First posted: 2025-04-20
Enrollment: 12
Sex: ALL
Minimum age (years): 18
Standard ages: ADULT
OLDER_ADULT
Accepts healthy volunteers: no
Allocation: RANDOMIZED
Intervention model: PARALLEL
Primary purpose: SUPPORTIVE_CARE

Brief summary: This study evaluates the impact of large language models (LLMs) versus traditional decision support tools on clinical decision-making in cardiology. General cardiologists will be randomized to manage real patient cases from a cardiovascular genetic cardiomyopathy clinic, with or without AI assistance. Each case will be assessed by two cardiologists, and their responses will be graded by blinded subspecialty experts using a standardized evaluation rubric.

Detailed description: Large language models have been shown to improve physician performance in simulated settings. Large language models have demonstrated promise in various healthcare contexts, including medical note-writing, addressing patient inquiries, and facilitating medical consultation. However, it remains uncertain whether large language models improve clinical reasoning of clinicians using real world cases.

Clinicians dedicate years of training to develop expertise, with clinical knowledge a key component. Clinicians have different areas of expertise, from generalists spanning diseases of all organ systems and patients of all ages, to subspecialists dedicated to often a handful of diseases effecting a specific organ. Both skill sets are vital to a well-functioning medical system, as generalists generally care for patients and refer to specialists when dedicated, specialty knowledge is required. There is a paucity of specialists, and thus the quality of triaging and referral to specialists is of upmost importance. We hypothesis that large language models may be able help generalists management complex patients, and improve their triage to specialists and subspecialists.

The scarcity of subspecialist medical expertise, particularly in rare, complex and life-threatening diseases, poses a significant challenge for healthcare delivery. This issue is particularly acute in cardiology where timely, accurate management determines outcomes. In this study, we will recruit General Cardiologists as participants who will be randomized to answer clinical management cases with or without access to a large language model. Each case is a real patient case of a patient referred to a subspeciality cardiovascular genetic cardiomyopathy clinic. Each case will be performed by two general cardiologists (one with access to a large language model and one without access). Each case has multiple components, and the participants will be asked to answer questions related to the management. Answers will be graded by independent, blinded subspeciality Cardiologists with expertise and training in genetic cardiomyopathies. An evaluation rubric was developed by 10 expert discussants.

Eligibility criteria: Inclusion Criteria:

* Board certified or board eligible Cardiologist.

Exclusion Criteria:

* Not currently practicing clinically

Primary outcomes:
measure: Subspecialist Preference
timeFrame: Subspecialist evaluation will occur within 1 month of participant completing their assessment
Secondary outcomes:
measure: Participants perspective on use of Large Language model
timeFrame: Within one-hour
Other outcomes:
Locations:
city: Palo Alto
country: United States
facility: Stanford
state: California
Study officials:
affiliation: Stanford University
name: Euan A Ashley, BSc, MB ChB, DPhil
role: PRINCIPAL_INVESTIGATOR
References: