Clinical trial NCT06642389: Evaluation of ChatGPT-4's Success Sonoanatomy
Official title: The Evaluation of ChatGPT-4's Success in Identifying Anatomical Landmarks in Ultrasound Images of Regional Anesthesia Techniques
Study type: OBSERVATIONAL
Overall status: COMPLETED
Conditions: Regional Anesthesia
Keywords: artificial intelligence
sonoanatomy
Lead sponsor: Kanuni Sultan Suleyman Training and Research Hospital
Sponsor class: OTHER
First posted: 2024-10-15
Enrollment: 147
Sex: ALL
Minimum age (years): 18
Standard ages: ADULT
OLDER_ADULT
Accepts healthy volunteers: no
Observational model: CASE_ONLY
Time perspective: PROSPECTIVE
Sampling method: PROBABILITY_SAMPLE
Study population: The study will include adult patients aged 18 years or older who are undergoing surgery at Health Sciences University Istanbul Kanuni Sultan Süleyman Education and Research Hospital. These patients will receive regional anesthesia under ultrasound guidance, and those who sign an informed consent form will be included. The study will exclude patients under 18 years old, those without a surgical history, patients who did not receive regional anesthesia under ultrasound guidance, and those who do not sign the informed consent form. This population provides a representative sample of adult surgical patients undergoing regional anesthesia, making it suitable for evaluating the accuracy of AI in identifying sonoanatomical landmarks in ultrasound images.

Brief summary: Aim and Importance:

Regional anesthesia techniques have advanced significantly with the advent of ultrasound guidance. Peripheral nerve blocks and fascial plane blocks can now be performed safely and effectively under ultrasound visualization. Research has shown that ultrasound use significantly improves block success rates. However, accurate application requires in-depth knowledge of sonoanatomy, as failure to identify critical structures may result in incorrect anesthetic placement or failed blocks. While experienced anesthesiologists can easily identify these anatomical landmarks, those less familiar with sonoanatomy may find it challenging.

This study aims to evaluate the effectiveness of ChatGPT-4 in identifying sonoanatomical structures in ultrasound images. A secondary objective is to assess whether artificial intelligence can evaluate the accuracy of regional anesthesia applications.

Expected Benefits and Risks:

The primary benefit is to explore the potential of AI-based systems in improving the learning and application of sonoanatomy, which may help anesthesiologists perform more accurate and successful blocks. We believe that the findings could contribute to regional anesthesia training. The study poses no risks to participants.

Study Type, Scope, and Design:

This prospective, observational study will be conducted at Health Sciences University Istanbul Kanuni Sultan Süleyman Education and Research Hospital. Ultrasound images from patients aged 18 and older undergoing regional anesthesia under ultrasound guidance will be photographed, without collecting personal data. Detailed images of the ultrasound-guided block steps will be captured. The position and orientation of the ultrasound probe will be documented for the AI model.

A customized GPT-4 model will be developed to evaluate the sonoanatomical structures in the provided ultrasound images based on the probe's position and orientation. Additionally, the AI model will predict which block is being performed and assess the success of the block by analyzing the images. An experienced anesthesiologist will evaluate the accuracy of the AI's predictions.

Detailed description: Background and Rationale:

With the increasing use of ultrasound in regional anesthesia, techniques such as peripheral nerve blocks and fascial plane blocks have become more reliable and safer. Ultrasound guidance has significantly improved the success rate of regional anesthesia, reducing complications by enabling accurate visualization of relevant anatomical structures. However, successful ultrasound-guided blocks require thorough knowledge of sonoanatomy. Without this expertise, there is a risk of improper anesthetic placement, potentially leading to block failure or unintended complications.

Experienced anesthesiologists proficient in sonoanatomy can easily interpret ultrasound images, but those with limited experience often face difficulties. This highlights the need for educational tools that can aid in teaching and improving the identification of anatomical landmarks. The development of AI-based systems, such as ChatGPT-4, for this purpose could revolutionize the training of regional anesthesia techniques by providing real-time feedback on ultrasound images.

Primary Aim:

The primary objective of this study is to evaluate the accuracy and effectiveness of ChatGPT-4 in identifying sonoanatomical landmarks from ultrasound images during regional anesthesia procedures.

Secondary Aim:

A secondary goal is to assess whether the AI model can evaluate the accuracy of block applications by analyzing the ultrasound images and determining the success of the block based on sonoanatomical features and block placement.

Expected Benefits:

The study aims to explore whether AI-based systems can be integrated into educational settings to aid anesthesiologists in mastering sonoanatomy for regional anesthesia. By facilitating the accurate identification of anatomical structures, the AI could potentially enhance the learning curve and improve block success rates. The findings of this study may lead to the development of advanced tools for training and performing ultrasound-guided regional anesthesia, benefiting both novice and experienced anesthesiologists.

Potential Risks:

There are no anticipated risks for participants in this study, as no personal data will be collected, and the study involves only the analysis of ultrasound images.

Study Design:

This is a prospective, observational study that will be conducted at Health Sciences University Istanbul Kanuni Sultan Süleyman Education and Research Hospital. The study will include patients aged 18 years and older who are undergoing surgery and receiving regional anesthesia under ultrasound guidance for analgesia or anesthesia purposes. Consent will be obtained from all patients before participating in the study.

Data Collection:

Only ultrasound images from the procedures will be captured, without collecting any personal or identifiable patient data. Each regional anesthesia block will be documented step-by-step through ultrasound images. These images will include key steps such as probe position, orientation, and the anatomical structures visualized during the procedure. The positioning and orientation of the ultrasound probe during the block will also be recorded.

AI Model Configuration:

A customized GPT-4 model will be developed and trained to analyze the ultrasound images. Based on the probe's position, region of placement, and the anatomical plane, the AI will attempt to identify the sonoanatomical structures present in the ultrasound images. The model will also make predictions regarding the type of regional block being performed.

In addition to identifying anatomical landmarks, the AI model will assess the success of the block by analyzing the final images from each procedure. It will provide a prediction of whether the block was successfully applied based on the anatomical structures and positioning of the needle and anesthetic.

Evaluation of AI Predictions:

The accuracy of the AI's predictions regarding anatomical landmarks and block success will be evaluated by an experienced anesthesiologist with expertise in regional anesthesia. This expert will compare the AI's predictions with their own interpretations of the ultrasound images to assess the AI's performance.

Study Outcome:

The primary outcome will be the accuracy of ChatGPT-4 in identifying sonoanatomical structures in ultrasound images. The secondary outcome will be the accuracy of the AI model in evaluating the success of block applications. These results will be compared to the evaluations of the experienced anesthesiologist to determine the AI model's efficacy.

Conclusion:

This study seeks to explore the potential of artificial intelligence, specifically ChatGPT-4, in aiding the identification of anatomical landmarks during ultrasound-guided regional anesthesia. By evaluating the AI's accuracy, the study aims to contribute to the development of innovative training tools that could enhance the education and practice of regional anesthesia techniques.

Eligibility criteria: Inclusion Criteria:

* Patients aged 18 years or older.
* Patients undergoing surgery.
* Patients receiving any regional anesthesia technique under ultrasound guidance.
* Patients who have signed an informed consent form.

Exclusion Criteria:

* Patients under the age of 18.
* Patients without a history of surgery.
* Patients who have not received any regional anesthesia technique under ultrasound guidance.
* Patients who have not signed the required informed consent documents will not be included in the study.

Primary outcomes:
measure: accuracy of ChatGPT-4
timeFrame: immediately after procedure
Secondary outcomes:
measure: ChatGPT-4's accuracy in predicting the specific block being performed
timeFrame: immediately after procedure
measure: ChatGPT-4's accuracy in assessing the success of the block
timeFrame: immediately after procedure
Other outcomes:
Locations:
city: Istanbul
country: Turkey
facility: Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital
Study officials:
affiliation: Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital
name: Engin ihsan Turan, Specialist
role: PRINCIPAL_INVESTIGATOR
References: