Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

Study Overview
=================
Brief Summary
-----------------
The investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process.

Detailed Description
-----------------
The release of ChatGPT, a natural language AI chat bot, has recently captured the attention of the general public and medical professionals world-wide. ChatGPT is a conversational AI language model designed by OpenAI that utilizes deep learning techniques to generate human like responses to questions. There has been increasing interest among the medical community on developing new ways to harness this technology to aid medical professionals. New applications have included writing scientific manuscripts, drafting correspondents, as well as testing its ability on standardized medical licensing examinations. ChatGPT was able to perform at or near passing threshold on the United States Medical Licensing Exam (USMLE). Despite ChatGPT demonstrating good medical knowledge, it is still unclear if this translates to real world clinical practice. Physician burnout is becoming an increasing problem. Per a recent Canadian Urologic Association (CUA) census, burnout was identified in 39% of urologists, with high number of patient visits/week to be cited as a predictor predictive of burnout. That begs the question, can ChatGPT be used for patient counseling and to improve patient flow in one's practice? ChatGPT has been shown to provide effective and safe responses to medical questions and even curbside consultations. However its ability to counsel patients in real time has not yet been studied. As such, the investigators wish to perform a pilot study at the Manitoba Men's Health Clinic to assess if pre-vasectomy counseling with ChatGPT can safely streamline the consultation process by reducing visit times, while increasing patient satisfaction with the consultation process. If the hypothesis provides true, further implementation of ChatGPT in a healthcare practice may work to reduce the burden on health care providers. There are no predicted adverse events of this study. There are no identified potential harms of this study.

Official Title
-----------------
Real World Utility of ChatGPT in Pre-vasectomy Counselling in an Office-based Setting

Conditions
-----------------
Vasectomy, Contraception

Intervention / Treatment
-----------------
* Other: ChatGPT Language Model


Participation Criteria
=================
Eligibility Criteria
-----------------
Inclusion Criteria: Patients undergoing vasectomies interested in participating Adult (>18 years old) Consenting Exclusion Criteria: Do not consent, uninterested in participating

Ages Eligible for Study
-----------------
Minimum Age: 18 Years
Maximum Age: 65 Years

Sexes Eligible for Study
-----------------
Male

Accepts Healthy Volunteers
-----------------
Accepts Healthy Volunteers

Study Plan
=================
How is the study designed?
-----------------

Design Details

Primary Purpose: Health Services Research
Allocation: Non-Randomized
Intervention Model: Parallel Assignment
Masking: Single


Arms and Interventions

| Participant Group/Arm | Intervention/Treatment |
| --- | --- |
| Experimental: Intervention arm - ChatGPT<br>Patient's interested in participating in the intervention group will be provided a secure ChatGPT account. They will have the opportunity to converse with ChatGPT to ask any potential questions they may have regarding their upcoming vasectomy. Patient's will then be seen for the standard pre-vasectomy consultation. | Other: ChatGPT Language Model<br>* ChatGPT Language Model - ability to converse with the model and ask questions regarding vasectomies<br>|
| No Intervention: Control arm - no ChatGPT<br>No intervention - standard of care | |

What is the study measuring?
-----------------
Primary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| Length of Consultation | Length of pre-vasectomy consultation as measured from beginning to end of telephone call | Through study completion, estimated to be 2 months measured for each phone call | 
| Number of questions asked | Number of questions asked during pre-vasectomy consultation | Through study completion, estimated to be 2 months measured for each phone call | 
| Satisfaction of patients assessed by Likert scale | Satisfaction of patients as measured by questionnaire with 10-point Likert Scale ([0-10] higher score correlates with higher satisfaction) | Through study completion, estimated to be 2 months measured for each patient | 

Secondary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| Commonly asked questions | Chat logs will be reviewed to examine common themes or questions and reported using descriptive statistics. | Through study completion period, estimated to be 2 months | 
| Incidence of inaccurate ChatGPT responses | ChatGPT responses will be reviewed by two licensed clinicians experienced in vasectomies to determine rates of inaccurate responses by the language models responses to patient questions. Incidence of inaccurate ChatGPT responses will be reported and through descriptive analysis this will be described and inaccurate responses will be conveyed. | Through study completion period, estimated to be 2 months | 

 Terms related to the study
=================
Keywords Provided by Centre Hospitalier Valida
-----------------
vasectomy, ChatGPT