# Assessing ChatGPT's Reliability in Endodontics: Implications for AI-Enhanced Clinical Learning
## 2 Materials and Methods  
### Question Design  
To conduct this study, two authors (A.S., Y.F.) designed 60 short questions related to endodontics, following the methodology established in earlier research [21]. The questions were based on the Position Statements of the European Society of Endodontology [38; 39; 40] and the AAE (American Association of Endodontics) Consensus Conference Recommended Diagnostic Terminology [41], as these sources reflect expert consensus across various key areas within the field of endodontics.  
The 60 questions were independently evaluated by two experts in the field of endodontics (M.LL.DP and V.DF.G.) using a 3-point Likert scale (0 = disagree; 1 = neutral; 2 = agree). They assessed the clarity of wording, relevance to the study context, and appropriateness for inclusion. The results were recorded in an Excel spreadsheet (version 16; Microsoft, Redmond, WA, USA) and subsequently analyzed. Any disagreements between the experts were independently reviewed by a third endodontic expert (J.A.). Based on the results, 30 questions were selected to evaluate the reliability and repeatability of response generation using ChatGPT-4 and ChatGPT-4o software. (Table 2).  
In the context of AI-based education, these questions were used to simulate learning prompts commonly employed on digital platforms for formative assessment or guided study.  
\begin{table}
\begin{tabular}{c c} \hline \hline
**Question** & \\
**Number** & **Question Description** \\ \hline
1 & What antibiotics are recommended to treat dental infections in patients who are allergic to beta-lactam antibiotics? Only short answer. \\  & If an adult patient with no allergies requires oral antibiotic prophylaxis prior to root canal treatment, how many grams of amoxicillin will he/she need and how long before should it be administered? Only short answer. \\  & If an adult patient is allergic to beta-lactam antibiotics and requires oral antibiotic prophylaxis prior to root canal treatment, how many grams of calmodulin will he/she need and how long before should it be administered? Only short answer. \\  & If an adult patient is allergic to beta-lactam antibiotics and requires oral antibiotic prophylaxis prior to root canal treatment, how many grams of azithromycin will he/she need and how long before should it be administered? Only short answer. \\  & If amoxicillin is used for a dental infection in a non-allergic patient, what would be the maintenance dose for how many days? Only short answer. \\  & If amoxicillin with clavulanic acid is used for a dental infection in a non-allergic patient, what would be the maintenance dose for how many days? Only short answer. \\  & If calmodulin is used for a dental infection in a patient who is allergic to beta-lactam antibiotics, what would be the maintenance dose? Only short answer. \\  & If clarithromycin is used for a dental infection in a patient who is allergic to beta-lactam antibiotics, what would be the maintenance dose? Only short answer. \\  & If azithromycin is used for a dental infection in a patient who is allergic to beta-lactam antibiotics, what would be the maintenance  
Evaluating the consistency and accuracy of ChatGPT's responses to these questions offers valuable insight into its effectiveness as a pedagogical support tool.