# Assessing ChatGPT's Reliability in Endodontics: Implications for AI-Enhanced Clinical Learning
## 1 Introduction
\begin{table}
\begin{tabular}{l c c} \hline \hline
**Version** & **Release Date** & **Main Features [6; 7]** \\ \hline GPT-1 & 2018 & First pre-trained generative model, \\  & & foundational for subsequent development. \\ GPT-2 & 2019 & Increased generative capacity, with greater \\ GPT-3 & 2020 & coherence in long sequences. \\ ChatGPT-3.5 & 2022 & Large-scale model with 175 billion parameters. \\ ChatGPT-4 & 2022 & Conversational adaptation of GPT-3; widely \\ ChatGPT-4 & 14 March 23 & Improvements in logical reasoning, expanded \\  & & context, and complex comprehension. \\ ChatGPT-4o & 13 May 24 & Multimodal optimization (text, audio, image), \\  & & with greater efficiency and speed. \\ ChatGPT-o1 & September 24 & Based on chain-of-thought prompting; recent \\  & & versions include o1, o3-mini, etc. \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Chronological evolution of ChatGPT versions and their main highlighted features. Within the field of endodontics, several studies have evaluated the performance of different versions of ChatGPT in various contexts, including its ability to answer frequently asked questions from the patient's perspective [31]. Its performance has also been assessed in answering dichotomous questions from the practitioner's perspective [21], as well as in evaluating its diagnostic accuracy in endodontic assessments [19]. The results suggest that, although ChatGPT cannot replace the clinical judgment of a dentist, it may serve as a valuable tool in the field of endodontics [21], acting as a complementary source of information [31]. However, the limitations of this technology must be taken into account, making it essential to verify its capabilities before integrating it into daily clinical practices [32]. In addition, when evaluating the efficiency of ChatGPT, it is important not only to assess the accuracy of its responses but also their repeatability, defined as the variation in answers when the same prompt is used consistently [33]. This variability can result in both correct and arbitrarily incorrect answers. In this context, repeatability is just as important as reliability, as inconsistent responses may confuse users who are unable to independently verify the content provided by ChatGPT [34]. This is particularly relevant in educational settings, where students may rely heavily on AI-generated content to understand complex topics [35]. Ensuring consistency in responses can help maintain pedagogical coherence and foster trust in digital learning tools. Therefore, assessing the repeatability of answers generated by LLMs can serve as an additional indicator of confidence in the information provided [36]. The literature reports varying degrees of repeatability in answers generated by ChatGPT-3.5 and ChatGPT-4 across different studies [26; 34; 37]. However, there is limited research evaluating the repeatability between ChatGPT-4 and ChatGPT-4o. The aim of this study was to evaluate the reliability and repeatability of responses generated by ChatGPT-4 compared to ChatGPT-4o in response to endodontic questions, with the broader goal of assessing their potential application in AI-enhanced educational settings. We hypothesized that there would be no difference between the ChatGPT-4 and ChatGPT-4o versions in terms of reliability and repeatability in generating responses in the field of endodontics.