# Developing the teledentistry acceptance survey for dentists -TAS-D: a Delphi study

Maha El Tantawi, Nour Ammar, Rodrigo Mariño, Sergio E Uribe, David Manton, Fernando N Hugo, Celine Clement, Christina P C Sim, Delphine Maret, Dorota T Kopycka-Kedzierawski, et al.

<figure><img src="image_1.png" /></figure>

## To cite this version:

Maha El Tantawi, Nour Ammar, Rodrigo Mariño, Sergio E Uribe, David Manton, et al.. Developing the teledentistry acceptance survey for dentists -TAS-D: a Delphi study. BMC Oral Health, 2024, 10.1186/s12903-024-04760-2 . hal-04676483

HAL Id: hal-04676483

https://hal.science/hal-04676483v1

Submitted on 23 Aug 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
RESEARCH

Open Access

<figure><img src="image_3.png" /></figure>

Check for
updates

# Developing the teledentistry acceptance survey for dentists – TAS-D: a Delphi study

Maha El Tantawi¹*, Nour Ammar¹,², Rodrigo Mariño³,⁴, Sergio E. Uribe²,⁵,⁶, David Manton⁷, Fernando N. Hugo⁸, Celine Clément⁹, Christina P.C. Sim¹⁰,¹¹, Delphine Maret¹², Dorota T. Kopycka-Kedzierawski¹³, Eliane Mbende¹⁴, Estie Kruger¹⁵, Romain Lan¹⁶, Leila Larbi Doghri¹⁷, McAllister Castelaz¹⁸, Mohammad Khursheed Alam¹⁹, Olushola Ibiyemi²⁰, Sudeshni Naidoo²¹, Eli Schwarz²², Harsh Priya²³, Mariana Minatel Braga²⁴, Nicolas Giraudeau²⁵ and Moréniké Oluwátóyin Foláyan²⁶

**Abstract**

**Introduction** The increasing interest in teledentistry since the COVID-19 pandemic warrants an evaluation of dentists' willingness to adopt it. This study aimed to develop a questionnaire to assess dentist's intention to use teledentistry and the associated factors.

**Methods** A literature search was used to identify items for the questionnaire. The Unified Theory of Acceptance and Use of Technology (UTAUT2) was adopted as framework. A Delphi panel was constituted of researchers with relevant publications and the International Association of Dental Research e-Oral Health Network members. Three Delphi consultations were conducted to establish consensus on items. Consensus was set at 80% agreement and content validity ratio (CVR), reaffirmed iteratively.

**Results** Nineteen out of 25 (76%) invited experts participated in the first round, 17 in the second and 15 in the third. The preliminary questionnaire had 81 items in three sections, reduced to 66, 45 and 33 items in the first, second and third rounds. After revision, the final version comprised eight items assessing dentists' backgrounds in Sect. 1, seven items identifying teledentistry uses in Sect. 2, and 17 items assessing intention to use teledentistry and its determinants in seven dimensions in Sect. 3. The initial CVR was 0.45, which increased to 0.80 at the end of the third round.

**Conclusion** A survey tool was developed to assess the acceptance of teledentistry, and its determinants based on the UTAUT2 framework through consensus among teledentistry experts. The tool had excellent validity and needs further evaluation of its psychometric properties.

**Keywords** Delphi, Teledentistry, UTAUT2, Dentists, Intention, Surveys and questionnaires, Consensus, Oral health, Referral and consultation, Technology, Telemedicine

<footnote>*Correspondence:
Maha El Tantawi
maha.tantawi@gmail.com
Full list of author information is available at the end of the article</footnote>
## Introduction

Restricted movement during COVID-19 was the driving force behind the large-scale use of information and communication technology (ICT) to enable the continuation of business, education, healthcare, and other activities [1]. The abrupt change caused by the pandemic facilitated the use of ICT applications that have been previously proposed but were poorly implemented. Teledentistry is an ICT application that has received sustained interest and a significant surge in use after the COVID-19 pandemic [2, 3]. Evidence attests to the effectiveness of teledentistry in enabling remote consultations, disseminating and following up preventive oral health measures, and improving oral healthcare delivery during emergencies and natural disasters [4].

The adoption of teledentistry, however, varies across countries and settings and is influenced by political support, legal frameworks, ICT infrastructure, possibility of billing, oral health professionals' teledentistry training and exposure, teledentistry acceptance by patients and dentists, to name a few [3]. Evidence suggests that decision-makers have accepted the use of teledentistry in several countries [5]. However, the adoption of its use is largely dependent on dentists' acceptance and their willingness to invest time and money for a wider scale implementation of teledentistry, among other factors [6]. A comprehensive assessment of dentists' acceptance of teledentistry is needed across sectors and settings. However, teledentistry acceptance has been assessed using multiple non-validated instruments, limiting meaningful comparisons of findings [7]. Also, little is known about the factors influencing dentists' willingness to adopt teledentistry. Yet, this information is important to promote the institution of enabling factors and address the barriers to the adoption of teledentistry.

The Unified Theory of Acceptance and Use of Technology (UTAUT) provides a theoretical framework for examining the factors influencing the acceptance of ICT [8]. This theory explains ICT adoption through four constructs: performance expectancy (the anticipated benefits of using ICT applications or systems), effort expectancy (the perceived ease of use), social influence (the impact of others' opinions on user's decision to adopt ICT) and facilitating conditions (the availability of necessary infrastructure and support for ICT utilization). To address certain limitations of the original UTAUT model, an enhanced version, UTAUT2, was developed. This iteration introduces additional constructs tailored to the context of emerging technologies and a diverse user base [9]. These constructs include hedonic motivation (the enjoyment derived from using the ICT application or system), price value (the cost-benefit assessment of using the

ICT), and habit and experience (users' familiarity with the ICT system) [9].

The UTAUT2 framework has been applied in various contexts, such as developing an eHealth acceptance scale in France [10], evaluating patients' acceptance of telemedicine in a cross-country survey [11], and appraising medical students' acceptance of blended learning [12]. Hence, the study aimed to develop a questionnaire to assess dentists' acceptance of teledentistry and identify the factors influencing this acceptance based on the UTAUT2 framework.

## Methods

Ethical approval was granted by the Research Ethics Committee at the Faculty of Dentistry, Alexandria University, Egypt (0575-01/2023). Written informed consent was obtained from the experts participating in the study when they confirmed their agreement to participate by email after receiving the invitation to collaborate.

## Study design

A three-round Delphi consensus-building process [13] was initiated involving a panel of experts specializing in e-oral health. The experts were asked to evaluate a comprehensive set of items organized under the constructs of the UTAUT2. This study serves as the inaugural phase of a project that seeks to develop and validate a tool to assess oral health professionals' and patients' acceptance of teledentistry.

## Rationale for the Delphi process

The Delphi technique is a consensus-building method that solicits anonymous and independent stakeholder feedback regarding a specific question. This approach enables stakeholders with varying levels of expertise to provide feedback without succumbing to peer pressure [14]. The Delphi technique can be efficiently conducted online and is well-suited for building consensus among experts from different countries or geographic regions. The process involves developing an initial questionnaire, then distributing it to stakeholders to rate its relevance to the research question and offer comments. Ratings are used to discriminate between relevant and irrelevant items to filter items, while comments suggest modifications. Subsequently, an updated version of the questionnaire undergoes another round of rating and commenting in an iterative process that persists until a consensus is achieved [13]. We adhered to the CREDES guidelines for conducting and reporting Delphi studies [15].

## Identification of candidate items for the survey tool

From February to March 2023, we conducted a thorough and systematic literature search to identify studies
employing the UTAUT2 framework to assess the acceptability of ICT applications in healthcare. PubMed database was searched using the terms "information technology" or "ICT," combined with "technology acceptance" or "technology adoption" or "technology use" AND "UTAUT" or "UTAUT2" or "Unified Theory of Acceptance and Use of Technology." Additionally, these terms were combined with terms such as "teledentistry" or "tel emedicine" or "e-health" or "m-health" or "e-oral health" or "m-oral health" or "mobile health" or "mobile oral health" or "digital health." Two independent reviewers (MET and NA) screened the titles and abstracts of the resulting citations to identify relevant studies. Full-text articles of the selected studies were then reviewed to confirm their use of UTAUT2 in the context of ICT acceptance in healthcare. Any discrepancies were resolved through discussion with a third reviewer (MOF). We searched PubMed, Scopus and Google Scholar in addition to hand searching relevant journals and the reference lists of the eligible studies to identify missing publications. We extracted relevant questions and their response options.

The preliminary version of the questionnaire was based on the structure used by Hayotte et al. [10], then we added further items identified from additional sources under the UTAUT2 dimensions [16–26]. Items were added until saturation occurred, and further items provided no new concept. The questionnaire was developed in English and the preliminary version is shown in Appendix 1. All items were included in consensus between the core study team members.

The questionnaire comprised three sections similar to what was used in previous studies [10, 16–26]. The first section had nine questions assessing dentists’ background namely gender, age, country of residence, highest academic degree, number of years practicing dentistry, whether the respondent was a general dental practitioner or a specialist, which specialty, number of patients per day, and workplace characteristics.

The second section assessed whether respondents agree that teledentistry would help in conducting nine procedures namely remote assessment, video consultations, emergency advice, online development of a treatment plan, explaining a treatment plan, providing dental hygiene education, training patients for dental hygiene, patient monitoring and sending patient information to others. Each question had a ‘yes/no’ response.

The third section assessed the facilitators and barriers to teledentistry. This section had 63 items that measured 10 dimensions based on the seven constructs of the UTAUT2 framework [9]. These dimensions were Performance Expectancy (PE) divided into non-patient centered (PEN) and patient centered (PEP) assessing

the benefits of teledentistry to dentist/ practice and to patients, acknowledging perceived utility as a primary driver of adoption, *Effort Expectancy (EE)* assessing the perceived ease of using teledentistry since users are more likely to embrace technology they perceive as easy to use, *Social Influence* divided into *General (SI-G)*, *Organizational (SI-O)*, and *Patients (SI-P)* highlighting the role of subjective norms and the influence of significant others in different circles in shaping users’ decision regarding teledentistry, *Facilitating Conditions (FC)* addressing the adequacy of infrastructure and support systems on adopting teledentistry, *Hedonic Motivation (HM)* and *Price Value (PV)* considering the emotional and economic aspects, in terms of enjoyment and affordability in shaping user attitudes and *Experience and Habit (EH)* acknowledging the role of dentist’s experience in facilitating the use of new technology. The section also had an 11th dimension assessing *behavioral intention (BI)* to use teledentistry. Participants indicated their agreement on a scale from 1 (Strongly Disagree), 2 (Disagree), 3 (Neither Agree nor Disagree), 4 (Agree) to 5 (Strongly Agree).

## Identification of experts

Recognizing the distinct roles of dentists and patients in teledentistry acceptance, this study focused on developing the Teledentistry Acceptance Survey for Dentists (TAS-D), as separate tools are necessary to address the unique perspectives of each group.

The expert panel comprised researchers engaged in e-oral health research, who had published at least one manuscript on teledentistry in the last five years. Invitations were also extended to members of the International Association of Dental Research (IADR) e-Oral Health Network (eOHN). We aimed to have geographic representation because technology infrastructure and legislative frameworks affect dentists’ acceptance and use of teledentistry, and these differ by region. Also, involving experts from different regions would enhance the generalizability of the proposed tool. We aimed to include 15 to 30 panel members. A larger group may reduce the response rate and make group management difficult without better outcomes [27].

Invitations were emailed to potential panel members by the Principal Investigator (PI), copying in the study's core team. The email outlined the study purpose and requested interested experts to reply, indicating their consent to participate. Invitations were extended to 42 experts, including 21 females (50%), from North America (9), South America (5), Australia (6), Europe (9), Asia (5), and Africa (8). Ten (23.8%) experts did not respond, 7 (16.7%) declined participation, and 25 (59.5%) agreed to join the Delphi panel.
## Delphi rounds

The consensus-building process proceeded in three rounds [15], with experts receiving instructions and a link to an electronic validation form via email from the PI in each round. The anonymity and objectivity of the process were maintained and only the PI knew the voting patterns on the items and who the voters were.

The initial version of the questionnaire was uploaded to SurveyMonkey, featuring a rating scale for experts to express the relevance of each item. The scale ranged from 1 (least relevance) to 5 (highest relevance). Experts could also suggest modifications in a comment box after each section.

In the first round, which began on January 18th, 2023, and lasted three weeks, experts were tasked with evaluating items to streamline their quantity, retain the most relevant, select optimal alternatives, verify alignment with specified dimensions, and provide feedback.

The second round commenced on April 9th, 2023, and closed three weeks later. Instructions provided an overview of the changes made after the first round, urging experts to retain only relevant items, remove duplicates, and verify correct categorization under each dimension.

The third and final round began on June 1st, 2023, and lasted three weeks. Instructions emphasized that this round did not include any additions or changes to item dimensions from previous rounds. Experts were instructed to categorize items as essential or non-essential, minimize neutral responses, and refine item wording for clarity.

## Definition of consensus and analysis

The data were retrieved as an Excel file (Microsoft Corp., WA, USA) from SurveyMonkey, and the items underwent both quantitative and qualitative evaluation against predefined criteria. For the quantitative evaluation, we recoded the relevance scores 1 or 2 as non-essential and relevance scores 4 or 5 as essential.

We followed a 4-step sequential process to build consensus. The first two steps were based on the percent agreement of the recoded relevance rating. In the first step, items labelled as non-essential by more than 80% of experts were removed. In the second step, items identified as essential by at least 80% of experts were retained [28, 29]. The next two steps were based on the content validity ratio (CVR) calculated as $CVR = [n_e - (N/2)] / (N/2)$, where $n_e$ is the number of experts indicating that the item was essential, and N is the total number of experts [30]. The CVR represents the degree to which the items reflect the content of its dimension. The CVR ranges from 1 to -1, with higher values indicating greater agreement on the item's relevance to the questionnaire [31]. In the third step, items with negative CVR were

removed signifying that less than 50% of experts considered them essential [30]. In the fourth step, the items were evaluated against the revised critical values of Lawshe's CVR that varied by the number of experts in the panel. Based on this, we retained items with CVR equal or greater to the critical value [32].

Calculations were performed after each round to refine the questionnaire for subsequent rounds. Items that did not meet the inclusion criteria were excluded. The CVR was assessed for improvement and recalculated with new expert ratings in the next round. Items that introduced unique concepts and had more neutral than negative votes were retained for further review. Qualitative adjustments based on expert feedback included rephrasing, repositioning, or adding items. The process was iterated until all items reached essential status with positive CVRs. A core team member not involved in the Delphi process conducted a final review and made minor changes to the questionnaire.

## Results

In the first round, 19 (76%) participated of 25 experts who initially consented to join the panel. Table 1 shows that the experts were geographically diverse, with three representatives maximum from any country. Participation was skewed towards females, professionals with direct clinical care duties, experts with a Ph.D. degree, and aged 45 years and older. Seventeen (89.5%) experts participated in round 2, and 15 (79%) participated in round 3. An overview of the process is illustrated in Fig. 1.

### Round 1

All items in Sect. 1 were considered essential and no modifications were suggested. For Sect. 2, a new item was added: "Assisting with referrals", another was rephrased to "Screening patient's oral condition remotely", and the response scale was changed from yes/no to a 5-point Likert scale ranging from "not at all" to "very much".

For Sect. 3, three items were labelled as non-essential by more than 80% of experts and were excluded. Seven items were identified as essential by at least 80% and were retained. Twenty-two items had negative CVR and were removed. For a panel of 19 experts, the revised critical value for Lawshe's CVR was 0.474. A total of 15 items were above this cutoff point and were retained. Twenty-three items below this cutoff point were retained for further assessment in round 2 since there were more undecided than non-essential votes for them. Also, 26 items were rephrased, and 10 items were shifted across dimensions. The label of the dimension *Price Value (PV)* was changed to *Perceived Price Value (PPV)*. Additionally, two new items were added: "Referral using teledentistry provides specialists
<table><caption>**Table 1** The profiles of experts participating in the Delphi panel (n = 19)</caption><thead><tr><th>Factor</th><th></th><th>N</th></tr></thead><tbody><tr><td rowspan="3">Sex</td><td>Male</td><td>6</td></tr><tr><td>Female</td><td>12</td></tr><tr><td>No response</td><td>1</td></tr><tr><td rowspan="5">Age categories</td><td>25-35</td><td>2</td></tr><tr><td>36-45</td><td>4</td></tr><tr><td>46-55</td><td>9</td></tr><tr><td>56-65</td><td>2</td></tr><tr><td>66+</td><td>2</td></tr><tr><td rowspan="6">Continent (countries)</td><td>North America (United States)</td><td>3</td></tr><tr><td>South America (Brazil)</td><td>2</td></tr><tr><td>Europe (France, Latvia, Netherlands)</td><td>5</td></tr><tr><td>Africa (Cameroon, Nigeria, South Africa, Tunisia)</td><td>5</td></tr><tr><td>Asia (India, Saudi Arabia, Singapore)</td><td>3</td></tr><tr><td>Australia</td><td>1</td></tr><tr><td rowspan="3">Highest academic degree</td><td>BDS (or equivalent)</td><td>0</td></tr><tr><td>MSc (or equivalent)</td><td>2</td></tr><tr><td>PhD (or equivalent)</td><td>17</td></tr><tr><td rowspan="2">Direct clinical care duties</td><td>Yes</td><td>11</td></tr><tr><td>No</td><td>8</td></tr></tbody></table>

<figure><img src="image_4.png" /><figcaption>**Fig. 1** The Delphi process rounds</figcaption></figure>

with more complete picture of patient's condition before examining the patient" to the Performance Expectancy - non-patient centered (PEN) dimension, and "Teledentistry easily fits within my clinical workflow" was added to the Effort Expectancy (EE) dimension.

After round 1, there were 9 items in Sects. 1, 10 items in Sect. 2, and 47 items in 10 dimensions in Sect. 3, after removing one dimension (Experience and Habit), with a total of 66 items in the questionnaire. The CVR ranged from 0.14 to 0.90, with an overall hypothetical

mean CVR after modifications = 0.45 indicating improvement from the initial CVR = 0.21 (Appendix 2).

### Round 2

No changes were made to Sect. 1 in round 2. For Sect. 2, one item, "training patients for oral hygiene", was rated as essential by 64.7% of the experts and its CVR was 0.294, lower than the cutoff point of CVR ≥ 0.529 for 17 responding experts in this round. Thus, this item was removed leaving 9 items in Sect. 2. For Sect. 3, none of
the 47 items were considered non-essential, although 8 (17%) items had negative CVR and were removed. Thir-teen (27.7%) items were considered essential, and 5 more items had CVR equal or greater than the critical value. Thus, 21 items from this section qualified for inclusion in round 3, to which 6 items were added for further testing. After round 2, Sect. 1 included 9 items, Sect. 2 included 9 items and Sect. 3 included 27 items in 9 dimensions after removing one dimension (*Social Influence - Organizational*), with a total of 45 items. The CVR was 0.44 and after removing the specified items, the hypothetical CVR increased to 0.64 (Appendix 3).

## Round 3

No changes were made to Sect. 1. At least 80% of the experts agreed that 7 of 9 items in Sect. 2, and 17 of 27 items in Sect. 3 were essential. None of the items in any section had negative CVR and, therefore, no item was removed because of this reason. Fifteen experts responded to this round and the critical CVR was 0.600. None of the items, other than those voted as essential by at least 80% of experts, had CVR more than this critical value so the remaining items were removed. Eventually, Sect. 1 included 9 items, Sect. 2 included 7 items and Sect. 3 included 17 items in 7 dimensions after removing two dimensions (*Social Influence - General and Social Influence - Patients*), with a total of 33 items. The CVR was 0.66 and increased to 0.80 after removing the non-eligible items (Appendix 4). Table 2 offers an overview of the modifications to the items.

In the revision of the final version of the questionnaire, minor edits were made including merging two questions in Sect. 1 that asked about dentists' specialties, thus, reducing the number of items in Sects. 1 to 8 instead of 9. In Sect. 2, the 5-point Likert scale was replaced with a scale ranging from zero "does not help at all" to 10 "extremely helpful". In Sect. 3, minor rephrasing of the last item was made. Appendix 5 shows the final questionnaire of 32 items.

## Discussion

We used a Delphi process to develop the TAS-D. After three Delphi rounds involving 15 to 19 experts who added, modified, shuffled, and removed items, and a final review by a study core team-member, the final version of TAS-D included 32 items: 8 in Sects. 1, 7 in Sect. 2, and 17 in Sect. 3. Section 3 explored the barriers to using teledentistry in seven dimensions representing five UTAUT2 constructs; with an 8th dimension assessing behavioral intentions. The CVR of the final questionnaire was 0.80. The reduced number of items and dimensions with high CVR provide a questionnaire that can assess dentists' acceptance of teledentistry pending

the assessment of its psychometric properties in future studies.

Several important findings emerged. First, the study gives insights about the scope of teledentistry based on feedback from experts. The modifications of items in Sect. 2 indicated that the experts favored the restriction of teledentistry to verbal communication such as advice, care of emergencies, consultations and explanations, follow up and referral and remote screening. Procedures like treatment planning or oral hygiene training or education were excluded. This consensus represents an approach to teledentistry that can allow care provision at times like the COVID-19 pandemic [3] and address more than 70% of the needs of individuals with oral health complaints [33]. Conversely, dental surgeons in China demonstrated that teledentistry can support hands-on procedures like the remote placement of an implant using robots controlled by 5G networks. However, the infrastructure allowing this may be well beyond reach in most settings [34]. Thus, the range of procedures included in this survey represents the most realistic and impactful scope of teledentistry.

Second, the study provides a perspective on the factors that experts considered unrelated to teledentistry acceptance. The Delphi rounds removed the *Social Influence* and *Experience and Habit* dimensions, indicating agreement that teledentistry should not be influenced by dentists' personal or professional social circles or their habits and experience. This may be attributed to the individualistic nature of dental practice, the professional autonomy that dentists enjoy [35] and the emphasis on evidence-based practice in decision-making [36]. On the other hand, subjective norms may have a stronger influence on mandatory than voluntary behaviors [37] and may represent a social pressure to resist [20]. *Social Influence* might have been removed because the experts felt that neither the profession nor the public may have – yet – formed an opinion to drive *Social Influence* [16], and that insufficient time has passed to build dentists' *Experience and Habit*. This agrees with research showing that *Social Influence* was neither significantly associated with medical professionals' acceptance of artificial intelligence [16], Filipino physiatrists' acceptance of tele-rehabilitation [17], nor Korean nursing students' attitudes toward using artificial intelligence [25]. By contrast, a study showed a significant association between *Social Influence* and nurses' intention to use mobile learning, which was mandated by their hospital [22]. We postulate that the exclusion of the dimensions measuring *Social Influence* and *Experience and Habit* from the TAS-D may reflect the current early stage of teledentistry use. Therefore, contextual factors such as organizational mandates and
<table><caption>**Table 2** Summary of questionnaire item modifications informed by experts' feedback</caption><thead><tr><th>Sections/ dimensions</th><th>Going in CVR in round 1</th><th>Eliminated from round 1</th><th>Moved-in in round 1</th><th>Moved-out in round 1</th><th>Added in round 1</th><th>Eliminated from round 2</th><th>Eliminated from round 3</th><th>Final items</th><th>Final CVR</th></tr></thead><tbody><tr><td>Section 1</td><td>9</td><td>0.79</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>9</td><td>0.73</td></tr><tr><td>Section 2</td><td>9</td><td>0.90</td><td>0</td><td>0</td><td>1</td><td>1</td><td>2</td><td>7</td><td>0.86</td></tr><tr><td>Section 3</td><td>63</td><td>0.10</td><td>25</td><td>10</td><td>3</td><td>2</td><td>20</td><td>10</td><td>0.81</td></tr><tr><td>Performance Expectancy: Non-patient-centered (PEN)</td><td>10</td><td>-0.13</td><td>6</td><td>1</td><td>0</td><td>1</td><td>0</td><td>3</td><td>0.75</td></tr><tr><td>Performance Expectancy: Patient-centered (PEP)</td><td>7</td><td>0.50</td><td>1</td><td>4</td><td>0</td><td>0</td><td>5</td><td>5</td><td>0.88</td></tr><tr><td>Effort Expectancy (EE)</td><td>6</td><td>0.23</td><td>2</td><td>0</td><td>0</td><td>1</td><td>2</td><td>2</td><td>0.75</td></tr><tr><td>Social Influence- General (SI-G)</td><td>6</td><td>-0.33</td><td>5</td><td>5</td><td>0</td><td>0</td><td>5</td><td>1</td><td>0</td></tr><tr><td>Social influence- Organization (SI-O)</td><td>9</td><td>0.18</td><td>3</td><td>0</td><td>2</td><td>0</td><td>4</td><td>-</td><td>-</td></tr><tr><td>Social Influence- Patients (SI-P)</td><td>3</td><td>0.54</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>-</td></tr><tr><td>Facilitating Conditions (FC)</td><td>4</td><td>0.32</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>2</td><td>0.69</td></tr><tr><td>Hedonic Motivation (HM)</td><td>5</td><td>0.26</td><td>1</td><td>0</td><td>1</td><td>0</td><td>0</td><td>1</td><td>0.81</td></tr><tr><td>Perceived Price Value (PPV)</td><td>7</td><td>-0.01</td><td>3</td><td>0</td><td>0</td><td>0</td><td>3</td><td>0</td><td>0.88</td></tr><tr><td>Experience &amp; Habit (HT)</td><td>3</td><td>-0.44</td><td>3</td><td>0</td><td>0</td><td>0</td><td>-</td><td>-</td><td>-</td></tr><tr><td>Behavioral intentions (BI)</td><td>3</td><td>-0.02</td><td>1</td><td>0</td><td>0</td><td>0</td><td>0</td><td>2</td><td>0.88</td></tr><tr><td>Total</td><td>81</td><td>0.21</td><td>25</td><td>10</td><td>3</td><td>3</td><td>21</td><td>12</td><td>33</td><td>0.80</td></tr></tbody></table>
supportive environments may influence teledentistry use [22].

Third, *Performance Expectancy* had the highest CVR reflecting experts' agreement on teledentistry's benefits to patients including care provision in remote settings and timely care, both of which have been tested during the COVID-19 pandemic [2]. Teledentistry also has the potential to reduce the carbon footprint of dental practice by decreasing patients' travel to the clinic with implications for sustainability, conservation of energy and reduced pollution [3, 38].

Fourth, *Perceived Price Value*, which had a high CVR, linked the use of teledentistry to insurance coverage. Funding and remuneration plans play crucial roles in facilitating the adoption of teledentistry and transitioning from research-oriented applications to broader implementation within the healthcare systems [3]. Professional dental bodies need to advocate for the incorporation of teledentistry within health systems and insurance plans coverage so that remote services can be available to patients.

Fifth, *Hedonic Motivation* had the third highest CVR. *Hedonic Motivation* is related to how interesting dentists perceive teledentistry. The novelty effect could influence dentists' initial acceptance of teledentistry in its early stages [39]. However, as time progresses, acceptance driven by novelty is anticipated to give way to a more realistic evaluation that must be accompanied by a supportive legal/ regulatory framework of the scope of practice and financial arrangements funding the service [40]. As the digital natives of Generation Z, born between 1996 and 2012, transition from studying to practicing dentistry [41] it may be assumed that more dentists will use technology because they enjoy it.

The study had some limitations. Most experts were senior professionals, which may have influenced the responses. We aimed to minimize selection bias by inviting males and females and experts from various regions to increase generalizability. The study's strengths include using the Delphi consensus building method to ensure that all experts provided their input with the least bias due to social desirability or the impact of power dynamics among the panel members. The panel was formed by purposefully selecting experts and potential items covering a wide range of scenarios. Furthermore, most experts regularly engage in direct clinical care duties, demonstrating a profound understanding of the practical realities of patient management and an understanding of the challenges associated with introducing new technologies into clinical practice. The study holds implications for defining the scope of teledentistry and understanding the factors influencing its acceptance among dentists. Future

studies are needed to assess the validity of the proposed tool among other oral healthcare professionals and its psychometric properties among dentists.

The development of the preliminary version of TAS-D is a step toward the standardized assessment of dentists' acceptance of teledentistry. This allows valid comparisons across dental settings, practitioners and technologies before teledentistry can be integrated into practice. For example, funders supporting research or implementation projects for teledentistry would appreciate knowing the level to which the planned intervention would be accepted by dentists who will use it. Also, policy makers instituting changes in healthcare systems need to understand the acceptance or resistance to the use of teledentistry before embarking on such a campaign. Dental schools and healthcare facilities investing in training and infrastructure to support and enable the incorporation of teledentistry into practice should also assess the existing attitude toward this technology and identify whether interventions are needed to promote positive professional attitude.

This study marks the initial phase in assessing dentists' acceptance of teledentistry, offering a standardized and comprehensive approach for comparisons across subgroups. Such an approach facilitates the identification of barriers to wide scale teledentistry implementation and developing and assessing interventions to drive implementation efforts.

## Conclusion

The TAS-D assesses dentists' profile, their opinions regarding the uses of teledentistry, intention to use teledentistry, and its determinants. The experts removed items in two dimensions of the UTAUT2, *social influence*, and *experience and habits*. The questionnaire had a high CVR indicating good agreement among experts on item relevance. This study opens the opportunity to assess the acceptance of teledentistry using a validated tool, thereby allowing for comparison of results. Future studies are needed to assess the psychometric properties of the survey and evaluate it among oral healthcare professionals.

## Supplementary Information

The online version contains supplementary material available at https://doi.org/10.1186/s12903-024-04760-2.

Supplementary Material 1

Supplementary Material 2

Supplementary Material 3

Supplementary Material 4

Supplementary Material 5
## Acknowledgements

Not available.

## Authors' contributions

Conceptualization: M.E.T, M.O.F, R.M, N.G; Methodology: M.E.T, M.O.F, R.M, N.G; Formal analysis: M.E.T; Investigation; M.E.T, N.A; Data Curation: M.E.T, N.A, R.M, S.E.U, D.M, F.N.H, C.C, C.P.C.S, D.M, D.T.K-K, E.M, E.K, R.L, L.L.D, M.C, M.K.A, O.I, S.N, E.S, H.P, M.M.B, N.G, M.O.F; Writing - Original Draft: M.E.T, M.O.F, R.M, N.G, N.A; Writing - Review & Editing: M.E.T, N.A, R.M, S.E.U, D.M, F.N.H, C.C, C.P.C.S, D.M, D.T.K-K, E.M, E.K, R.L, L.L.D, M.C, M.K.A, O.I, S.N, E.S, H.P, M.M.B, N.G, M.O.F.

## Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. SEU acknowledges financial support from the European Union's Horizon 2020 research and innovation program under grant agreement No 857287 for the Baltic Biomaterials Centre of Excellence and financial support from The Latvian Council of Science, project No Izp-2022/1-0047, "IEVA Project."

## Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

## Declarations

### Ethics approval and consent to participate

Ethical approval was granted by the Research Ethics Committee at the Faculty of Dentistry, Alexandria University, Egypt (0575-01/2023). Written informed consent was obtained from the experts participating in the study when they confirmed their agreement to participate by email after receiving the invitation to collaborate.

### Consent for publication

Not applicable.

### Competing interests

Maha El Tantawi, Rodrigo Mariño, Mariana Minatel Braga, and Moréniké Oluwátóin Foláyan are Senior Board Members at BMC Oral Health. Mohammad Khursheed Alam is an editorial board member at BMC Oral Health. The other authors declare no conflict of interest.

### Author details

¹Department of Pediatric Dentistry and Dental Public Health, Faculty of Dentistry, Alexandria University, Champollion St, Azarita, Alexandria, Egypt.

²Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilian University of Munich, Munich, Germany. ³Center for Research in Epidemiology, Economics and Oral Public Health (CIEESPO), Faculty of Dentistry, Universidad de La Frontera, Temuco, Chile. ⁴Melbourne Dental School, Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia. ⁵Department of Conservative Dentistry and Oral Health, Riga Stradiņus University, Riga, Latvia. ⁶Baltic Biomaterials Centre of Excellence, Headquarters at Riga Technical University & RSU Institute of Stomatology, Riga, Latvia. ⁷Centrum voor Tandheelkunde en Mondzorgkunde, University of Groningen, Groningen, The Netherlands.

⁸Department of Epidemiology and Health Promotion, New York University College of Dentistry, New York, NY, USA. ⁹Department of Public Health, Interpsy Research Unit, CHRU Nancy, University Hospital, University of Lorraine, Vandoeuvre-Lès-Nancy, France. ¹⁰Department of Restorative Dentistry, National Dental Centre Singapore, Singapore, Singapore. ¹¹Oral Health Academic Clinical Programme, Duke-NUS Medical School, Singapore, Singapore.

¹²Department of Dental Surgery, Université Paul Sabatier, Centre Hospitalier Universitaire, Toulouse, France. ¹³Department of Dentistry, Eastman Institute for Oral Health, University of Rochester, Rochester, USA. ¹⁴Department of Public Health, Faculty of Medicine & Biomedical Sciences, University of Yaoundé 1, Yaoundé, Cameroon. ¹⁵School of Allied Health, The University of Western Australia, Perth, Australia. ¹⁶Aix-Marseille University, CNRS, EFS, ADES, Marseille, France. ¹⁷UPSBD, Ministère de la Santé, Tunis, Tunisie. ¹⁸Department of General Sciences, Marquette University, Wisconsin, USA. ¹⁹Department of Preventive Dentistry, College of Dentistry, Jouf University, Sakaka, Saudi Arabia. ²⁰University of Ibadan, Ibadan, Nigeria. ²¹Department of Community Dentistry, Faculty

of Dentistry, University of the Western Cape, Cape Town, South Africa. ²²Oregon Health & Science University, Portland, OR, USA. ²³Department of Public Health Dentistry, Centre for Dental Education and Research, All India Institute of Medical Sciences, New Delhi, India. ²⁴School of Dentistry, University of São Paulo, São Paulo, Brazil. ²⁵CEPEL, CNRS, University of Montpellier, Montpellier, France. ²⁶Department of Child Dental Health, Obafemi Awolowo University, Ille-Ife, Osun State, Nigeria.

Received: 24 March 2024 Accepted: 16 August 2024

Published online: 22 August 2024

## References

1. De'R, Pandey N, Pal A. Impact of digital surge during Covid-19 pandemic: a viewpoint on research and practice. Int J Inf Manage. 2020;55:102171. https://doi.org/10.1016/J.IJINFOMGT.2020.102171.

2. Irving M, Stewart R, Spallek H, Blinkhorn A. Using teledentistry in clinical practice as an enabler to improve access to clinical care: a qualitative systematic review. J Telemed Telecare. 2018;24:129–46. https://doi.org/10.1177/1357633X16686776.

3. El Tantawi M, Lam WYH, Giraudeau N, Virtanen JI, Matanhire C, Chifamba T, et al. Teledentistry from research to practice: a tale of nineteen countries. Front Oral Health. 2023;4:1188557. https://doi.org/10.3389/FROH.2023.1188557/BIBTEX.

4. Valeri C, Quinzi V, Di Giandomenico D, Fani E, Leonardi R, Marzo G. Teledentistry: a bibliometric analysis of the scientific publication's trend. Digit Health. 2023;9. https://doi.org/10.1177/20552076231204747.

5. Inquimbert C, Talla PK, Emami E, Giraudeau N. Dialogue with key stakeholders on digital technology for oral health: meeting report. 2023.

6. Brunner M, McGregor D, Keep M, Janssen A, Spallek H, Quinn D, et al. An eHealth capabilities framework for graduates and health professionals: mixed-methods study. J Med Internet Res. 2018;20. https://doi.org/10.2196/10229.

7. Homis K, Ramachandran V, Del Campo DM, Del Campo LM, Kusnoto B, Atsawasuwan P, et al. The use of teleorthodontics during the COVID-19 pandemic and beyond - perspectives of patients and providers. BMC Oral Health. 2023;23. https://doi.org/10.1186/S12903-023-03215-4.

8. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q. 2003;27:425–78. https://doi.org/10.2307/30036540.

9. Venkatesh V, Thong JYL, Xu X. Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q. 2012;36:157–78. https://doi.org/10.2307/41410412.

10. Hayotte M, Thérouanne P, Gray L, Corrion K, D'Arripe-Longueville F. The French eHealth acceptability scale using the unified theory of acceptance and use of technology 2 model: instrument validation study. J Med Internet Res. 2020;22(4):e16520. https://doi.org/10.2196/16520. E16520. https://WwwJmirOrg/2020/4/E16520 2020;22.

11. Schmitz A, Díaz-Martín AM, Yagüe Guillén MJ. Modifying UTAUT2 for a cross-country comparison of telemedicine adoption. Comput Hum Behav. 2022;130. https://doi.org/10.1016/J.CHB.2022.107183.

12. Azizi SM, Roobahani N, Khatony A. Factors affecting the acceptance of blended learning in medical education: application of UTAUT2 model. BMC Med Educ. 2020;20:1–9. https://doi.org/10.1186/S12909-020-02302-2/FIGURES/2.

13. Ravid-Saffir A, Sella S, Ben-Eli H. Development and validation of a questionnaire for assessing parents' health literacy regarding vision screening for children: a Delphi study. Sci Rep 2023. 2023;13:1. https://doi.org/10.1038/s41598-023-41006-7.

14. Falzarano M, Zipp GP. Seeking consensus through the use of the Delphi technique in health sciences research. J Allied Health. 2013;42:99–105.

15. Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and Reporting DELphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31:684–706. https://doi.org/10.1177/0269216317690685.

16. Cornelissen L, Egher C, van Beek V, Williamson L, Hommes D. The drivers of Acceptance of artificial intelligence-powered care pathways among medical professionals: web-based survey study. JMIR Form Res. 2022;6(6):e33368. https://doi.org/10.2196/33368. E33368. https://FormativeJmirOrg/2022/6/E33368 2022.
17. Leochico CFD, Perez MFJ, Mojica JAP, Ignacio SD. Telerehabilitation readiness, knowledge, and acceptance of future physiatrists in the Philippines: an online survey during the COVID-19 pandemic. Front Rehabilitation Sci. 2022;3:921013. https://doi.org/10.3389/FRESC.2022.921013/BIBTEX.

18. Fujimori R, Liu K, Soeno S, Naraba H, Ogura K, Hara K et al. Acceptance, barriers, and facilitators to implementing artificial intelligence-based decision support systems in emergency departments: quantitative and qualitative evaluation n.d. https://doi.org/10.2196/36501.

19. Békés V, van Doorn KA, Böthe B. Assessing patients' attitudes towards telepsychotherapy: the development of the unified theory of acceptance and use of technology-patient version. Clin Psychol Psychother. 2022;29:1918-27. https://doi.org/10.1002/CPP.2760.

20. Chaveesuk S, Khalid B, Bsoul-Kopowska M, Rostanska E, Chaiyasoonthorn W. Comparative analysis of variables that influence behavioral intention to use MOOCs. PLoS ONE. 2022;17:e0262037. https://doi.org/10.1371/JOURNAL.PONE.0262037.

21. Broetje S, Bauer GF, Jenny GJ. Acceptance of an internet-based team development tool aimed at improving work-related well-being in nurses: cross-sectional study. JMIR Nurs. 2022;5. https://doi.org/10.2196/36702.

22. Su CY, Chao CM. Investigating factors influencing nurses' behavioral intention to use mobile learning: using a modified unified theory of acceptance and use of technology model. Front Psychol. 2022;13:673350. https://doi.org/10.3389/FPSYG.2022.673350/BIBTEX.

23. Liu Y, Lu X, Zhao G, Li C, Shi J. Adoption of mobile health services using the unified theory of acceptance and use of technology model: self-efficacy and privacy concerns. Front Psychol. 2022;13:944976. https://doi.org/10.3389/FPSYG.2022.944976/BIBTEX.

24. Bai B, Guo Z. Understanding users' continuance usage behavior towards digital health information system driven by the digital revolution under COVID-19 context: an extended UTAUT model. Psychol Res Behav Manag. 2022;15:2831. https://doi.org/10.2147/PRBM.S364275.

25. Kwak Y, Seo YH, Ahn JW. Nursing students' intent to use AI-based health-care technology: path analysis using the unified theory of acceptance and use of technology. Nurse Educ Today. 2022;119:105541. https://doi.org/10.1016/J.NEDT.2022.105541.

26. Camacho J, Zanoletti-Manello M, Landis-Lewis Z, Kane-Gill SL, Boyce RD. A conceptual framework to study the implementation of clinical decision support systems (BEAR): literature review and concept mapping. J Med Internet Res. 2020;22:e18388. https://doi.org/10.2196/18388.

27. Bucyibaruta JB, Doriccah M, Bamford L, van der Elizabeth A, Dyer TA, Murphy A, et al. Building consensus in defining and conceptualizing acceptability of healthcare: a Delphi study. Public Health Nurs. 2023;40:273-82. https://doi.org/10.1111/PHN.13153.

28. Tyler N, Planner C, Shears B, Hernan A, Panagioti M, Giles S. Developing the Resident measure of Safety in Care Homes (RMOS): a Delphi and think aloud study. Health Expect. 2023. https://doi.org/10.1111/HEX.13730.

29. Baeninger M, Piccolo MS, Gragnani A. Developing an instrument to assess physician knowledge of initial care for burn patients. Burns. 2023;49:1282-8. https://doi.org/10.1016/J.BURNS.2022.12.006.

30. Ramli NF, binti, Talib O bin, Manaf UKbinti, Hassan A. SA binti. Content validity of STEMTIP using CVR method. Int J Acad Res Bus Soc Sci 2018;8. https://doi.org/10.6007/IJARBSS/V8-I7/4559

31. Masbernat-Almenara M, Rubi-Carnacea F, Opisso E, Duarte-Oller E, Medina-Casanovas J, Valenzuela-Pascual F. Developing an assistive technology usability questionnaire for people with neurological diseases. PLoS ONE. 2023;18:e0281197. https://doi.org/10.1371/JOURNAL.PONE.0281197.

32. Ayre C, Scally AJ. Critical values for Lawshe's content validity ratio. Http://DxDoiOrg/10.1177/0748175613513808. 2013;47:79-86. https://doi.org/10.1177/0748175613513808.

33. Ali SA, Al-Qahtani AMA, Al Banai SR, Albaker FJ, Almarri AE, Al-Haithami K, et al. Role of newly introduced Teledentistry Service in the management of Dental emergencies during COVID-19 pandemic in Qatar: a cross-sectional analysis. Telemed J E Health. 2022;28:1623-32. https://doi.org/10.1089/TMJ.2021.0584.

34. Leary K. A Chinese Robot dentist operated on a human patient for the First Time ever. Futurism; 2023. https://futurism.com/a-chinese-robot-dentist-operated-on-a-human-patient-for-the-first-time-ever.

35. Guay AH. The evolution of dental group practices. J Calif Dent Assoc. 2013;41(12):899-904.

36. Chiappelli F. Evidence-based dentistry: two decades and beyond. J Evid Based Dent Pract. 2019;19:7-16. https://doi.org/10.1016/J.JEBDP.2018.05.001.

37. Chang A, UTAUT. UTAUT 2: a review and agenda for Future Research. Winners. 2012;13:10-114. https://doi.org/10.21512/TW.V13I2.656.

38. Folayan MO, El Tantawi M. Decarbonization of transport and oral health. BioMed. 2023;3:392-9. https://doi.org/10.3390/BIOMED3030032.

39. Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet. 2018;391:1357-66. https://doi.org/10.1016/S0140-6736(17)32802-7.

40. Giraudeau N. Teledentistry and COVID-19: be mindful of bogus good ideas! Inquiry. 2021;58. https://doi.org/10.1177/00469580211015050.

41. López-Santacruz HD, Guízar-Mendoza JM, López-Santacruz HD, Guízar-Mendoza JM. A new challenge for dental education: generation Z. Odovtos Int J Dent Sci. 2022;24:22-6. https://doi.org/10.15517/IJDS.2022.50804.

## Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.