# Patient satisfaction with e-oral health care in rural and remote settings: a systematic review

Elham Emami, Hermina Harnagea, Richa Shrivastava, Motahareh Ahmadi, Nicolas Giraudeau

► To cite this version:

Elham Emami, Hermina Harnagea, Richa Shrivastava, Motahareh Ahmadi, Nicolas Giraudeau. Patient satisfaction with e-oral health care in rural and remote settings: a systematic review. Systematic Reviews, 2022, 11 (1), pp.234. 10.1186/s13643-022-02103-2. hal-03841359

HAL Id: hal-03841359

https://hal.umontpellier.fr/hal-03841359

Submitted on 7 Jun 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH

Open Access

<figure><img src="image_2.png" /></figure>

Check for
updates

# Patient satisfaction with e-oral health care in rural and remote settings: a systematic review

Elham Emami<fnref n="1" />*, Hermina Harnagea<fnref n="1" />, Richa Shrivastava²,³, Motahareh Ahmadi<fnref n="1" /> and Nicolas Giraureau⁴

**Abstract**

**Background:** During the past decade e-oral health technology has been used to address the oral health care challenges in rural and remote settings. This review systematically evaluated the literature on patient satisfaction with e-oral health care in rural and remote communities.

**Methods:** The systematic review included interventional and observational studies published between 1946 and 2021, in the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, and Global Health. Patient satisfaction with received oral health care using self-reported measures, at any time after the intervention, was the main outcome of the review. The other primary outcomes were undesirable consequences of the health care (e-health or conventional) such as diagnostic error. The secondary outcomes considered were waiting time, number of visits, travel, and the cost of oral health care. Two independent researchers assessed the risk of bias using the ROBINS-I risk of bias assessment tool for non-randomized studies.

**Results:** Among 898 studies, 16 studies were included in the review. In most studies reporting patient satisfaction, all patients had shown willingness for teleconsultation for a dental problem and they were mostly satisfied due to saved travel time, saved working days, and prompt treatment onset. Most of the studies acknowledged teledentistry as a cost-effective and cost-saving method. Moreover, the teledentistry consultations showed diagnostic reliability and validity values comparable to conventional dental consultations. The majority of studies were considered level 4 and 3b, due to limited sample populations, analysis based on limited alternatives or costs, non-consistent sensitivity analysis, failure to appropriately control known confounders, and/or failure to carry out an appropriate follow-up of patients.

**Conclusion:** Available evidence indicates that e-oral health is associated with higher patient satisfaction and has been found to be an effective and reliable method for patients in rural and remote areas. Therefore, in these areas, the use of e-oral health should be encouraged. However, methodological inconsistencies in the current evidence suggest the need for long-term cohort studies and clinical trials, as well as cost analysis on e-oral health in rural settings.

**Systematic review registration:** The systematic review protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO) under the registration number CRD42016039942.

**Keywords:** e-health, e-oral health, Teledentistry, Rural and remote communities, Patient satisfaction

**Background**

Since 2018, the World Health Organization (WHO) has recommended the use of digital technologies in health care sectors under the resolution adopted by the World Health Assembly [1]. The oral health resolution voted by the WHO Executive Board in 2021 includes digital

<footnote>*Correspondence: elham.emami@mcgill.ca</footnote>

<footnote n="1">¹ Faculty of Dental Medicine and Oral Health Sciences, McGill University, 2001 McGill College, suite 500, Montreal, QC, Canada
Full list of author information is available at the end of the article</footnote>
technologies and teledentistry as a tool to translate health policy into action [2]. According to Eysenbach's definition, "E-Health is an emerging field in the intersection of medical informatics, public health and business, referring to health services and information delivered or enhanced through the internet and other related technologies" [3]. The use of e-health and e-oral health technologies enables effective remote screening, diagnosis, faster referral from primary care to specialist services, reduced amount of travel to urban sites, and increased cost-effectiveness of health care [4–6]. Furthermore, e-oral health has been used as a tool for promoting oral health, preventing dental disease, and improving oral health literacy [7, 8]. It facilitates access to dental care for high-risk populations in underserved communities, such as rural and remote communities, people with special health care needs, and people with low socio-economic status [6, 8]. E-oral health also provides an opportunity to reduce overall cost and improve oral health outcomes [6, 7].

Moreover, e-health and e-oral health technologies also improve patient health care communication and remote education [9, 10]. The effectiveness of e-health has been especially acknowledged during the COVID-19 pandemic [11], and telemedicine and teledentistry have addressed patients' needs during the closure of dental clinics in this period. Patient-based evaluation of health care is a source of information and a tool for empowerment for health care users [12]. In fact, patients' satisfaction with various dimensions of health care is a major concern in public and private health care sectors, and has been considered as the “voice of the customer” [13]. Patient satisfaction is a quality care indicator reflecting patients' experience with received health care services in terms of quality, accessibility, availability, and affordability [14–17]. Evaluation of patient's satisfaction with health care could also reflect health care disparities especially in the context of rural and remote settings [17]. It has been reported that patients living in rural and remote communities may be dissatisfied with oral health care and face suboptimal oral health care outcomes because of the limited number of dental professionals in these areas, as well as less access to dental care and oral health literacy related to geographical barriers [10, 18, 19]. Furthermore, professional incompetency due to the lack of specialists or peer feedback may be a source of patient dissatisfaction [19–21]. Given that a large number of e-health strategic plans are being developed in rural and remote areas across the world, further investigation on this topic will support policy decision-making and planning for e-oral health programs, which will lead to the improvement of oral health and oral health care in rural and remote areas. However, to our knowledge, no systematic reviews have been carried out on the effect of e-oral health technology

on patient satisfaction in rural and remote settings [18, 21–23].

Therefore, this systematic review aimed to answer the following questions:

1) When compared with conventional oral health care, do e-oral health care interventions improve the satisfaction of patients in rural and remote settings with received oral health care?

2) Is the harmful effect of diagnostic errors made in e-oral health care interventions in patients in need of oral health care in rural and remote settings comparable to the effect of such errors in conventional oral health care?

3) To what extent does e-oral health care improve patient satisfaction with care in terms of reducing waiting time, number of visits, travel, and the cost of care for patients in need of oral health care in rural and remote settings, when compared to conventional oral health care?

## Methods

The protocol of this systematic review was registered in PROSPERO (International Prospective Register of Systematic Reviews, registration number CRD42016039942) and was previously published [22]. The PRISMA reporting guidelines were followed [24] (Additional file 1).

## Information sources and search strategy

Electronic literature searches were conducted in summer 2017 and updated in February 2021 in the following databases: Cochrane Central Register of Controlled Trials (The Cochrane Library, current issue), MEDLINE (OVID interface, 1946 onwards), EMBASE (OVID interface, 1974 onwards), and Global Health (OVID interface, 1973 onwards). As described in the published protocol, the search strategy used medical subject headings (MeSH), EMTREEs, and text words related to the field of the study (Additional file 2). It was then peer-reviewed by HH and RS and complemented by hand searching the list of references in the identified publications or relevant reviews. The searches' procedures were adapted to all databases using the proper syntax, subject headings, and controlled vocabulary considering maximized sensitivity of the search. No language restrictions were used in the search strategies in order to maximize the sensitivity and to identify the number of publications in other languages and verify the existing risk of bias. NICE Evidence and TRIP database were searched for grey literature using subject keywords.
## Inclusion and exclusion criteria

We included English and French language original research studies in the review, with a defined quantitative methodological approach (interventional or observational) including randomized clinical trials, quasi-experimental trials, longitudinal cohorts, and cross-sectional surveys. We excluded case reports, position papers, reviews, and ongoing studies [22].

We adopted the Eysenbach definition of e-health [3]: any type of e-oral health technology that could address the oral health needs of participants in terms of education, consultation, screening, diagnosis, treatment, support, or any other type of application in the field of dental medicine [23], with no limitation in terms of the duration of the intervention and the type of stakeholders involved in the intervention. Conventional oral health care was defined as traditional approaches to oral health care including patients' education, consultation, disease screening, diagnosis, treatment, and support, or any other type of application in the field of dental medicine [22].

Patient satisfaction with received oral health care using self-reported measures, at any time after the intervention, was the main outcome of the review. The other primary outcome was undesirable consequences of the health care (e-health or conventional) such as diagnostic error. The secondary outcomes considered were waiting time, number of visits, travel, and the cost of oral health care [22].

## Data extraction

The identified articles from search results were transferred to EndNote software. The process of data selection and collection was pilot tested in 10% of randomly selected included articles. Cohen's kappa test was used to assess the reviewers' agreement on study eligibility (k=0.878) [22]. Two independent reviewers screened all retrieved titles and abstracts using the inclusion criteria [22] (HH, MA). Discrepancies between reviewers were discussed and resolved through consensus.

The reviewers independently extracted the data from the full text of the included studies by adapting the review form from Effective Practice and Organization of Care (EPOC) Resources for review authors [25], as a data extraction method (Additional file 3).

## Risk of bias in individual studies

Two reviewers (MA, RS) independently assessed the quality of the reports and the risk of bias. For the assessment of experimental studies, the Cochrane Collaboration tool for assessing the risk of bias was used. The assessment of observational studies was performed using

the ROBINS-I risk of bias assessment tool for non-randomized studies [26] (Additional file 4). Disagreement was resolved by consultation with a third reviewer (EE).

## Data synthesis

A narrative synthesis was conducted in line with the guidance from the Centre for Reviews and Dissemination [27]. Text and tables summarize and explain the characteristics of the findings in the included studies. The following variables were extracted, and validation checks were performed by HH and RS to assess the accuracy of the extracted fields: (i) lead author and year of publication, (ii) target condition, (iii) study design and sample size, (iv) country and setting of the study, (v) technologies features, (vi) main result, (vii) patient satisfaction measure, and (viii) other outcomes (Table 1). In view of the significant clinical, methodological, and statistical heterogeneity among the studies identified, the data available did not permit meaningful meta-analysis to be performed. According to Haidich, “meta-analysis should be conducted when a group of studies is sufficiently homogeneous in terms of subjects involved, interventions, and outcomes to provide a meaningful summary” [28]. Consequently, we conducted a broad narrative synthesis of the data.

## Results

### Study selection

The electronic search yielded a total of 898 studies from MEDLINE (n=378), EMBASE (n=414), COCHRANE (n=44), and GLOBAL (n=62). After removing duplicates, 716 studies remained for screening. The screening based on title and abstract resulted in the exclusion of 647 articles, with the main reasons for elimination being that the studies were not related to dentistry and/or did not have a quantitative design. Of the 69 potentially eligible studies, full-text screening led to a further exclusion of 53 studies, which were deemed not relevant to the study aim (Fig. 1). The excluded studies were not centered on patients but rather, they were conducted only among dental professionals and did not consider rural and remote aspects. A total of 16 studies were included in this review.

### Study characteristics

The majority of the studies were conducted between 2010 and 2019 [31–44], with only two prior studies carried out in 1998 and 2002 [29, 30]. In total, five studies were from Australia [35, 40–43], three from India [34, 39, 44], two studies were conducted in the USA [36, 37], two in Spain [32, 33], one in Canada [29], one in the UK [30], one in Italy [38], and one in Finland [31]. The types of studies comprised non-randomized clinical
<table><caption>**Table 1** Characteristics of the included studies and summary of results (N=16)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Intervention Type technology</th><th>Outcome Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>1. Patterson and Botch- way 1998 [29] Canada</td><td>J Can Dent Assoc</td><td>Pilot study Cross-sectional (observational)</td><td>Dental screen- ing</td><td>-137 screened via traditional method -Among them, 32 telehealth screened after 2 months, -27 analyzed as 5 children lost teeth in between the 2 months</td><td>N/A</td><td>2 Elementary Schools</td><td>-Telehealth screenings conducted by dental hygiene students and regional dental officer. Images were transmitted to the Tele- health Centre and screened by the same dental hygien- ists and dentist who had conducted the initial school screenings. Tele- health screenings were compared to baseline data</td><td>LinkCaser Sys- tem: fully inter- active audio and video components via telephone lines</td><td>Effectiveness of telehealth technology versus traditional screenings, screening time, screening cost</td><td>-Deft/DMFT indices score and number of errors in spreadsheet compilation</td><td>-No significant differ- ence between two methods and agree- ment between these ranged between 89%-100% -Perfect agree- ment was found for primary teeth to be extracted, perma- nent missing and permanent filling; very good agree- ment for primary filled; and moderate agreement for both decay groups</td></tr><tr><td>2. Scuffham and Steed 2002 [30] United King- dom</td><td>J of Telemedi- cine and Tele care</td><td>Non-rand- omized trial for 12 months</td><td>Economic evaluation of teledentistry</td><td>25</td><td>Mean 46 (16-49)</td><td>Patients requir- ing a referral to a specialist in 2 general practices. Ques- tionnaires: 14 patients; 18 specialists and 15 GDPs</td><td>-Specialist consultation via vide- oconference compared to specialist out- reach visits and patients' hospi- tal visits at two general dental practices</td><td>Videoconfer- ence: ISDN connection, Teleconsulta- tion</td><td>Costs fixed, direct, indirect</td><td>-Questionnaires completed by patients, GDPs, and specialists</td><td>-Additional cost for national health service (€36 and €44/patients at both dental practices) compared to outreach visits, cost savings (€270 and €1.54 at both dental practices) compared with hospital visits -Indirect cost savings were higher with teledentistry (79%) and outreach visits (84%) compared to hospital visits -Cost-savings for the NHS, however patients (travel) and general dental prac- tioners incurred some new costs (time)</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants<br>Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Intervention</th><th>Outcome</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>3. Ignatius et al 2010 [31] Finland</td><td>J of Telemedicine and Tele care</td><td>Observational descriptive</td><td>Diagnosis and treatment plans</td><td>49: 25 professionals: 18 dentists, 2 dental hygienists and 5 nurses; 24 patients</td><td>N/A</td><td>Patients requiring prosthetic or rehabilitation treatment Central hospital and regional health centers</td><td>-Effectiveness of videocoferencing for accurate diagnosis and making treatment plans for rehabilitation treatment</td><td>Videocoferencing using standard commercial units via an IP network, at bandwidths of 762 kb/s- 2 Mb/s</td><td>Number of diagnosis and treatment planning Satisfaction of dentists and patients</td><td>-Dentist examination by videocoference;<br>-Questionnaires</td><td>-Videoconferencing equipment functioning was reliable and led to smooth consultations in 24 out of 27 cases<br>-Patients were satisfied. The greater the distance, the higher the satisfaction (p &lt; 0.01)<br>-Professionals were also satisfied</td></tr><tr><td>4. Herce et al 2011 [32] Spain</td><td>J Oral Maxillofac Surg</td><td>Evaluative pilot study (multicenter, longitudinal, descriptive)</td><td>Evaluation of presurgical management of impacted third molar pathology</td><td>97 (52♀ 45♂)</td><td>35.07 ± 13</td><td>Patients with impacted third molars with no contraindication for extraction under local anesthesia; university hospital and 4 rural dental clinics</td><td>-Presurgical management of third molar pathology: dentist examination via PC, information is gathered and sent to Oral and Maxillofacial surgery unit</td><td>Store-and-forward telemedicine system (SFTMS)</td><td>Clinical effectiveness of SFTMS as a preoperative management and planning tool; waiting intervals; patient satisfaction</td><td>-Evaluation of teleconsultations by the maxillofacial surgeon, patient examination and clinical information compared to clinical data registered by PC dentist<br>-Days between visit to PC dentist and day of inclusion on surgical wait list<br>-Avoidance of unnecessary hospital visits<br>-No statistical significance in cancellations between telemedicine and traditional system (p = 0.76)<br>-Patient satisfaction: 77.3% very satisfied and 22.3% just satisfied</td><td>-The SFTMS is an effective tool in the presurgical management of patients<br>-Statistically significant shorter waiting intervals achieved by SFTMS (3.33; 95% CI = 2-4.65 days) in comparison to conventional referral system (28; 95% CI = 24.51-29.6 days) (p &lt; .001)<br>-Avoidance of unnecessary hospital visits<br>-No statistical significance in cancellations between telemedicine and traditional system (p = 0.76)<br>-Patient satisfaction: 77.3% very satisfied and 22.3% just satisfied</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Participants</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>5. Salazar-Fernandez et al. 2012 [33] Spain</td><td>J Oral Maxillofac Surg</td><td>Quasi-experimental Analytical Clinical study</td><td>Management of temporomandibular Joint (TMJ) Disorders patients</td><td>1052 E: 342 (276♀ 66♂) C: 710 (587♀ 123♂)</td><td></td><td>E: 38.3 C: 41.08</td><td>TMJ Disorders patients in 10 primary care hospitals, Northern Seville</td><td>-Using telemedicine system (images and clinical records examined by 2 distant maxillofacial surgeons) as a method for the selection, diagnosis, and treatment of patients with TMJ disorders at remote site compared to conventional hospital consultation</td><td>Store-and-forward telemedicine system through the Andalusian Public Health System Intranet (TMJ, ISDR-B, and Frame Relay/ADSL networks) to the e-mail account</td><td>1. Clinical effectiveness (rates of diagnosis of myofascial syndrome and/or internal derangement Wilkes Stages I-II-III, internal derangement Wilkes Stages IV-V, other arthropathies; resolved teleconsultations, number of second teleconsultations; rate of referrals to hospitals; mean treatment delay; reduction of number of first hospital visits, 2. Cost (lost working hours/patients) 3. Patient satisfaction</td><td>1. Clinical effectiveness (rates of diagnosis of myofascial syndrome and/or internal derangement Wilkes Stages I-II-III, internal derangement Wilkes Stages IV-V, other arthropathies; resolved teleconsultations, number of second teleconsultations; rate of referrals to hospitals; mean treatment delay; reduction of number of first hospital visits, 2. Cost (lost working hours/patients) 3. Patient satisfaction</td><td>-X-ray images, clinical information, standard Questionnaires satisfaction surveys</td><td>-No statistical differences in clinical effectiveness were found between the two groups (standard vs telemedicine) -Rates of pathologies requiring assistance in the TMJ unit (10.2% vs 11.6%) -Patients requiring non-surgical treatment (89.7% vs 88.4%) -Resolved consultations (88% vs 74.5%; p = 0.07) -Second teleconsultation (0.8% vs 4.6%; p = 0.07) -Mean cost of lost working hours per patient (16.8 Vs 32.24; p < 0.01) -Mean waiting time was significantly lesser in teleconsultation (2.3 days; 95% CI: 2.2-2.4) compared to standard system (78.6 days; 95% CI: 77.0-80.1) (p = 0.00) -63% patients were very satisfied, 36.7% satisfied, and only 1 patient was unsatisfied</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>6. Birur et al 2015 [34]</td><td>J of ADA</td><td>Descriptive Observational study</td><td>Screening</td><td>3440 Cohort 1 (targeted screening by health care workers) = 2000 Cohort 2 (Oppor- tunistic screening by dental profession- als) = 1440</td><td>(&gt;40)</td><td>Adults with high prevalence of oral cancer risk habits Primary health center</td><td>-Effective- ness of a mobile-phone based remote oral-cancer surveillance program to detect lesions and capture interpretable images -Dental screening by general dentist and health care workers and specialist diagnosis (reference standard)</td><td>Mobile health application for remote oral cancer surveillance (Oncogrid)</td><td>Lesion detection, Capture of interpretable images of the oral cavity</td><td>-Risk evaluation questionnaire, -image detection by specialist, -histological evaluation using WHO classification</td><td>-In the targeted cohort showed 45% concordance with specialists and the opportunistic cohort showed 100% concordance</td></tr><tr><td>7. Marino et al. 2016 [35]</td><td>Journal of Telemedicine and Telecare</td><td>Cost-analysis</td><td>Screening and caries assessment Cost evaluation</td><td>100</td><td>N/A</td><td>Residential aged care facility in rural areas of the Austral- ian state of Victoria,</td><td>-Comparing the cost and ben- efits of face- to-face patient examination assessments conducted by a dentist with two teledentistry (asynchronous and real time)</td><td>Teledentistry</td><td>Costs-fixed, direct, indirect</td><td>-Costs</td><td>-Cost for Tel- edental asynchron- ous = AU$32.35/ resident (lowest); -Cost for tel- edental real time = AU$41.28/ resident -Cost for face-to- face examina- tion = AU$36.59/ resident</td></tr></tbody></table>
<table><caption>**Table 1 (continued)**</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Participants</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>8. Wood et al 2016 (i) [36] USA</td><td>J Oral Maxillofac Surg</td><td>Cross sectional</td><td>Assessing perceived utility and demand for the application of telemedicine for improved patient care</td><td>226 GP and 41 OMS</td><td>NA</td><td>NA</td><td>Practicing Virginia Dental Association members on an e-mail list (approximately 2,200) Virginia Society of Oral Maxillofacial Surgery members on an e-mail list (approximately 213)</td><td>-Determine the perceived utility and demand for the application of telemedicine</td><td>Teledentistry</td><td>Perceived utility and demand for the application of telemedicine</td><td>-Two distinct questionnaires, one for the non-surgical dental practitioners (GPs) and oral and maxillofacial surgeons (OMS)</td><td>-Rural patients had a longer time from referral to OMS consultation (P=.003) and traveled longer distances (P&lt;.0001); -GPs moderately agreed to the benefits of telemedicine while OMS were mostly neutral -GPs agreed to refer more patients if teleconsultation was used. More referrals would influence OMS's decision to offer teleconsultations -GPs had neutral opinion on the reliability of teleconsultations, whereas OMS said they would use it if provided equally good consultations as face-to-face consultations</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>9. Wood et al 2016 (II) [37] USA</td><td>J Oral Maxillofac Surg</td><td>Retrospective study</td><td>Assessing patients for surgical treatment under Anesthesia (triage)</td><td>335 (331 δ (99%))</td><td>Mean 32.5 years (SD = 9.31 years)</td><td>Data were collected from a retrospective patient chart review from telemedicine consultations performed between the Virginia Commonwealth University Medical Center and the Virginia Department of Corrections from May 2008 to June 2014</td><td>-Efficiency and reliability of telemedicine consultations for preoperative assessment of patients</td><td>Data from telemedicine consultations</td><td>Chief complaint, history of current illness, and medical history by "face-to-face" video interview, examination by intraoral camera, Radiographic examinations, Physical examination assisted by a nurse or surgical technician at the remote site, estimated cost savings over the 6-year period on comparing with the previous study data at the National Institute of Justice</td><td>-Dental electronic health charts</td><td>.92.2% of the time practitioners successfully used the data collected for diagnosis and treatment plan .95.9% patients were given an accurate diagnosis and treatment plan .99.6% patients were accurately triaged .98% patients were given adequate medical assessments and underwent surgery as planned .Cost saving was substantial at $134,640 for 6 years</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>10. Petruzzi and De Benediktis 2016 [38] Italy</td><td>Oral Surg Oral Med Oral Pathol Oral Radiol</td><td>Cross-sectional Observational study</td><td>Diagnosis</td><td>96 65 rural</td><td>N/A</td><td>339 clinical images relating to the 96 cases sent by eighty clinicians (general dental practitioners, hygienists, and physicians) and patients, or their relatives 92/96 patients (96%) attended Oral Medicine unit for a clinical examination. In 45 cases a biopsy was performed</td><td>-Clinical images were spontaneously sent to the authors' smartphones via WhatsApp. Images were reviewed by two oral medicine experts. The patients then underwent an oral mucosa examination at the clinic, where all biopsied lesions were examined histopathologically by an independent pathologist</td><td>WhatsApp messenger mobile application version 2.10 or higher. One examiner used an iPhone 4s (3.5" screen) and the other a Galaxy S III (4.8" screen)</td><td>Agreement rates between TM oral medicine expert's diagnosis and clinicopath assessment</td><td>-Percentage calculation</td><td>-316 photos (93%) were good quality photos<br/>-Telemedicine impressions by the two oral medicine experts agreed with the clinicopathologic assessment for 82% cases, with an inter-rater reliability of 100%<br/>-Agreement rate for traumatic cases was 95%, for infectious lesion 96%, for pre-neoplastic/neoplastic disorders 71%, for autoimmune 82% and for non-pathological conditions was 67%</td><td></td></tr></tbody></table>
<table><caption>**Table 1 (continued)**</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Participants</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Outcome</th><th>Results</th></tr></thead><tbody><tr><td>11. Purohit BM et al. 2016 [39] India</td><td>Journal of Public Health Dentistry</td><td>Cross-sectional study</td><td>Screening/ dental caries assessment</td><td>139 (62♂, 77♀)</td><td></td><td>12 years</td><td>School children from same racial/ ethnic group located in the region of the outreach health centers of Bhopal district</td><td>-Standardized video recording of the oral cavity for caries assessment</td><td>A Sony Xperia smart phone with an 8-megapixel camera, 720 * 1,280-pixel resolution, and LED flashlight was used to standardise video recording of the oral cavity. The video files were stored in MP4 format, with a duration of 40 s and a file size of 60 MB, respectively</td><td>Mean DMFT</td><td>-Visual tactile and video-graphic assessments</td><td></td><td>-Mean DMFT was 2.47 ± 2.01 by visual tactile and 2.46 ± 1.91 by video-graphic assessment (p = 0.76)<br/>-Fair agreement between visual tactile and video-graphic assessment (intraclass correlation coefficient = 0.56)<br/>-Video-graphic assessment: Sensitivity and specificity values were 0.86 and 0.58 respectively. Positive and negative predictive values were 0.90 and 0.48 respectively (area under the curve = 0.69)</td></tr></tbody></table>
<table><caption>**Table 1 (continued)**</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Outcome</th><th>Results</th></tr></thead><tbody><tr><td>12. Estai Met al. 2017 [40] Australia</td><td>Australian Health Review</td><td>A cost-minimization analysis</td><td>Cost analysis Screening</td><td>2.7 million children</td><td>5-14 years</td><td>Australian school children (Australian Bureau of Statistics)</td><td>-Compare the costs of teledentistry and traditional dental screening approaches</td><td>Teledentistry</td><td>The fixed costs and the variable costs, including staff salary, travel and accommodation costs, and cost of supply</td><td>-Costs</td><td>-Total estimated cost of teledentistry model = $50 million<br/>-The fixed cost of teledentistry = $1 million and fixed cost of staff salaries = $49 million<br/>-Total annual saving with the teledentistry was $85 million. Estimated staff salary saved = $56 million, and the estimated travel allowance and supply expenses avoided = $16 million and $14 million respectively<br/>-Teledentistry cost an average of $19 per child, compared to $41-187 per child for traditional screening, depending on the distance from residence</td><td></td></tr></tbody></table>
<table><caption>**Table 1 (continued)**</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Participants</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>13. Teoh J et al. 2018 [41] Australia</td><td>Telemedicine and e-health</td><td>A model-based analysis was conducted to determine the potential costs of implementing teledentistry at the hospital</td><td>Assess the use of Teledentistry</td><td>367 Teledentistry appropriate consultations</td><td>NA</td><td>Royal Children's Hospital for rural and regional patients</td><td>Assess the use of Teledentistry in delivering specialist dental services</td><td>Teledentistry</td><td>Teledentistry</td><td> timely consultations (whether the patient presented within an appropriate time according to the recommended schedule)</td><td>Review of dental records of orthodontic or paediatric dental consultations at the hospital</td><td>-Cost-effective-ness analysis comparing teledentistry with the traditional method of consultation</td><td>-241(65.7%) consultations were timely</td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>-The cost saving with teledentistry consultation was A$136.95 per appointment more compared to hospital consultations</td></tr><tr><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td>-With teledentistry, there will be a societal cost saving of $3,160.81 for every timely cleft lip and palate consultation and hospital consultations could have freed up 36.7 days of clinic time</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Participants<br>Sample size total (gender)</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>14. Tynan et al. 2018 (0) [42]<br>Australia</td><td>BMC Health services research</td><td>A mixed method comparison study</td><td>Impact and experience of an integrated oral health program utilising tele-dentistry and Oral Health Therapists (OHT)</td><td>27 residents (10♂, 17♀)<br>One focus group (5) + 8<br>Interviews (gender non-specified)</td><td>Mean 77.09 (34–101) 82.4 (44–97)</td><td>A total of 252 audits were complete across nine residential aged care facilities (111 audits at facilities with integrated oral health and 141 audits at facilities without integrated oral health Out of the 27 participants, 7 were from residential aged care facilities with integrated oral health program and 20 were from facilities without program Participants for qualitative data included 5 nurses from facilities with integrated program and 8 nurses from facilities without the program</td><td>-Comparison between facilities with and without an integrated program by Audits, GOHAI surveys, 1 FG + 8 interviews</td><td>Tele-dentistry (a dentist for a remote real-time oral examination if required) The OHT, specifically trained in manipulating the intraoral camera, can simultaneously communicate with a remotely located dentist</td><td>Comparison facilities with and without integrated oral health program</td><td>Audit<br>-Qualitative content analysis<br>-GOHAI questionnaires</td><td>Audit comparison of facilities with integrated oral health program implemented and with integrated programs showed better compliance with oral health standards at integrated facilities (More satisfactory oral health plans, 89.2% vs 75.2%; p = 0.005)<br><br>-Mean GOHAI score 50.6 ± 5.1 vs 51 ± 5 indicating poor oral health quality of life<br><br>-Thematic analysis showed improvements in importance placed on oral health, better access to services and training, and decreased disruption in facilities with integrated programs</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Participants</th><th>Age: Mean ± SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Outcome</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>15. Tynan et al. 2018 (II) [43] Australia</td><td>Aust. J. Rural Health</td><td>A quality improvement study incorporating pre- and post chart audits and pre- and post consultation with key stakeholders, including staff and residents, expert opinion on cost estimates and field notes were used</td><td>Screening via the oral health therapist and telemedicine appointment</td><td>116</td><td></td><td>N/A</td><td>One regional and three rural residential aged care facilities situated in a non-metropolitan hospital and health service in Queensland</td><td>Audits comparison between facilities with and without an integrated program Perceived impacts on staff and residents Cost comparison</td><td>Teledentistry</td><td>Comparison facilities with and without integrated oral health program</td><td>Number of appointments avoided at an oral health facility Feedback on program experience by staff and residents Compliance with oral health care plan implementation Observations of costs involved to deliver new service</td><td>Positive feedback was received from staff, residents, and their families Staff and managers reported increased awareness of residents' oral health needs and prevention requirements; improved access to resources for oral health management; and savings from reducing the need to transport residents to an oral health facility Reduced disruption to high care residents; Positive cultural change in staff toward oral health care Initial screenings by the therapist resulted in potential problems being identified and addressed earlier than in the past</td><td>Increase up to 96% of residents with an appropriate oral health care plan was observed Positive feedback was received from staff, residents, and their families Staff and managers reported increased awareness of residents' oral health needs and prevention requirements; improved access to resources for oral health management; and savings from reducing the need to transport residents to an oral health facility Reduced disruption to high care residents; Positive cultural change in staff toward oral health care Initial screenings by the therapist resulted in potential problems being identified and addressed earlier than in the past</td></tr></tbody></table>
<table><caption>Table 1 (continued)</caption><thead><tr><th>Author/ year/country</th><th>Journal</th><th>Design (assessed by researcher)</th><th>Field of application</th><th>Sample size total (gender)</th><th>Age: Mean±SD, (min-max yrs)</th><th>Source</th><th>Description of the intervention</th><th>Type technology</th><th>Type outcome measure</th><th>Measurement instrument</th><th>Results</th></tr></thead><tbody><tr><td>16. Vinayagamoorthy et al. 2019 [44]</td><td>Aust. J. Rural Health</td><td>An observational cross-sectional study</td><td>Preventive screening of oral potentially malignant Disorders</td><td>131<br>64.1%♀ + 35.9%♂</td><td>Mean (SD) age of 37.34 years (11.31)</td><td>Primary care setting in Udupi District, Karnataka, South India</td><td>-Clinical oral examination followed by photo capture of five areas of the patients' mouth</td><td>A Samsung Note 2 mobile phone with an 8-megapixel camera and a display with a resolution of 720 x 1280 pixels with autofocus (Samsung, Seoul, South Korea) was used<br>The photo messaging feature of the WhatsApp messenger (Version 2.17.190; WhatsApp, Mountain View, CA, USA)<br>Both the examiners examined the images in their mobile phones (Android smartphones with a display size of 5.50" and a display resolution of 1080 x 1920 pixels)<br>separately with the display brightness at 50%</td><td>Reliability measures for the use of a photo messaging service in diagnosing oral potentially malignant disorders, as compared to the clinical examination</td><td>-Reliability of an exact diagnostic match of lesions between the examinations<br>-Inter-examiner and intra-examiner reliability of the clinical oral examination and photographic examination<br>-Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value<br>-Agreement between the two examiners for the diagnosis based on photo messaging</td><td>-When lesions were classified as normal or abnormal, the reliability between diagnoses for Examiners 1 and 2 based on photo messaging and clinical oral examination was 0.68 and 0.67, respectively<br>-Sensitivity for examiners 1 and 2 were 98.5% and 99.04%, respectively, and specificity was 72% and 64%, respectively<br>-When the agreement between photo messaging and clinical oral examination for an exact diagnostic match was evaluated, the reliability was 0.59 and 0.55 for Examiners 1 and 2, respectively<br>-Sensitivity for examiners 1 and 2 were 98.1% and 98.7%, respectively, and specificity was 64% and 52% respectively</td></tr></tbody></table>
<figure><img src="image_3.png" /><figcaption>**Fig. 1** PRISMA flow diagram (Adapted from PRISMA 2020 statement)</figcaption></figure>

trials [30, 33], observational studies [31, 34, 36, 37, 39, 42–44], pilot intervention studies [29, 32, 38], and cost analysis [35, 40, 41]. Most studies used teledentistry consultations, either live or *store and forward* [29, 30, 32, 33, 35, 37, 40–43], and other studies used smartphone-based applications like WhatsApp [38, 44], the Oncogrid application for oral cancer surveillance [34], and videographic examination [39].

In several studies, teledentistry-based general dental examination and screening were done using intraoral cameras [29–31, 39, 42, 43]. In other studies, specialized dental services were provided such as oral and maxillofacial surgery for impacted third molar pathology, cleft lip and palate patient management, temporomandibular joint disorders [32, 33, 36, 37, 41], oral pathology for preventive screening of oral potentially malignant disorders [44], oral medicine and diagnosis for oral cancer surveillance [34, 38], and prosthodontics for dental prosthetics and oral rehabilitation [31]. All of these specialized dental services primarily used the teledentistry model for specialist teleconsultations, disease screening, diagnosis and surveillance, treatment planning, preoperative assessment and management

of patients requiring operative procedures, as well as referrals [31–34, 36–38, 41, 44].

## Synthesis of the results

### Patient satisfaction

In three studies reporting patient satisfaction, 63 to 78% of patients were very satisfied with e-oral health care and 22 to 37% were satisfied [31–33]. Only one study reported dissatisfaction in one patient (0.3%) [33]. All patients in these studies had shown willingness for teleconsultation for a dental problem [31–33]. As per Herce et al., 77.7% patients out of a total of 90 patients were very satisfied with this type of care, 22.3% patients were just satisfied, and no patient was unsatisfied [32]. Similarly, Salazar-Fernandez et al. [33] reported that 63% of 283 patients were very satisfied, 36.7% were satisfied, and only 1 patient was unsatisfied. Patients were satisfied with such consultations due to saved travel time, saved working days, and prompt treatment onset [33]. In addition, in the study by Ignatius et al. [31], 65% of 24 patients rated their satisfaction with the teleconsultation as 9 or 10 on a scale of 4 (worst) to 10 (best).
These studies reported association of patient satisfaction with travel time [31], prompt treatment initiation, and workdays not lost [33]. As per Ignatius et al. [31], patient satisfaction was associated with the travel distance: the greater the distance of the patient's residence from the hospital, the greater the patient's satisfaction with e-oral health.

Moreover, Ignatius et al. reported that dental professionals were satisfied with the performance of teledentistry devices [31]. Furthermore, in a study conducted by Wood et al. [36], general dental practitioners moderately agreed with benefits of teledentistry and expressed a desire to refer more patients through telemedicine consultations. While oral and maxillofacial surgeons were mostly neutral, they acknowledged that more referrals would influence their decision to provide telemedicine consultations and implement teledentistry in their practice [36].

## Harmful effect of diagnostic errors made in e-oral health care interventions

There were no studies that found harmful effects, but five studies found that the e-oral health technology was reliable and in acceptable agreement with the standard consultations. According to Wood et al., 92.2% of the time, the practitioners were successful in making the diagnosis and treatment plan by using the teleconsultation data [37]. Nearly 96% of the patients were given an accurate diagnosis and treatment plan, 99.6% of patients were triaged correctly, and 98.0% were given sufficient medical and physical assessment and immediately underwent surgery after teleconsultation [37].

Petruzzi et al., Patterson et al., Vinayagamoorthy et al., and Purohit BM et al. reported significant agreement between teledentistry consultation and clinicopathologic examination [29, 38, 39, 44]. According to Vinayagamoorthy et al., substantial agreement was found when the lesions were dichotomized as normal and abnormal (examiner 1 and 2, K reliability: 0.68 and 0.67, sensitivity: 98.5% and 99.04%, specificity: 72% and 64%), but slightly reduced when assessed for the exact diagnostic match (examiner 1 and 2, K reliability: 0.59 and 0.55, sensitivity: 98.1% and 98.7%, specificity: 64% and 52%) [44]. Birur et al. reported 45% and 100% concordance with the specialists in the targeted cohort and opportunistic cohort respectively [34]. In a study by Purohit BM et al., the sensitivity and specificity were 0.86 and 0.58 for videography-based teledentistry assessment [39].

## Impact on waiting time, number of visits, travel, and the cost of care for patients

According to Herce et al. [32], the mean waiting interval for patients managed through teledentistry was 3.33 days

since the visit to the primary care dentist compared to 28 days for those managed through the conventional referral system [32]. The cancellation rate on-the-day of surgery for telemedicine was 7.8% and for the conventional system was 8.85% [32]. Salazar-Fernandez et al. [33] found that both the teleconsultations and hospital visits were clinically effective [33]. No statistically significant difference between the two techniques was noted for the rates of pathologies requiring assistance, patients requiring nonsurgical treatment, resolved consultations, and second teleconsultations [33]. The effectiveness and efficiency also varied with the distance of the patient's residence from the hospital [37, 41]. Teoh et al. [41] performed analysis of subgroups determined a priori, based on the distance travelled by the study participants (< 50 km, 50-80 km, 81-150 km, 151-225 km, and > 225 km). Based on the cost-effectiveness analysis, these authors concluded that the greater the distance between the patient's residence and the hospital, the more cost-effective and time-saving teledentistry intervention would be [41]. For instance, the cost difference between tele- and hospital consultations at > 225 km distance was AUS 458.85, the incremental cost-effectiveness ratio was -10,550.45, the hours saved were 5.02, and the total distance saved was 450.03 km [41]. Furthermore, this study showed that patients could save an average of 2 h and 21 min of travel time and 178.6 km of travel distance [41]. However, this treatment modality was not as cost effective if a patient resided within 50 km of the hospital [41]. As per the study by Wood et al. [37], average estimated distance of the patients from the clinic was 50 miles and the average roundtrip cost estimate of driving this distance was approximately $60.00 per patient.

As per Ignatius et al. [31] and Scuffman and Steed [30], the additional training of the general dental practitioners and familiarity with equipment and procedures were associated with better teledentistry related outcomes. Training may have higher initial cost but it can be cost-effective in the long run [30]. Birur et al. also reported better concordance in the presence of trained onsite health workers such as in the diagnosis and surveillance of oral cancer [34].

Seven studies acknowledged teledentistry as a cost-effective and cost-saving method. A study by Estai et al. [40] compared traditional dental screening at school with teledentistry using a cost-minimization analysis. This study demonstrated the ability of teledentistry in minimizing the cost; for instance, the total estimated cost and fixed cost of the teledentistry model was $50 million and the estimated annual reduction with the teledentistry model was $85 million, which included staff salary savings, travel allowance avoided, and supply expenses avoided [40]. Similarly, cost analysis by Marino et al.
[35] showed that asynchronous teleconsultation was the lowest cost service model with AU$32.35 cost per resident compared to traditional face-to-face (average cost: AU$36.59 per resident) and real-time (average cost: AU$41.28 per resident) consultations.

According to Wood et al., consultation by telemedicine for 255 patients and eliminating in-office consultation saved a significant amount equivalent to $134,640 [37]. In a model-based analysis, in Teoh et al. [41] the expected cost per consultation for conventional care was AU$431.29 and that for teledentistry was AU$294.35, saving an average AU$136.94 in societal costs per consultation. They also mentioned that teledentistry would save AU$50,258.92 in total costs per year, and that costs to the patient were reduced by 69% [41]. Comparing the conventional care in hospital to teledentistry, the largest difference in cost savings was the costs to the patient including their transportation, accommodation, and lost productivity costs, amounting to AU$70,719.19 [41]. The sensitivity analysis after adjustment of potential variables showed that teledentistry is a cost-saving option to society with the saving of $3,160.81 for every timely cleft lip and palate consultation compared to hospital consultation [41]. Salazar-Fernandez et al. [33] reported the mean cost of lost working hours per patient was significantly less (50%) in teleconsultation (16.8 h) compared to the standard system (32.24 h).

Tynan et al. [43], on the other hand, compared three cost scenarios: screening by an oral health therapist in a residential aged care facility, teledentistry in a residential aged care facility, and resident attendance at an oral health clinic. Screening by an oral health therapist was deemed the lowest cost scenario when compared to the other two since the teledentistry setup in scenario 2 and dentist time in scenario 3 increased total costs [43]. In a cost-minimization analysis by Scuffham and Steed [30], the cost of teledentistry was compared with two modes, outreach visits (specialist regularly visiting the two remote communities) and hospital visits. In both the communities, teleconsultation was associated with additional costs to the health organization and society compared with outreach visits [30]. However, the cost savings for teleconsultation varied between the communities compared to hospital visits. In one community, cost savings were higher due to more travel time and travel cost [30]. Nonetheless, the researchers concluded that teledentistry would be a cost-effective tool for the health organization in the long run [30].

### Risk of bias assessment

Additional file 4 presents the risk of bias assessment tool in individual studies. Thirteen of the selected studies were found to have moderate risk of bias, and two other

<table><caption>**Table 2** Selected articles' levels of evidence</caption><thead><tr><td>Author/year/country/</td><td>Level of evidence (Oxford Centre for EBM 2009)</td></tr></thead><tbody><tr><td>1. Patterson and Botchway/1998/Canada [29]</td><td>4</td></tr><tr><td>2. Scuffham and Steed/2002/United Kingdom [30]</td><td>3b</td></tr><tr><td>3. Ignatius et al./2010/Finland [31]</td><td>3b</td></tr><tr><td>4. Herce et al./2011/Spain [32]</td><td>1b</td></tr><tr><td>5. Salazar-Fernandez et al./2012/Spain [33]</td><td>1b</td></tr><tr><td>6. Birur et al./2015/India [34]</td><td>1b</td></tr><tr><td>7. Marino et al./2016/Australia [35]</td><td>2b</td></tr><tr><td>8. Wood et al./2016 (I)/USA [36]</td><td>4</td></tr><tr><td>9. Wood et al./2016 (II)/USA [37]</td><td>2b</td></tr><tr><td>10. Petruzzi and De Benedittis./2016/Italy [38]</td><td>4</td></tr><tr><td>11. Purohit BM et al./2016/India [39]</td><td>4</td></tr><tr><td>12. Estai M et al./2017/Australia [40]</td><td>3b</td></tr><tr><td>13. Teoh J et al./2018/Australia [41]</td><td>3b</td></tr><tr><td>14. Tynan et al./2018 (I)/Australia [42]</td><td>4</td></tr><tr><td>15. Tynan et al./2018 (II)/Australia [43]</td><td>4</td></tr><tr><td>16. Vinayagamoorthy et al./2019/India [44]</td><td>4</td></tr></tbody></table>

[Ref: Centre for Evidence-Based Medicine. Levels of Evidence. Oxford: Oxford Centre for Evidence-Based Medicine; 2009. https://www.cebm.ox.ac.uk/resou rces/levels-of-evidence/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009. Accessed 20 October 2020]

studies had critical risk in the overall assessment [29–35, 37–44]. One article was found to be ineligible for performing risk for bias assessment using the ROBINS-I tool [36]. Table 2 shows the level of evidence according to the Oxford Centre for Evidence-Based Medicine [45]. The majority of studies (11 out of 16) were considered level 4 and 3b.

### Discussion

Patients' satisfaction with access to care in rural and remotes areas is one of the most important objectives of digital health. The findings of this systematic review suggest that 63% to 78% of patients living in rural and remote areas were very satisfied with e-oral health care interventions [31–33]. This satisfaction was mainly attributed to clinical effectiveness in making the diagnosis and treatment plan, less waiting time, prompt treatment onset, cost effectiveness, saved travel time, and saved working days [32, 33, 35, 37, 40–43]. Moreover, studies reporting on agreement of teledentistry consultation versus conventional dental consultations found comparable diagnostic reliability and validity values [32, 33, 35, 41].

Previous research has reported a rural–urban disparity regarding patients’ satisfaction with oral health care [46, 47]. Additionally, literature suggests that rural residents could have a higher level of satisfaction with oral health care services if they receive these services in a
timely manner in their vicinity. For instance, a study on patient satisfaction with emergency oral health care services in rural Tanzania reported satisfaction among 92.7% of patients because of availability of these services in their area [48]. Another study reported 80% satisfaction among patients visiting a rural dental institution in India [49].

The included studies also measured a wide range of other outcomes that were positively associated with e-oral health that we are not reporting here since they were not included in the published protocol. These outcomes include dental professionals' satisfaction and perceptions about teledentistry [31, 36], perceived utility and demand for the application of telemedicine [36], surgery cancellation rate [32], number of appointments avoided at an oral health facility [43], and compliance with oral health care plan implementation [43].

The available emerging evidence and recent systematic reviews on e-oral health suggest that this technology is effective in promoting oral health and preventing dental problems, and that it has acceptable diagnostic performance [50–52]. Some authors have reported that tele-disease screening, tele-diagnosis, tele-consultations, treatment planning, and referrals, are comparable to face-to-face dentist-patient interaction [53, 54]. Additionally, according to previous studies these technologies seem to be beneficial in school-based programs, long-term care facilities, and areas with limited access to care, including rural and remote areas. However, in the absence of real comparative data it is hard to know how relevant these results are.

E-health services in rural and remote areas have been used for mental health, oncology, geriatrics, paediatric care, trauma treatment, specialist rheumatologist services, wound care management, and chronic disease management [55, 56]. Similar to our results, these e-health services were also found to be effective in rural areas in terms of better patient's and professional's satisfaction and acceptance, access to care, convenience, reliability, and reduced overall cost and travel time [55–57]. However, the success of e-health services in rural areas also depends on design and implementation of these services, information and technological support, as well as user training of the health personnel [57].

This systematic review reveals that multiple digital tools such as WhatsApp, emails, and videoconferencing have been used to connect oral health professionals and patients. This shows the necessity to work on formal teledentistry platforms. Furthermore, the type of digital tools will influence the quality of the diagnosis and the treatment plan. On the other hand, patients' knowledge concerning the use of digital technologies is an important aspect and may influence patients' expectation and satisfaction with the use of such technologies.

The satisfaction of patients may also be influenced by the type of dental care. For example, the use of teledentistry for early detection of oral cancer may result in higher patient satisfaction when compared with the telemonitoring of the outcomes of orthodontic care. In fact, the use of digital technology should be encouraged in the prevention of oral diseases and improving access to care. According to the French national law on telemedicine enacted in 2009, the telemedicine activities should take into account "the deficiencies in the provision of care due to insularity and geographical isolation" [58]. The WHO mOralHealth program [59] is an example of strategies that encourage worldwide e-oral health policies and programs to improve oral health literacy and access to care.

The recent development of e-health technologies and their integration and implementation in primary oral health care by interdisciplinary teams has the potential to address the dental needs of individuals in remote and rural communities, to provide satisfaction to these individuals, and to alleviate the burden of access to care. The findings also have the potential to empower the isolated dental workforce working in rural and remote zones across the world.

However, this review is limited due to its narrow inclusion criteria in regard to language and inclusion of various study designs, and caution should be taken when interpreting the results. Moreover, based on the level of evidence (Oxford Centre for EBM) and ROBINS-I assessments, most of the included studies had moderate or low quality as well as moderate to critical risk of bias. Furthermore, the reporting of outcomes in the included studies varies considerably. Although ROBINS-I is a comprehensive and rigorous tool for assessing bias risk, its reliability is questioned due to a lack of agreement among the examiners [60]. These findings may affect the overall conclusions drawn in this study.

Our findings indicate significant inconsistencies in the methodologies of the included studies in terms of study setting, study design, sampling, data collection, and data analysis. Therefore, future high-quality studies using a mixed-method research design are required to provide quality data especially from end users' perspectives. Quantitative data of the mixed methods should include randomized controlled trials with valid instruments allowing scoring patient satisfaction whereas the qualitative element can aid in gaining in-depth understanding of patients' satisfaction with e-oral health. Standardized economic analyses are also required. Furthermore, future research on e-oral health should consider patient-centered oral health care, patient experiences with care, and the cost effectiveness of these technologies, particularly in underserved areas. Further research is needed to understand the role of e-oral health technologies
in addressing rural oral health disparities. Moreover, research into the application of these technologies in academic settings will shed light on their significance in education.

## Conclusion

Our results suggest that patient satisfaction could be associated with several modalities of e-oral health care. E-oral health seems a feasible option for providers who want to contribute to oral care services in rural and remote areas. However, only speculative conclusions can be drawn based on the quality of the included studies, implying that long-term robust cohort studies and clinical trials, as well as cost assessments on e-oral health in rural settings, are required in the future. As telehealth continues to be developed, special care should be given to incorporate features that further enable patients' satisfaction and acceptance. On the other hand, as more patients are using telehealth, additional training for dentists is an important part of assuring better positive outcomes for patients.

## Supplementary Information

The online version contains supplementary material available at https://doi.org/10.1186/s13643-022-02103-2.

**Additional file 1.** PRISMA 2009 Checklist.

**Additional file 2.** Appendix 2. Search methodology.

**Additional file 3.** Effective Practice and Organisation of Care (EPOC). Data collection form. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2013.

**Additional file 4.** The Risk Of Bias In Non-randomized Studies–of Inter-ventions (ROBINS-I) assessment tool.

## Acknowledgements

The authors thank M. Dupont, librarian at Université de Montréal, for his prompt collaboration in electronic search development and updating.

## Authors' contributions

All authors have made significant contributions to this systematic review. EE contributed largely to the conception and development of this review project and protocol. She provided guidance to the research team members. She coordinated all aspects of the study and played an essential role in the analysis and interpretation of the results. HH conducted the literature review. EE, HH, RS, and MA were involved in data extraction, data analysis, data interpretation, and article writing. All the authors critically revised the manuscript and approved the final version.

## Funding

No external funding.

## Availability of data and materials

Not applicable.

## Declarations

### Ethics approval and consent to participate

Not applicable.

## Consent for publication

Not applicable.

## Competing interests

The authors declare that they have no competing interests.

## Author details

¹Faculty of Dental Medicine and Oral Health Sciences, McGill University, 2001 McGill College, suite 500, Montreal, QC, Canada. ²Faculty of Dentistry, Université de Montréal, Montréal, Québec, Canada. ³Present Address: Postgraduate Institute of Medical Education and Research, Chandigarh, India. ⁴UMR 5112, CEPEL, CNRS, Université de Montpellier, Montpellier, France.

Received: 2 July 2021 Accepted: 16 October 2022

Published online: 29 October 2022

## References

1. World Health Organization- Seventy-first World Health Assembly. Agenda item 12.4. Digital health resolution. Geneva: World Health Organization; 2018.

2. World Health Organization- Executive Board 148th session (EB148/8). Oral health resolution. Geneva: World Health Organization; 2021.

3. Eysenbach G. What is e-health? J Med Internet Res. 2001;3(2):e20.

4. Deldar K, Bahaadinbeigy K, Tara SM. Teleconsultation and clinical decision making: a systematic review. Acta Inform Med. 2016;24(4):286-92.

5. Indria D, Alajlani M, Fraser HSF. Clinicians perceptions of a telemedicine system: a mixed method study of Makassar City, Indonesia. BMC Med Inform Decis Mak. 2020;20(1):233.

6. Mariño R, Ghanim A. Definition of teledentistry. In: Giraudeau N, editor. e-Health Care in Dentistry and Oral Medicine. Switzerland: Springer International Publishing AG; 2018.

7. Mariño R, Chinnasamy A. e-Oral Health Tools. In: Giraudeau N, editor. e-Health Care in Dentistry and Oral Medicine. Switzerland: Springer International Publishing AG; 2018.

8. Mariño R. e-(Oral) health: a world-wide overview [Guest Editorial]. J Int Soc Telemed eHealth. 2019;7:e7(1-2).

9. Sanchez Dils E, Lefebvre C, Abeyta K. Teledentistry in the United States: a new horizon of dental care. Int J Dent Hyg. 2004;2(4):161-4.

10. Skillman SM, Doescher MP, Mouradian WE, Brunson DK. The challenge to delivering oral health services in rural America. J Public Health Dent. 2010;70(Suppl 1):S49-57.

11. Monaghesh E, Hajizadeh A. The role of telehealth during COVID-19 outbreak: a systematic review based on current evidence. BMC Public Health. 2020;20(1):1193.

12. Snyder CF, Wu AW, Miller RS, Jensen RE, Bantug ET, Wolff AC. The role of informatics in promoting patient-centered care. Cancer J. 2011;17(4):211-8.

13. Griffin A, Hauser JR. The Voice of the Customer. Mark Sci. 1993;12(1):1-27.

14. Vuori H. Patient satisfaction–does it matter? Qual Assur Health Care. 1991;3(3):183-9.

15. Pascoe GC. Patient satisfaction in primary health care: a literature review and analysis. Eval Program Plann. 1983;6(3-4):185-210.

16. Williams SJ, Calnan M. Key determinants of consumer satisfaction with general practice. Fam Pract. 1991;8(3):237-42.

17. Cleary PD, McNeil BJ. Patient satisfaction as an indicator of quality care. Inquiry. 1988;25(1):25-36.

18. Emami E, Wootton J, Galarneau C, Bedos C. Oral health and access to dental care: a qualitative exploration in rural Quebec. Can J Rural Med. 2014;19(2):63-70.

19. Sharifian N, Bedos C, Wootton J, El-Murr IJ, Charbonneau A, Emami E. Dental students' perspectives on rural dental practice: a qualitative study. J Can Dent Assoc. 2015;81:f23.

20. dela Cruz GG, Rozier RG, Slade G. Dental screening and referral of young children by pediatric primary care providers. Pediatrics. 2004;114(5):e642-52.

21. Jalil A, Zakar R, Zakar MZ, Fischer F. Patient satisfaction with doctor-patient interactions: a mixed methods study among diabetes mellitus patients in Pakistan. BMC Health Serv Res. 2017;17(1):155.
22. Emami E, Kadoch N, Homayounfar S, Harnagea H, Dupont P, Girareau N, et al. Patient satisfaction with E-Oral Health care in rural and remote settings: a systematic review protocol. Syst Rev. 2017;6(1):174.

23. Mariño R, Ghanim A. Teledentistry: a systematic review of the literature. J Telemed Telecare. 2013;19(4):179-83.

24. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

25. Cochrane Effective Practice and Organisation of Care (EPOC). Data collection form. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2017. http://epoc.cochrane.org/epoc-specific-resources-review-authors. Accessed 18 Mar 2020.

26. Sterne JAC, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.

27. Centre for Reviews and Dissemination. Systematic reviews- centre for reviews and dissemination's guidance for undertaking reviews in health care. York, UK: University of York; 2009.

28. Haidich AB. Meta-analysis in medical research. Hippokratia. 2010;14(Suppl 1):29-37.

29. Patterson S, Botchway C. Dental screenings using telehealth technology: a pilot study. J Can Dent Assoc. 1998;64(11):806-10.

30. Scuffham PA, Steed M. An economic evaluation of the Highlands and Islands teledentistry project. J Telemed Telecare. 2002;8(3):165-77.

31. Ignatius E, Perälä S, Mäkelä K. Use of videoconferencing for consultation in dental prosthetics and oral rehabilitation. J Telemed Telecare. 2010;16(8):467-70.

32. Herce J, Lozano R, Salazar CI, Rollon A, Mayorga F, Gallana S. Management of impacted third molars based on telemedicine: a pilot study. J Oral Maxillofac Surg. 2011;69(2):471-5.

33. Salazar-Fernandez CI, Herce J, Garcia-Palma A, Delgado J, Martín JF, Soto T. Telemedicine as an effective tool for the management of temporomandibular joint disorders. J Oral Maxillofac Surg. 2012;70(2):295-301.

34. Birur PN, Sunny SP, Jena S, Kandasarma U, Raghavan S, Ramaswamy B, et al. Mobile health application for remote oral cancer surveillance. J Am Dent Assoc. 2015;146(12):886-94.

35. Mariño R, Tonmukayakul U, Manton D, Stranieri A, Clarke K. Cost-analysis of teledentistry in residential aged care facilities. J Telemed Telecare. 2016;22(6):326-32.

36. Wood EW, Strauss RA, Janus C, Carrico CK. The use of telemedicine in oral and maxillofacial surgery. J Oral Maxillofac Surg. 2016;74(4):719-28.

37. Wood EW, Strauss RA, Janus C, Carrico CK. Telemedicine consultations in oral and maxillofacial surgery: a follow-up study. J Oral Maxillofac Surg. 2016;74(2):262-8.

38. Petruzzi M, De Benedittis M. WhatsApp: a telemedicine platform for facilitating remote oral medicine consultation and improving clinical examinations. Oral Surg Oral Med Oral Pathol Oral Radiol. 2016;121(3):248-54.

39. Purohit BM, Singh A, Dwivedi A. Utilization of teledentistry as a tool to screen for dental caries among 12-year-old school children in a rural region of India. J Public Health Dent. 2016;77(2):174-80.

40. Estai M, Bunt S, Kanagasingam Y, Tennant M. Cost savings from a teledentistry model for school dental screening: an Australian health system perspective. Aust Health Rev. 2017;42(5):482-90.

41. Teoh J, Hsueh A, Mariño R, Manton D, Hallett K. Economic Evaluation of Teledentistry in Cleft Lip and Palate Patients. Telemed J E Health. 2018;24(6):449-56.

42. Tynan A, Deeth L, McKenzie D. An integrated oral health program for rural residential aged care facilities: a mixed methods comparative study. BMC Health Serv Res. 2018;18(1):515.

43. Tynan A, Deeth L, McKenzie D, Bourke C, Stenhouse S, Pitt J, et al. Integrated approach to oral health in aged care facilities using oral health practitioners and teledentistry in rural Queensland. Aust J Rural Health. 2018;26:290-4.

44. Vinayagamoorthy K, Acharya S, Kumar M, Pentapati KC, Acharya S. Efficiency of a remote screening model for oral potentially malignant disorders using a free messaging application: a diagnostic test for accuracy study. Aust J Rural Health. 2019;27(2):170-6.

45. Centre for Evidence-Based Medicine. Levels of evidence. Oxford: Oxford Centre for Evidence-Based Medicine; 2009. https://www.cebm.ox.ac.uk/resources/levels-of-evidence/oxford-centre-for-evidence-based-medicine-levels-of-evidence-march-2009. Accessed 20 Oct 2020.

46. Alhozgi A, Feine JS, Tanwir F, Shrivastava R, Galarneau C, Emami E. Rural-urban disparities in patient satisfaction with oral health care: a provincial survey. BMC Oral Health. 2021;21(1):261.

47. Akbar F, Pratiwi R, Samad R, Fanissa F. Patient satisfaction on health service center in urban and rural area. Adv Health Sci Res. 2017;2:92-9.

48. Ntabaye MK, Scheutz F, Poulsen S. Patient satisfaction with emergency oral health care in rural Tanzania. Community Dent Oral Epidemiol. 1998;26(5):289-95.

49. Bansal M, Gupta N, Saini GK, Sharma N. Satisfaction level among patients visiting a rural dental institution toward rendered dental treatment in Haryana. North India J Educ Health Promot. 2018;7:81.

50. Estai M, Kanagasingam Y, Tennant M, Bunt S. A systematic review of the research evidence for the benefits of teledentistry. J Telemed Telecare. 2018;24(3):147-56.

51. Fernández CE, Maturana CA, Coloma SI, Carrasco-Labra A, Giacaman RA. Teledentistry and mHealth for promotion and prevention of oral health: a systematic review and meta-analysis. J Dent Res. 2021;100(9):914-27.

52. Gurgel-Juarez N, Torres-Pereira C, Haddad AE, Sheehy L, Finestone H, Mallet K, et al. Accuracy and effectiveness of teledentistry: a systematic review of systematic reviews. Evid Based Dent. 2022;23(3):1-8.

53. Alabdullah JH, Daniel SJ. A systematic review on the validity of teledentistry. Telemed J E Health. 2018;24(8):639-48.

54. Irving M, Stewart R, Spallek H, Blinkhorn A. Using teledentistry in clinical practice as an enabler to improve access to clinical care: a qualitative systematic review. J Telemed Telecare. 2018;24(3):129-46.

55. Banbury A, Roots A, Nancarrow S. Rapid review of applications of e-health and remote monitoring for rural residents. Aust J Rural Health. 2014;22(5):211-22.

56. Rygh EM, Hjortdahl P. Continuous and integrated health care services in rural areas. A literature study. Rural Remote Health. 2007;7(3):766.

57. LeBlanc M, Petrie S, Paskaran S, Carson DB, Peters PA. Patient and provider perspectives on eHealth interventions in Canada and Australia: a scoping review. Rural Remote health. 2020;20(3):5754.

58. Légifrance. Section 1- Télémédecine, Article L.6316-1 du code de la santé publique Paris, France: Légifrance- Legal and Administrative Information Department; updated July 2019. https://www.legifrance.gov.fr/codes/article_lc/LEGIARTI000038887059/#:~:text=La%20t%C3%A9l%C3%A9m%C3%A9decine%20est%20une%20forme,information%20et%20de%20la%20communication.&text=La%20d%C3%A9finition%20des%20actes%20de,%C5%93uvre%20sont%20fix%C3%A9s%20par%20d%C3%A9cret. Accessed on 18 Feb 2021.

59. World Health Organization, International Telecommunication Union. Report of the Global mOralHealth Workshop, 10-12 October 2018, Montpellier, France. Geneva: World Health Organization; 2019.

60. Thomson H, Craig P, Hilton-Boon M, Campbell M, Katikireddi SV. Applying the ROBINS-I tool to natural experiments: an example from public health. Syst Rev. 2018;7(1):15.

## Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Ready to submit your research? Choose BMC and benefit from:

* fast, convenient online submission

* thorough peer review by experienced researchers in your field

* rapid publication on acceptance

* support for research data, including large and complex data types

* gold Open Access which fosters wider collaboration and increased citations

* maximum visibility for your research: over 100M website views per year

At BMC, research is always in progress.

Learn more biomedcentral.com/submissions

<figure><img src="image_4.png" /></figure>