# Smile Aesthetic Evaluation on Videographs: An Intra-Rater and Inter-Rater Agreement Study

Mathias Faure-Brac, Angéline Antezack, Sebastien Melloul, Mehdi Hadj Saïd, Anne Raskin, Virginie Monnet-Corti

► To cite this version:

Mathias Faure-Brac, Angéline Antezack, Sebastien Melloul, Mehdi Hadj Saïd, Anne Raskin, et al. Smile Aesthetic Evaluation on Videographs: An Intra-Rater and Inter-Rater Agreement Study. Dentistry Journal, 2022, Oral Hygiene, Periodontology and Peri-implant Diseases, 10 (5), pp.87. 10.3390/dj10050087. [hal-03754431](https://hal-03754431)

HAL Id: hal-03754431

https://amu.hal.science/hal-03754431v1

Submitted on 21 Jun 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
Article

# Smile Aesthetic Evaluation on Videographs: An Intra-Rater and Inter-Rater Agreement Study

Mathias Faure-Brac<fnref n="1" />,<fnref n="2" /> ID, Angéline Antezack <fnref n="1" />,<fnref n="2" />,<fnref n="3" /> ID, Sebastien Melloul <fnref n="1" />,<fnref n="2" />, Mehdi Hadj Saïd <fnref n="1" />,<fnref n="2" /> ID,
Anne Raskin <fnref n="1" />,<fnref n="2" />,<fnref n="4" /> ID and Virginie Monnet-Corti <fnref n="1" />,<fnref n="2" />,<fnref n="3" />,* ID

<figure><img src="image_2.png" /></figure>

check for
updates

**Citation:** Faure-Brac, M.; Antezack, A.; Melloul, S.; Hadj Said, M.; Raskin, A.; Monnet-Corti, V. Smile Aesthetic Evaluation on Videographs: An Intra-Rater and Inter-Rater Agreement Study. *Dent. J.* **2022**, *10*, 87. https://doi.org/10.3390/dj10050087

Academic Editor: Nikolaos Gkantidis

Received: 31 March 2022

Accepted: 12 May 2022

Published: 16 May 2022

**Publisher's Note:** MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_3.png" /></figure>

**Copyright:** © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

**Abstract:** The aim of this study was to assess on videographs the intra- and inter-rater reproducibility of the Smile Esthetic Index (SEI) that has been previously validated on photographs. Smile videographs were obtained using a smartphone associated with the Smile Lite MDP mounted on a tripod. They were then randomized and evaluated twice consecutively at a 1-week interval by three periodontists according to the SEI based on 10 variables. Cohen's Kappa and Fleiss' Kappa tests were performed to measure intra- and inter-rater agreement. Sixty-five smile videographs of 24 men and 41 women (mean age 33 ± 11.3 years) were scored. A mean intra-rater agreement of 0.68 (0.64–0.73) was obtained, representing substantial agreement. The inter-rater agreement calculated for each variable ranged from 0.31 for the variable "absence of visible excessive gingiva" to 0.90 for the variable "absence of diastema and/or missing inter-dental papilla." Within the limits of this study, we have demonstrated that it was possible to use videographs to reproducibly evaluate an aesthetic score (SEI) previously validated on photographs.

**Keywords:** aesthetics; smiling; score; periodontics; videography

## 1. Introduction

The smile of patients is a sign of their satisfaction at the end of the treatments but also of their complexes before care. Several studies have shown that the aesthetics of the smile are a major concern for patients and have a significant impact on facial attractiveness [1–3]. Recently, the Smile Esthetic Index (SEI) has been proposed as a reliable and reproducible method to evaluate the aesthetics of a smile using photographs [4,5]. However, the visibility of the periodontium inevitably varies depending on whether the smile is “natural” or “forced” and thus appears difficult to assess objectively on photographs [6,7]. Indeed, when the dentist asks the patient to perform a forced smile in front of the camera lens, the patient displays less periodontium than the actual maximum smile [8].

In plastic and reconstructive surgery, studies [9,10] have evaluated the smile dynamics and soft tissue changes that occur as the face transitions from the resting to the maximum smile position. These studies have shown that the evaluation of the smile should be done on a dynamic capture of this mimic rather than on static captures. Using videographs, Tarantili et al. [11] showed that the average duration of a spontaneous smile was 500 ms, which explains the intrinsic difficulty of capturing this very brief moment on photographs.

<footnote n="1">¹ Faculté des Sciences Médicales et Paramédicales, Ecole de Médecine Dentaire, Aix-Marseille Université, Provence-Alpes-Côte D'azur, 13385 Marseille, France; mathias.faure-brac@univ-amu.fr (M.F.-B.); angeline.antezack@univ-amu.fr (A.A.); dr.melloul@gmail.com (S.M.); mehdi.hadj@yahoo.fr (M.H.S.); anne.raskin@univ-amu.fr (A.R.)</footnote>

<footnote n="2">² Assistance Publique-Hopitaux de Marseille (AP-HM), Hopital Timone, Provence-Alpes-Côte D'azur, 13385 Marseille, France</footnote>

<footnote n="3">³ UMR D-258 Microbes Evolution Phylogénie et Infection (MEPHI), Institut de Recherche Pour Le Développement (IRD), Aix-Marseille Université, Provence-Alpes-Côte D'azur, 13385 Marseille, France</footnote>

<footnote n="4">⁴ UMR 7268 Anthropologie Bio-Culturelle Droit Éthique et Santé, Aix-Marseille Université, Provence-Alpes-Côte D'azur, 13385 Marseille, France</footnote>

<footnote>* Correspondence: virginie.corti@univ-amu.fr; Tel.: +33-486136868</footnote>
However, the patient and his family will judge the aesthetic results of periodontal treatments when the maximum of gum is exposed even though the maximum smile lasts a very short time [12]. Walder et al. [13] compared the use of videographs and photographs to assess the aesthetics of the natural and forced smile. They concluded that videographs provided diagnostic information that cannot be obtained with photographs alone, and also that videographic images should be preferred to still images by professionals. Currently, videographs are used in restorative or prosthetic dentistry as well as in orthodontics to evaluate teeth and their aesthetics during the smile [14–17]. In contrast, in periodontics, gingival aesthetics have been assessed primarily on photographs [5,12]. A recent review of the literature concerning the evaluation of gingival aesthetics after root coverage concluded that recording short videographs before and after surgery rather than using photographs could more accurately unveil the visibility of the periodontium during smiling and speaking and therefore would allow a better aesthetic evaluation of the results [18].

The aim of this study was to assess on videographs the intra- and inter-rater reproducibility of the Smile Esthetic Index (SEI) that has been previously validated on photographs.

## 2. Materials and Methods

This study was approved by our university hospital (Assistance Publique—Hôpitaux de Marseille, AP-HM), under the registration n° 2019-106. An informed consent statement authorizing the anonymous use of the videographs was obtained for each patient.

Patients were selected over a time period of 6 months (from 1 January 2019 to 30 June 2019) according to the following inclusion criteria:

- Age > 18 years.

- Not belonging to a "protected patient" category.

- Healthy and/or reduced periodontium.

- Full dental arch in the maxilla (at least 15 to 25).

- Coming for a consultation at the periodontology department, AP-HM.

The calculation of the sample size (n = 65) was undertaken only to validate on videographs the feasibility of using a score already validated on photographs [4].

Only one investigator (the resident) recorded, edited and numbered the videographs. Three raters (one resident, two teachers in Periodontology) evaluated the videographs according to the SEI (Rotundo et al., 2015).

### 2.1. *Equipment for the Acquisition of Videographs and for Their Editing, Storage and Viewing*

A smartphone (Iphone 8 ©, Apple, Cupertino, CA, USA) was used for the acquisition of videographs. Its lens was positioned in the middle of the Smile Lite MDP ©, (Smile Line, St-Imier, Switzerland), which allows a reproducible condition of light, and both were mounted on a 160 cm tripod with a 360° 3D swivel head (AMZDEAL tripod Camera 160 cm ©, AMAZON, Seattle, WA, USA).

The editing software (Imovie ©, Apple) allowed us to keep the most relevant moments of the videographic sequences.

The videographs were in MPEG-4 format with a resolution display of 1920 × 1080 pixels.

An IPad 2 © (Apple) and a Macbook Pro © (Apple) computer were used to collect the data and to view the videographs.

### 2.2. *Conducting the Standardized Videography*

#### 2.2.1. Position of the Investigator

Sitting in an operator's chair behind the lens at the same height and facing the subject (front position).

#### 2.2.2. Position of the Subject Being Evaluated

At 35 cm from the camera lens, sitting on an operator's chair with the back against the backrest in a straight position, the two feet on the ground, and the bi-pupillary plane parallel to the ground.
After the frontal shot, the investigator rotated the seat so that the subject was in profile (side position) and then ¾ positions [10,15].

## 2.3. Realization of the Shooting: Scenography

To obtain and capture a natural smile but also a large spontaneous smile and laughter, the scenography consisted of 3 steps: (Figure 1)

<figure><img src="image_4.png" /><figcaption>**Figure 1.** Set-up of the acquisition system for recording a videograph.</figcaption></figure>

1. Confidence building and relaxation of the subject: The investigator asked 3 simple questions: What is your name? Where are you from? Why are you here today?

2. Ask the subject to make a natural and a forced smile.

3. Pronunciation by the investigator of 3 funny sentences, asking the subject to repeat them. These included two French tongue twisters: "Les chaussettes de l'archiduchesse sont-elles sèches ou archi-sèches?" "Tes laitues naissent-elles? Yes mes laitues naissent". Two English tongue twisters could also be used: "She sells sea-shells on the sea-shore of Seychelles", and "If Peter Piper picked a peck of pickled peppers, how many pickled peppers would Peter Piper pick?"

To finish, the last sentence was "Pretend to be happy to see me and have a good time" in order to get a smile or even a spontaneous laugh in order to uncover the maximum of visible gum.

This scenography started again from step 2 after each change of position (left side, ¾ left, front, ¾ right, right side positions).

## 2.4. Editing of the Videographs

The aim of the editing was to select the time periods corresponding to the analyzed criteria. Arbitrarily, a duration of 45 s was chosen for the complete video sequence (Supplementary Materials).

## 2.5. Data Collection

The videographs were anonymized and numbered chronologically from 001 to 065.
The questionnaires were available on an online customized Google form (Figure 2) that allowed data collection.

<figure><img src="image_5.png" /><figcaption>**Figure 2.** Smile Esthetic Index questionnaire (Rotundo et al., 2015) customized on Google forms for SEI data collection. The score (with a maximum of 10 points) was calculated as the sum of the marks attributed to each of the 10 answers (yes = 1 point; no = 0 point).</figcaption></figure>

The score (with a maximum of 10 points) was calculated as the sum of the marks attributed to each of the 10 answers: yes = 1 point; no = 0 point.

First, a training phase consisted in watching videographs and understanding each question of the questionnaire by the 3 raters together. Then, separately, each rater watched each video as many times as they wanted with the possibility to stop and go back, and filled in the online Google form.

The calculation of the intra-rater agreement consisted of each rater filling in the online questionnaire on Google forms again, one week after the first evaluation. In order to avoid bias, the order of viewing (and their numbering) of the videographs of the 2 consecutive viewings one week apart was determined using 2 online randomization tables (https://www.randomizer.org/ (accessed on 1 July 2019)) to ensure that the rater did not remember his previous answers.

## 2.6. Statistical Analysis

The statistical analysis was carried out using XLstat software, version 3.1. (Addinsoft®, Bordeaux, France).

Intra-rater agreements of each rater were calculated for each of the 10 questions using Cohen's Kappa tests. In addition, a Fleiss' Kappa test was performed to obtain the inter-rater agreement for each of the 10 questions.

Furthermore, the Cohen's Kappa results were interpreted according to Landis and Koch's scale [19].

Statistically significant difference was set at a *p*-value of 0.05 (*p* < 0.05).

## 3. Results

Our sample consisted of 24 men and 41 women, i.e., 36% men and 64% women. The age of the subjects ranged from 21 to 74 years (mean age 33.0 ± 11.3 years). The average scores of the three raters ranged from 6.51 to 6.72 with an overall mean of 6.64 (Table 1).
<table><caption>**Table 1.** Overall mean scores of each rater for the 10 questions.</caption><thead><tr><th>Question No.</th><th>Rater 1</th><th>Rater 2</th><th>Rater 3</th></tr></thead><tbody><tr><td>1 (correct smile line)</td><td>26</td><td>32</td><td>29</td></tr><tr><td>2 (correct face midline)</td><td>52</td><td>51</td><td>51</td></tr><tr><td>3 (correct tooth/crown alignment)</td><td>25</td><td>22</td><td>20</td></tr><tr><td>4 (absence of visible tooth deformity)</td><td>30</td><td>38</td><td>39</td></tr><tr><td>5 (absence of visible tooth dyschromy)</td><td>46</td><td>48</td><td>45</td></tr><tr><td>6 (absence of visible gingival dyschromy)</td><td>51</td><td>53</td><td>52</td></tr><tr><td>7 (absence of visible gingival recessions)</td><td>39</td><td>39</td><td>42</td></tr><tr><td>8 (absence of visible gingival excess)</td><td>55</td><td>53</td><td>55</td></tr><tr><td>9 (absence of gingival visible scars)</td><td>64</td><td>64</td><td>64</td></tr><tr><td>10 (absence of visible diastema and/or missing inter-dental papillae)</td><td>37</td><td>39</td><td>41</td></tr><tr><td>Mean overall scores on 10 questions</td><td>6.72 ± 0.07</td><td>6.51 ± 0.12</td><td>6.69 ± 0.08</td></tr></tbody></table>

The intra-rater agreement rates of the three raters were 0.73, 0.64 and 0.67 (Table 2), which is considered to be a substantial agreement according to Landis & Koch (Table 3) [19].

<table><caption>**Table 2.** Intra-rater agreement among the three raters for the 10 questions.</caption><thead><tr><th>Questionnaire</th><th>Rater 1</th><th>Rater 2</th><th>Rater 3</th></tr></thead><tbody><tr><td>Mean</td><td>0.73</td><td>0.64</td><td>0.67</td></tr><tr><td>Min</td><td>0.46</td><td>0.30</td><td>0.42</td></tr><tr><td>Max</td><td>1.00</td><td>0.99</td><td>0.98</td></tr></tbody></table>

<table><caption>**Table 3.** Assessment of the level of agreement according to Landis and Koch [19].</caption><thead><tr><th>Strength of Agreement</th><th>Kappa Values</th></tr></thead><tbody><tr><td>Poor</td><td>&lt;0.00</td></tr><tr><td>Slight</td><td>0.00-0.20</td></tr><tr><td>Fair</td><td>0.21-0.40</td></tr><tr><td>Moderate</td><td>0.41-0.60</td></tr><tr><td>Substantial</td><td>0.61-0.80</td></tr><tr><td>Perfect</td><td>0.81-1.00</td></tr></tbody></table>

For the 10 SEI questions, inter-rater variations ranged from 0.31 to 0.90 (p < 0.001). The lowest agreement was obtained for the question assessing the absence of visible excessive gingiva (Fleiss' Kappa = 0.31), whereas the highest agreement (Fleiss' Kappa = 0.90) was obtained for the one assessing the absence of diastema and/or missing inter-dental papilla (Table 4).

<table><caption>**Table 4.** Inter-rater agreement by Fleiss' Kappa test for each of the 10 SEI questions among the three raters.</caption><thead><tr><th>Questions</th><th>Fleiss' Kappa</th><th>p-Value</th></tr></thead><tbody><tr><td>1 (correct smile line)</td><td>0.72</td><td>&lt;0.0001</td></tr><tr><td>2 (correct face midline)</td><td>0.51</td><td>&lt;0.0001</td></tr><tr><td>3 (correct tooth/crown alignment)</td><td>0.55</td><td>&lt;0.0001</td></tr><tr><td>4 (absence of visible tooth deformity)</td><td>0.47</td><td>&lt;0.0001</td></tr><tr><td>5 (absence of visible tooth dyschromy)</td><td>0.73</td><td>&lt;0.0001</td></tr><tr><td>6 (absence of visible gingival dyschromy)</td><td>0.65</td><td>&lt;0.0001</td></tr><tr><td>7 (absence of visible gingival recessions)</td><td>0.69</td><td>&lt;0.0001</td></tr><tr><td>8 (absence of visible gingival excess)</td><td>0.31</td><td>&lt;0.0001</td></tr><tr><td>9 (absence of gingival visible scars)</td><td>0.39</td><td>&lt;0.0001</td></tr><tr><td>10 (absence of visible diastema and/or missing inter-dental papillae)</td><td>0.90</td><td>&lt;0.0001</td></tr></tbody></table>
**4. Discussion**

The analysis of the smile by the periodontist is a key step in better understanding the patient's expectations as well as a tool for diagnosis and establishment of therapeutic proposals. The aesthetics of the smile are based on a global harmony between the labial frame, the gingival frame and the teeth [20]. Beyond its subjective character, the beauty of a smile is evaluated by (a) facial references, (b) criteria related to the teeth and (c) the periodontium such as the smile line, the shape and the colour of the teeth, and the gingival contour [21–23]. Currently, the Smile Esthetic Index, based on the evaluation of 10 variables, is the only reliable and reproducible method to objectively quantify the aesthetic value of a smile [4]. Namely, the absence or presence of each of the 10 variables are scored (0 or 1) and the sum of the 10 scores corresponds to the SEI of the subject (from 0, very bad to 10, very good). To date, the SEI has only been validated on photographs, whereas the recording of short videographs seems to allow a more accurate appreciation of the visibility of the periodontium during the smile and thus a better aesthetic analysis [18].

Our sample consisted of 24 men and 41 women, i.e., 36% men and 64% women. In our study there were more women than men; in fact, our method of recruitment over time reflects the higher proportion of women coming to our periodontal department as shown in a recent study [24].

Our results showed a mean inter-rater agreement of 0.59 (0.31–0.90) and a mean intra-rater agreement of 0.68 (0.64–0.73), demonstrating the feasibility and reproducibility of quantifying the aesthetic value of a smile from videographs. In the original photographic study, Rotundo et al. achieved a mean inter-rater reproducibility of 0.45 (0.17–0.75) based on Fleiss' Kappa for SEI assessment [4]. Our higher agreement results may be partly related to the fact that our study had only three raters whereas Rotundo et al. had ten. In addition, our three raters were exclusively periodontists, whereas the raters in the Rotundo et al. study were more heterogeneous, including periodontists, general dentists, orthodontists and restorative dentists.

In our study, the lowest inter-rater agreement was obtained for the question "absence of visible excessive gingiva" (Fleiss' Kappa = 0.31). In the Rotundo et al. study, the lowest inter-rater agreement was obtained for the question "absence of visible scar" (Fleiss' Kappa = 0.17) [4]. This difference can be explained by the subjectivity of the notion of "excessive" gingiva in our study. On the other hand, Rotundo et al. pointed out the quality of the images used and the fact that only 5% of these images showed the presence of a scar as possible explanations for the low inter-rater agreement. The highest inter-rater agreement was obtained for the question "absence of diastema and/or missing inter-dental papilla" in our study as in the Rotundo et al. study (Fleiss' Kappa = 0.90 and 0.75, respectively). According to Rotundo et al. and our results, we can speculate that videographs can be used for evaluating the SEI as photographs are [4].

Many studies have been conducted in order to determine the parameters of an ideal smile [4,25]. Different aesthetic scores have been proposed and validated using photographs but none, to our knowledge, has been validated using videographs. However, videography is the only means of capturing the amplitudes of movement of the lips as well as the different angles of view of the gingiva, which are very difficult to obtain on a single photograph [26]. Thus, when comparing the diagnostic value of photography and videography in the evaluation of a smile, Walder et al. observed a clear preference of the raters for videography, emphasizing the fact that it gives more information than still images [13]. In addition, photographs of the smile taken on different days exhibited differences in 80% of cases. Videography thus seems to allow a more faithful and reproducible evaluation of the aesthetic criteria of a smile. Chaves et al. evaluated the influence of a maxillary midline diastema on the aesthetic perception of a panel including orthodontists, restorative and prosthetic dentists, and laypersons, using videography [17]. The reliability of their method was confirmed by an intra-class correlation value of 0.81 for orthodontists, 0.73 for restorative and prosthetic specialists, and 0.71 for laypersons.
Videography seems to be a particularly relevant tool in the evaluation of smile aesthet-
ics because it captures a set of mimics rarely visible on simple photographs taken in front of
a practitioner [27]. Furthermore, the patient is accustomed to shooting with a smartphone
in his everyday life. Thus, it is easier to relax the patient in front of a smartphone than in
front of the lens of a more impressive professional camera which creates more “medical”
distance and tenses the mimics. The strength of our study lies in the simplicity of the setting
for recording videos of patients’ smiles. Furthermore, the use of videographs should be
one of the pedagogical tools for the training of future dentists [28] in order to teach them
how to preserve or restore the smile of their patient.

The main limit of this study is the limited number of only three raters, which includes
the investigator who recorded and edited the videographs. This caveat will be corrected in
a future study.

We did not correlate our objective evaluation of the SEI with the patient’s subjective
evaluation and with the oral health criterion [29,30]. This could also be addressed in a
future study. We also observed that the maximum smile in these videographs revealed a
larger amount of gingiva than the forced smile picture.

It would be interesting to quantify the amount of gingival visibility on the videographs
to increase the accuracy of diagnosis and evaluation of aesthetic results. Following this,
the gingival aesthetics during the smile before and after periodontal plastic surgery could
be compared.

**5. Conclusions**

Within the limits of this study, we have demonstrated that it is possible to repro-
ducibly evaluate an aesthetic score (SEI) on videographs which was previously validated
on photographs.

It would be important to correlate the oral health criterion to the assessment of smile
aesthetics for future research. We can also conclude that it is possible to simply make short
videographs of the smile and laughter of our patients with a smartphone associated with
an affordable investment in materials: a Smile Lite and an adjustable tripod. The advantage
of the videograph over the photograph is that it gives us more precise information on the
visibility of the teeth and periodontium during a natural mimicry. Moreover, if necessary,
the pause/capture of some sequences allow us to choose the most relevant snapshot(s) to
evaluate the different aesthetic criteria.

**Supplementary Materials:** The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/dj10050087/s1; Video S1: Videography 1; Video S2: Videography 2.

**Author Contributions:** Conceptualization: V.M.-C., S.M., M.F.-B. Investigation: V.M.-C., S.M., M.F.-B. Software/analysis of data: M.F.-B., M.H.S., A.R. Supervision: V.M.-C., S.M. Writing—original draft: M.F.-B., A.A. Writing—review and editing: M.F.-B., A.A., V.M.-C. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Institutional Review Board Statement:** The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of ASSISTANCE PUBLIQUE-HÔPITAUX DE MARSEILLE, AP-HM (protocol code 2019-106 in 2019).

**Informed Consent Statement:** Informed consent was obtained from all subjects involved in the study.

**Data Availability Statement:** The data presented in this study are available in Supplementary Materials.

**Acknowledgments:** We would like to thank Basheer Khadaroo for the English translation.

**Conflicts of Interest:** The authors declare no conflict of interest.
## References

1. Dong, J.K.; Jin, T.H.; Cho, H.W.; Oh, S.C. The Esthetics of the Smile: A Review of Some Recent Studies. *Int. J. Prosthodont.* **1999**, *12*, 9–19. [PubMed]

2. Sriphadungporn, C.; Chamnannidiadha, N. Perception of Smile Esthetics by Laypeople of Different Ages. *Prog. Orthod.* **2017**, *18*, 1–8. [CrossRef] [PubMed]

3. Al-Lahham, A.; Souza, P.H.C.; Miyoshi, C.S.; Ignacio, S.A.; Meira, T.M.; Tanaka, O.M. An Eye-Tracking and Visual Analogue Scale Attractiveness Evaluation of Black Space between the Maxillary Central Incisors. *Dent. Press J. Orthod.* **2021**, *26*, 1–27. [CrossRef] [PubMed]

4. Rotundo, R.; Nieri, M.; Bonaccini, D.; Mori, M.; Lamberti, E.; Massironi, D.; Giachetti, L.; Franchi, L.; Venezia, P.; Cavalcant, R.; et al. The Smile Esthetic Index (SEI): A Method to Measure the Esthetics of the Smile. An Intra-Rater and Inter-Rater Agreement Study. *Eur. J. Oral Implantol.* **2015**, *8*, 397–403.

5. Rotundo, R.; Genzano, L.; Nieri, M.; Covani, U.; Peñarrocha-Oltra, D.; Peñarrocha-Diago, M. Smile Esthetic Evaluation of Mucogingival Reconstructive Surgery. *Odontology* **2021**, *109*, 295–302. [CrossRef]

6. Sepolia, S.; Sepolia, G.; Kaur, R.; Gautam, D.K.; Jindal, V.; Gupta, S.C. Visibility of Gingiva-An Important Determinant for an Esthetic Smile. *J. Indian Soc. Periodontol.* **2014**, *18*, 488–492. [CrossRef]

7. Liébart, M.F.; Fouque-Deruelle, C.; Santini, A.; Dillier, F.L.; Monnet-Corti, V.; Glise, J.M.; Borghetti, A. Smile Line and Periodontium Visibility. *Periodontal Pract. Today* **2004**, *1*, 17–25.

8. Coachman, C. Dynamic Documentation of the Smile and the 2D/3D Digital Smile Design Process. *Int. J. Periodontics Restor. Dent.* **2017**, *37*, 183–193. [CrossRef]

9. Rubin, L.R. The Anatomy of a Smile: Its Importance in the Treatment of Facial Paralysis. *Plast. Reconstr. Surg.* **1974**, *53*, 384–387. [CrossRef]

10. Paletz, J.L.; Manktelow, R.T.; Chaban, R. The Shape of a Normal Smile: Implications for Facial Paralysis Reconstruction. *Plast. Reconstr. Surg.* **1994**, *93*, 784–791. [CrossRef]

11. Tarantili, V.V.; Halazonetis, D.J.; Spyropoulos, M.N. The Spontaneous Smile in Dynamic Motion. *Am. J. Orthod. Dentofac. Orthop.* **2005**, *128*, 8–15. [CrossRef] [PubMed]

12. Cairo, F.; Pagliaro, U.; Buti, J.; Baccini, M.; Graziani, F.; Tonelli, P.; Pagavino, G.; Tonetti, M.S. Root Coverage Procedures Improve Patient Aesthetics. A Systematic Review and Bayesian Network Meta-Analysis. *J. Clin. Periodontol.* **2016**, *43*, 965–975. [CrossRef] [PubMed]

13. Walder, J.F.; Freeman, K.; Lipp, M.J.; Nicolay, O.F.; Cisneros, G.J. Photographic and Videographic Assessment of the Smile: Objective and Subjective Evaluations of Posed and Spontaneous Smiles. *Am. J. Orthod. Dentofac. Orthop.* **2013**, *144*, 793–801. [CrossRef] [PubMed]

14. Sarver, D.M.; Ackerman, M.B. Dynamic Smile Visualization and Quantification: Part 1. Evolution of the Concept and Dynamic Records for Smile Capture. *Am. J. Orthod Dentofac. Orthop.* **2003**, *124*, 4–12. [CrossRef]

15. Sarver, D.M.; Ackerman, M.B. Dynamic Smile Visualization and Quantification: Part 2. Smile Analysis and Treatment Strategies. *Am. J. Orthod. Dentofac. Orthop.* **2003**, *124*, 116–127. [CrossRef]

16. Desai, S.; Upadhyay, M.; Nanda, R. Dynamic Smile Analysis: Changes with Age. *Am. J. Orthod. Dentofac. Orthop.* **2009**, *136*, 1–10. [CrossRef]

17. Chaves, P.R.B.; Karam, A.M.; Machado, A.W. Does the Presence of Maxillary Midline Diastema Influence the Perception of Dentofacial Esthetics in Video Analysis? *Angle Orthod.* **2021**, *91*, 54–60. [CrossRef]

18. Mounssif, I.; Stefanini, M.; Mazzotti, C.; Marzadori, M.; Sangiorgi, M.; Zucchelli, G. Esthetic Evaluation and Patient-Centered Outcomes in Root-Coverage Procedures. *Periodontol. 2000* **2018**, *77*, 19–53. [CrossRef]

19. Landis, J.R.; Koch, G.G. The Measurement of Observer Agreement for Categorical Data. *Biometrics* **1977**, *33*, 159–174. [CrossRef]

20. Garber, D.A.; Salama, M.A. The Aesthetic Smile: Diagnosis and Treatment. *Periodontol. 2000* **1996**, *11*, 18–28. [CrossRef]

21. Margossian, P.; Laborde, G.; Koubi, S.; Tardivo, D.; Magne, P. Determination of Facial References for Esthetic Restorative Treatment. *Int J. Periodontics Restor. Dent.* **2021**, *41*, 113–119. [CrossRef] [PubMed]

22. Montero, J.; Gómez-Polo, C.; Santos, J.A.; Portillo, M.; Lorenzo, M.C.; Albaladejo, A. Contributions of Dental Colour to the Physical Attractiveness Stereotype. *J. Oral Rehabil.* **2014**, *41*, 768–782. [CrossRef] [PubMed]

23. Charruel, S.; Perez, C.; Foti, B.; Camps, J.; Monnet-Corti, V. Gingival Contour Assessment: Clinical Parameters Useful for Esthetic Diagnosis and Treatment. *J. Periodontol.* **2008**, *79*, 795–801. [CrossRef] [PubMed]

24. Varela-Centelles, P.; Diz-Iglesias, P.; Estany-Gestal, A.; Blanco-Hortas, A.; Bugarín-González, R.; Seoane-Romero, J.M. Regular Dental Attendance and Periodontal Health Knowledge: A Cross-sectional Survey. *Oral Dis.* **2020**, *26*, 419–428. [CrossRef]

25. Le Roch, S.; Rouche, F.; Valet, F.; Bouchard, P.; the ESCAPE group; Abrahamsson, I.; Artzi, Z.; Asbi, T.; Balta, M.G.; Bizzarro, S.; et al. European Survey on Criteria of Aesthetics for Periodontal Evaluation: The ESCAPE Study. *J. Clin. Periodontol* **2019**, *46*, 1116–1123. [CrossRef]

26. Khan, M.; Kazmi, S.M.R.; Khan, F.R.; Samejo, I. Analysis of different characteristics of smile. *BDJ Open* **2020**, *6*, 1–5. [CrossRef]

27. Cairo, F.; Barootchi, S.; Tavelli, L.; Barbato, L.; Wang, H.; Rasperini, G.; Graziani, F.; Tonetti, M. Aesthetic-And Patient-related Outcomes Following Root Coverage Procedures: A Systematic Review and Network Meta-analysis. *J. Clin. Periodontol.* **2020**, *47*, 1403–1415. [CrossRef]
28. Aldhuwayhi, S. Perceptions of dental aesthetics among future Arabian oral health care professions: A cross-sectional study. *Rev. Argentina Clin. Psicol.* **2021**, *2*, 948-954. [CrossRef]

29. Ulu Güzel, K.G.; Akyildiz, M.; Doğusal, G.; Keleş, S.; Sönmez, I. Evaluation of oral health status of children in pretreatment and after treatment for 18 month. *Cent. Eur. J. Public Health* **2018**, *2*, 199-203. [CrossRef]

30. Guo, S.; Chen, Y.; Mallineni, S.K.; Huang, S.; Liu, B.; Zhang, S.; Lu, C. Feasibility of oral health evaluation by intraoral digital photography: A pilot study. *Int. J. Med. Res.* **2021**, *49*, 1-8. [CrossRef]