# An Ultra-Short Measure of Excessive Daytime Sleepiness Is Related to Circadian Biological Rhythms: The French Psychometric Validation of the Barcelona Sleepiness Index.

Julien Coelho, Régis Lopez, Jacques Taillard, Emmanuel d'Incau, Guillaume

Fond, Pierre Philip, Jean Arthur Micoulaud Franchi

► To cite this version:

Julien Coelho, Régis Lopez, Jacques Taillard, Emmanuel d'Incau, Guillaume Fond, et al. An Ultra-Short Measure of Excessive Daytime Sleepiness Is Related to Circadian Biological Rhythms: The French Psychometric Validation of the Barcelona Sleepiness Index. Journal of Clinical Medicine, 2022, 11 (13), 10.3390/jcm11133892. doi:10.3390/jcm11133892

HAL Id: hal-04056296

https://hal.science/hal-04056296

Submitted on 3 Apr 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

Article

# An Ultra-Short Measure of Excessive Daytime Sleepiness Is Related to Circadian Biological Rhythms: The French Psychometric Validation of the Barcelona Sleepiness Index

Julien Coelho<sup>1,2,3,*</sup>, Régis Lopez<sup>4,5</sup>, Jacques Taillard<sup>1,2</sup> <sup>●</sup>, Emmanuel D'Incau<sup>2,3</sup> <sup>●</sup>, Guillaume Fond<sup>6,7</sup>, Pierre Philip<sup>1,2,3</sup> and Jean-Arthur Micoulaud-Franchi<sup>1,2,3</sup>

<figure><img src="image_3.png" /></figure>

check for
updates

**Citation:** Coelho, J.; Lopez, R.; Taillard, J.; D'Incau, E.; Fond, G.; Philip, P.; Micoulaud-Franchi, J.-A. An Ultra-Short Measure of Excessive Daytime Sleepiness Is Related to Circadian Biological Rhythms: The French Psychometric Validation of the Barcelona Sleepiness Index. *J. Clin. Med.* **2022**, *11*, 3892. https://doi.org/10.3390/jcm11133892

Academic Editor: Pierre A. Geoffroy

Received: 18 May 2022

Accepted: 16 June 2022

Published: 4 July 2022

**Publisher's Note:** MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_4.png" /></figure>

**Copyright:** © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

**Abstract:** The Barcelona Sleepiness Index (BSI) is an ultra-short instrument with several advantages for assessing excessive daytime sleepiness (EDS). The present study was performed to analyze the validity of the French version of the BSI in screening for EDS. We conducted a cross-sectional study on a population of students using an online questionnaire. The French version of the BSI was developed by a rigorous forward-backward translation process. We computed the discrimination properties of the BSI to predict EDS assessed by the Epworth Sleepiness Scale (ESS), as well as correlations with other sleep measures. In total, 662 students were enrolled in the study (mean age: 20.9 years, 76.0% women). The BSI score (mean = 1.5 ± 1.0) showed a strong correlation with the ESS score ($r = 0.47, p < 10^{-4}$) and acceptable discrimination of EDS assessed by ESS score $\ge 11$ (AUC = 0.742) with an optimal cutoff point of 2, as in the original study. The BSI score was significantly associated with sleep deprivation and social jetlag. Therefore, the French version of the BSI is a valid ultra-short instrument for EDS screening in individuals. In addition, the BSI score may be associated with both homeostatic and circadian processes. Further studies are needed to confirm these findings in general populations and in patients with sleep disorders.

**Keywords:** sleep; patient health questionnaire; sleepiness; circadian rhythm; psychometrics

## 1. Introduction

Excessive daytime sleepiness (EDS) is widespread in the general population [1], constitutes a common symptom of sleep disorders [2], and is associated with poor physical and mental health outcomes [3]. The severity of EDS can be objectively evaluated using direct electrophysiological recordings or indirect behavioral measures [4]; it can be subjectively evaluated using questionnaires [5-7]. Objective evaluations are suitable for clinical practice or research settings, while subjective evaluations are suitable for the assessment of sleepiness in epidemiological settings. The Epworth Sleepiness Scale (ESS), which consists of a questionnaire with questions related to the respondent's propensity to fall asleep in eight specific situations scored on a scale of 0-3, is the most widely used and validated scale

<footnote n="1">1. Mixed Research Unit (UMR) 6033, Health Department, Medical Sciences, Sleep, Addiction, Neuropsychiatry (SANPSY), Bordeaux University, F-33000 Bordeaux, France; jacques.taillard@u-bordeaux.fr (J.T.); pierre.philip@u-bordeaux.fr (P.P.); jean-arthur.micoulaud-franchi@u-bordeaux.fr (J.-A.M.-F.)</footnote>

<footnote n="2">2. National Center for Scientific Research (CNRS), SANPSY, UMR 6033, F-33000 Bordeaux, France; edincau@free.fr</footnote>

<footnote n="3">3. CHU Bordeaux, University Department of Sleep Medicine, CHU Bordeaux, F-33000 Bordeaux, France</footnote>

<footnote n="4">4. Sleep Disorders Center, Department of Neurology, Gui-de-Chauliac Hospital, CHU Montpellier, F-34000 Montpellier, France; r-lopez@chu-montpellier.fr</footnote>

<footnote n="5">5. INSERM U1061, Université Montpellier 1, F-34000 Montpellier, France</footnote>

<footnote n="6">6. EA 3279: CERESS—Centre d'Etude et de Recherche sur les Services de Santé et la Qualité de Vie, Marseille University, F-13000 Marseille, France; guillaume.fond@gmail.com</footnote>

<footnote n="7">7. Hôpital La Conception, Assistance Publique des Hôpitaux de Marseille, F-13000 Marseille, France</footnote>

<footnote>* Correspondence: julien_coelho78@hotmail.fr; Tel.: +33-(0)6-4570-6212</footnote>
used for this purpose [5,8]. The questionnaire is easy to complete, differentiates among levels of EDS, and is sensitive to treatment-induced changes [9]. However, the design of the ESS has been criticized because some items are excessively general or almost identical; moreover, the total score focuses on sleep propensity, which is a subtype of EDS [10]. In addition, questionnaires that show stronger correlations with objective sleepiness tests would be useful [9], and the ESS does not consider variations in sleepiness throughout the day. Indeed, EDS reportedly has circadian rhythmicity based on subjective ratings [11] and electrophysiological recordings [12]; it should be systematically evaluated while considering the time of day. Circadian biological rhythms have demonstrated correlations with sleep and health outcomes; thus, they are important to consider in evaluations of sleep-wake disturbances [3]. The Time-Of-Day Sleepiness Scale (TODSS)—a long (24-item) scale that divides the ESS items and scores into the morning, afternoon, and evening categories—was created for this purpose [13]. Finally, despite its short length, the ESS may be excessively long for patients with sleep disturbances that can interfere with cognitive performance and attention [14]. The use of ultra-short questionnaires should be favored in such populations.

In recent decades, questionnaire design has improved with the establishment of focus groups during the design process [15]. The involvement of such groups allows the identification of real concerns of a specific group of people; it also considers the actual language and expressions used by these people, while reflecting a consensus among members of that group. The Barcelona Sleepiness Index (BSI) was developed and validated using this rigorous methodology in a three-step process [16]. Initially, 138 situations that could cause sleepiness were identified using focus groups. Then, 16 items were selected based on their psychometric properties. Finally, the BSI was developed from the two items that showed the greatest ability to predict objective sleepiness [16]. This screening instrument has several advantages. First, it is an ultra-short instrument that consists of only two items; such brevity and simplicity ensure fair and accessible use in the general population [17]. Second, it explores EDS while considering circadian biological rhythms through the examination of individuals in both the morning and afternoon [16]. Third, it shows stronger correlations with objective measures of sleepiness, compared with the ESS; it also has sufficient sensitivity to detect changes [16].

Considering the differences among populations in terms of medical conditions, as well as cultural and demographic factors (reflected in the variable cutoffs of questionnaires in different studies), the BSI should be validated for each language. Although French is the sixth most widely spoken language with 300 million speakers worldwide, the psychometric properties of the BSI have not been investigated in French-speaking adults. The present study was performed to analyze the validity of a French version of the BSI in screening for EDS after rigorous translation and validation with regard to sleep-wake timing, sleep disturbances, and mental health outcomes.

## 2. Materials and Methods

### 2.1. *Setting and Participants*

This cross-sectional study was conducted between December 2019 and January 2020 in a study population that consisted of medical students from Bordeaux University; such students represent a population at low risk of sleep breathing disorders but with high levels of EDS because of chronic sleep deprivation and circadian misalignment [18]. Various solicitation channels (e.g., email, management, and flyers) were used to maximize the response rate. The participants were informed of the research objective to evaluate sleep and asked to complete an Internet-based questionnaire.

### 2.2. *Research Tools*

The following sociodemographic data were recorded: age, sex, and year of study. The BSI is an ultra-short scale that evaluates EDS with scores of 0 (No), 1 (Yes, I feel sleepy BUT I do not fall asleep), 2 (Yes, I feel sleepy AND I fall asleep), or 3 (Yes, I fall asleep unexpectedly) for two items that explore different sleepiness-related situations
(relaxing and standing inactive) at different times of day (morning and afternoon) [16]. The original version found that a cutoff score of ≥2 indicated severe EDS. The French version of the BSI was developed using a forward-backward translation method by two independent native French speakers and two independent native English speakers. We ensured the clarity and cultural acceptability of the French version of the BSI in a French student population by administering the instrument to 10 students. This preliminary test revealed no difficulties in understanding the items of the French BSI. No adaptations were required. The version of the French BSI used in this study is shown in Table 1. The score ranged from 0 to 6. Daytime disturbances assessed by the ESS and the Toronto Hospital Alertness Test (THAT) were used for convergent concurrent validation of the BSI [8,19]. The THAT is a 10-item self-reported questionnaire rated on a 6-point Likert scale, which is designed to measure perceived alertness during daytime; higher scores indicate greater alertness. A French version obtained after a rigorous translation process is available on sleepontario.com. Each scale referred to an EDS subtype: the ESS explored sleep propensity (similar to the BSI), while the THAT assessed alertness (the opposite of drowsiness). For divergent concurrent validation, insomnia symptoms were assessed with the Insomnia Severity Scale (ISI) [20], while anxiety and depressive symptoms were measured using the Patient Health Questionnaire 4 (PHQ-4) scale, a short 4-item instrument rated on a 3-point Likert scale with two items for each mental health symptom. A score ≥3 was considered indicative of anxiety or depressive symptoms [21]. Sleep-wake timing was studied for external validation of the BSI to investigate the impact of sleep deprivation and disrupted circadian biological rhythms on the BSI scores. The questions were based on the Munich ChronoType Questionnaire [22]. Participants were asked what time they usually went to bed (bedtime, "What time do you usually go to bed at night?") and got up (rise time, "What time do you usually get up in the morning?") and how many hours of actual sleep they achieved (sleep duration, "How many hours of actual sleep do you get at night?") on workdays and on free days. These answers were then used to estimate their mean sleep efficiency (ratio of sleep duration over time-in-bed, defined as the difference between bedtime and rise time) [23]; their mean sleep duration (including workdays and free days), was regarded as a proxy for their homeostatic-dependent process; and their social jetlag (defined as the time difference between mid-sleep on workdays and mid-sleep on free days, with mid-sleep as the median between bedtime and rise time) [24], regarded as a proxy for their circadian-dependent process. Sleep deprivation was defined as <7 h per night on workdays, as recommended by the National Sleep Foundation [25]. Social jetlag with a shift of ≥2 h was considered significant [26].

<table><caption>**Table 1.** French translation and description of the Barcelona Sleepiness Index (n = 662).</caption><thead><tr><th></th><th></th><th></th><th></th><th></th><th></th></tr></thead><tbody><tr><td>These questions refer to the sleepiness experienced during recent weeks</td><td>No</td><td>Yes, I feel sleepy BUT I do not fall asleep</td><td>Yes, I feel sleepy AND I fall asleep</td><td>Yes, I fall asleep unexpectedly</td></tr><tr><td>Ces questions font référence à la somnolence ressentie dans les semaines précédentes</td><td>Non</td><td>Oui, Je me sens somnolent-e MAIS je ne m'endors Pas</td><td>Oui, je me sens Somnolent-e ET je m'endors</td><td>Oui, je m'endors subitement</td></tr><tr><td>In the morning, when relaxing</td><td>Le matin, en se reposant</td><td>228 (34.4%)</td><td>323 (48.8%)</td><td>102 (15.4%)</td><td>9 (1.4%)</td></tr><tr><td>In the afternoon, when standing, inactive in a public place (waiting to be served, or for the bus, subway, or a friend, etc.)</td><td>Dans l'après-midi, en se tenant debout, inactif-ve dans un lieu public (en faisant la queue, ou en attendant le bus, le métro, ou un ami, etc.)</td><td>266 (40.2%)</td><td>356 (53.8%)</td><td>38 (5.7%)</td><td>2 (0.3%)</td></tr></tbody></table>
## 2.3. Statistical Analysis

Data analysis was performed using R, version 4.1.2 (R Foundation for Statistical Computing, Vienna, Austria). Descriptive statistics were calculated as frequencies (%) for categorical variables and as means ± standard deviations for continuous variables. First, prediction by the BSI of EDS assessed by the ESS was evaluated by receiver operating characteristic analyses and areas under the curve (AUCs). Two ESS score cutoff points were considered (≥11 for significant EDS and ≥16 for severe EDS). We hypothesized acceptable discrimination (AUC 0.7–0.8), consistent with the original validation study [16]. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and Youden index (YI) were computed. The cutoff point that maximized the YI was regarded as the best performance. We expected a cutoff point of 2, consistent with the original study [16]. Then, we estimated correlations of the BSI score with sleep and mental health outcomes, using Pearson's correlation coefficient with a significance level of 5%. To control for the increase in type I error associated with multiple comparisons, all *p*-values were corrected by the Benjamini–Hochberg method [27]. We estimated correlations of the BSI score with daytime disturbances assessed by the ESS and the THAT. We hypothesized medium (>0.4) to high (>0.6) degrees of correlation, consistent with the original convergent concurrent validation study [16,28]. We estimated correlations of the BSI score with insomnia, anxiety, and depressive symptoms (ISI and PHQ-4). We hypothesized low (>0.2) to medium (>0.4) degrees of correlation, consistent with previous divergent concurrent ESS validations [29,30]. For the BSI external validation process, we specifically analyzed the correlations of the global BSI score and the two separate BSI items (morning and afternoon) with sleep-wake timing, specifically mean sleep duration (hh:mm) and social jetlag (hh:mm). For comparison, correlations with ESS and THAT scores were also calculated.

# 3. Results

## 3.1. Sample Description

The study population consisted of 662 students, representing 13.8% of the theoretical enrollment of 4807 students in the first and second cycles of medical studies at Bordeaux University. The mean age of the participants was 20.9 years (standard deviation = 2.6 years), 76.0% were women, and 41.4% were freshmen (first year of study). Typical sleep-wake timings were 23:30 to 07:34 on workdays with 7 h 25 min of sleep and 23:57 to 09:07 on free days with 8 h 20 min of sleep (Supplementary Materials Figure S1). In total, 180 students (27.2%) were classified as sleep-deprived (<7 h) and 68 (10.3%) had significant social jetlag (≥2 h). Additional information concerning sleep-wake timing, sleep disturbances, and mental health outcomes are presented in Table 2. The BSI score ranged from 0 to 6 with a mean of 1.5 (±1.0); 309 students (46.7%) had a score ≥2 (Figure 1).

<table><caption>**Table 2.** Descriptive characteristics (n = 662).</caption><thead><tr><th></th><th>Total<br>n = 662</th><th>Mean ± Standard Deviation<br>(Min:Max)</th></tr></thead><tbody><tr><td>Age (years)</td><td></td><td>20.9 ± 2.6 (16:35)</td></tr><tr><td>Sex</td><td></td><td></td></tr><tr><td>Male</td><td>159 (24.0%)</td><td></td></tr><tr><td>Female</td><td>503 (76.0%)</td><td></td></tr><tr><td>Year of study</td><td></td><td></td></tr><tr><td>Freshmen</td><td>274 (41.4%)</td><td></td></tr><tr><td>Others</td><td>388 (58.6%)</td><td></td></tr><tr><td>Bedtime on workdays (hh:mm)</td><td></td><td>23:30 ± 51 min</td></tr><tr><td>Rise time on workdays (hh:mm)</td><td></td><td>07:34 ± 45 min</td></tr></tbody></table>
<table><caption>**Table 2.** *Cont.*</caption><thead><tr><th></th><th>Total<br>n = 662</th><th>Mean ± Standard Deviation<br>(Min:Max)</th></tr></thead><tbody><tr><td>Sleep duration on workdays (hh:mm)</td><td></td><td></td></tr><tr><td>– 7 h</td><td>482 (72.8%)</td><td rowspan="3">7 h 25 ± 54 min</td></tr><tr><td>– 6–7 h</td><td>144 (21.8%)</td></tr><tr><td>– &lt;6 h</td><td>36 (5.4%)</td></tr><tr><td>Bedtime on free days (hh:mm)</td><td></td><td>23:57 ± 68 min</td></tr><tr><td>Rise time on free days (hh:mm)</td><td></td><td>09:07 ± 76 min</td></tr><tr><td>Sleep duration on free days (hh:mm)</td><td></td><td>8 h 27 ± 100 min</td></tr><tr><td>Mean sleep duration (hh:mm)</td><td></td><td>7 h 43 ± 53 min</td></tr><tr><td>Mean sleep efficiency (mean percentage)</td><td></td><td></td></tr><tr><td>– &lt;85%</td><td>17 (2.6%)</td><td rowspan="3">92% ± 3% (73%:97%)</td></tr><tr><td>– 85–95%</td><td>566 (85.5%)</td></tr><tr><td>– ≥95%</td><td>79 (11.9%)</td></tr><tr><td>Social jetlag (hh:mm)</td><td></td><td></td></tr><tr><td>– Significant (≥2 h)</td><td>68 (10.3%)</td><td>55 ± 47 min (–85:225)</td></tr><tr><td>Insomnia Severity Scale (ISI)</td><td></td><td></td></tr><tr><td>– Score ≥ 15</td><td>146 (22.0%)</td><td>10.1 ± 5.3 (0:28)</td></tr><tr><td>Epworth Sleepiness Scale (ESS)</td><td></td><td></td></tr><tr><td>– Score ≥ 11</td><td>423 (63.9%)</td><td rowspan="2">12.5 ± 5.2 (0:24)</td></tr><tr><td>– Score ≥ 16</td><td>186 (28.1%)</td></tr><tr><td>Anxiety symptoms (PHQ-4)</td><td></td><td></td></tr><tr><td>– Score ≥ 3</td><td>277 (41.8%)</td><td>2.5 ± 1.9 (0:6)</td></tr><tr><td>Depressive symptoms</td><td></td><td></td></tr><tr><td>– Score ≥ 3</td><td>211 (31.9%)</td><td>2.0 ± 1.7 (0:6)</td></tr><tr><td>Barcelona Sleepiness Index (BSI)</td><td></td><td></td></tr><tr><td>– Score ≥ 2</td><td>309 (46.7%)</td><td>1.5 ± 1.0 (0:6)</td></tr></tbody></table>

<figure><img src="image_5.png" /><figcaption>**Figure 1.** Frequency histogram of the BSI score (n = 662).</figcaption></figure>
## 3.2. Ability of BSI Score to Predict EDS

Prediction of EDS according to ESS score was better when using a cutoff point of 11 (AUC = 0.742) than when using a cutoff point of 16 (AUC = 0.681); discrimination was considered acceptable overall (Supplementary Materials Figure S2). The BSI cutoff point of 2 maximized the YI at both ESS cutoff points with high PPV (82%) for discriminating EDS (ESS score ≥ 11) from non-EDS (ESS score < 11) and high NPV (82%) for discriminating severe EDS (ESS score ≥ 16) from non-severe EDS (ESS score < 16) (Table 3).

<table><caption>**Table 3.** Ability of BSI score to predict EDS, according to ESS score.</caption><thead><tr><th></th><th>BSI Score</th><th>Prevalence</th><th>Sensitivity</th><th>Specificity</th><th>PPV</th><th>NPV</th><th>YI</th></tr></thead><tbody><tr><td rowspan="3">ESS score ≥ 11</td><td>≥1</td><td>85%</td><td>94%</td><td>29%</td><td>70%</td><td>72%</td><td>0.23</td></tr><tr><td>≥2</td><td>47%</td><td>60%</td><td>77%</td><td>82%</td><td>52%</td><td>0.37</td></tr><tr><td>≥3</td><td>14%</td><td>22%</td><td>99%</td><td>98%</td><td>42%</td><td>0.21</td></tr><tr><td rowspan="3">ESS score ≥ 16</td><td>≥1</td><td>85%</td><td>96%</td><td>19%</td><td>32%</td><td>92%</td><td>0.15</td></tr><tr><td>≥2</td><td>47%</td><td>66%</td><td>61%</td><td>40%</td><td>82%</td><td>0.27</td></tr><tr><td>≥3</td><td>14%</td><td>28%</td><td>91%</td><td>56%</td><td>77%</td><td>0.19</td></tr></tbody></table>

BSI: Barcelona Sleepiness Index; EDS: Excessive Daytime Sleepiness; ESS: Epworth Sleepiness Scale; PPV: positive predictive value; NPV: negative predictive value; YI: Youden index.

## 3.3. Concurrent and External Validity of the BSI

BSI concurrent and external validity results are presented in Table 4. With regard to convergent validation, the correlations of BSI score with ESS and THAT scores were medium and highly significant ($r = 0.47, p < 10^{-4}$ and $r = -0.40, p < 10^{-4}$, respectively). With regard to divergent validation, the correlations of the BSI score with insomnia, anxiety, and depressive symptoms were low but significant ($r = 0.36, p < 10^{-4}$; $r = 0.15, p < 10^{-4}$; $r = 0.24, p < 10^{-4}$). With regard to external validity, the correlations of the BSI score with sleep-wake timing were all significant. The afternoon item showed weak correlations with mean sleep duration ($r = 0.11, p = 0.006$) and mean sleep efficiency ($r = -0.09, p = 0.017$), while the morning item showed no correlations. Conversely, the afternoon item showed no correlation with social jetlag, while the morning item showed a weak correlation ($r = 0.13, p = 0.001$). Indeed, social jetlag of ≥ 2 h was present in 18 of the 111 students (16.2%) who would fall asleep when relaxing in the morning vs. 50 of the 551 students (9.1%) who would not fall asleep ($p = 0.024$). Note that the correlation with sleep-wake timing was greater for the BSI score than for the ESS score, while the correlations with mean sleep duration and mean sleep efficiency were lower for the BSI score than for the THAT score.

<table><caption>**Table 4.** Correlations of BSI score (and each item on the scale) with sleep outcomes ($n = 662$).</caption><thead><tr><th></th><th>BSI Score</th><th>ESS Score</th><th>THAT Score</th><th>ISI Score</th><th>Anxiety Symptoms</th><th>Depressive Symptoms</th><th>Mean Sleep Duration</th><th>Mean Sleep Efficiency</th><th>Social Jetlag</th></tr></thead><tbody><tr><td>BSI Morning item</td><td>0.80 *</td><td>0.35 *</td><td>-0.31 *</td><td>0.30 *</td><td>0.10 #</td><td>0.16 *</td><td>-0.07</td><td>-0.07</td><td>0.13 *</td></tr><tr><td>BSI Afternoon item</td><td>0.69 *</td><td>0.35 *</td><td>-0.29 *</td><td>0.22 *</td><td>0.13 *</td><td>0.20 *</td><td>-0.11 #</td><td>-0.09 †</td><td>-0.02</td></tr><tr><td>BSI score</td><td>-</td><td>0.47 *</td><td>-0.40 *</td><td>0.36 *</td><td>0.15 *</td><td>0.24 *</td><td>-0.11 #</td><td>-0.10 #</td><td>0.09 †</td></tr><tr><td>ESS score</td><td>-</td><td>-</td><td>-0.34 *</td><td>0.27 *</td><td>0.17 *</td><td>0.21 *</td><td>-0.08</td><td>-0.05</td><td>0.01</td></tr><tr><td>THAT score</td><td>-</td><td>-</td><td>-</td><td>-0.56 *</td><td>-0.46 *</td><td>-0.53 *</td><td>0.17 *</td><td>0.22 *</td><td>0.03</td></tr></tbody></table>

ESS: Epworth Sleepiness Scale; THAT: Toronto Hospital Alertness Test; ISI: Insomnia Severity Index Pearson's correlation coefficient: † $p < 0.05$, # $p < 0.01$, * $p < 0.001$.

# 4. Discussion

In this sample of medical students with high rates of chronic sleep deprivation and circadian misalignment, we found that the French version of the BSI showed good psy-
chometric properties in terms of cutoff, as well as convergent and divergent concurrent validation. The BSI showed the same cutoff (score ≥ 2) as the original study for severe EDS. The BSI score showed stronger correlations with closed constructs (daytime sleepiness of the ESS and alertness during daytime) than with more distant constructs (insomnia, anxiety, and depressive symptoms). The score of the French version of the BSI was strongly correlated with the score of the ESS (*r* = 0.47, *p* < 0.001), the most widely used validated scale in clinical and research settings. This result was consistent with the original study (*r* = 0.52, *p* < 0.001) conducted in an older population of patients with sleep breathing disorders [16].

Notably, in contrast to the ESS, this study showed that the BSI score exhibited weak but significant correlations with sleep-wake timing. When BSI components were considered separately, the morning item was significantly associated with social jetlag, a proxy for the circadian-dependent process, while the afternoon item was significantly associated with mean sleep duration, a proxy for the homeostatic-dependent process. Therefore, this study showed that the score in an ultra-short instrument for EDS may be associated with both homeostatic and circadian processes.

In particular, social jetlag, a chronic disturbance of the circadian system observed frequently among individuals with evening chronotype [31], was associated with a twofold increased risk of morning EDS. This result was consistent with the synchrony effect framework that describes different circadian rhythmicity of EDS (superior performance at optimal times of day and inferior performance at suboptimal times of day) depending on an individual's chronotype [32]. It is important to note that the sleepiness-related situation also differed between the two items of the BSI: lower arousal for the morning item and higher arousal for the afternoon item. These differences presumably influenced the assessment of EDS, similar to the findings with objective measures [33]. However, the circadian rhythmicity of EDS does not appear to depend on the type of measurement (i.e., objective or subjective) [34].

These considerations highlight the importance of considering circadian rhythmicity when measuring EDS; they support the use of a sleepiness scale that considers biological rhythms. Thus far, only the TODSS has addressed this issue [13]. This scale divides the ESS items and scores into the morning, afternoon, and evening categories. However, it has several limitations. First, the TODSS is a long (24-item) scale, which may call on the abstraction abilities of the respondents several times. Indeed, they must project themselves into activities at different times of the day, with a reduced probability of prior exposure to such situations. Second, impacts on biological rhythms (e.g., sleep-wake timing, sleep complaints, and mental health outcomes) were not estimated. Third, there has been no validation of the TODSS in the general population. The BSI constitutes a suitable ultra-short instrument for the identification of EDS in a population of young adults at risk of sleep deprivation or disrupted biological rhythms. Further studies are needed to confirm these findings in a general population with individuals of different ages and socio-professional categories (with consideration of sex) and in patients with other sleep disorders, including sleep breathing disorders as in the original validation study [16].

Indeed, the BSI score exhibited weak but significant correlations with mean sleep efficiency, a measure of nocturnal awakening that is frequently altered in sleep disorders (e.g., sleep breathing disorders, chronic insomnia, periodic sleep movements) [35,36]. It would be useful to evaluate the associations of the BSI score and each of the scale items among patients with different sleep disorders, including patients with rare hypersomnia's that combine different subtypes of EDS (e.g., drowsiness, sleep inertia, sleep attacks, and long sleep time). In addition, the consideration of sleep disturbances overall, such as by combining the ESS with a global tool (e.g., the Pittsburgh Sleep Quality Index [37]), could provide a better understanding of interactions between the BSI score and sleep disturbances.

This study had some limitations. First, medical students were included on a voluntary basis, which limited the representativeness of our sample. Women were overrepresented (76.0% vs. 65.0% in French medical studies), while freshmen were underrepresented (41.4%
vs. 65.1% among all medical students at Bordeaux University). However, additional analyses showed consistent results across these different subgroups (Supplementary Materials Table S1). Moreover, our sample showed a 27.2% prevalence of chronic sleep deprivation, which was similar to the prevalence of short sleep duration (<7 h) in studies conducted among medical students in different countries (from 24% in the United Kingdom to 49% in Taiwan) [38]. Similarly, the prevalence of significant social jetlag (≥2 h) were equivalent between our sample (10.3%) and a 2020 Dutch general population survey (8%) [39]; the prevalence of insomnia in our study (22.0%) was equivalent to the prevalence in a 2020 representative study performed in a general population (21%) [40]. Nevertheless, our study participants were at high risk of severe EDS (28.1%) and the results cannot be extrapolated to the generation population. Despite this limitation, medical students are particularly affected by sleep hygiene problems that can induce EDS, and they constitute a suitable population for preventive actions on sleep behavior that could benefit from the use of this scale [41]. Second, there were no subjective assessments of sleepiness at the wheel or objective measures of EDS for external validity. Therefore, further studies are needed to evaluate the predictive value of the BSI with electrophysiological recordings, as in the original study [16], along with the risk of motor vehicle accidents related to sleepiness, which is the main direct consequence of EDS [42]. Such studies are particularly important because none of the BSI items explore accidental risk situations, as in the ESS. The relationships between the BSI score and each of the scale items with overall assessments of function would also be useful. Third, there was no evaluation of medical and psychiatric status, legal and illegal consumption, and comorbidities associated with sleep disorders (e.g., sleep breathing disorders) to consider the effects of such factors in external validation of the French version of the BSI. Although our sample comprised a population at low risk of sleep disorders, substance use disorders and mental health complaints are common in this population and should be considered when assessing sleep, EDS, and circadian biological rhythms [43,44]. Fourth, test-retest repeatability and sensitivity to change were not studied. However, the BSI represents a favorable tool for measuring and monitoring sleepiness in large samples, in an epidemiological context, or as part of a sleep hygiene intervention. Further studies are needed to explore the sensitivity of the BSI score to change in the general population.

**5. Conclusions**

The French version of the BSI scale, produced by rigorous translation and validation processes regarding sleep-wake timing, sleep complaints, and mental health outcomes, is a valid ultra-short instrument for EDS screening. These results highlight the importance of considering homeostatic pressure, circadian rhythmicity, and sleepiness-related situations when measuring EDS.

**Supplementary Materials:** The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm11133892/s1, Figure S1: Sleep schedules (n = 662); Figure S2: Receiver operating characteristic analysis of the ability of BSI score to predict EDS, according to ESS score; Table S1: Subgroup correlation analyses.

**Author Contributions:** Conceptualization, J.-A.M.-F.; Data curation, J.-A.M.-F.; Formal analysis, J.C.; Investigation, J.-A.M.-F.; Methodology, J.T. and J.-A.M.-F.; Project administration, J.-A.M.-F.; Resources, J.-A.M.-F.; Software, J.C. and J.T.; Supervision, J.-A.M.-F.; Validation, R.L., E.D. and P.P.; Visualization, J.C.; Writing—original draft, J.C.; Writing—review & editing, J.C., R.L., J.T., E.D., G.F., P.P. and J.-A.M.-F. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Institutional Review Board Statement:** The project was conducted in accordance with the Declaration of Helsinki. The protocol was approved by the Commission Informatique et Libertés, which is the national authority that ensures that research data collection does not violate freedoms, rights, and human privacy (No. 2214478). The study protocol was evaluated by the Committee for the Protection
of Persons of Île-de-France XI, which determined that this research was outside the scope of the provisions governing biomedical research.

**Informed Consent Statement:** Informed consent was obtained from all participants in the study.

**Data Availability Statement:** Not applicable.

**Acknowledgments:** We thank the medical students of the dual science/health course for their support in distributing the questionnaire and informing medical students about this research.

**Conflicts of Interest:** The authors declare no conflict of interest.

## References

1. Young, T.B. Epidemiology of Daytime Sleepiness: Definitions, Symptomatology, and Prevalence. *J. Clin. Psychiatry* **2004**, *65* (Suppl. S16), 12–16. [PubMed]

2. Léger, D.; Stepnowsky, C. The Economic and Societal Burden of Excessive Daytime Sleepiness in Patients with Obstructive Sleep Apnea. *Sleep Med. Rev.* **2020**, *51*, 101275. [CrossRef] [PubMed]

3. Buysse, D.J. Sleep Health: Can We Define It? Does It Matter? *Sleep* **2014**, *37*, 9–17. [CrossRef] [PubMed]

4. Freedman, N. Objective and Subjective Measurement of Excessive Sleepiness. *Sleep Med. Clin.* **2012**, *7*, 219–232. [CrossRef]

5. Johns, M.W. A New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale. *Sleep* **1991**, *14*, 540–545. [CrossRef] [PubMed]

6. Kaida, K.; Takahashi, M.; Akerstedt, T.; Nakata, A.; Otsuka, Y.; Haratani, T.; Fukasawa, K. Validation of the Karolinska Sleepiness Scale against Performance and EEG Variables. *Clin. Neurophysiol.* **2006**, *117*, 1574–1581. [CrossRef]

7. MacLean, A.W.; Fekken, G.C.; Saskin, P.; Knowles, J.B. Psychometric Evaluation of the Stanford Sleepiness Scale. *J. Sleep Res.* **1992**, *1*, 35–39. [CrossRef]

8. Kaminska, M.; Jobin, V.; Mayer, P.; Amyot, R.; Perraton-Brillon, M.; Bellemare, F. The Epworth Sleepiness Scale: Self-Administration versus Administration by the Physician, and Validation of a French Version. *Can. Respir. J.* **2010**, *17*, 438676. [CrossRef] [PubMed]

9. Kendzerska, T.B.; Smith, P.M.; Brignardello-Petersen, R.; Leung, R.S.; Tomlinson, G.A. Evaluation of the Measurement Properties of the Epworth Sleepiness Scale: A Systematic Review. *Sleep Med. Rev.* **2014**, *18*, 321–331. [CrossRef]

10. Miletin, M.S.; Hanly, P.J. Measurement Properties of the Epworth Sleepiness Scale. *Sleep Med.* **2003**, *4*, 195–199. [CrossRef]

11. Åkerstedt, T.; Hallvig, D.; Kecklund, G. Normative Data on the Diurnal Pattern of the Karolinska Sleepiness Scale Ratings and Its Relation to Age, Sex, Work, Stress, Sleep Quality and Sickness Absence/Illness in a Large Sample of Daytime Workers. *J. Sleep Res.* **2017**, *26*, 559–566. [CrossRef] [PubMed]

12. Meza-Vargas, S.; Giannouli, E.; Younes, M. Enhancements to the Multiple Sleep Latency Test. *Nat. Sci. Sleep* **2016**, *8*, 145–158. [CrossRef] [PubMed]

13. Dolan, D.C.; Taylor, D.J.; Okonkwo, R.; Becker, P.M.; Jamieson, A.O.; Schmidt-Nowara, W.; Rosenthal, L.D. The Time of Day Sleepiness Scale to Assess Differential Levels of Sleepiness across the Day. *J. Psychosom. Res.* **2009**, *67*, 127–133. [CrossRef] [PubMed]

14. Seda, G.; Han, T.S. Effect of Obstructive Sleep Apnea on Neurocognitive Performance. *Sleep Med. Clin.* **2020**, *15*, 77–85. [CrossRef] [PubMed]

15. Hughes, D.; DuMont, K. Using Focus Groups to Facilitate Culturally Anchored Research. *Am. J. Community Psychol.* **1993**, *21*, 775–806. [CrossRef]

16. Guaita, M.; Salamero, M.; Vilaseca, I.; Iranzo, A.; Montserrat, J.M.; Gaig, C.; Embid, C.; Romero, M.; Serradell, M.; León, C.; et al. The Barcelona Sleepiness Index: A New Instrument to Assess Excessive Daytime Sleepiness in Sleep Disordered Breathing. *J. Clin. Sleep Med.* **2015**, *11*, 1289–1298. [CrossRef] [PubMed]

17. Dobrow, M.J.; Hagens, V.; Chafe, R.; Sullivan, T.; Rabeneck, L. Consolidated Principles for Screening Based on a Systematic Review and Consensus Process. *CMAJ* **2018**, *190*, E422–E429. [CrossRef]

18. Jahrami, H.; Dewald-Kaufmann, J.; Faris, M.A.-I.; AlAnsari, A.M.S.; Taha, M.; AlAnsari, N. Prevalence of Sleep Problems among Medical Students: A Systematic Review and Meta-Analysis. *J. Public Health* **2020**, *28*, 605–622. [CrossRef]

19. Shapiro, C.M.; Auch, C.; Reimer, M.; Kayumov, L.; Heslegrave, R.; Huterer, N.; Driver, H.; Devins, G.M. A New Approach to the Construct of Alertness. *J. Psychosom. Res.* **2006**, *60*, 595–603. [CrossRef]

20. Bastien, C.H.; Vallières, A.; Morin, C.M. Validation of the Insomnia Severity Index as an Outcome Measure for Insomnia Research. *Sleep Med.* **2001**, *2*, 297–307. [CrossRef]

21. Kroenke, K.; Spitzer, R.L.; Williams, J.B.W.; Löwe, B. An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ-4. *Psychosomatics* **2009**, *50*, 613–621. [CrossRef]

22. Roenneberg, T.; Wirz-Justice, A.; Merrow, M. Life between Clocks: Daily Temporal Patterns of Human Chronotypes. *J. Biol. Rhythm.* **2003**, *18*, 80–90. [CrossRef]

23. Reed, D.L.; Sacco, W.P. Measuring Sleep Efficiency: What Should the Denominator Be? *J. Clin. Sleep Med.* **2016**, *12*, 263–266. [CrossRef]
24. Roenneberg, T.; Pilz, L.K.; Zerbini, G.; Winnebeck, E.C. Chronotype and Social Jetlag: A (Self-) Critical Review. *Biology* **2019**, *8*, 54.
[CrossRef]

25. Hirshkowitz, M.; Whiton, K.; Albert, S.M.; Alessi, C.; Bruni, O.; DonCarlos, L.; Hazen, N.; Herman, J.; Adams Hillard, P.J.; Katz, E.S.; et al. National Sleep Foundation's Updated Sleep Duration Recommendations: Final Report. *Sleep Health* **2015**, *1*, 233-243.
[CrossRef]

26. Beauvalet, J.C.; Quiles, C.L.; de Oliveira, M.A.B.; Ilgenfritz, C.A.V.; Hidalgo, M.P.L.; Tonon, A.C. Social Jetlag in Health and Behavioral Research: A Systematic Review. *CPT* **2017**, *7*, 19-31. [CrossRef]

27. Chen, S.-Y.; Feng, Z.; Yi, X. A General Introduction to Adjustment for Multiple Comparisons. *J. Thorac. Dis.* **2017**, *9*, 1725-1729.
[CrossRef]

28. Shahid, A.; Chung, S.A.; Maresky, L.; Danish, A.; Bingeliene, A.; Shen, J.; Shapiro, C.M. The Toronto Hospital Alertness Test Scale: Relationship to Daytime Sleepiness, Fatigue, and Symptoms of Depression and Anxiety. *Nat. Sci. Sleep* **2016**, *8*, 41-45. [CrossRef]

29. Cho, Y.W.; Song, M.L.; Morin, C.M. Validation of a Korean Version of the Insomnia Severity Index. *J. Clin. Neurol. 2014*, *10*, 210-215. [CrossRef]

30. Nuyen, B.A.; Fox, R.S.; Malcarne, V.L.; Wachsman, S.I.; Sadler, G.R. Excessive Daytime Sleepiness as an Indicator of Depression in Hispanic Americans. *Hisp. Health Care Int.* **2016**, *14*, 116-123. [CrossRef]

31. Taillard, J.; Sagaspe, P.; Philip, P.; Bioulac, S. Sleep Timing, Chronotype and Social Jetlag: Impact on Cognitive Abilities and Psychiatric Disorders. *Biochem. Pharmacol.* **2021**, *191*, 114438. [CrossRef] [PubMed]

32. Nowack, K.; Van Der Meer, E. The Synchrony Effect Revisited: Chronotype, Time of Day and Cognitive Performance in a Semantic Analogy Task. *Chronobiol. Int.* **2018**, *35*, 1647-1662. [CrossRef] [PubMed]

33. Bonnet, M.H.; Arand, D.L. Arousal Components Which Differentiate the MWT from the MSLT. *Sleep* **2001**, *24*, 441-447. [CrossRef] [PubMed]

34. Taillard, J.; Philip, P.; Coste, O.; Sagaspe, P.; Bioulac, B. The Circadian and Homeostatic Modulation of Sleep Pressure during Wakefulness Differs between Morning and Evening Chronotypes. *J. Sleep Res.* **2003**, *12*, 275-282. [CrossRef]

35. Andrillon, T.; Solelhac, G.; Bouchequet, P.; Romano, F.; Le Brun, M.-P.; Brigham, M.; Chennaoui, M.; Léger, D. Revisiting the Value of Polysomnographic Data in Insomnia: More than Meets the Eye. *Sleep Med.* **2020**, *66*, 184-200. [CrossRef]

36. Lusic Kalcina, L.; Valic, M.; Pecotic, R.; Pavlinac Dodig, I.; Dogas, Z. Good and Poor Sleepers among OSA Patients: Sleep Quality and Overnight Polysomnography Findings. *Neurol. Sci.* **2017**, *38*, 1299-1306. [CrossRef]

37. Buysse, D.J.; Reynolds, C.F.; Monk, T.H.; Berman, S.R.; Kupfer, D.J. The Pittsburgh Sleep Quality Index: A New Instrument for Psychiatric Practice and Research. *Psychiatry Res.* **1989**, *28*, 193-213. [CrossRef]

38. Azad, M.C.; Fraser, K.; Rumana, N.; Abdullah, A.F.; Shahana, N.; Hanly, P.J.; Turin, T.C. Sleep Disturbances among Medical Students: A Global Perspective. *J. Clin. Sleep Med.* **2015**, *11*, 69-74. [CrossRef]

39. Koopman, A.D.M.; Rauh, S.P.; van 't Riet, E.; Groeneveld, L.; van der Heijden, A.A.; Elders, P.J.; Dekker, J.M.; Nijpels, G.; Beulens, J.W.; Rutters, F. The Association between Social Jetlag, the Metabolic Syndrome, and Type 2 Diabetes Mellitus in the General Population: The New Hoorn Study. *J. Biol. Rhythms* **2017**, *32*, 359-368. [CrossRef]

40. Institut National du Sommeil et de la Vigilance (National Institute of Sleep and Alertness). Bien Dormir Pour Mieux Faire Face (Sleep Well to Cope Better). 2020. Available online: https://institut-sommeil-vigilance.org/bien-dormir-pour-mieux-faire-face-enquete-insv-mgen-2021 (accessed on 16 May 2022).

41. Brown, F.C.; Buboltz, W.C.; Soper, B. Relationship of Sleep Hygiene Awareness, Sleep Hygiene Practices, and Sleep Quality in University Students. *Behav. Med.* **2002**, *28*, 33-38. [CrossRef]

42. Bioulac, S.; Micoulaud-Franchi, J.-A.; Arnaud, M.; Sagaspe, P.; Moore, N.; Salvo, F.; Philip, P. Risk of Motor Vehicle Accidents Related to Sleepiness at the Wheel: A Systematic Review and Meta-Analysis. *Sleep* **2017**, *40*, zsx134. [CrossRef] [PubMed]

43. Adan, A. A Chronobiological Approach to Addiction. *J. Subst. Use* **2013**, *18*, 171-183. [CrossRef]

44. Chaput, J.-P.; Dutil, C.; Featherstone, R.; Ross, R.; Giangregorio, L.; Saunders, T.J.; Janssen, I.; Poitras, V.J.; Kho, M.E.; Ross-White, A.; et al. Sleep Timing, Sleep Consistency, and Health in Adults: A Systematic Review. *Appl. Physiol. Nutr. Metab.* **2020**, *45*, S232-S247. [CrossRef] [PubMed]