# Development of the acne-specific quality of life questionnaire Quality of Life Relevance-Acne

Pavel Chernyshov, Francesca Sampogna, Giulia Raimondi, Christos Zouboulis, Michael Boffa, Servando Marron, Liana Manolache, Nives Pustišek, Vincenzo Bettoli, Dimitra Koumaki, et al.

<figure><img src="image_1.png" /></figure>

## To cite this version:

Pavel Chernyshov, Francesca Sampogna, Giulia Raimondi, Christos Zouboulis, Michael Boffa, et al. Development of the acne-specific quality of life questionnaire Quality of Life Relevance-Acne. Journal of The American Academy of Dermatology international/JAAD Int, 2024, 16, pp.9-17. 10.1016/j.jdin.2024.03.007. inserm-04581041

HAL Id: inserm-04581041

https://inserm.hal.science/inserm-04581041

Submitted on 21 May 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
<figure><img src="image_1.png" /></figure>

Check for
updates

# Development of the acne-specific quality of life questionnaire Quality of Life Relevance-Acne

Pavel V. Chernyshov, MD, PhD,ª Francesca Sampogna, PhD,ᵇ Giulia Raimondi, PhD,ᵇ,c

Christos C. Zouboulis, MD, PhD,ᵈ Michael J. Boffa, MD, MSc,ᶜ Servando E. Marron, MD,ᵈ

Liana Manolache, MD, PhD,ᶜ Nives Pustišek, MD, PhD,ᵇ Vincenzo Bettoli, MD, PhD,ᵢ

Dimitra Koumaki, MD, PhD,ⱼ Anthony P. Bewley, MD, PhD,ᵏ,¹ Brigitte Dreno, MD, PhD,ᵇ and
Lucia Tomas-Aragones, PhDⁿ

**Background:** Participating members of the European Academy of Dermatology and Venereology Task Forces on quality of life (QoL) and Patient Oriented Outcomes and Acne, Rosacea and Hidradenitis Suppurativa initiated data collection in 9 European countries and formed the list of the most relevant topics for acne patients.

**Objective:** The aim of this study was to develop a new acne-specific health-related QoL instrument based on the list of the most relevant topics for acne patients.

**Methods:** After assessment by acne patients (n = 715) on how clear and relevant the items in the prototype questionnaire were, a group of experts on acne and QoL performed discussions on items inclusion, which resulted in a series of 21 items. Then another group of acne patients (n = 1502) filled in the new version of the instrument. A factor analysis was conducted on the 21-item version.

**Results:** Three-factor model with 19 items indicated a satisfactory fit. The three dimensions were called: Socioemotional; Symptoms; Stigma and Suicidal thoughts.

**Limitations:** Included patients and experts may not fully represent acne patients and health care professionals worldwide.

**Conclusion:** A final 19-item version of the Quality of Life Relevance-Acne was developed. (JAAD Int 2024;16:9-17.)

From the Department of Dermatology and Venereology, National Medical University, Kiev, Ukraineª; Clinical Epidemiology Unit, Istituto Dermopatico dell'Immacolata IDI-IRCCS, Rome, Italyᵇ; Department of Developmental and Social Psychology, Sapienza University of Rome, Rome, Italyᶜ; Departments of Dermatology, Venereology, Allergology and Immunology, Staedtisches Klinikum Dessau, Brandenburg Medical School Theodor Fontane and Faculty of Health Sciences Brandenburg, Dessau, Germanyᵈ; Department of Dermatology, Mater Dei Hospital, Msida, Maltaª; Department of Dermatology, University Hospital Miguel Servet, Aragon Psychodermatology Research Group associated to Aragon Health Sciences Institute (IACS), Zaragoza, Spainf; Dermatology, Dali Medical, Bucharest, Romaniag; Children's Hospital Zagreb, Zagreb, Croatiah; Section of Dermatology, Department of Medical Sciences, University of Ferrara, Ferrara, Italyi; Department of Dermatology and Venereology, University Hospital of Heraklion, Heraklion, Greecej; Barts Health NHS Trust, London, UKk; Queen Mary University, London, UKl; Department of Dermato-Oncology, Nantes Université, Univ Angers, INSERM, Immunology and New Concepts in Immunotherapy (INCIT), Nantes, Francem; and Department of

Psychology, University of Zaragoza; Aragon Health Sciences Institute (IACS), Zaragoza, Spain.ⁿ

Funding sources: EADV project no 2019-06.

**Patient consent:** The authors obtained written consent from patients for their photographs and medical information to be published in print and online and with the understanding that this information may be publicly available. Patient consent forms were not provided to the journal but are retained by the authors.

**IRB approval status:** Reviewed and approved by the University Research Ethics Committee; approval #124/2019.

Accepted for publication March 20, 2024.

**Correspondence to:** Pavel V. Chernyshov, MD, PhD, Department of Dermatology and Venereology, National Medical University, 13 Bulvar Shevchenko, Kiev, 01601, Ukraine. E-mail: chernyshovpavel@ukr.net.

2666-3287

© 2024 by the American Academy of Dermatology, Inc. Published by Elsevier Inc. This is an open access article under the CC BY license ([http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)).

[https://doi.org/10.1016/j.jdin.2024.03.007](https://doi.org/10.1016/j.jdin.2024.03.007)
# Development of the acne-specific quality of life questionnaire Quality of Life Relevance-Acne

<figure><img src="image_3.png" /></figure>

Check for
updates

Pavel V. Chernyshov, MD, PhD,ª Francesca Sampogna, PhD,ᵇ Giulia Raimondi, PhD,ᵇ,c

Christos C. Zouboulis, MD, PhD,ᵈ Michael J. Boffa, MD, MSc,ᶜ Servando E. Marron, MD,ᵈ

Liana Manolache, MD, PhD,ᶜ Nives Pustišek, MD, PhD,ᵇ Vincenzo Bettoli, MD, PhD,ᵢ

Dimitra Koumaki, MD, PhD,ⱼ Anthony P. Bewley, MD, PhD,ᵏ,¹ Brigitte Dreno, MD, PhD,ᵇ and
Lucia Tomas-Aragones, PhDⁿ

**Background:** Participating members of the European Academy of Dermatology and Venereology Task Forces on quality of life (QoL) and Patient Oriented Outcomes and Acne, Rosacea and Hidradenitis Suppurativa initiated data collection in 9 European countries and formed the list of the most relevant topics for acne patients.

**Objective:** The aim of this study was to develop a new acne-specific health-related QoL instrument based on the list of the most relevant topics for acne patients.

**Methods:** After assessment by acne patients (n = 715) on how clear and relevant the items in the prototype questionnaire were, a group of experts on acne and QoL performed discussions on items inclusion, which resulted in a series of 21 items. Then another group of acne patients (n = 1502) filled in the new version of the instrument. A factor analysis was conducted on the 21-item version.

**Results:** Three-factor model with 19 items indicated a satisfactory fit. The three dimensions were called: Socioemotional; Symptoms; Stigma and Suicidal thoughts.

**Limitations:** Included patients and experts may not fully represent acne patients and health care professionals worldwide.

**Conclusion:** A final 19-item version of the Quality of Life Relevance-Acne was developed. (JAAD Int 2024;16:9-17.)

From the Department of Dermatology and Venereology, National Medical University, Kiev, Ukraineª; Clinical Epidemiology Unit, Istituto Dermopatico dell'Immacolata IDI-IRCCS, Rome, Italyᵇ; Department of Developmental and Social Psychology, Sapienza University of Rome, Rome, Italyᶜ; Departments of Dermatology, Venereology, Allergology and Immunology, Staedtisches Klinikum Dessau, Brandenburg Medical School Theodor Fontane and Faculty of Health Sciences Brandenburg, Dessau, Germanyᵈ; Department of Dermatology, Mater Dei Hospital, Msida, Maltaª; Department of Dermatology, University Hospital Miguel Servet, Aragon Psychodermatology Research Group associated to Aragon Health Sciences Institute (IACS), Zaragoza, Spainf; Dermatology, Dali Medical, Bucharest, Romaniag; Children's Hospital Zagreb, Zagreb, Croatiah; Section of Dermatology, Department of Medical Sciences, University of Ferrara, Ferrara, Italyi; Department of Dermatology and Venereology, University Hospital of Heraklion, Heraklion, Greecej; Barts Health NHS Trust, London, UKk; Queen Mary University, London, UKl; Department of Dermato-Oncology, Nantes Université, Univ Angers, INSERM, Immunology and New Concepts in Immunotherapy (INCIT), Nantes, Francem; and Department of

Psychology, University of Zaragoza; Aragon Health Sciences Institute (IACS), Zaragoza, Spain.ⁿ

Funding sources: EADV project no 2019-06.

**Patient consent:** The authors obtained written consent from patients for their photographs and medical information to be published in print and online and with the understanding that this information may be publicly available. Patient consent forms were not provided to the journal but are retained by the authors.

**IRB approval status:** Reviewed and approved by the University Research Ethics Committee; approval #124/2019.

Accepted for publication March 20, 2024.

**Correspondence to:** Pavel V. Chernyshov, MD, PhD, Department of Dermatology and Venereology, National Medical University, 13 Bulvar Shevchenko, Kiev, 01601, Ukraine. E-mail: chernyshovpavel@ukr.net.

2666-3287

© 2024 by the American Academy of Dermatology, Inc. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

https://doi.org/10.1016/j.jdin.2024.03.007
**Key words:** acne; patient-reported outcome measures; quality of life.

INTRODUCTION

Acne has a significant
negative influence on pa-
tients’ health-related quality
of life (HRQoL).¹ HRQoL
assessment in patients with
acne is recommended by
several national and interna-
tional guidelines including
the European Dermatology
Forum S3-Guideline for the
Treatment of Acne and rec-
ommendations of the
European Academy of Dermatology and
Venereology Task Forces on QoL and Patient
Oriented Outcomes and Acne, Rosacea and
Hidradenitis Suppurativa.<sup>1,2</sup> Several different acne-
specific instruments are available to assess QoL in
patients with acne vulgaris, each one evaluating
some QoL domains but none of which address
them all.<sup>3</sup> Participating members of the European
Academy of Dermatology and Venereology Task
Forces on QoL and Patient Oriented Outcomes and
Acne, Rosacea and Hidradenitis Suppurativa initiated
data collection in 9 European countries and formed
the list of the most relevant topics for acne patients.<sup>4</sup>
The aim of this study was to develop a new acne-
specific HRQoL instrument based on the list of the
most relevant topics for acne patients.

METHODS

A combination of the most relevant topics and
factor analysis results¹ was used as a prototype of a
new acne-specific instrument. Acne patients were
asked how clear and relevant the items are.

Group of experts (consisted of all authors from
the authors' list except G.R.) on acne and QoL
performed discussions on items inclusion (eg to
exclude duplications), more clear formulation and
incorporation of additional items, resulting in a list of
21 items. Separate discussion was organized by the
expert group on scoring system for the new acne-
specific HRQoL instrument.

After that, another group of acne patients filled in
the 21-item version of the new acne-specific QoL
instrument.

Statistical analyses

All the analyses were performed with Mplus 8.3
(Muthén & Muthén, 1998-2017) and the packages

CAPSULE SUMMARY

* This article provides information on the development of an acne-specific quality of life questionnaire (Quality of Life Relevance-Acne).

* The final version of the Quality of Life Relevance-Acne consists of 3 dimensions and 19 items.

Mokken (version 3.0.4) and
Psych (version 2.3.6) for R.⁵,⁶

The analyses were con-
ducted on the pool of 21
items. The sample was
randomly split into 2 sub-
samples using the SPSS
function. In the first sample
an exploratory factor anal-
ysis (EFA) was performed,
and items with factor load-
ings less than 0.40 were
removed. The following

indices were used to assess model fit: (1) the Root Mean Square Error of Approximation (RMSEA), with values below 0.05 indicating evidence of absolute fit, values between 0.05 and 0.08 indicating adequacy of the model, and values above or equal to 0.10 indicating poor fit of the model<sup>7,8</sup>; (2) the Tucker Lewis Index, with values ≥ 0.95 indicating good fit of the model and values of 0.90 and higher an acceptable fit; (3) the Comparative Fit Index, with values ≥ 0.95 indicating good model fit and values of 0.90 and higher an acceptable fit; (4) the Standardized Root Mean square Residual, with values < 0.08 indicating good fit<sup>9</sup>; and (5) the chi-square (χ<sup>2</sup>) test, with *P* values greater than .05 indicating an adequate fit to the data. However, χ<sup>2</sup> is sensitive to sample size, and so *P* values might become significant for large samples.<sup>10</sup> In the second subsample a confirmatory factor analysis (CFA) was performed to confirm the stability of the factor solution obtained in the previous step. The models from both EFA and CFA were evaluated using the Mean-and Variance-adjusted Weighted Least Square estimator with a polychoric correlation matrix. The adequacy of the CFA model was evaluated with the same fit indices reported above.

While it is true that goodness-of-fit indices (eg, RMSEA) are associated with CFA, they are also used in the context of EFA as well, as reported by literature,<sup>11,12</sup> since they can offer valuable insights into model fit, even in the absence of a predetermined factor structure.

Indices of internal consistency (ie, ordinal alpha, Molenaar Sijtsma statistic [MS], and latent class reliability coefficient [LCRCI]) were calculated on the whole sample. In order to assess the presence of any floor and/or ceiling effect, mean scores for each
**Key words:** acne; patient-reported outcome measures; quality of life.

## INTRODUCTION

Acne has a significant negative influence on patients' health-related quality of life (HRQoL).¹ HRQoL assessment in patients with acne is recommended by several national and international guidelines including the European Dermatology Forum S3-Guideline for the Treatment of Acne and recommendations of the European Academy of Dermatology and Venereology Task Forces on QoL and Patient Oriented Outcomes and Acne, Rosacea and Hidradenitis Suppurativa.¹,² Several different acne-specific instruments are available to assess QoL in patients with acne vulgaris, each one evaluating some QoL domains but none of which address them all.³ Participating members of the European Academy of Dermatology and Venereology Task Forces on QoL and Patient Oriented Outcomes and Acne, Rosacea and Hidradenitis Suppurativa initiated data collection in 9 European countries and formed the list of the most relevant topics for acne patients.⁴ The aim of this study was to develop a new acne-specific HRQoL instrument based on the list of the most relevant topics for acne patients.

## CAPSULE SUMMARY

* This article provides information on the development of an acne-specific quality of life questionnaire (Quality of Life Relevance-Acne).

* The final version of the Quality of Life Relevance-Acne consists of 3 dimensions and 19 items.

## METHODS

A combination of the most relevant topics and factor analysis results¹ was used as a prototype of a new acne-specific instrument. Acne patients were asked how clear and relevant the items are.

Group of experts (consisted of all authors from the authors' list except G.R.) on acne and QoL performed discussions on items inclusion (eg to exclude duplications), more clear formulation and incorporation of additional items, resulting in a list of 21 items. Separate discussion was organized by the expert group on scoring system for the new acne-specific HRQoL instrument.

After that, another group of acne patients filled in the 21-item version of the new acne-specific QoL instrument.

## Statistical analyses

All the analyses were performed with Mplus 8.3 (Muthén & Muthén, 1998-2017) and the packages

Mokken (version 3.0.4) and Psych (version 2.3.6) for R.⁵,⁶

The analyses were conducted on the pool of 21 items. The sample was randomly split into 2 subsamples using the SPSS function. In the first sample an exploratory factor analysis (EFA) was performed, and items with factor loadings less than 0.40 were removed. The following

indices were used to assess model fit: (1) the Root Mean Square Error of Approximation (RMSEA), with values below 0.05 indicating evidence of absolute fit, values between 0.05 and 0.08 indicating adequacy of the model, and values above or equal to 0.10 indicating poor fit of the model⁷,⁸; (2) the Tucker Lewis Index, with values ≥ 0.95 indicating good fit of the model and values of 0.90 and higher an acceptable fit; (3) the Comparative Fit Index, with values ≥ 0.95 indicating good model fit and values of 0.90 and higher an acceptable fit; (4) the Standardized Root Mean square Residual, with values < 0.08 indicating good fit⁹; and (5) the chi-square (χ²) test, with *P* values greater than .05 indicating an adequate fit to the data. However, χ² is sensitive to sample size, and so *P* values might become significant for large samples.¹⁰ In the second subsample a confirmatory factor analysis (CFA) was performed to confirm the stability of the factor solution obtained in the previous step. The models from both EFA and CFA were evaluated using the Mean-and Variance-adjusted Weighted Least Square estimator with a polychoric correlation matrix. The adequacy of the CFA model was evaluated with the same fit indices reported above.

While it is true that goodness-of-fit indices (eg, RMSEA) are associated with CFA, they are also used in the context of EFA as well, as reported by literature,¹¹,¹² since they can offer valuable insights into model fit, even in the absence of a predetermined factor structure.

Indices of internal consistency (ie, ordinal alpha, Molenaar Sijtsma statistic [MS], and latent class reliability coefficient [LCRCI]) were calculated on the whole sample. In order to assess the presence of any floor and/or ceiling effect, mean scores for each
Abbreviations used:

χ2: chi-square

CFA: confirmatory factor analysis

EFA: exploratory factor analysis

HR: health-related

LCRC: latent class reliability coefficient

MCID: minimal clinically important difference

MS: Molenaar Sijtsma statistic

QoL: quality of life

RMSEA: Root Mean Square Error of Approximation

factor were calculated and skewness and kurtosis of each dimension were inspected.

Ethical approval was obtained from the local ethical research committee. Informed consent from patients was obtained in all cases.

## RESULTS

Acne patients (n = 715) were asked to assess how clear the items formed on the base of combination of the most relevant topics and factor analysis results are and about the impact of the items on their life during last 2 weeks. Response rate was from 99.70% to 87.83%. Mean age of patients was 22.66 ± 4.13 years (age ranges: 12-40 years). Patients' answers on clarity and impact of the first set of items are presented in Table I.

Based on 5 rounds of experts group discussions, 29 items from the initial list were deleted or replaced by the following 4 items: "I found it difficult to communicate with others because of my acne", "I was upset about having acne", "I have been stressed because of my acne", "I felt lonely because of my acne". Meanwhile, 2 new items were added: "My acne caused suicidal thoughts" and "People offered advice, or said things to me about my acne when I had not asked them to do that". A four-point Likert scale (never, rarely, sometimes, frequently) was selected by the group of experts as a scoring system of the new acne-specific HRQoL questionnaire.

Factor analyses were conducted on the final pool of 21 items. Response rate in a second group of patients (n = 1502) was 99.73%. Mean age of patients was 24.27 ± 4.72 years (age ranges: 13-41 years). On the first subsample (n = 722), the EFA suggested a three-factor model that fitted the data best [χ2 (150) = 511.11, P < .001; RMSEA = 0.058, 90% CI = 0.052-0.063; Comparative Fit Index= 0.97; Tucker Lewis Index= 0.96; Standardized Root Mean square Residual = 0.04]. When inspecting the model, results indicated 1 item with low factor loading (<0.40) and 1 item with cross-loadings on 2 factors, therefore these 2 items ("I have been concerned about the side effects from treatment of my acne"

and "I felt lonely because of my acne") were removed from further analyses. The CFA on the second subsample (n = 776) of the three-factor model with 19 items indicated a satisfactory fit [χ2 (149) = 664.78, P < .001; RMSEA = 0.067, 90% CI = 0.062-0.072; Comparative Fit Index = 0.95; Tucker Lewis Index= 0.94; Standardized Root Mean square Residual = 0.05] (see Fig 1 for standardized factor loadings).

The first dimension included 11 items concerning psychosocial aspects of the disease, such as dissatisfaction with appearance, difficulties in social life, and emotions such as concern about the side effect of the medication, worry, stress, and lack in self-confidence, and being upset. This dimension has been called "Socioemotional". The second dimension was called "Symptoms", as it included 4 symptoms. The third dimension included 4 items, 1 of them on suicide and the others on stigma. It was thus called "Stigma and Suicidal thoughts".

The questionnaire (Table II) showed satisfactory internal consistency for all 3 subscales (Socioemotional: Ordinal alpha = 0.91, MS = 0.88, and LCRC = 0.89; Symptoms: Ordinal alpha = 0.85, MS = 0.81, and LCRC = 0.78; Stigma and Suicidal thoughts: Ordinal alpha = 0.80, MS = 0.73, and LCRC = 0.71). Skewness and kurtosis for the 3 factors were: F1: Skewness = 0.43, Kurtosis = -0.77; F2: Skewness = 1.69, Kurtosis = 2.00; F3: Skewness = 0.81, Kurtosis = 0.28.

## DISCUSSION

The aim of the current work was to develop a new self-reported acne-specific questionnaire measuring HRQoL based on the most relevant topics for acne patient with additions of items that aimed to identify patients who need immediate psychological help. Our findings suggest the presence of 3 factors, which were named as Socioemotional, Symptoms, and Stigma and Suicidal thoughts. For each factor, skewness and kurtosis fell in the ranges commonly used to assess the normality of the distribution (ie, -2.00 to +2.00).¹³ Therefore, no ceiling or floor effect were detected in our analyses.

It is well-known that acne produces cosmetic disfigurement and patients suffering from visible skin conditions have an increased risk of depression, anxiety, body dysmorphic disorder, feelings of stigmatization, and self-harm ideation.¹⁴ Feelings about the appearance of the skin over the last month had significant impact on school and university students with acne.¹⁵ Due to the strong desire to have a clear skin, they might feel the need to constantly hide behind makeup, which further diminishes their confidence.¹⁶
Abbreviations used:

χ2: chi-square

CFA: confirmatory factor analysis

EFA: exploratory factor analysis

HR: health-related

LCRC: latent class reliability coefficient

MCID: minimal clinically important difference

MS: Molenaar Sijtsma statistic

QoL: quality of life

RMSEA: Root Mean Square Error of Approximation

factor were calculated and skewness and kurtosis of each dimension were inspected.

Ethical approval was obtained from the local ethical research committee. Informed consent from patients was obtained in all cases.

## RESULTS

Acne patients (n = 715) were asked to assess how clear the items formed on the base of combination of the most relevant topics and factor analysis results are and about the impact of the items on their life during last 2 weeks. Response rate was from 99.70% to 87.83%. Mean age of patients was 22.66 ± 4.13 years (age ranges: 12-40 years). Patients' answers on clarity and impact of the first set of items are presented in Table I.

Based on 5 rounds of experts group discussions, 29 items from the initial list were deleted or replaced by the following 4 items: "I found it difficult to communicate with others because of my acne", "I was upset about having acne", "I have been stressed because of my acne", "I felt lonely because of my acne". Meanwhile, 2 new items were added: "My acne caused suicidal thoughts" and "People offered advice, or said things to me about my acne when I had not asked them to do that". A four-point Likert scale (never, rarely, sometimes, frequently) was selected by the group of experts as a scoring system of the new acne-specific HRQoL questionnaire.

Factor analyses were conducted on the final pool of 21 items. Response rate in a second group of patients (n = 1502) was 99.73%. Mean age of patients was 24.27 ± 4.72 years (age ranges: 13-41 years). On the first subsample (n = 722), the EFA suggested a three-factor model that fitted the data best [χ2 (150) = 511.11, P < .001; RMSEA = 0.058, 90% CI = 0.052-0.063; Comparative Fit Index= 0.97; Tucker Lewis Index= 0.96; Standardized Root Mean square Residual = 0.04]. When inspecting the model, results indicated 1 item with low factor loading (<0.40) and 1 item with cross-loadings on 2 factors, therefore these 2 items ("I have been concerned about the side effects from treatment of my acne"

and "I felt lonely because of my acne") were removed from further analyses. The CFA on the second subsample (n = 776) of the three-factor model with 19 items indicated a satisfactory fit [χ2 (149) = 664.78, P < .001; RMSEA = 0.067, 90% CI = 0.062-0.072; Comparative Fit Index = 0.95; Tucker Lewis Index= 0.94; Standardized Root Mean square Residual = 0.05] (see Fig 1 for standardized factor loadings).

The first dimension included 11 items concerning psychosocial aspects of the disease, such as dissatisfaction with appearance, difficulties in social life, and emotions such as concern about the side effect of the medication, worry, stress, and lack in self-confidence, and being upset. This dimension has been called "Socioemotional". The second dimension was called "Symptoms", as it included 4 symptoms. The third dimension included 4 items, 1 of them on suicide and the others on stigma. It was thus called "Stigma and Suicidal thoughts".

The questionnaire (Table II) showed satisfactory internal consistency for all 3 subscales (Socioemotional: Ordinal alpha = 0.91, MS = 0.88, and LCRC = 0.89; Symptoms: Ordinal alpha = 0.85, MS = 0.81, and LCRC = 0.78; Stigma and Suicidal thoughts: Ordinal alpha = 0.80, MS = 0.73, and LCRC = 0.71). Skewness and kurtosis for the 3 factors were: F1: Skewness = 0.43, Kurtosis = -0.77; F2: Skewness = 1.69, Kurtosis = 2.00; F3: Skewness = 0.81, Kurtosis = 0.28.

## DISCUSSION

The aim of the current work was to develop a new self-reported acne-specific questionnaire measuring HRQoL based on the most relevant topics for acne patient with additions of items that aimed to identify patients who need immediate psychological help. Our findings suggest the presence of 3 factors, which were named as Socioemotional, Symptoms, and Stigma and Suicidal thoughts. For each factor, skewness and kurtosis fell in the ranges commonly used to assess the normality of the distribution (ie, -2.00 to +2.00).¹³ Therefore, no ceiling or floor effect were detected in our analyses.

It is well-known that acne produces cosmetic disfigurement and patients suffering from visible skin conditions have an increased risk of depression, anxiety, body dysmorphic disorder, feelings of stigmatization, and self-harm ideation.¹⁴ Feelings about the appearance of the skin over the last month had significant impact on school and university students with acne.¹⁵ Due to the strong desire to have a clear skin, they might feel the need to constantly hide behind makeup, which further diminishes their confidence.¹⁶
<table><caption>**Table I.** Patients' (n = 715) answers on clarity and impact of the first set of items</caption><thead><tr><th></th><th>Items of the long version</th><th>How clear is the item?</th><th>Impact of the item during last 2 weeks</th></tr></thead><tbody><tr><td>1</td><td>I feel like an "outcast" because of my acne</td><td>Very clear 68.4% (n = 699)</td><td>67.9% (n = 713)</td></tr><tr><td>2</td><td>I have difficulties in relationships with my spouse/partner because of my acne</td><td>Very clear 88.0% (n = 686)</td><td>37.2% (n = 705)</td></tr><tr><td>3</td><td>I have difficulties in relationship with my close friends because of my acne</td><td>Very clear 90.9% (n = 681)</td><td>34.3% (n = 712)</td></tr><tr><td>4</td><td>I have difficulties in relationship with my immediate family because of my acne</td><td>Very clear 91.6% (n = 633)</td><td>38.5% (n = 712)</td></tr><tr><td>5</td><td>I feel social withdrawal because of my acne</td><td>Very clear 90.1% (n = 680)</td><td>66.5% (n = 710)</td></tr><tr><td>6</td><td>Acne interferes with my sex life</td><td>Very clear 91.9% (n = 668)</td><td>35.1% (n = 700)</td></tr><tr><td>7</td><td>Acne affects my social or leisure activities</td><td>Very clear 93.1% (n = 666)</td><td>79.1% (n = 708)</td></tr><tr><td>8</td><td>My acne stops me from being close with those I love</td><td>Very clear 91.7% (n = 662)</td><td>49.4% (n = 702)</td></tr><tr><td>9</td><td>My acne affects my going out, playing and doing hobbies</td><td>Very clear 92.8% (n = 667)</td><td>57.0% (n = 707)</td></tr><tr><td>10</td><td>I have problems with the use of public changing rooms/ swimming pools because of my acne</td><td>Very clear 90.6% (n = 661)</td><td>43.0% (n = 703)</td></tr><tr><td>11</td><td>It was difficult to do any sport because of my acne</td><td>Very clear 92.4% (n = 662)</td><td>37.1% (n = 706)</td></tr><tr><td>12</td><td>I believe that people are staring at me because of my acne</td><td>Very clear 95.0% (n = 662)</td><td>83.6% (n = 706)</td></tr><tr><td>13</td><td>People are calling me names, tease, bully, ask questions or avoid me because of my acne</td><td>Very clear 95.0% (n = 659)</td><td>61.3% (n = 703)</td></tr><tr><td>14</td><td>Acne prevents me from working or studying or I have problems at work or studying</td><td>Very clear 94.4% (n = 655)</td><td>39.1% (n = 704)</td></tr><tr><td>15</td><td>I have sleep problems because of my acne</td><td>Very clear 87.6% (n = 653)</td><td>15.8% (n = 703)</td></tr><tr><td>16</td><td>Acne interferes with my going shopping or looking after my home or garden</td><td>Very clear 82.1% (n = 653)</td><td>35.9% (n = 702)</td></tr><tr><td>17</td><td>I am aggressive because of my acne</td><td>Very clear 92.0% (n = 649)</td><td>79.3% (n = 700)</td></tr><tr><td>18</td><td>I am frustrated because of my acne</td><td>Very clear 91.2% (n = 649)</td><td>96.7% (n = 698)</td></tr><tr><td>19</td><td>I am embarrassed because of my acne</td><td>Very clear 90.8% (n = 649)</td><td>82.5% (n = 698)</td></tr><tr><td>20</td><td>I am worrying or anxious because of my acne</td><td>Very clear 92.9% (n = 650)</td><td>82.9% (n = 700)</td></tr><tr><td>21</td><td>I feel sad because of my acne</td><td>Very clear 93.2% (n = 648)</td><td>95.6% (n = 698)</td></tr><tr><td>22</td><td>I am discouraged because of my acne</td><td>Very clear 88.6% (n = 643)</td><td>82.3% (n = 693)</td></tr><tr><td>23</td><td>I am ashamed because of my acne</td><td>Very clear 92.2% (n = 640)</td><td>79.7% (n = 696)</td></tr><tr><td>24</td><td>I am annoyed because of my acne</td><td>Very clear 93.3% (n = 638)</td><td>76.6% (n = 696)</td></tr><tr><td>25</td><td>I am more irritable because of my acne</td><td>Very clear 88.2% (n = 642)</td><td>70.1% (n = 692)</td></tr><tr><td>26</td><td>I am concerned or worried about meeting new people because of my acne</td><td>Very clear 95.3% (n = 639)</td><td>88.3% (n = 693)</td></tr><tr><td>27</td><td>I tend to do things by myself because of my acne</td><td>Very clear 82.6% (n = 638)</td><td>48.9% (n = 687)</td></tr><tr><td>28</td><td>My acne causes discomfort or pain</td><td>Very clear 92.4% (n = 633)</td><td>83.7% (n = 689)</td></tr><tr><td>29</td><td>My skin feels dirty because of my acne</td><td>Very clear 92.0% (n = 635)</td><td>92.0% (n = 688)</td></tr><tr><td>30</td><td>My skin hurts/is sore because of my acne</td><td>Very clear 90.4% (n = 633)</td><td>96.8% (n = 687)</td></tr><tr><td>31</td><td>My skin burns because of my acne</td><td>Very clear 93.0% (n = 631)</td><td>54.7% (n = 688)</td></tr><tr><td>32</td><td>My skin itches because of my acne</td><td>Very clear 95.3% (n = 633)</td><td>71.9% (n = 688)</td></tr><tr><td>33</td><td>My skin is irritated because of my acne</td><td>Very clear 93.9% (n = 636)</td><td>92.1% (n = 687)</td></tr><tr><td>34</td><td>My skin is sensitive because of my acne</td><td>Very clear 95.9% (n = 632)</td><td>88.0% (n = 689)</td></tr><tr><td>35</td><td>My skin bleeds because of my acne</td><td>Very clear 86.4% (n = 631)</td><td>54.9% (n = 680)</td></tr><tr><td>36</td><td>I am concerned medication will not clear my face acne fast enough</td><td>Very clear 91.7% (n = 628)</td><td>84.1% (n = 685)</td></tr><tr><td>37</td><td>I am annoyed at having to spend time cleaning/treating facial acne</td><td>Very clear 94.6% (n = 629)</td><td>76.7% (n = 687)</td></tr><tr><td>38</td><td>I am concerned about the side effects from treatment of my acne</td><td>Very clear 94.6% (n = 631)</td><td>71.2% (n = 681)</td></tr><tr><td>39</td><td>Water bothers my acne</td><td>Very clear 88.8% (n = 632)</td><td>37.8% (n = 682)</td></tr><tr><td>40</td><td>I am dissatisfied with my self-appearance because of my acne</td><td>Very clear 96.4% (n = 631)</td><td>96.6% (n = 686)</td></tr><tr><td>41</td><td>I wish I looked better because of my acne</td><td>Very clear 94.1% (n = 632)</td><td>100% (n = 689)</td></tr><tr><td>42</td><td>I don't like photographs of me because of my acne</td><td>Very clear 96.5% (n = 632)</td><td>94.5% (n = 688)</td></tr><tr><td>43</td><td>I am upset about having facial acne</td><td>Very clear 95.7% (n = 633)</td><td>99.0% (n = 687)</td></tr><tr><td>44</td><td>I worry that my acne may get worse</td><td>Very clear 96.2% (n = 630)</td><td>97.7% (n = 687)</td></tr></tbody></table>

Continued
<table><caption>**Table I.** Patients' (n = 715) answers on clarity and impact of the first set of items</caption><thead><tr><th></th><th>Items of the long version</th><th>How clear is the item?</th><th>Impact of the item during last 2 weeks</th></tr></thead><tbody><tr><td>1</td><td>I feel like an "outcast" because of my acne</td><td>Very clear 68.4% (n = 699)</td><td>67.9% (n = 713)</td></tr><tr><td>2</td><td>I have difficulties in relationships with my spouse/partner because of my acne</td><td>Very clear 88.0% (n = 686)</td><td>37.2% (n = 705)</td></tr><tr><td>3</td><td>I have difficulties in relationship with my close friends because of my acne</td><td>Very clear 90.9% (n = 681)</td><td>34.3% (n = 712)</td></tr><tr><td>4</td><td>I have difficulties in relationship with my immediate family because of my acne</td><td>Very clear 91.6% (n = 633)</td><td>38.5% (n = 712)</td></tr><tr><td>5</td><td>I feel social withdrawal because of my acne</td><td>Very clear 90.1% (n = 680)</td><td>66.5% (n = 710)</td></tr><tr><td>6</td><td>Acne interferes with my sex life</td><td>Very clear 91.9% (n = 668)</td><td>35.1% (n = 700)</td></tr><tr><td>7</td><td>Acne affects my social or leisure activities</td><td>Very clear 93.1% (n = 666)</td><td>79.1% (n = 708)</td></tr><tr><td>8</td><td>My acne stops me from being close with those I love</td><td>Very clear 91.7% (n = 662)</td><td>49.4% (n = 702)</td></tr><tr><td>9</td><td>My acne affects my going out, playing and doing hobbies</td><td>Very clear 92.8% (n = 667)</td><td>57.0% (n = 707)</td></tr><tr><td>10</td><td>I have problems with the use of public changing rooms/ swimming pools because of my acne</td><td>Very clear 90.6% (n = 661)</td><td>43.0% (n = 703)</td></tr><tr><td>11</td><td>It was difficult to do any sport because of my acne</td><td>Very clear 92.4% (n = 662)</td><td>37.1% (n = 706)</td></tr><tr><td>12</td><td>I believe that people are staring at me because of my acne</td><td>Very clear 95.0% (n = 662)</td><td>83.6% (n = 706)</td></tr><tr><td>13</td><td>People are calling me names, tease, bully, ask questions or avoid me because of my acne</td><td>Very clear 95.0% (n = 659)</td><td>61.3% (n = 703)</td></tr><tr><td>14</td><td>Acne prevents me from working or studying or I have problems at work or studying</td><td>Very clear 94.4% (n = 655)</td><td>39.1% (n = 704)</td></tr><tr><td>15</td><td>I have sleep problems because of my acne</td><td>Very clear 87.6% (n = 653)</td><td>15.8% (n = 703)</td></tr><tr><td>16</td><td>Acne interferes with my going shopping or looking after my home or garden</td><td>Very clear 82.1% (n = 653)</td><td>35.9% (n = 702)</td></tr><tr><td>17</td><td>I am aggressive because of my acne</td><td>Very clear 92.0% (n = 649)</td><td>79.3% (n = 700)</td></tr><tr><td>18</td><td>I am frustrated because of my acne</td><td>Very clear 91.2% (n = 649)</td><td>96.7% (n = 698)</td></tr><tr><td>19</td><td>I am embarrassed because of my acne</td><td>Very clear 90.8% (n = 649)</td><td>82.5% (n = 698)</td></tr><tr><td>20</td><td>I am worrying or anxious because of my acne</td><td>Very clear 92.9% (n = 650)</td><td>82.9% (n = 700)</td></tr><tr><td>21</td><td>I feel sad because of my acne</td><td>Very clear 93.2% (n = 648)</td><td>95.6% (n = 698)</td></tr><tr><td>22</td><td>I am discouraged because of my acne</td><td>Very clear 88.6% (n = 643)</td><td>82.3% (n = 693)</td></tr><tr><td>23</td><td>I am ashamed because of my acne</td><td>Very clear 92.2% (n = 640)</td><td>79.7% (n = 696)</td></tr><tr><td>24</td><td>I am annoyed because of my acne</td><td>Very clear 93.3% (n = 638)</td><td>76.6% (n = 696)</td></tr><tr><td>25</td><td>I am more irritable because of my acne</td><td>Very clear 88.2% (n = 642)</td><td>70.1% (n = 692)</td></tr><tr><td>26</td><td>I am concerned or worried about meeting new people because of my acne</td><td>Very clear 95.3% (n = 639)</td><td>88.3% (n = 693)</td></tr><tr><td>27</td><td>I tend to do things by myself because of my acne</td><td>Very clear 82.6% (n = 638)</td><td>48.9% (n = 687)</td></tr><tr><td>28</td><td>My acne causes discomfort or pain</td><td>Very clear 92.4% (n = 633)</td><td>83.7% (n = 689)</td></tr><tr><td>29</td><td>My skin feels dirty because of my acne</td><td>Very clear 92.0% (n = 635)</td><td>92.0% (n = 688)</td></tr><tr><td>30</td><td>My skin hurts/is sore because of my acne</td><td>Very clear 90.4% (n = 633)</td><td>96.8% (n = 687)</td></tr><tr><td>31</td><td>My skin burns because of my acne</td><td>Very clear 93.0% (n = 631)</td><td>54.7% (n = 688)</td></tr><tr><td>32</td><td>My skin itches because of my acne</td><td>Very clear 95.3% (n = 633)</td><td>71.9% (n = 688)</td></tr><tr><td>33</td><td>My skin is irritated because of my acne</td><td>Very clear 93.9% (n = 636)</td><td>92.1% (n = 687)</td></tr><tr><td>34</td><td>My skin is sensitive because of my acne</td><td>Very clear 95.9% (n = 632)</td><td>88.0% (n = 689)</td></tr><tr><td>35</td><td>My skin bleeds because of my acne</td><td>Very clear 86.4% (n = 631)</td><td>54.9% (n = 680)</td></tr><tr><td>36</td><td>I am concerned medication will not clear my face acne fast enough</td><td>Very clear 91.7% (n = 628)</td><td>84.1% (n = 685)</td></tr><tr><td>37</td><td>I am annoyed at having to spend time cleaning/treating facial acne</td><td>Very clear 94.6% (n = 629)</td><td>76.7% (n = 687)</td></tr><tr><td>38</td><td>I am concerned about the side effects from treatment of my acne</td><td>Very clear 94.6% (n = 631)</td><td>71.2% (n = 681)</td></tr><tr><td>39</td><td>Water bothers my acne</td><td>Very clear 88.8% (n = 632)</td><td>37.8% (n = 682)</td></tr><tr><td>40</td><td>I am dissatisfied with my self-appearance because of my acne</td><td>Very clear 96.4% (n = 631)</td><td>96.6% (n = 686)</td></tr><tr><td>41</td><td>I wish I looked better because of my acne</td><td>Very clear 94.1% (n = 632)</td><td>100% (n = 689)</td></tr><tr><td>42</td><td>I don't like photographs of me because of my acne</td><td>Very clear 96.5% (n = 632)</td><td>94.5% (n = 688)</td></tr><tr><td>43</td><td>I am upset about having facial acne</td><td>Very clear 95.7% (n = 633)</td><td>99.0% (n = 687)</td></tr><tr><td>44</td><td>I worry that my acne may get worse</td><td>Very clear 96.2% (n = 630)</td><td>97.7% (n = 687)</td></tr></tbody></table>

Continued
<table><caption>**Table I. Cont'd**</caption><thead><tr><th colspan="2">Items of the long version</th><th>How clear is the item?</th><th>Impact of the item during last 2 weeks</th></tr></thead><tbody><tr><td>45</td><td>I feel lacking in self-confidence because of my acne</td><td>Very clear 95.8% (n = 637)</td><td>95.1% (n = 690)</td></tr><tr><td>46</td><td>I need to use makeup because of my acne</td><td>Very clear 92.1% (n = 633)</td><td>79.3% (n = 691)</td></tr></tbody></table>

Severe acne can cause soreness, swelling, and bleeding, making pain and discomfort challenging symptoms of this condition.¹⁷,¹⁸

Acne can be associated with multiple breakouts, treatment failure, and scarring. The social stigma associated with it can be destabilizing for the individuals, leading to symptoms of anxiety and depression.¹⁹ In 1 study nearly 2 in 3 teenagers acknowledged that acne had been a source of embarrassment.²⁰ Moreover, the social stigma associated with acne, together with the fear of being treated differently, can often lead individuals to withdraw from social interactions, deepening feelings of loneliness and sadness.²¹ The prevalence of bullying, unsolicited advice, and tactless questions among acne patients is high and often lead to long-term negative effects.²² Some patients even considered COVID-19 related quarantine as a positive factor to decrease stress, stigmatization, and bullying.²²,²³

The constant worry that acne can exacerbate these symptoms, making individuals susceptible to a wider range of psychological problems including suicidal thoughts.²⁴,²⁵ Although psychiatric comorbidities frequently accompany acne patients in dermatology, they are almost never directed to dermatology-psychiatry liaison clinics. Depression, anxiety, stress, decreased self-esteem, suicidal thoughts, and even suicide attempts are too frequent to ignore in these patients.²⁶ Acne can play an important negative role in sexuality and satisfaction.²⁷ Surprisingly, acne's effect on sexual difficulties, work or school was not associated with the decision to visit a dermatologist in 1 study.²⁸

The limitation of our study is that included patients and experts may not be fully representative of all acne patients and health care professionals worldwide.

Most of the items from the initial list that represented topics from acne-specific and dermatology-specific instruments were not relevant to acne patients, especially for more recent time periods.³,⁴ Therefore, it could be that clinically effective treatment may not apparently improve patients' quimp during the selected time period. The acne-specific QoL questionnaire Quality of Life Relevance-Acne

may help to present detailed analysis of patients' quimp and therefore may be important to establish individual long-term treatment strategy, to increase treatment adherence, and could be helpful for other dermatological purposes where the QoL measurement is important.⁴,²⁹ We hope that our new acne-specific HRQoL questionnaire contains the most important and relevant items for acne patients worldwide. A promising and innovative approach is to create new QoL instruments by international groups of specialists, rather than within individual countries, as in the case of the European KIDSCREEN/DISABKIDS project³⁰ or the InToDermQoL questionnaire and its epidermolysis bullosa-specific module.³¹,³² Relevance of topics for acne patient was checked in different European countries and validation of the new acne-specific instrument will be organized simultaneously in different countries and languages to avoid potential cross-cultural inequivalence.

The methodology of QoL instrument validation is constantly becoming more rigorous and practically oriented.³³ In order to define when the change in a score of a HRQoL instrument becomes 'significant' to a patient, the minimal clinically important difference (MCID) can be calculated. The MCID represents the smallest improvement considered worthwhile by a patient. The concept of an MCID is offered as the new standard for determining minimal effectiveness of a given treatment and for describing patient satisfaction in reference to that treatment.³⁴ In order to give clinically useful meaning to QoL scores, it is possible to define score band descriptors.³⁵ Detailed recommendations on treatment goals and changes of treatment approaches, based on a HRQoL questionnaire with a validated banding system, may be an important and promising approach.³ MCID and score banding system were established for the most widely used dermatology-specific HRQoL instrument the Dermatology Life Quality Index and for the InToDermQoL questionnaire.³⁶⁻³⁸ Therefore extensive validation and establishing severity banding system and MCID for the Quality of Life Relevance-Acne questionnaire is an important task for future studies. QoL assessment in dermatology is a rapidly developing field with a gradual shift from
<table><caption>**Table I. Cont'd**</caption><thead><tr><th colspan="2">Items of the long version</th><th>How clear is the item?</th><th>Impact of the item during last 2 weeks</th></tr></thead><tbody><tr><td>45</td><td>I feel lacking in self-confidence because of my acne</td><td>Very clear 95.8% (n = 637)</td><td>95.1% (n = 690)</td></tr><tr><td>46</td><td>I need to use makeup because of my acne</td><td>Very clear 92.1% (n = 633)</td><td>79.3% (n = 691)</td></tr></tbody></table>

Severe acne can cause soreness, swelling, and bleeding, making pain and discomfort challenging symptoms of this condition.¹⁷,¹⁸

Acne can be associated with multiple breakouts, treatment failure, and scarring. The social stigma associated with it can be destabilizing for the individuals, leading to symptoms of anxiety and depression.¹⁹ In 1 study nearly 2 in 3 teenagers acknowledged that acne had been a source of embarrassment.²⁰ Moreover, the social stigma associated with acne, together with the fear of being treated differently, can often lead individuals to withdraw from social interactions, deepening feelings of loneliness and sadness.²¹ The prevalence of bullying, unsolicited advice, and tactless questions among acne patients is high and often lead to long-term negative effects.²² Some patients even considered COVID-19 related quarantine as a positive factor to decrease stress, stigmatization, and bullying.²²,²³

The constant worry that acne can exacerbate these symptoms, making individuals susceptible to a wider range of psychological problems including suicidal thoughts.²⁴,²⁵ Although psychiatric comorbidities frequently accompany acne patients in dermatology, they are almost never directed to dermatology-psychiatry liaison clinics. Depression, anxiety, stress, decreased self-esteem, suicidal thoughts, and even suicide attempts are too frequent to ignore in these patients.²⁶ Acne can play an important negative role in sexuality and satisfaction.²⁷ Surprisingly, acne's effect on sexual difficulties, work or school was not associated with the decision to visit a dermatologist in 1 study.²⁸

The limitation of our study is that included patients and experts may not be fully representative of all acne patients and health care professionals worldwide.

Most of the items from the initial list that represented topics from acne-specific and dermatology-specific instruments were not relevant to acne patients, especially for more recent time periods.³,⁴ Therefore, it could be that clinically effective treatment may not apparently improve patients' quimp during the selected time period. The acne-specific QoL questionnaire Quality of Life Relevance-Acne

may help to present detailed analysis of patients' quimp and therefore may be important to establish individual long-term treatment strategy, to increase treatment adherence, and could be helpful for other dermatological purposes where the QoL measurement is important.⁴,²⁹ We hope that our new acne-specific HRQoL questionnaire contains the most important and relevant items for acne patients worldwide. A promising and innovative approach is to create new QoL instruments by international groups of specialists, rather than within individual countries, as in the case of the European KIDSCREEN/DISABKIDS project³⁰ or the InToDermQoL questionnaire and its epidermolysis bullosa-specific module.³¹,³² Relevance of topics for acne patient was checked in different European countries and validation of the new acne-specific instrument will be organized simultaneously in different countries and languages to avoid potential cross-cultural inequivalence.

The methodology of QoL instrument validation is constantly becoming more rigorous and practically oriented.³³ In order to define when the change in a score of a HRQoL instrument becomes 'significant' to a patient, the minimal clinically important difference (MCID) can be calculated. The MCID represents the smallest improvement considered worthwhile by a patient. The concept of an MCID is offered as the new standard for determining minimal effectiveness of a given treatment and for describing patient satisfaction in reference to that treatment.³⁴ In order to give clinically useful meaning to QoL scores, it is possible to define score band descriptors.³⁵ Detailed recommendations on treatment goals and changes of treatment approaches, based on a HRQoL questionnaire with a validated banding system, may be an important and promising approach.³ MCID and score banding system were established for the most widely used dermatology-specific HRQoL instrument the Dermatology Life Quality Index and for the InToDermQoL questionnaire.³⁶⁻³⁸ Therefore extensive validation and establishing severity banding system and MCID for the Quality of Life Relevance-Acne questionnaire is an important task for future studies. QoL assessment in dermatology is a rapidly developing field with a gradual shift from
<figure><img src="image_2.png" /><figcaption>**Fig 1.** Standardized factor loadings of each dimension. F1 = Socioemotional dimension; F2 = Symptoms dimension; F3 = Stigma and Suicidal thoughts dimension.</figcaption></figure>
<figure><img src="image_4.png" /><figcaption>**Fig 1.** Standardized factor loadings of each dimension. F1 = Socioemotional dimension; F2 = Symptoms dimension; F3 = Stigma and Suicidal thoughts dimension.</figcaption></figure>
<table><caption>**Table II.** Final version of the Quality Of Life Relevance-Acne questionnaire</caption><thead><tr><th>Quality of Life Relevance-Acne</th><th></th></tr></thead><tbody><tr><td>1 I have been dissatisfied with my self-appearance because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>2 I have not liked photographs of me because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>3 My skin has burned because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>4 My skin had been itchy because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>5 My skin has been irritated because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>6 My skin has been sensitive because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>7 It was difficult to do sport or use swimming pools or public changing rooms because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>8 Acne has interfered with my sex life</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>9 I have been concerned medication will not clear my acne fast enough</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>10 I have been concerned about the side effects from treatment of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>11 I worried that my acne may get worse</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>12 I found it difficult to communicate with others because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>13 I felt lacking in self-confidence because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>14 I was upset about having acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr></tbody></table>
<table><caption>**Table II.** Final version of the Quality Of Life Relevance-Acne questionnaire</caption><thead><tr><th></th><th>Quality of Life Relevance-Acne</th><th></th></tr></thead><tbody><tr><td>1</td><td>I have been dissatisfied with my self-appearance because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>2</td><td>I have not liked photographs of me because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>3</td><td>My skin has burned because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>4</td><td>My skin had been itchy because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>5</td><td>My skin has been irritated because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>6</td><td>My skin has been sensitive because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>7</td><td>It was difficult to do sport or use swimming pools or public changing rooms because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>8</td><td>Acne has interfered with my sex life</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>9</td><td>I have been concerned medication will not clear my acne fast enough</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>10</td><td>I have been concerned about the side effects from treatment of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>11</td><td>I worried that my acne may get worse</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>12</td><td>I found it difficult to communicate with others because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>13</td><td>I felt lacking in self-confidence because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>14</td><td>I was upset about having acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr></tbody></table>
<table><caption>**Table II. Cont'd**</caption><tr><td>15</td><td>I have been stressed because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>16</td><td>My acne caused suicidal thoughts</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>17</td><td>I felt lonely because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>18</td><td>People bullied me because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>19</td><td>People offered advice, or said things to me about my acne when I had not asked them to do that</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr></table>

theory to practice³³ and we hope that our new questionnaire will be used not only in research studies and core outcome sets³⁹ but also in clinical practice.

The authors thank Ms. Liliia Lobanova for her help with data collection.

**Conflicts of interest**

None declared.

**REFERENCES**

1. Chernyshov PV, Zouboulis CC, Tomas-Aragones L, et al. Quality of life measurement in acne. Position paper of the European Academy of Dermatology and Venereology Task Forces on quality of life and patient oriented outcomes and acne, rosacea and hidradenitis suppurativa. *J Eur Acad Dermatol Venereol.* 2018;32(2):194-208.

2. Nast A, Dréno B, Bettoli V, et al. European evidence-based (S3) guideline for the treatment of acne – update 2016 – short version. *J Eur Acad Dermatol Venereol.* 2016;30(8):1261-1268.

3. Marron SE, Chernyshov PV, Tomas-Aragones L. Quality-of-life research in acne vulgaris: current status and future directions. *Am J Clin Dermatol.* 2019;20(4):527-538.

4. Chernyshov PV, Sampogna F, Zouboulis CC, et al. Which health-related quality of life items most affect acne patients? *Dermatology.* 2023;239(2):267-272.

5. Revelle W. psych: Procedures for Psychological, Psychometric, and Personality Research. Northwestern University; 2023. R package version 2.3.6 https://CRAN.R-project.org/package=psych

6. van der Ark LA. New developments in mokken scale analysis in R. *J Stat Software.* 2012;48(5):1-27.

7. Browne MW, Cudeck R. Alternative ways of assessing model fit. *Socio Methods Res.* 1992;21(2):230-258.

8. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. *Struct Equ Model.* 1999;6(1):1-55.

9. Yu CY, Muthén B. Evaluating Cutoff Criteria of Model Fit Indices for Latent Variable Models with Binary and Continuous Outcomes. Doctoral Dissertation; 2002. http://www.statmodel.com/download/Yudissertation.pdf

10. Schumacker R, Lomax R. A Beginner's Guide to Structural Equation Modeling. 3rd ed. Routledge; 2010:530.

11. Nichols AL, Edlund JE. The Cambridge Handbook of Research Methods and Statistics for the Social and Behavioral Sciences. Cambridge University Press; 2023:887.

12. Preacher KJ, Zhang G, Kim C, Mels G. Choosing the optimal number of factors in exploratory factor analysis: a model selection perspective. *Multivariate Behav Res.* 2013;48(1):28-56.

13. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. 7th ed. Prentice Hall; 2010:761.

14. Tomas-Aragones L, Marron SE. Body image and body dysmorphic concerns. *Acta Derm Venereol.* 2016;96(217):47-50.

15. Pochynok T, Chernyshov IP, Asayevich N, Sushko S, Kopylova V, Chernyshov PV. Quality of life of school and university students with acne. *Acta Dermatovenerol Croat.* 2018;26(2):139-145.

16. França K, Keri J. Psychosocial impact of acne and post-inflammatory hyperpigmentation. *An Bras Dermatol.* 2017; 92(4):505-509.

17. Zaenglein AL, Pathy AL, Schlosser BJ, et al. Guidelines of care for the management of acne vulgaris. *J Am Acad Dermatol.* 2016;74(5):945-73.e33.

18. Bhate K, Williams HC. Epidemiology of acne vulgaris. *Br J Dermatol.* 2013;168(3):474-485.

19. Samuels DV, Rosenthal R, Lin R, Chaudhari S, Natsuaki MN. Acne vulgaris and risk of depression and anxiety: a meta-analytic review. *J Am Acad Dermatol.* 2020;83(2):532-541.

20. Ritvo E, Del Rosso JQ, Stillman MA, La Riche C. Psychosocial judgements and perceptions of adolescents with acne vulgaris: a blinded, controlled comparison of adult and peer evaluations. *Biopsychosoc Med.* 2011;5:11.

21. Zaenglein AL. Acne vulgaris. *N Engl J Med.* 2018;379(14):1343-1352.

22. Chernyshov PV, Tomas-Aragones L, Manolache L, et al. Bullying in persons with skin diseases. *J Eur Acad Dermatol*
<table><caption>**Table II. Cont'd**</caption><tr><td>15</td><td>I have been stressed because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>16</td><td>My acne caused suicidal thoughts</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>17</td><td>I felt lonely because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>18</td><td>People bullied me because of my acne</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr><tr><td>19</td><td>People offered advice, or said things to me about my acne when I had not asked them to do that</td><td>1. Frequently<br>2. Sometimes<br>3. Rarely<br>4. Never</td></tr></table>

theory to practice³³ and we hope that our new questionnaire will be used not only in research studies and core outcome sets³⁹ but also in clinical practice.

The authors thank Ms. Liliia Lobanova for her help with data collection.

**Conflicts of interest**

None declared.

**REFERENCES**

1. Chernyshov PV, Zouboulis CC, Tomas-Aragones L, et al. Quality of life measurement in acne. Position paper of the European Academy of Dermatology and Venereology Task Forces on quality of life and patient oriented outcomes and acne, rosacea and hidradenitis suppurativa. *J Eur Acad Dermatol Venereol.* 2018;32(2):194-208.

2. Nast A, Dréno B, Bettoli V, et al. European evidence-based (S3) guideline for the treatment of acne - update 2016 - short version. *J Eur Acad Dermatol Venereol.* 2016;30(8):1261-1268.

3. Marron SE, Chernyshov PV, Tomas-Aragones L. Quality-of-life research in acne vulgaris: current status and future directions. *Am J Clin Dermatol.* 2019;20(4):527-538.

4. Chernyshov PV, Sampogna F, Zouboulis CC, et al. Which health-related quality of life items most affect acne patients? *Dermatology.* 2023;239(2):267-272.

5. Revelle W. psych: Procedures for Psychological, Psychometric, and Personality Research. Northwestern University; 2023. R package version 2.3.6 https://CRAN.R-project.org/package=psych

6. van der Ark LA. New developments in mokken scale analysis in R. *J Stat Software.* 2012;48(5):1-27.

7. Browne MW, Cudeck R. Alternative ways of assessing model fit. *Socio Methods Res.* 1992;21(2):230-258.

8. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. *Struct Equ Model.* 1999;6(1):1-55.

9. Yu CY, Muthén B. Evaluating Cutoff Criteria of Model Fit Indices for Latent Variable Models with Binary and Continuous Outcomes. Doctoral Dissertation; 2002. http://www.statmodel.com/download/Yudissertation.pdf

10. Schumacker R, Lomax R. A Beginner's Guide to Structural Equation Modeling. 3rd ed. Routledge; 2010:530.

11. Nichols AL, Edlund JE. The Cambridge Handbook of Research Methods and Statistics for the Social and Behavioral Sciences. Cambridge University Press; 2023:887.

12. Preacher KJ, Zhang G, Kim C, Mels G. Choosing the optimal number of factors in exploratory factor analysis: a model selection perspective. *Multivariate Behav Res.* 2013;48(1):28-56.

13. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. 7th ed. Prentice Hall; 2010:761.

14. Tomas-Aragones L, Marron SE. Body image and body dysmorphic concerns. *Acta Derm Venereol.* 2016;96(217):47-50.

15. Pochynok T, Chernyshov IP, Asayevich N, Sushko S, Kopylova V, Chernyshov PV. Quality of life of school and university students with acne. *Acta Dermatovenerol Croat.* 2018;26(2):139-145.

16. França K, Keri J. Psychosocial impact of acne and post-inflammatory hyperpigmentation. *An Bras Dermatol.* 2017; 92(4):505-509.

17. Zaenglein AL, Pathy AL, Schlosser BJ, et al. Guidelines of care for the management of acne vulgaris. *J Am Acad Dermatol.* 2016;74(5):945-73.e33.

18. Bhate K, Williams HC. Epidemiology of acne vulgaris. *Br J Dermatol.* 2013;168(3):474-485.

19. Samuels DV, Rosenthal R, Lin R, Chaudhari S, Natsuaki MN. Acne vulgaris and risk of depression and anxiety: a meta-analytic review. *J Am Acad Dermatol.* 2020;83(2):532-541.

20. Ritvo E, Del Rosso JQ, Stillman MA, La Riche C. Psychosocial judgements and perceptions of adolescents with acne vulgaris: a blinded, controlled comparison of adult and peer evaluations. *Biopsychosoc Med.* 2011;5:11.

21. Zaenglein AL. Acne vulgaris. *N Engl J Med.* 2018;379(14):1343-1352.

22. Chernyshov PV, Tomas-Aragones L, Manolache L, et al. Bullying in persons with skin diseases. *J Eur Acad Dermatol*
Venereol. 2024;38(4):752-760. https://doi.org/10.1111/jdv. 19683

23. Chernyshov PV, Tomas-Aragones L, Augustin M, et al. Position statement of the European Academy of Dermatology and Venereology Task Force on Quality of Life and Patient Oriented Outcomes on quality of life issues in dermatologic patients during the COVID-19 pandemic. *J Eur Acad Dermatol Venereol.* 2020;34(8):1666-1671.

24. Xu S, Zhu Y, Hu H, et al. The analysis of acne increasing suicide risk. *Medicine (Baltimore)*. 2021;100(24):e26035.

25. Gupta N, Gupta M. The controversies surrounding acne and suicide: essential knowledge for clinicians. *Cureus*. 2023;15(8): e43867.

26. Aslan Kayiran M, Karadag AS, Jafferany M. Psychodermatology of acne: dermatologist's guide to inner side of acne and management approach. *Dermatol Ther*. 2020;33(6):e14150.

27. Beisert M, Pilarczyk K, Zakrzewska M, Pawlaczyk M. Sexual satisfaction and self-esteem in women with acne. *J Cosmet Dermatol*. 2020;19(7):1768-1773.

28. Chernyshov PV, Petrenko A, Kopylova V. What health-related quality of life factors influence the decision of patients with acne to visit a dermatologist? *J Clin Aesthet Dermatol*. 2018; 11(7):21-25.

29. Finlay AY, Salek MS, Abeni D, et al. Why quality of life measurement is important in dermatology clinical practice: an expert-based opinion statement by the EADV Task Force on Quality of Life. *J Eur Acad Dermatol Venereol*. 2017;31(3): 424-431.

30. Ravens-Sieberer U, Schmidt S, Gosch A, Erhart M, Petersen C, Bullinger M. Measuring subjective health in children and adolescents: results of the European KIDSCREEN/DISABKIDS Project. *Psychosoc Med*. 2007;4:Doc08.

31. Chernyshov PV, Boffa MJ, Corso R, et al. Creation and pilot test results of the dermatology-specific proxy instrument: the Infants and Toddlers Dermatology Quality of Life. *J Eur Acad Dermatol Venereol*. 2018;32(12):2288-2294.

32. Chernyshov PV, Suru A, Gedeon I, et al. Epidermolysis bullosa-specific module of the Infants and Toddlers Dermatology Quality of Life (InToDermQoL) questionnaire. *J Eur Acad Dermatol Venereol*. 2019;33(3):612-617.

33. Chernyshov PV. The evolution of quality of life assessment and use in dermatology. *Dermatology*. 2019;235(3):167-174.

34. Copay AG, Subach BR, Glassman SD, Polly DW Jr, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. *Spine J*. 2007;7:541-546.

35. Finlay AY, Sampogna F. What do scores mean? Informed interpretation and clinical judgement are needed. *Br J Dermatol*. 2018;179:1021-1022.

36. Basra MK, Salek MS, Camilleri L, Sturkey R, Finlay AY. Determining the minimal clinically important difference and responsiveness of the Dermatology Life Quality Index (DLQI): further data. *Dermatology*. 2015;230:27-33.

37. Chernyshov PV, Marron SE, Boffa MJ, et al. Sensitivity to treatment and score bands of the Infants and Toddlers Dermatology Quality of Life questionnaire. *JAAD Int*. 2022;10: 61-67.

38. Chernyshov PV, Marron SE, Koumaki D, et al. Responsiveness and minimal clinically important difference of the Infants and Toddlers Dermatology Quality of Life questionnaire. *Dermatol Ther (Heidelb)*. 2023;13(11):2879-2893.

39. Chernyshov PV, Evers AWM, Bewley A, et al. Quality of life assessment in core outcome sets: a position statement of the EADV task force on quality of life and patient oriented outcomes. *J Eur Acad Dermatol Venereol*. 2022;36(1):20-23.
Venereol. 2024;38(4):752-760. https://doi.org/10.1111/jdv. 19683

23. Chernyshov PV, Tomas-Aragones L, Augustin M, et al. Position statement of the European Academy of Dermatology and Venereology Task Force on Quality of Life and Patient Oriented Outcomes on quality of life issues in dermatologic patients during the COVID-19 pandemic. *J Eur Acad Dermatol Venereol.* 2020;34(8):1666-1671.

24. Xu S, Zhu Y, Hu H, et al. The analysis of acne increasing suicide risk. *Medicine (Baltimore)*. 2021;100(24):e26035.

25. Gupta N, Gupta M. The controversies surrounding acne and suicide: essential knowledge for clinicians. *Cureus*. 2023;15(8): e43867.

26. Aslan Kayiran M, Karadag AS, Jafferany M. Psychodermatology of acne: dermatologist's guide to inner side of acne and management approach. *Dermatol Ther*. 2020;33(6):e14150.

27. Beisert M, Pilarczyk K, Zakrzewska M, Pawlaczyk M. Sexual satisfaction and self-esteem in women with acne. *J Cosmet Dermatol*. 2020;19(7):1768-1773.

28. Chernyshov PV, Petrenko A, Kopylova V. What health-related quality of life factors influence the decision of patients with acne to visit a dermatologist? *J Clin Aesthet Dermatol*. 2018; 11(7):21-25.

29. Finlay AY, Salek MS, Abeni D, et al. Why quality of life measurement is important in dermatology clinical practice: an expert-based opinion statement by the EADV Task Force on Quality of Life. *J Eur Acad Dermatol Venereol*. 2017;31(3): 424-431.

30. Ravens-Sieberer U, Schmidt S, Gosch A, Erhart M, Petersen C, Bullinger M. Measuring subjective health in children and adolescents: results of the European KIDSCREEN/DISABKIDS Project. *Psychosoc Med*. 2007;4:Doc08.

31. Chernyshov PV, Boffa MJ, Corso R, et al. Creation and pilot test results of the dermatology-specific proxy instrument: the Infants and Toddlers Dermatology Quality of Life. *J Eur Acad Dermatol Venereol*. 2018;32(12):2288-2294.

32. Chernyshov PV, Suru A, Gedeon I, et al. Epidermolysis bullosa-specific module of the Infants and Toddlers Dermatology Quality of Life (InToDermQoL) questionnaire. *J Eur Acad Dermatol Venereol*. 2019;33(3):612-617.

33. Chernyshov PV. The evolution of quality of life assessment and use in dermatology. *Dermatology*. 2019;235(3):167-174.

34. Copay AG, Subach BR, Glassman SD, Polly DW Jr, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. *Spine J*. 2007;7:541-546.

35. Finlay AY, Sampogna F. What do scores mean? Informed interpretation and clinical judgement are needed. *Br J Dermatol*. 2018;179:1021-1022.

36. Basra MK, Salek MS, Camilleri L, Sturkey R, Finlay AY. Determining the minimal clinically important difference and responsiveness of the Dermatology Life Quality Index (DLQI): further data. *Dermatology*. 2015;230:27-33.

37. Chernyshov PV, Marron SE, Boffa MJ, et al. Sensitivity to treatment and score bands of the Infants and Toddlers Dermatology Quality of Life questionnaire. *JAAD Int*. 2022;10: 61-67.

38. Chernyshov PV, Marron SE, Koumaki D, et al. Responsiveness and minimal clinically important difference of the Infants and Toddlers Dermatology Quality of Life questionnaire. *Dermatol Ther (Heidelb)*. 2023;13(11):2879-2893.

39. Chernyshov PV, Evers AWM, Bewley A, et al. Quality of life assessment in core outcome sets: a position statement of the EADV task force on quality of life and patient oriented outcomes. *J Eur Acad Dermatol Venereol*. 2022;36(1):20-23.