# Validation of the French Clinical Assessment Interview for Negative Symptoms in a Sample of Stable French Individuals With Schizophrenia

Yasmine Laraki, Cindy Lebrun, Marine Merenciano, Margot Eisenblaetter, Jerôme Attal, Alexandra Macgregor, Amandine Decombe, Delphine Capdevielle, Stephane Raffard

► To cite this version:

Yasmine Laraki, Cindy Lebrun, Marine Merenciano, Margot Eisenblaetter, Jerôme Attal, et al. Val-
idation of the French Clinical Assessment Interview for Negative Symptoms in a Sample of Stable
French Individuals With Schizophrenia. Frontiers in Psychiatry, inPress, 13, pp.836600. 10.3389/fp-
syt.2022.836600. hal-03647358

HAL Id: hal-03647358

https://hal.science/hal-03647358

Submitted on 12 Jul 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

Check for
updates

# Validation of the French Clinical Assessment Interview for Negative Symptoms in a Sample of Stable French Individuals With Schizophrenia

Yasmine Laraki<fnref n="1" />,²*†, Cindy Lebrun², Marine Merenciano<fnref n="1" />, Margot Eisenblaetter², Jerôme Attal<fnref n="1" />, Alexandra Macgregor<fnref n="1" />, Amandine Decombe<fnref n="1" />, Delphine Capdevielle<fnref n="1" />,³ and Stéphane Raffard<fnref n="1" />,²†

OPEN ACCESS

**Edited by:**

Ingrid Melle,
University of Oslo, Norway

**Reviewed by:**

Sonia Dollfus,
Université de Caen Normandie,
France
Philip D. Harvey,
University of Miami, United States
William Horan,
University of California, Los Angeles,
United States

*Correspondence:

Yasmine Laraki
y-laraki@chu-montpellier.fr

†ORCID:

Stéphane Raffard
orcid.org/0000-0001-5563-0323
Yasmine Laraki
orcid.org/0000-0001-6675-9974

**Specialty section:**

This article was submitted to
Schizophrenia,
a section of the journal
Frontiers in Psychiatry

Received: 15 December 2021

Accepted: 21 February 2022

Published: 01 April 2022

**Citation:**

Laraki Y, Lebrun C, Merenciano M, Eisenblaetter M, Attal J, Macgregor A, Decombe A, Capdevielle D and Raffard S (2022) Validation of the French Clinical Assessment Interview for Negative Symptoms in a Sample of Stable French Individuals With Schizophrenia. *Front. Psychiatry* 13:836600. doi: 10.3389/fpsyt.2022.836600

**Objectives:** The Clinical Assessment Interview for Negative Symptoms (CAINS) is an interview-based instrument evaluating the existence and severity of negative symptoms in people diagnosed with schizophrenia or schizoaffective disorder. The aim of this study is to translate and validate a French version of the CAINS in a French sample of outpatients diagnosed with schizophrenia or schizoaffective disorder.

**Methods:** In this study, we included 84 outpatients with a diagnosis of schizophrenia from the University Department of Adult Psychiatry in Montpellier, France. All participants were assessed for the severity of negative symptoms as well as level of depression. Psychometric properties of the French CAINS were investigated including its factor structure, internal consistency, and interrater and test-retest reliabilities. We also determined the discriminant and convergent validity.

**Results:** Exploratory factor analysis and parallel analysis reproduced the two-factor model, and explained 43.55% of the total score variation with good internal consistency (Cronbach α of 0.87). Both interrater and test-retest reliabilities were high for the CAINS and its subscales (intraclass correlation coefficient range, 0.89-0.99). The standard errors of measurement and minimal detectable change were also investigated. Convergent validity of the CAINS was underpinned by correlations obtained with various measures of negative symptoms. Adequate discriminant validity was established by showing that the CAINS did not correlate with positive symptoms.

**Conclusion:** Overall, our results obtained were similar to those found in the original study of the CAINS. Structural analyses also replicated the two-factor model of the CAINS. Our results indicate that the French CAINS has robust psychometric properties and is a valid tool for evaluating negative symptoms in French-speaking individuals diagnosed with schizophrenia.

**Keywords:** negative symptoms, schizophrenia, rating scale, validation, Clinical Assessment Interview for Negative Symptoms

<footnote n="1">¹ University Department of Adult Psychiatry, CHU Montpellier, University of Montpellier, Hôpital la Colombière, Montpellier, France, ² Université Paul Valéry Montpellier 3, EPSYLON EA, Montpellier, France, ³ IGF, University of Montpellier, CNRS, INSERM, Montpellier, France</footnote>
# INTRODUCTION

Researchers and clinicians have consistently shown that negative symptoms of schizophrenia are resistant to pharmaceutical treatments and persist even when positive symptoms are in remission (1–3). Moreover negative symptoms are associated with augmented caregiver burden, lowered prognostic outcomes, and poorer social functioning and may even be a predictor of social impairment within this population (4–8). A great deal of research has attempted to better understand the underlying mechanisms and constructs of negative symptoms, with the objective of increasing treatment options for this population. Increased understanding of negative symptoms requires the development of assessment tools that specifically capture the underlying constructs of negative symptoms, such as stated by the National Institute of Mental Health (NIMH) (9).

Historically, the most frequently used assessments to evaluate negative symptoms were the Scale for the Assessment of Negative Symptoms (SANS) (10) and the negative subscale of the Positive and Negative Syndrome Scale (PANSS) (11). Although the PANSS and SANS are often used in both clinical and research settings, it has been shown that caution is necessary in the interpretability of the results obtained using such scales (see for review) (12, 13). Evidence shows that some items included in these scales (such as attentional impairment or mannerisms) do not actually reflect negative symptom domains of schizophrenia (9, 14). Following the NIMH conference, experts concluded that negative symptoms are best conceptualized through five negative symptom domains (anhedonia, asociality, avolition, alogia, and blunted affect) and that rating scales should focus on findings drawn from affective sciences and fields of psychopathology (9). Recently, the European Psychiatric Association (EPA) have presented specific recommendations on how to better assess and obtain a more comprehensive understanding of negative symptoms present in individuals diagnosed with schizophrenia (14). As such, the EPA encourages clinicians and researchers to use second-generation scales such as the Brief Negative Symptom Scale (BNSS) (15) and the Clinical Assessment Interview for Negative Symptoms (CAINS) (16). Overall, these instruments share several similarities, such as having undergone rigorous analytical procedures, containing 13 items, including comprehensive manuals and probing interview questions and cover the five core negative symptom domains (17). Large-scale validation studies have also demonstrated strong psychometric properties for the BNSS and the CAINS (see for review) (14, 17). Hence, validations of the BNSS and CAINS are paramount in improving the assessments and treatment of negative symptoms in people with schizophrenia (9, 14).

To this date, the BNSS has been translated and validated into the French language in a large European and multicenter study (18) and has undergone cross-cultural psychometric analyses (19), but validation of the CAINS in the French language has yet to be done.

The main objective of the creators of the CAINS was to create a reliable, practical, and comprehensive tool that would best measure negative symptoms and would serve in both clinical and research settings (20). Following rigorous and multilevel

analytic techniques including item deletions, modifications, and revisions, the developers of the CAINS were able to produce a clear, psychometrically valid scale that best captures the underlying mechanisms of negative symptoms (4, 5, 16, 20). This tool is a semistructured scale that measures constructs of motivation, pleasure, interest for social relationships and affective expression (5). Contrarily to the BNSS, the CAINS contains a lengthier interview that can provide more of a nuanced analysis of the range and frequencies of pleasurable activities (17). Overall, the CAINS measures negative symptoms across three life domains: recreational, social, and vocational. The CAINS includes assessments in terms of behavioral involvement in activities and experiences in terms of motivation, thus allowing for a complete image of the negative symptomatology (4). The validation of the original CAINS included nearly 500 individuals diagnosed with schizophrenia (5, 16). As the CAINS has become a common tool used to measure negative symptoms in schizophrenia and has been translated and validated in German, Spanish, Korean, Serbian, and Chinese, consistently showing high psychometric properties throughout (21–25).

The aim of the present study was to translate the original English version of the CAINS into French and evaluate its factor structure, internal consistency, and both interrater and test–retest reliability. We also determined the discriminant and convergent validity of this French version of the CAINS.

# MATERIALS AND METHODS

## Participants

A total of 84 stable outpatients with a diagnosis of schizophrenia or schizoaffective disorder were recruited from the University Department of Adult Psychiatry in Montpellier, France. All participants had to be aged between 18 and 60 years, have a confirmed diagnosis of schizophrenia based on the *Diagnostic Statistical Manual of Mental Disorders, Fifth Edition* (26), and were able to speak and understand French. Patients were excluded from participating if they had a history of a traumatic brain injury or if they were unable to participate in the assessment (e.g., if there was presence of severe psychiatric symptoms). All participants included in this study were considered to be in stable phases of illness by the investigator, which was defined by no hospitalizations over the past 6 months, and no changes in pharmacological treatments were expected within the month of recruitment (or within the month preceding recruitment).

This study was approved by the institution's ethics committee (IRB approval number: 202100974) and is in line with the Declaration of Helsinki 1975 standards for human experimentation.

## Procedure

The CAINS and its corresponding manual was translated and adapted into French following the specific guidelines for translations and cultural adaptation standards (27). To begin, we contacted the initial developers of the CAINS and obtained formal authorization to conduct the French translation and adaptation of the tool. The CAINS was then translated into
the target language by two independent professional translators. A third expert then compared both forward translations and resolved any discrepancies between both versions into a single target translation. A back-translation was then done by a bilingual expert; a comparison between the back-translation and the original tool was revised, and any discrepancies were discussed and resolved. A panel of experts then compared the back-translation to the original version in order to verify that both English versions were equivalent in terms of conceptual content. Following a panel discussion, a harmonized version of the tool in the target language was proposed. A pretest was conducted on 10 patients in order to verify that the interview was understandable by our target population. Given that no difficulties were observed, a finalized version of the tool was proofread and any remaining errors were corrected before obtaining the final version of the French CAINS.

Once the finalized version of the French CAINS was developed, the two psychologists received full training on administering and scoring the CAINS. The training took place at the University Department of Adult Psychiatry in Montpellier and included videotaped interviews as well as group discussions regarding the scoring. Specifically, the training covered how to administer the evaluation, based on the probing questions of the manual, as well as how to conduct the ratings, based on the training videos and gold standards provided by the developers of the CAINS (5, 12, 16, 20). Gold standard ratings of the videotaped interviews were also provided, which allowed the research team to increase rater competency. The trained research psychologists had previously received full training regarding the other measures used in this study [PANSS, SANS, and Calgary Depression Scale for Schizophrenia (CDSS)].

Once recruitment for this study was ready to begin, patients were contacted to participate in this study. All participants received a full explanation of the study and its objectives before giving their informed written consent. Participant inclusions began with collecting sociodemographic data and treatment dosages before administering the different clinical assessments. Interrater reliability was possible with the assistance of the second trained research psychologist who scored simultaneously the CAINS assessment for 22 participants. For the test-retest reliability, the same research psychologist assessed another 22 participants twice (at a 2-week interval).

## Measures

The CAINS (5) is a 13-item interview-based instrument evaluating the existence and severity of negative symptoms in people diagnosed with schizophrenia or schizoaffective disorder (4, 20). The semistructured interview includes specific questions and prompts for the clinician administering the test. Scoring is based on specific descriptors provided for each item and their corresponding ratings (16). All items are scored on a 5-point scale ranging from absent/no deficit (0) to severe deficit (4), whereby higher scores reflect greater impairment. The CAINS comprises two subscales: motivation and pleasure (MAP; nine items) and expression (EXP; four items). Generally speaking, the MAP subscale evaluates the presence of decreased motivation for close relationships and in experienced pleasure. The EXP subscale

measures deficits in terms of expression of emotions and speech. Subscale scores as well as total CAINS scores may be calculated by adding the results of each item. The time frame of the CAINS questions refers to experiences over the past week.

The PANSS (11) was used to determine convergent and discriminant validities of the French CAINS. The PANSS is a 30-item scale used to assess severity of symptomatology in individuals diagnosed with schizophrenia. Similarly to the CAINS, the PANSS measures symptomatology over the last 7 days. The PANSS comprises three subscales: positive, negative, and general psychopathology symptoms. Every item is rated on a 7-point scale ranging from 1 (absent) to 7 (extreme). Higher scores on the PANSS reflect greater impairment. The PANSS has been translated and validated in French with good psychometric properties (28). In this study, the PANSS had high internal consistency (total score, $\alpha = 0.87$) (29).

The SANS (10) was used to measure the convergent validity of the French CAINS. The SANS is a clinician-rated scale composed of 25 items grouped into the following five domains: (1) affective flattening, (2) alogia, (3) avolition-apathy, (4) anhedonia-asociality, and (5) attention. All items are scored on a 6-point scale ranging from 0 (absent) to 5 (severe), whereby higher total scores represent greater impairment. The SANS has been translated and validated into French (30) with good psychometric properties. In this study, the SANS had excellent internal consistency (total score, $\alpha = 0.94$) (29).

The CDSS (31) was used to measure the level of depressive symptoms. The CDSS is a structured interview scale composed of nine items. The total score of the CDSS can be calculated by adding the scores of each item. Each item can be scored on a 4-point scale ranging from 0 (absent) to 3 (severe), again higher scores indicating greater level of depression. The French version of the CDSS (32) has good internal consistency as well as good interrater reliability. In this study, this scale had acceptable internal consistency (total score, $\alpha = 0.77$) (29).

## Statistical Analysis Plan

All variables were tested for normality prior to analysis, and no normal distribution was considered if absolute values for skewness and kurtosis were greater than 3 and 10, respectively (33). First, we ran preliminary analyses concerning the demographic and clinical variables.

Item and scale characteristics [means, standard deviations (SDs), and corrected-item correlations] of the CAINS and its subscales were calculated. Internal scale consistency of the CAINS was calculated using means of Cronbach $\alpha$ (34). Values between 0.81 and 0.90 indicate good reliability, and values great than 0.91 are considered excellent (29).

Test-retest reliability and interrater reliability of the CAINS were evaluated using the intraclass correlation coefficient (ICC) with a 95% confidence interval (35). ICC was based on a two-way (random-effects) repeated-measures analysis of variance model with absolute agreement. Generally speaking, ICC results are considered good if the ICC is greater than 0.7, and anything greater than 0.9 is considered of excellent reliability (29). In order to differentiate between actual difference and random measurement error, we utilized the standard error of
measurement (SEM) and minimal detectable change (MDC), considered best practice in clinical literature (36). The SEM [SD × √(1 - ICC)] was calculated for the CAINS and subscales for both test-retest and interrater reliabilities. We created a variable of SD difference by calculating the difference between the SDs of the first test scores and retest scores. The SEM was then used to calculate the MDC with 95% confidence using the following formula: MDC = SEM × 1.96. The SEM is an estimation of the expected random variations in scores when no real change has occurred (36). The MDC uses the SEM to estimate the minimal amount of change that needs to be perceived, for a real change to be considered, and would not be due to inherent variation (36, 37). For a clearer clinical understanding, the MDC may be expressed as a percentage (MDC%), representing a relative amount of random variation of measurement. The MDC% can be calculated using the following formula: (MDC/mean of the CAINS) × 100 (37).

In order to investigate the CAINS structure and establish construct validity an exploratory factor analysis (principal axis factoring method with an oblimin rotation) was performed. The Kaiser-Meyer-Olkin measure of sampling adequacy (KMO) and Bartlett test of sphericity were first performed to measure whether our sample was large enough to conduct an exploratory factor analysis. KMO values between 0.70 and 0.79, between 0.80 and 0.90, and greater than 0.90 are good, mediocre, and superb, respectively. Given that the Kaiser criterion for factor extraction (eigenvalues >1.0) (38) may cause an overestimation of the number of factors (39), we decided to use scree plot and a parallel analysis (40) set at 0.01 to determine the factors to be retained.

Pearson correlations between the CAINS and clinical variables were used to determine both convergent and discriminant

validities. Specifically, convergent validity was established by examining whether the CAINS subscales (and individual items) significantly correlated with negative symptoms (based on the SANS and PANSS negative subscales). Discriminant validity was shown by verifying that the CAINS did not correlate with positive symptoms (PANSS positive subscale). A Bonferroni correction was applied to correct for multiple comparisons (set at $p_{corr} \le 0.003$).

All analyses were performed using the Statistical Package for the Social Sciences, version 24.0, with a two-tailed $\alpha$ level of 5% (41).

## RESULTS

Descriptive analyses were carried out using descriptive statistics. Data normality was confirmed for all variables using skewness and kurtosis standards (33). Demographic and clinical variables for the 84 participants are presented in Table 1.

## Item, Subscale Analyses, and Internal Consistency for the French Clinical Assessment Interview for Negative Symptoms

Item and subscale analyses for the French version of the CAINS are presented in Table 2. All corrected item-total correlation values for the 13 items were higher than 0.3, ranging from 0.41 to 0.69, with a mean of 0.54, indicating that items correlated well with the subscales (29). The correlation between the MAP and the EXP subscales was moderate ($r = 0.47, N = 84; p \le 0.01$). Internal consistency reliability was high for the total CAINS scale ($\alpha = 0.87$), as well as for the MAP ($\alpha = 0.86$) and EXP ($\alpha = 0.82$) subscales.

## Test-Retest Reliability

The ICC for the test-retest reliability of the total score of the CAINS was excellent: 0.92 with a 95% confidence interval ranging from 0.82 to 0.97; $p \le 0.0001$. The SEM and MDC were, respectively, 1.92 and 3.76, for the CAINS total scores, indicating that a change of approximately 4 points on the CAINS represents a real change with a 95% confidence level. The MDC% was 13.81%, signifying that a change of 13% in the CAINS total score is appropriate to detect a real change in symptomatology in an individual with a 95% confidence. Precisely, the average ICC for the CAINS MAP subscale was 0.89, ranging from 0.74 to 0.95 ($p \le 0.0001$). For the MAP subscale, the SEM was 1.97, and the MDC was 3.85. Concerning the EXP subscale of the CAINS, the average ICC was 0.89, ranging from 0.74 to 0.96 ($p \le 0.0001$). The SEM and MDC for the EXP subscale were 1.45 and 2.84, respectively.

## Interrater Reliability

The ICC for the total CAINS score was 0.99 ($p \le 0.0001$), with a 95% confidence interval ranging from 0.96 to 0.99, signifying high interrater reliability for the CAINS total scores. The SEM and MDC were, respectively, 1.23 and 2.42 for the CAINS

<table><caption>TABLE 1 | Demographic and clinical characteristics (N = 84).</caption><thead><tr><th></th><th>Value [mean ± SD (range) or %]</th></tr></thead><tbody><tr><td><strong>Demographic variables</strong></td><td></td></tr><tr><td>Gender (female)</td><td>23%</td></tr><tr><td>Age, years</td><td>35.50 ± 9.1 (19–59)</td></tr><tr><td><strong>Clinical variables</strong></td><td></td></tr><tr><td>Age at onset of illness, years</td><td>23.00 ± 5.78 (14–43)</td></tr><tr><td>Duration of illness, years</td><td>12.32 ± 8.59 (0.25–8.59)</td></tr><tr><td>Antipsychotic treatment (atypical, typical, clozapine, combination)</td><td>61.0, 8.5, 25.6, 3.7%</td></tr><tr><td>PANSS total score</td><td>59.76 ± 16.08 (36–138)</td></tr><tr><td>PANSS positive</td><td>13.30 ± 5.64 (7–40)</td></tr><tr><td>PANSS negative</td><td>16.44 ± 6.13 (7–37)</td></tr><tr><td>PANSS general psychopathology</td><td>30.02 ± 7.62 (19–61)</td></tr><tr><td>SANS total score</td><td>40.07 ± 21.66 (2–114)</td></tr><tr><td>Flat affect</td><td>10.30 ± 6.95 (0–31)</td></tr><tr><td>Alogia</td><td>4.13 ± 4.16 (0–19)</td></tr><tr><td>Apathy</td><td>5.7 ± 3.66 (0–15)</td></tr><tr><td>Anhedonia</td><td>8.43 ± 4.56 (0–19)</td></tr><tr><td>Attention</td><td>2.29 ± 2.48 (0–9)</td></tr><tr><td>CDSS total score</td><td>4.24 ± 3.87 (0–16)</td></tr></tbody></table>

PANSS, Positive and Negative Syndrome Scale; SANS, Scale for Assessment of Negative Symptoms; CDSS, Calgary Depression Scale for Schizophrenia.
total scores with an MDC% of 12.05%. The average ICCs for the MAP and EXP subscales were 0.99 and 0.96, respectively. Concerning the MAP subscale, the SEM was 0.82, and the MDC was 1.61. The SEM and MDC for the EXP subscale were 0.78 and 1.53, respectively.

## Construct Validity

The KMO (KMO = 0.80) and Bartlett test of sphericity (Bartlett $\chi^2 = 495.26, p \le 0.001$) indicate that the CAINS was psychometrically fit for exploratory factor analysis. Examination of the scree plot and parallel analysis suggested a two-factor solution (Figure 1). Each extracted factor from the exploratory factor analysis exceeded the corresponding mean random data set eigenvalue at the 99th percentile (factor 1, 5.17 vs. 1.86; factor 2, 1.80 vs. 1.62). The next factors were not supported (factor 3, 1.20 vs. 1.48; factor 4, 1.06 vs. 1.32; factor 5, 0.73 vs. 1.22; factor 6, 0.64 vs. 1.11; factor 7, 0.58 vs. 1.03; factor 8, 0.42 vs. 0.93; factor 9, 0.37 vs. 0.85; factor 10, 0.32 vs. 0.77; factor 11, 0.26 vs. 0.69; factor 12, 0.19 vs. 0.60; and factor 13, 0.18, vs. 0.50). Based on these criteria, a forced two-factor exploratory factor analysis using principal axis factoring with oblimin rotation was performed on the CAINS. The eigenvalues were 4.67 and 1.38 explaining 35.93 and 10.62%, respectively. Factor 1 loadings ranged from 0.32 to 0.87. The loadings for factor 2 ranged from 0.50 to 0.85. Table 3 indicates the different loadings for each item on the two factors. Factor 1 regroups items 1–9 and similarly to the original version of the CAINS represents the motivation and pleasure subscale. Factor 2 regroups items 10–13 and refers to the expression subscale.

## Convergent and Discriminant Validities

The clinical indicators used to test convergent and discriminant validity are presented in Table 4. Bonferroni correction for the correlations resulted in lowering the required *p*-values for significance level set to $p_{corr} \le 0.003$. For the convergent validity, the CAINS scale was strongly associated with the PANSS negative subscale ($r = 0.71$), as well as with the SANS total score ($r = 0.73$). In addition, we further demonstrated convergent validity by testing the correlations between similar items of the CAINS with the similar subscales of the SANS, that is, of alogia, blunted affect, anhedonia, and apathy. We obtained positive and significant correlations for all of the symptoms; alogia, $r(83) = 0.58, p < 0.001$; blunted affect, $r(83) = 0.68, p < 0.001$; anhedonia, $r(83) = 0.65, p < 0.001$; and apathy, $r(83) = 0.60, p < 0.001$. These conclusive results provide additional support toward convergent validity of the CAINS. The CAINS was not related to the positive subscale of the PANSS, nor with depression (measured using the CDSS), indicating discriminant validity. Only the CAINS EXP subscale was moderately associated with the general psychopathology subscale of the PANSS.

## DISCUSSION

This study validated a French version of the CAINS in a sample of 84 patients diagnosed with either schizophrenia or schizoaffective disorder. The mean scores in our sample ranged from 0.86 to

2.99, reflecting a moderately symptomatic sample. The internal consistency values of the overall French CAINS and its subscales were high. We obtained similar Cronbach $\alpha$ compared with those obtained in the original tool (5): CAINS (0.76), MAP (0.74), and EXP (0.88) subscales and to other language versions of the scale (21–24). The interrater and test–retest reliabilities were also high with ICC values >0.9, showing excellent reliability over time and across assessors. Overall, and as mentioned by authors of other validations of the CAINS (5, 21–24), we obtained very high reliabilities indicating that the accompanying manual of the CAINS is straightforward, comprehensive, and helpful in obtaining similar results across raters and time. Furthermore, the MDC obtained indicates that when using the French CAINS to measure negative symptomatology, a change in total score of 4 points shows a true change at a 95% confidence level. Item-total correlation values were also high, ranging from 0.41 to 0.69, indicating very good discrimination between the 13 items. Additionally, structural analyses of the French CAINS reproduced the two dimensional structure found in the original development of the tool, encompassing a motivation/pleasure and an expression dimension (4, 5, 16, 20). The item pertaining to motivation in the vocational domain had a relatively low loading unto factor 1 (0.32) compared with the other loadings. This may indicate that this item is difficult to measure within this population as participants may be motivated in engaging in vocation related and/or school activities but do not actually initiate any active engagements within these domains. Similarly to the initial validation (16) and in the final validation (5) of the CAINS, this item had low loadings into the MAP subscale (0.43 and 0.24, respectively). Ultimately, the low loadings of this item onto the MAP subscale may indicate that this variable has a weak influence unto the motivation and pleasure factor.

<table><caption>TABLE 2 | Internal consistency of CAINS item and subscale scores ($n = 84$).</caption><thead><tr><th></th><th>Mean</th><th>SD</th><th>r</th><th>Scale α</th></tr></thead><tbody><tr><td>Motivation and pleasure subscale score</td><td>17.05</td><td>7.02</td><td></td><td>0.855</td></tr><tr><td>Item 1: social, family relationships</td><td>1.02</td><td>0.99</td><td>0.53</td><td></td></tr><tr><td>Item 2: social, friendships</td><td>1.52</td><td>1.06</td><td>0.49</td><td></td></tr><tr><td>Item 3: social, past week pleasure</td><td>1.54</td><td>1.18</td><td>0.51</td><td></td></tr><tr><td>Item 4: social, expected pleasure</td><td>2.19</td><td>1.12</td><td>0.67</td><td></td></tr><tr><td>Item 5: vocational, motivation</td><td>2.33</td><td>1.29</td><td>0.52</td><td></td></tr><tr><td>Item 6: vocational, expected pleasure</td><td>2.99</td><td>1.09</td><td>0.41</td><td></td></tr><tr><td>Item 7: recreation, motivation</td><td>1.70</td><td>1.27</td><td>0.59</td><td></td></tr><tr><td>Item 8: recreation, past week pleasure</td><td>1.74</td><td>1.12</td><td>0.69</td><td></td></tr><tr><td>Item 9: recreation, expected pleasure</td><td>2.01</td><td>1.17</td><td>0.61</td><td></td></tr><tr><td>Expression subscale score</td><td>5.30</td><td>3.71</td><td></td><td>0.819</td></tr><tr><td>Item 10: expression, facial</td><td>1.69</td><td>1.13</td><td>0.47</td><td></td></tr><tr><td>Item 11: expression, vocal prosody</td><td>1.29</td><td>1.16</td><td>0.57</td><td></td></tr><tr><td>Item 12: expression, gestures</td><td>1.46</td><td>1.21</td><td>0.51</td><td></td></tr><tr><td>Item 13: expression, speech</td><td>0.86</td><td>1.11</td><td>0.51</td><td></td></tr><tr><td>CAINS total score</td><td>22.35</td><td>9.35</td><td></td><td>0.871</td></tr></tbody></table>

CAINS, Clinical Assessment Interview for Negative Symptoms; SD, standard deviation. r, corrected item-total correlation; Scale $\alpha$, Cronbach $\alpha$. All items were scored on a 5-point scale (0–4), with a higher score indicating greater impairment.
<figure><img src="image_3.png" /><figcaption>**FIGURE 1** | Scree plot and parallel analysis of eigenvalues for the Clinical Assessment Interview for Negative Symptoms (13 items) factors.</figcaption></figure>

As expected, both subscales of the French CAINS highly correlated with the negative subscale of the PANSS demonstrating strong convergent validity. Similar correlations were found in our study compared with the original validation of the CAINS (5). Interestingly the motivation/pleasure subscale mostly correlated with the anhedonia and apathy dimensions of the SANS, which was also the case in the original validation. The strongest correlation with the expression subscale was with the flat affect dimension of the SANS, and this was also found in the original validation of the tool. Furthermore, no significant

<table><caption>**TABLE 3** | Exploratory factor analysis for the French CAINS items with OBLIMIN rotation.</caption><thead><tr><th>CAINS items</th><th>Factor 1</th><th>Factor 2</th></tr></thead><tbody><tr><td>Item 8: recreation, past week pleasure</td><td>0.87</td><td></td></tr><tr><td>Item 9: recreation, expected pleasure</td><td>0.83</td><td></td></tr><tr><td>Item 7: recreation, motivation</td><td>0.79</td><td></td></tr><tr><td>Item 3: social, past week pleasure</td><td>0.65</td><td></td></tr><tr><td>Item 4: social, expected pleasure</td><td>0.62</td><td></td></tr><tr><td>Item 1: social, family relationships</td><td>0.50</td><td></td></tr><tr><td>Item 2: social, friendships</td><td>0.45</td><td></td></tr><tr><td>Item 6: vocational, expected pleasure</td><td>0.41</td><td></td></tr><tr><td>Item 5: vocational, motivation</td><td>0.32</td><td></td></tr><tr><td>Item 12: expression, gestures</td><td></td><td>0.85</td></tr><tr><td>Item 11: expression, vocal prosody</td><td></td><td>0.81</td></tr><tr><td>Item 10: expression, facial</td><td></td><td>0.71</td></tr><tr><td>Item 13: expression, speech</td><td></td><td>0.50</td></tr></tbody></table>

CAINS, Clinical Assessment Interview for Negative Symptoms.

<table><caption>**TABLE 4** | Convergent and discriminant validity of the CAINS.</caption><thead><tr><th></th><th>CAINS<br>motivation/pleasure<br>subscale</th><th>CAINS<br>expression<br>subscale</th></tr></thead><tbody><tr><td><strong>PANSS</strong></td><td></td><td></td></tr><tr><td>Negative subscale</td><td>0.60*</td><td>0.65*</td></tr><tr><td>Positive subscale</td><td>0.02</td><td>0.14</td></tr><tr><td>General psychopathology subscale</td><td>0.27</td><td>0.34*</td></tr><tr><td><strong>SANS</strong></td><td></td><td></td></tr><tr><td>Blunted affect subscore</td><td>0.43*</td><td>0.72*</td></tr><tr><td>Alogia subscore</td><td>0.28</td><td>0.50*</td></tr><tr><td>Anhedonia/asociality subscore</td><td>0.70*</td><td>0.54*</td></tr><tr><td>Apathy/avolition subscore</td><td>0.60*</td><td>0.47*</td></tr><tr><td>Attention subscore</td><td>0.14</td><td>0.35*</td></tr><tr><td><strong>CDSS</strong></td><td>0.24</td><td>0.15</td></tr></tbody></table>

CAINS, Clinical Assessment Interview for Negative Symptoms; PANSS, Positive and Negative Syndrome Scale; SANS, Scale for the Assessment of Negative Symptoms; CDSS, Calgary Depression Scale for Schizophrenia.

*Pearson correlations with Bonferroni correction resulted in lowering of the p-value level set at $p_{corr} \le 0.003$.

association was found between the alogia subscore and the MAP subscale of the CAINS. Kring et al. (5) also showed no association between these two variables. The attention dimension of the SANS was not evaluated in the original study (5); however, our results indicate an association between attention and the EXP subscale of the CAINS.

Discriminant validity of the CAINS was good and showed thorough non-significant correlations with the positive subscale of the PANSS. Similarly to results of the original validation of
the CAINS (5), no correlation was found between the CAINS and level of depression. Hence, the French version of the CAINS seems to measure conceptually distinct symptoms than those of depression and positive symptoms of psychosis.

Our study included a few limitations. Although our sample size was large enough to conduct factor analyses, we did not have a 10:1 ratio between the number of participants and number of items in the scale. Another limitation is that both interrater agreement and test-retest were assessed only in a subsample of the group. An additional limit to this study is regarding the relatively low symptomatology severity of our sample group. Indeed, all participants involved in the study were in stable phases of illness and under pharmacological treatments. Future validations would benefit from including participants with a larger variation in positive and negative symptomatology. Finally, even though our study reproduced the two-factor structure of the original CAINS, a confirmatory factor analysis on another schizophrenic population would further validate the structure of this tool in the French language.

## CONCLUSION

Validity and reliability of the French CAINS were high and comparable to the findings described in the original version of the CAINS (5). Based on the results obtained in this study, the French CAINS has robust psychometric properties and is a valid assessment tool that can be used to evaluate the motivational and expressive mechanisms of negative symptoms in French-speaking individuals diagnosed with schizophrenia. The CAINS is a tool that was developed to address negative symptoms based on affective neuroscience research, in large samples, and using robust data analyses approaches. Further validations and cross-cultural psychometric analyses would be necessary to further validate this second-generation rating scale. This would provide clinicians and researchers another tool, in addition to the BNSS, for valid negative symptom assessment options, with hopes of ultimately bettering our care of people with schizophrenia. The French CAINS evaluates the five negative symptom domains

across different life areas and is psychometrically valid and consistent with the current literature of the negative symptoms, hence a useful tool that can be used in both clinical and research environments.

## DATA AVAILABILITY STATEMENT

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

## ETHICS STATEMENT

The studies involving human participants were reviewed and approved by the Institutional Review Board, Montpellier University Hospital, approval number: 202100974. The patients/participants provided their written informed consent to participate in this study.

## AUTHOR CONTRIBUTIONS

SR and DC designed the study. JA, AM, AD, and ME participated in the recruitment process. YL and MM recruited and collected the data. YL, CL, and SR analyzed and interpreted the data. All authors contributed to the manuscript.

## FUNDING

The funding sources had no role in the study design, recruitment, analysis, and interpretation nor in the writing of this manuscript.

## ACKNOWLEDGMENTS

We sincerely thank all participants for having taken the time to participate in this study.

## REFERENCES

1. Murphy BP, Chung Y-C, Park T-W, McGorry PD. Pharmacological treatment of primary negative symptoms in schizophrenia: a systematic review. *Schizophr Res.* (2006) 88:5–25. doi: 10.1016/j.schres.2006.07.002

2. Leucht S, Pitschel-Walz G, Abraham D, Kissling W. Efficacy and extrapyramidal side-effects of the new antipsychotics olanzapine, quetiapine, risperidone, and sertindole compared to conventional antipsychotics and placebo. A meta-analysis of randomized controlled trials. *Schizophr Res.* (1999) 35:51–68. doi: 10.1016/S0920-9964(98)00105-4

3. Leucht S, Arbter D, Engel RR, Kissling W, Davis JM. How effective are second-generation antipsychotic drugs? A meta-analysis of placebo-controlled trials. *Mol Psychiatry.* (2009) 14:429–47. doi: 10.1038/sj.mp.4002136

4. Blanchard JJ, Kring AM, Horan WP, Gur R. Toward the next generation of negative symptom assessments: the collaboration to advance negative symptom assessment in schizophrenia. *Schizophr Bull.* (2011) 37:291–9. doi: 10.1093/schbul/sbq104

5. Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The clinical assessment interview for negative symptoms (CAINS): final development and validation. *Am J Psychiatry.* (2013) 170:165–72. doi: 10.1176/appi.ajp.2012.12010109

6. Norman RMG, Malla AK, McLean T, Voruganti LPN, Cortese L, McIntosh E, et al. The relationship of symptoms and level of functioning in schizophrenia to general wellbeing and the quality of life scale: general wellbeing and quality of life scale. *Acta Psychiatr Scand.* (2000) 102:303–9. doi: 10.1034/j.1600-0447.2000.102004303.x

7. Strauss GP, Harrow M, Grossman LS, Rosen C. Periods of recovery in deficit syndrome schizophrenia: a 20-year multi-follow-up longitudinal study. *Schizophr Bull.* (2010) 36:788–99. doi: 10.1093/schbul/sbn167

8. Katschnig H. Schizophrenia and quality of life: schizophrenia and quality of life. *Acta Psychiatr Scand.* (2000) 102:33–7. doi: 10.1034/j.1600-0447.2000.00006.x

9. Kirkpatrick B, Fenton WS, Carpenter WT, Marder SR. The NIMH-MATRICS consensus statement on negative symptoms. *Schizophr Bull.* (2006) 32:214–9. doi: 10.1093/schbul/sbj053
10. Andreasen NC. The scale for the assessment of negative symptoms (SANS): conceptual and theoretical foundations. *Br J Psychiatry Suppl.* (1989) 7:49–58. doi: 10.1192/s0007125000291496

11. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. *Schizophr Bull.* (1987) 13:261–76. doi: 10.1093/schbul/13.2.261

12. Blanchard JJ, Cohen AS. The structure of negative symptoms within schizophrenia: implications for assessment. *Schizophr Bull.* (2006) 32:238–45. doi: 10.1093/schbul/sbj013

13. Kumari S, Malik M, Florival C, Manalai P, Sonje SS. An assessment of five (PANSS, SAPS, SANS, NSA-16, CGI-SCH) commonly used symptoms rating scales in schizophrenia and comparison to newer scales (CAINS, BNSS). *J Addict Res Ther.* (2017) 8:324. doi: 10.4172/2155-6105.1000324

14. Galderisi S, Mucci A, Dollfus S, Nordentoft M, Falkai P, Kaiser S, et al. EPA guidance on assessment of negative symptoms in schizophrenia. *Eur Psychiatry.* (2021) 64:e23. doi: 10.1192/eurpsy.2021.11

15. Kirkpatrick B, Strauss GP, Nguyen L, Fischer BA, Daniel DG, Cienfuegos A, et al. The brief negative symptom scale: psychometric properties. *Schizophr Bull.* (2011) 37:300–5. doi: 10.1093/schbul/sbj059

16. Horan WP, Kring AM, Gur RE, Reise SP, Blanchard JJ. Development and psychometric validation of the clinical assessment interview for negative symptoms (CAINS). *Schizophr Res.* (2011) 132:140–5. doi: 10.1016/j.schres.2011.06.030

17. Strauss GP, Gold JM. A psychometric comparison of the clinical assessment interview for negative symptoms and the brief negative symptom scale. *Schizophr Bull.* (2016) 42:1384–94. doi: 10.1093/schbul/sbw046

18. Mucci A, Vignapiano A, Bitter I, Austin SF, Delouche C, Dollfus S, et al. A large European, multicenter, multinational validation study of the brief negative symptom scale. *Eur Neuropsychopharmacol.* (2019) 29:947–59. doi: 10.1016/j.euroneuro.2019.05.006

19. Tatsumi K, Kirkpatrick B, Strauss GP, Opler M. The brief negative symptom scale in translation: a review of psychometric properties and beyond. *Eur Neuropsychopharmacol.* (2020) 33:36–44. doi: 10.1016/j.euroneuro.2020.01.018

20. Forbes C, Blanchard JJ, Bennett M, Horan WP, Kring A, Gur R. Initial development and preliminary validation of a new negative symptom measure: the clinical assessment interview for negative symptoms (CAINS). *Schizophr Res.* (2010) 124:36–42. doi: 10.1016/j.schres.2010.08.039

21. Engel M. Validation of the German version of the clinical assessment interview for negative symptoms (CAINS). *Psychiatry Res.* (2014) 220:659–63. doi: 10.1016/j.psychres.2014.07.070

22. Valiente-Gómez A, Mezquida G, Romaguera A, Vilardebò I, Andrés H, Granados B, et al. Validation of the Spanish version of the clinical assessment for negative symptoms (CAINS). *Schizophr Res.* (2015) 166:104–9. doi: 10.1016/j.schres.2015.06.006

23. Ristić I, Jerotić S, Zebić M, Savić B, Vuković V, Russo M, et al. Factorial structure of the Serbian version of the clinical assessment interview for negative symptoms – evidence for three factors of negative symptoms. *Front Psychol.* (2020) 11:570356. doi: 10.3389/fpsyg.2020.570356

24. Jung SI, Woo J, Kim Y-T, Kwak SG. Validation of the Korean-version of the clinical assessment interview for negative symptoms of schizophrenia (CAINS). *J Korean Med Sci.* (2016) 31:1114. doi: 10.3346/jkms.2016.31.7.1114

25. Xie D, Shi H, Lui SSY, Shi C, Li Y, Ho KKY, et al. Cross cultural validation and extension of the clinical assessment interview for negative symptoms (CAINS) in the Chinese context: evidence from a spectrum perspective. *Schizophr Bull.* (2018) 44:S547–55. doi: 10.1093/schbul/sby013

26. American Psychiatric Association [APA]. *Diagnostic and Statistical Manual of Mental Disorders*. 5th ed. Worcester, MA: American Psychiatric Association (2013). doi: 10.1176/appi books.9780890425596

27. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (pro) measures: report of the ISPOR task force

for translation and cultural adaptation. *Value Health.* (2005) 8:94–104. doi: 10.1111/j.1524-4733.2005.04054.x

28. Lançon C, Reine G, Llorca PM, Auquier P. Validity and reliability of the French-language version of the positive and negative syndrome scale (PANSS). *Acta Psychiatr Scand.* (1999) 100:237–43. doi: 10.1111/j.1600-0447.1999.tb10851.x

29. Field AP. *Discovering Statistics Using SPSS*. 3rd ed. Thousand Oaks, CA: SAGE Publications (2009).

30. Lecrubier Y, Boyer P. Fiche descriptive et traduction française de la SANS. *Psychiatr Psychobiol.* (1987) 2:414–23.

31. Addington D, Addington J, Maticka-Tyndale E. Assessing depression in schizophrenia: the Calgary depression scale. *Br J Psychiatry Suppl.* (1993) 22:39–44. doi: 10.1192/s0007125000292581

32. Bernard D, Lançon C, Auquier P, Reine G, Addington D. Calgary depression scale for schizophrenia : a study of the validity of a French-language version in a population of schizophrenic patients. *Acta Psychiatr Scand.* (1998) 97:36–41. doi: 10.1111/j.1600-0447.1998.tb09960.x

33. Weston R, Gore PA. A brief guide to structural equation modeling. *Counsel Psychol.* (2006) 34:719–51. doi: 10.1177/0011000006286345

34. Cronbach LJ. Coefficient alpha and the internal structure of tests. *Psychometrika.* (1951) 16:297–334. doi: 10.1007/BF02310555

35. Lord FM, Novick MR, Birnbaum A. *Statistical Theories of Mental Test Scores* (Nachdr. der Ausg. Reading, Mass. [u.a.], 1968). Charlotte: Information Age Publishing (2008).

36. Portney LG, Watkins MP. *Foundations of Clinical Research : Applications to Practice*. 3rd ed. Hoboken, NJ: Prentice Hall (2009).

37. Villalba FJ, Policastro PO, Soliño S, Andreu M, Novoa GA, Raguzzi IA, et al. Standard measurement error and minimal detectable change of the Back-PAQ ArgSpan questionnaire : secondary analysis. *Musculoskelet Sci Pract.* (2021) 51:102315. doi: 10.1016/j.msksp.2020.102315

38. Kaiser HF. The application of electronic computers to factor analysis. *Educ Psychol Measur.* (1960) 20:141–51. doi: 10.1177/0013164460020001116

39. Costello AB, Osborne J. Best practices in exploratory factor analysis : four recommendations for getting the most from your analysis. *Pract Assess Res Eval.* (2005) 10:10.

40. Patil Vivek H, Surendra N, Sanjay M, Donavan D. *Parallel Analysis Engine to Aid in Determining Number of Factors to Retain Using R [Computer Software]*. (2017). Available online at: https://analytics.gonzaga.edu/parallelengine/ (accessed October 10, 2021).

41. IBM Corp. IBM SPSS Statistics for Windows, (Version 24.0). Armonk, NY: IBM Corp (2016).

**Conflict of Interest:** The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

**Publisher's Note:** All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Copyright © 2022 Laraki, Lebrun, Merenciano, Eisenblaetter, Attal, Macgregor, Decombe, Capdevielle and Raffard. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.