# The Strengths Use Scale: Psychometric Properties, Longitudinal Invariance and Criterion Validity

Llewellyn E van Zyl, Diane Arijs, Matthew L Cole, Aldona Gliíska-Newes, Lara C Roll, Sebastiaan Rothmann, Rebecca Shankland, Jacqueline M Stavros, Nicolas B Verger

<figure><img src="image_1.png" /></figure>

## To cite this version:

Llewellyn E van Zyl, Diane Arijs, Matthew L Cole, Aldona Gliíska-Newes, Lara C Roll, et al. The Strengths Use Scale: Psychometric Properties, Longitudinal Invariance and Criterion Validity. Frontiers in Psychology, 2021, 12, 10.3389/fpsyg.2021.676153. [https://doi.org/10.3389/fpsyg.2021.676153](https://doi.org/10.3389/fpsyg.2021.676153). [hal-05297838](https://HAL.inhal-05297838)

HAL Id: hal-05297838

https://hal.science/hal-05297838v1

Submitted on 5 Oct 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
<figure><img src="image_3.png" /></figure>

Check for
updates

# The Strengths Use Scale: Psychometric Properties, Longitudinal Invariance and Criterion Validity

Llewellyn E. van Zyl<sup>1,2,3,4*</sup>, Diane Arijs<sup>5</sup>, Matthew L. Cole<sup>6</sup>, Aldona Gliiska-Newes<sup>7</sup>, Lara C. Roll<sup>2,5</sup>, Sebastiaan Rothmann<sup>2</sup>, Rebecca Shankland<sup>8</sup>, Jacqueline M. Stavros<sup>6</sup> and Nicolas B. Verger<sup>9</sup>

<sup>1</sup>Department of Industrial Engineering & Innovation Sciences, Human Performance Management, University of Eindhoven, Eindhoven, Netherlands, <sup>2</sup>Optentia Research Focus Area, North-West University Vaal Triangle Campus (VTC), Vanderbijlpark, South Africa, <sup>3</sup>Department of Human Resource Management, University of Twente, Enschede, Netherlands, <sup>4</sup>Department of Social Psychology, Institut für Psychologie, Goethe University, Frankfurt, Germany, <sup>5</sup>Department of Work and Organisation Studies, KU Leuven, Leuven, Belgium, <sup>6</sup>College of Business and Information Technology, Lawrence Technological University, Southfield, MI, United States, <sup>7</sup>Faculty of Economic Sciences and Management, Nicolaus Copernicus University, Torun, Poland, <sup>8</sup>DIPHE, Department of Psychology, Education and Vulnerabilities, Université Lumière Lyon 2, Lyon, France, <sup>9</sup>Department of Psychology, School of Life and Health Sciences, Glasgow Caledonian University, Glasgow, United Kingdom

## OPEN ACCESS

**Edited by:**

Jeff Klibert,
Georgia Southern University,
United States

**Reviewed by:**

Sai-fu Fung,
City University of Hong Kong, China
Willibald Ruch,
University of Zurich, Switzerland

**\*Correspondence:**

Llewellyn E. van Zyl
llewellyn101@gmail.com

**Specialty section:**

This article was submitted to
Positive Psychology,
a section of the journal
Frontiers in Psychology

Received: 04 March 2021

Accepted: 11 May 2021

Published: 15 June 2021

**Citation:**

van Zyl LE, Arijs D, Cole ML, Gliiska-Newes A, Roll LC, Rothmann S, Shankland R, Stavros JM and Verger NB (2021) The Strengths Use Scale: Psychometric Properties, Longitudinal Invariance and Criterion Validity. *Front. Psychol.* 12:676153.
doi: 10.3389/fpsyg.2021.676153

Strengths use is an essential personal resource to consider when designing higher-educational programs and interventions. Strengths use is associated with positive outcomes for both the student (e.g., study engagement) and the university (e.g., academic throughput/performance). The Strengths Use Scale (SUS) has become a popular psychometric instrument to measure strengths use in educational settings, yet its use has been subjected to limited psychometric scrutiny outside of the U.S. Further, its longitudinal stability has not yet been established. Given the wide use of this instrument, the goals of this study were to investigate (a) longitudinal factorial validity and the internal consistency of the scale, (b) its equivalence over time, and (c) criterion validity through its relationship with study engagement over time. Data were gathered at two-time points, 3 months apart, from a sample of students in the Netherlands (n = 360). Longitudinal confirmatory factor analyses showed support for a two-factor model for overall strengths use, comprised of Affinity for Strengths and Strengths Use Behaviors. The SUS demonstrated high levels of internal consistency at both the lower- and upper bound limits at both time points. Further, strict longitudinal measurement invariance was established, which confirmed the instrument's temporal stability. Finally, criterion validity was established through relating strengths use to study engagement at different time stamps. These findings support the use of the SUS in practice to measure strengths use and to track the effectiveness of strengths use interventions within the higher education sector.

**Keywords:** Strengths Use Scale, strengths assessment, psychometric properties, longitudinal invariance, positive psychological assessment, psychological strengths
# INTRODUCTION

University students are three times more likely to develop psychopathological complaints and common mental health problems than the general population (Blanco et al., 2008; Seligman, 2012). This stems from severe psychological distress experienced as a result of an imbalance between their study demands (e.g., workload/time pressure), their study resources (e.g., lecturer support), and personal resources (e.g., strengths use; Lesener et al., 2020). The problem is exacerbated by intensive educational programmes, poor social relationships with peers (Houghton et al., 2018; Basson and Rothmann, 2019), drastic life changes, elevated levels of social comparison, peer pressure, and an imbalance between their studies and home life (Bergin and Pakenham, 2015). This, in turn, negatively affects students' motivation, study engagement, learning potential, academic performance, and overall academic throughput (Ebert et al., 2018). Therefore, it is not surprising that universities are implementing interventions to help students either (a) find a balance between their study demands/resources or (b) develop the internal personal resources needed to offset university life's impact on their well-being and academic performance (Seligman, 2012).

An essential personal resource targeted by these interventions relates to identifying and using personal strengths during one's studies. Strengths refer to the inherent psychological traits that students are naturally good at, leading to optimal functioning or performance in desired outcomes (Govindji and Linley, 2007). These are naturally occurring capacities that are universally valued by society (Huber et al., 2017). When students can live out their strengths during their studies, it could lead to positive outcomes for the self and others. Research shows that strengths are associated with positive self-esteem, goal achievement, social behaviors, happiness, and well-being (Littman-Ovadia et al., 2017). Further, when students can live out their strengths at university, it also reduces reported levels of stress, depression, and anxiety (Schutte and Malouff, 2018). When students use their strengths during their studies, they are also more likely to perform academically and less likely to fall out of or change academic programmes (Seligman, 2012).

However, despite these positive associations, intervention studies centered around strengths-based development have shown mixed results (White, 2016; Roll et al., 2019; White et al., 2019). Although some strengths-based interventions have led to mental health and well-being changes, others did not (Quinlan et al., 2012; White et al., 2019). Van Zyl et al. (2019) argued that this is primarily because of poor intervention design and -measurement, where the focus is on measuring outcomes rather than on the underlying mechanisms being targeted by the intervention. In other words, strengths interventions aim to develop strengths *use*; however, what is ultimately measured is strengths possession or strengths knowledge. In fact, several studies have shown that only knowing what one's strengths are (strengths knowledge) is not enough to facilitate sustainable changes in positive individual outcomes (Seligman et al., 2005; Wood et al., 2011; Seligman, 2012; Proyer et al., 2015a,b; Miglianico et al., 2020). Only when one can actively apply

one's strengths (i.e., strengths use) would it lead to happier and healthier lives (Govindji and Linley, 2007). Therefore, strengths use has become a central tenet in recent strengths-based intervention studies.

To measure such, Govindji and Linley (2007) developed the Strengths Use Scale (SUS), a 14 item self-report scale that aims to measure active strengths use. The instrument aims to measure both opportunities to use strengths (affinity for strengths use), as well as individual strengths, use behaviors (strengths use behaviors) (Van Woerkom et al., 2016a). The SUS is the most widely used instrument to assess general strengths use and has been translated into German (Huber et al., 2017), French (Forest et al., 2012), Hebrew (Littman-Ovadia et al., 2017), Finish (Vuurinen et al., 2020), Chinese (Bu and Duan, 2020), and even adapted to work settings (Dubreuil et al., 2014). Despite its wide use, only four studies have actively attempted to investigate its validity and reliability: Govindji and Linley (2007) and Wood et al. (2011) in the US, Huber et al. (2017) in Germany, and Duan et al. (2018) in China. Although all four studies have shown that SUS was a reliable and valid tool, those outside of the U.S. required several modifications (e.g., correlating error terms or item parceling) to ensure data-model fit. This trend is also prevalent in several empirical studies where the SUS was used (e.g., Mahomed, 2019; Mahomed and Rothmann, 2020; Vuorinen et al., 2020). Any form of statistical modification of a psychometric instrument fundamentally changes the content of what is being measured, thus limiting comparisons between studies (Price, 2017). As such, a thorough investigation as to the psychometric properties of the SUS is needed.

Therefore, the purpose of this study was to investigate the psychometric properties, longitudinal invariance, and criterion validity of the SUS within a student population. Specifically, it aimed to determine the (a) longitudinal factorial validity and the internal consistency of the instrument (b) its temporal equivalence, and (c) its relationship with strengths use and study engagement over time.

# LITERATURE REVIEW

## Conceptualization and Measurement of Strengths Use

Positive psychology is rooted in the tenet that individuals have inherent psychological strengths, which are activated to manage hardships and promote optimal human functioning (Peterson and Seligman, 2004). Strengths develop out of adversity and are *essential* to one's definition of self, are *effortless* in their enactment and *energizing* when activated (Matsuguma and Niemiec, 2020). Therefore, psychological strengths can be seen as positive, trait-like capacities that define good character and highlight “what is right” about an individual (Richter et al., 2020). These ideas are in line with Linley and Harrington's (2006, p. 86) definition of strengths as “natural capacities for behaving, thinking or feeling in a way that allows optimal functioning and performance in the pursuit of valued outcomes.” These capacities are universally valued by society as they lead to positive outcomes and benefits
for both the self (e.g., positive mental health) and others (e.g., positive community climate) (Huber et al., 2017).

Further, research suggests that strengths are also relatively stable over time (Snow, 2019), are valued across cultures and educational contexts (McGrath, 2015), buffer against the onset of psychopathology (Peterson et al., 2006), enhance mental health (Seligman, 2012; Proyer et al., 2015a), and lead to context-specific positive outcomes such as study engagement, and academic performance (Kwok and Fang, 2020). Further, despite being relatively stable over time, strengths remain malleable and can be developed through interventions to promote strengths awareness and active strengths use (Huber et al., 2017).

Govindji and Linley (2007) argued that merely possessing a strength is not an effective means to promote personal growth and development. Instead, individuals need to both become aware- and develop a deep understanding of their strengths (i.e., strengths awareness/knowledge) and exert conscious effort to apply such in different situations (Wood et al., 2011). Strengths awareness/knowledge refers to the ability to know the things one is naturally good at and understand what role strengths play in one's daily life (Wood et al., 2011). On the other hand, strengths use refers to the extent to which one is both driven to apply and opportunities to use one's strengths in different situations (Wood et al., 2011; Van Woerkom et al., 2016a). Govindji and Linley (2007) conceptualization of strengths use is built on the organismic value process (OVP). The OVP proposes that strengths are naturally occurring traits that develop from within, where individuals are inherently driven to actively use, develop, apply, and play to their strengths in daily life. Further, individuals yearn to live by their strengths and are unconsciously drawn to activities, hobbies, studies, or work aligned to their strengths (Wood et al., 2011). Therefore, individuals are naturally drawn to activities aligned to their strengths (i.e., strengths affinity) and exhibit active strengths use behaviors (Wood et al., 2011; Van Woerkom et al., 2016a).

Although strengths possession and awareness/knowledge are shown to be important within the educational environment, intervention studies have shown that its indeed the conscious use of strengths that leads to sustainable changes in mental health and well-being over time (Wood et al., 2011; Seligman, 2012; Van Zyl and Rothmann, 2019; Miglianico et al., 2020). Govindji and Linley (2007) found that active strengths use leads to higher levels of happiness, personal fulfillment, and subjective- and psychological well-being. In contrast, strengths possession/awareness were not independent predictors of happiness or well-being (Seligman et al., 2005; Govindji and Linley, 2007). Albeit strengths awareness/possession is a precursor to active strengths use (Seligman et al., 2005). Despite these findings, most academic research has focused on the awareness-, identification- or possession of strengths, rather than the actual use thereof (Wood et al., 2011; Huber et al., 2017).

This is further indicated by the vast array of propriety psychometric instruments used to identify or assess strengths (Richter et al., 2020). These include, but are not limited to, the Clifton Strengths-Finder (Rath, 2007), the VIA Signature Strengths Inventory for adults (Peterson and Seligman, 2004) and children (Ruch et al., 2014), the Signature Strengths

Questionnaire-72 (Rashid et al., 2017), the Personal Strengths Inventory (Kienfie Liau et al., 2011), the Realise2 Strengths Finder (Linley et al., 2010), and the Employee Strengths At Work Scale (Bhatnagar, 2020). Each of these instruments aims to measure various forms of manifested strengths ranging from character strengths to inherent talents. In contrast, only two psychometric instruments are available that measures strengths use: the Strengths-Use and Deficit Correction Behavior Scale (SUDCO; Van Woerkom et al., 2016a) and the Strengths Use Scale (SUS: Govindji and Linley, 2007; Wood et al., 2011).

The SUDCO aims to measure (a) strengths use behaviors, (b) deficit correction behaviors and perceived organizational support for (c) strengths use, and (d) -deficit correction (Van Woerkom et al., 2016a). Although this instrument has shown to be a valid and reliable tool to measure strengths use, it was crafted to be used within organizational settings (Van Woerkom et al., 2016a). This implies that the SUDCO cannot measure strengths use in other contexts (e.g., educational settings) or assess general strengths use behaviors or opportunities. Given that the SUDCO also focuses on deficit correction, the tool is not in line with the tenets of positive psychology (i.e., moving away from a focus on “fixing what is wrong,” but rather focus on developing what already works well; Seligman and Csikszentmihalyi, 2014). Further, the instrument is also not widely used within the literature (with only 71 citations on Google Scholar at the time of writing, i.e., early December 2020).

In contrast, the SUS is currently the most popular psychometric tool to measure strengths use behaviors and -opportunities within the literature with over a 1,000 citations (Govindji and Linley, 2007; Wood et al., 2011, p. 499). This 14 item self-report instrument aims to measure the extent to which individuals are drawn to activities that are aligned to their strengths and the extent to which strengths are actively used in a general way (Wood et al., 2011). The SUS has been translated into German (Huber et al., 2017), French (Forest et al., 2012), Hebrew (Littman-Ovadia et al., 2017), Finish (Vuorinen et al., 2020), Chinese (Bu and Duan, 2020), and adapted to work settings (Dubreuil et al., 2014). The instrument's popularity may be attributable to the fact that it was the first instrument developed to measure strengths use and that it is more inclined with the purest, functional principles of positive psychology.

## Factorial Validity of the Strengths Use Scale

The Strengths Use Scale (SUS) was initially developed as a self-report measure to understand the extent to which individuals can apply their strengths in daily life (Govindji and Linley, 2007). The instrument was developed around the idea that “strengths are natural, they come from within, and we are urged to use them, develop them, and play to them by an inner, energizing desire. Further, when we use our strengths, we feel good about ourselves, we are better able to achieve things, and we are working toward fulfilling our potential” (Linley and Harrington, 2006, p. 41). From this conceptualization, strengths use has both an active application component
(strengths use behaviors) and encompasses opportunities to apply strengths to achieve personal goals or to facilitate personal development (opportunities to apply; Van Woerkom et al., 2016a).

Based on this conceptualization, Govindji and Linley (2007) generated 19 initial items, rated on a 7-point agreement type Likert scale, to measure strengths use from this perspective. Participants were instructed that these questions “*ask you about your strengths, that is, the things that you are able to do well or do best*” (Govindji and Linley, 2007, p. 147). A sample of 214 university students from the U.S. was requested to complete the SUS (Govindji and Linley, 2007). Principal component analysis revealed that three components with eigenvalues >1 could be extracted. However, the screen-plot showed that only a single component with 14 items could meaningfully be extracted from the data. These 14 items declared 56.2% of the total variance in a single “Strengths use” factor, with item loadings ranging from 0.52 to 0.79 (Govindji and Linley, 2007). The one-factor model showed to be significantly related to self-esteem, subjective well-being, psychological well-being, and subjective vitality, which established its concurrent validity (Govindji and Linley, 2007). However, this study only employed an exploratory approach, drawing a small sample from a single context. Therefore, the factorial validity could not formally be established nor verified. Despite showing promises, the authors argued that further validation studies on the SUS were needed.

In response, Wood et al. (2011) argued for the validation of the SUS within a general adult population (N = 227). This was done to increase the generalizability of the SUS within the U.S. Wood et al. (2011) employed both traditional factor analyses and parallel analyses to determine the factorial structure of the SUS. The results showed that a single strengths use factor could be extracted from the data based on eigenvalues. Items loaded between 0.66 and 0.87 on the single factor and declared 70.25% of the total variance.

Outside of the U.S., the SUS showed slightly different results. In the German validation, Huber et al. (2017) attempted to validate a translated version of the SUS within a sample of native German speakers. The authors employed both a traditional Exploratory Factor Analysis (EFA)- as well as a Confirmatory Factor Analysis (CFA) approach (through Structural Equation Modeling; SEM) to validate the instrument. The EFA showed that a single-factorial model, explaining 58.4% variance, with factor loadings ranging between 0.58 and 0.86, could be extracted from the data. The first factor had an eigenvalue of 8.60, with the remaining values clearly below the point of intersection (0.855–0.172). However, three items did not load sufficiently on the single strengths use factor (with factor loadings ranging from 0.336 to 0.410). The CFA was then conducted to determine if the hypothesized structure of the German SUS sample fitted the data well. However, the initial model fit of the German version was not satisfactory. Several modifications to the overall model needed to be implemented to enhance both model fit and measurement quality. This indicates that there may be conceptual overlap in understanding some items and that the factorial structure of the 14-items SUS may need further investigation.

## Internal Consistency of the SUS

Another factor to consider when considering the SUS as a viable and reliable tool to measure strengths use is its level of internal consistency or “reliability.” Reliability refers to the consistency and stability of an instrument to produce stable results (Wong and Wong, 2020). The SUS has shown to be a reliable measure across cultures; however, the level of internal consistency seems to vary within and between samples. In the original two U.S. validation studies, the SUS produced Cronbach's alpha coefficients ranging from 0.95 (Govindji and Linley, 2007) to 0.97 (Wood et al., 2011). Outside of the U.S., the SUS has shown acceptable levels of internal consistency in Germany (α = 0.84: Huber et al., 2017), China (α = 0.94: Bu and Duan, 2020), Finland (α = 0.88: Vuorinen et al., 2020), and the U.K. (α = 0.90: McTiernan et al., 2020).

Further, the test-retest reliability of the SUS was tested through intra-class correlations spanning three-time points (3 and 6 months after the first measurement). The test statistic was significant and very high ($r_{icc} = 0.85$), indicating that the SUS scores remained sufficiently stable without any specific intervention. Conversely, after a positive psychology intervention, strengths use scores have been shown to increase (e.g., Dubreuil et al., 2016), indicating that the scale is sensitive to measure changes.

However, despite the criticisms around Cronbach's alpha, only one other study employed a more restrictive and robust metric for internal consistency. Mahomed and Rothmann (2020) found that the composite reliability (i.e., upper bound level of internal consistency) of the SUS was 0.92. No other study specifically attempted to determine the upper level of internal consistency of the SUS.

## Stability of the SUS Over Time: Longitudinal Measurement Invariance

The temporal stability of the SUS is another essential metric to consider. This can be assessed through longitudinal measurement invariance (LMI). LMI is concerned with testing the factorial equivalence or equality of a construct over time (rather than across groups; Wong and Wong, 2020). Specifically, LMI assesses if the SUS produces similar factorial structures (configural invariance), if items load similarly on their respective factors (metric invariance), if the SUS shows to have similar intercepts (scalar invariance), and if similar residual errors are produced over time (Wong and Wong, 2020). LMI is a desirable characteristic of a measurement instrument as it provides evidence that a construct can be both measured and interpreted the same across different time stamps; therefore making meaningful interpretations and comparisons of mean scores of strengths use over time possible (Cheung and Rensvold, 2002; Widaman et al., 2010). No study has attempted to assess the LMI of the SUS over time, and therefore no specific reference points for such can be established from the current literature.

However, both Peterson and Seligman (2004) and Govindji and Linley (2007) argued that strengths are considered trait-like factors that are relatively stable over time. Further, the extent to which one would apply or use one's strengths is also considered
stable over time, unless individuals are exposed to- or engage in strengths-based developmental initiatives (Seligman, 2012; Huber et al., 2017). Therefore, it is expected that strengths-use, without intervention, should stay relatively stable over time.

## Criterion Validity: Strengths Use and Study Engagement

A final metric to consider when validating an instrument is criterion validity. Criterion validity can be measured through establishing relationships with theoretically closely related variables (concurrent validity), and through the ability to predict outcomes on these related variables over time (predictive validity; Van Zyl, 2014). An important criterion to consider associated with active strengths use is study engagement (Ouweneel et al., 2011; Seligman, 2012; Stander et al., 2015; Kwok and Fang, 2020). Study engagement is a persistent and pervasive positive, fulfilling, and study-related state of mind characterized by feelings of vigor, showing dedication to one's studies and being absorbed in one's study-related tasks (Schaufeli et al., 2002). Drawing from desire theory, Seligman (2012) argued that when students can live in accordance with their strengths (i.e., engage in learning activities congruent with their strengths), or if they engage in study-related activities that are aligned to their strengths, that they will experience more engagement in their studies. The broaden-and-build theory of positive emotions further postulates that strengths are essential personal resources individuals can activate to translate positive emotional experiences into study-related engagement (Fredrickson, 2001). Several studies have also specifically shown that higher levels of active strengths-use lead to increased study and work-related engagement (Ouweneel et al., 2011; Seligman, 2012; Stander et al., 2015; Kwok and Fang, 2020). As such, both concurrent validity and predictive validity could be established by associating SUS with study engagement at different points in time.

## The Current Study

Given the importance of strengths use, and the popularity of the SUS within the literature, it is imperative to ensure that it is a valid and reliable instrument. As such, the purpose of this study was to investigate the psychometric properties, longitudinal invariance, and criterion validity of the Strengths Use Scale (SUS) within a student population. Specifically, the aim was to determine the: (a) longitudinal factorial validity and the internal consistency of the instrument, (b) its equivalence over time, and (c) criterion validity through its relationship with study engagement over time.

# RESEARCH METHODS

## Research Approach

A quantitative, electronic survey-based longitudinal design was employed to determine the psychometric properties, longitudinal invariance and criterion validity of the SUS. This design entailed the distribution of questionnaires at two-time points over 3 months.

<table><caption>**TABLE 1** | Demographic characteristics of participants (n = 360).</caption><thead><tr><th>Item</th><th>Category</th><th>Frequency (f)</th><th>Percentage (%)</th></tr></thead><tbody><tr><td rowspan="3">Gender</td><td>Male</td><td>266</td><td>73.9</td></tr><tr><td>Female</td><td>93</td><td>25.8</td></tr><tr><td>Other</td><td>1</td><td>0.3</td></tr><tr><td rowspan="3">Age (years)</td><td>20–22 years</td><td>284</td><td>78.9</td></tr><tr><td>23–25 years</td><td>67</td><td>18.6</td></tr><tr><td>23–30 years</td><td>8</td><td>2.2</td></tr><tr><td rowspan="2">Nationality</td><td>Dutch</td><td>352</td><td>97.8</td></tr><tr><td>Other</td><td>8</td><td>2.2</td></tr><tr><td rowspan="2">Level of education</td><td>Bachelor's degree</td><td>219</td><td>60.8</td></tr><tr><td>Master's degree</td><td>141</td><td>39.2</td></tr></tbody></table>

## Participants and Sampling Strategy

An availability-based sampling strategy was employed to draw 360 respondents from a University in The Netherlands to participate in this study. **Table 1** provides an overview of the demographic characteristics of the sample. Validity responses were established by implementing two attention check items. If participants failed to score on these items, they were excluded from the analysis. As presented in **Table 1**, the majority of the participants were Dutch (97.8%) males (73.9%) between the ages of 20 and 22 years (78.9%) with a Bachelor's Degree (60.8%).

## Research Procedure

The data obtained for this paper are drawn from two large-scale cross-cultural student well-being projects. The Dutch sample consisted of two different datasets: one contained only third-year students and the other only master students. Data collection occurred during 2019-2020. The first cohort of data was collected between February to May 2019 and the second from November 2019 to January 2020 (before the COVID-19 outbreak). The period between measurements was 3 months. Online surveys were distributed at Time 1 and repeated at Time 2. A unique code was assigned to individuals to match Time 1 and Time 2 responses. Links were sent out to participants to their institutional email via QualtricsTM (www.qualtrics.com). In each survey, the rights and responsibilities of the participants were discussed. Participants provided online written informed consent. They were informed that their anonymity would be guaranteed and that their data would be stored in password-secured systems. Participants were informed they could withdraw their participation in this study at any time, without any repercussion for them. The purpose of the study was explained alongside the risks and benefits of the study. Participants' questions were answered at any step of the study.

## Measuring Instruments

The study made use of the three psychometric instruments.

A demographic questionnaire was used to gather basic biographic and demographic information about the participants. It aimed to capture respondents' self-identified gender identity, current age, nationality, home language, and level of education.
The Strengths Use Scale (SUS)<fnref n="1" /> developed by Govindji and Linley (2007) to measure how students actively used their strengths. The 14-item self-report questionnaire measured strengths use on an agreement-type Likert scale ranging from 1 (Strongly disagree) to 7 (Strongly agree) with items such as “I achieve what I want by using my strengths” and “Most of my time is spent doing things that I am good at doing.” The SUS showed acceptable levels of internal consistency at the lower bound limit with a Cronbach’s alpha of 0.95 (Govindji and Linley, 2007).

The Utrecht Work Engagement Scale for students (UWES-9S) developed by Schaufeli et al. (2006) was used to measure study engagement. The 9-item questionnaire is rated on a six-point agreement type Likert scale ranging from 1 (Never) to 7 (Always). It measures the three components of study engagement with three items each. Example items are “When I am doing my work as a student, I feel bursting with energy” (vigor), “I am proud of my studies” (dedication), and “I get carried away when I am studying” (absorption). The UWES-9S has shown to be a valid and reliable measure in various contexts, with Cronbach Alpha's ranging from 0.72 to 0.93 (Schaufeli et al., 2006; Cadime et al., 2016).

## Statistical Analyses

Data were analyzed using SPSS v26 (IBM SPSS, 2019) and Mplus v 8.4 (Muthén and Muthén, 2020). A six-phased longitudinal factor analytical strategy through structural equation modeling was employed to investigate the psychometric properties, temporal stability, and concurrent/predictive validity of the SUS over time.

First, to explore the factorial structure of the SUS, an exploratory factor analytical (EFA) strategy was employed on the baseline data. To determine factorability, the Kaiser-Meyer-Olkin (KMO) measure and Bartlett's sphericity test was used. A KMO value larger than 0.60 and a statistically significant chi-square value on Bartlett's test of sphericity would indicate that the data were factorable (Kaiser and Rice, 1974). Thereafter, an EFA was conducted through the structural equation modeling approach with the maximum likelihood estimation method and a Geomin (Oblique) rotation. Competing EFA factorial models were specified to be extracted based on Eigenvalues larger than 1 (Muthén and Muthén, 2020). Model fit statistics (c.f. Table 2) were used to establish data-model fit and to compare the competing EFA models. Further, items were required to load statistically significantly (Factor loading >0.40; *p* < 0.01) on their respective extracted factors and needed to declare at least 50% of the overall variance.

Second, a competing confirmatory factor analytical (CFA) measurement modeling strategy with the maximum likelihood estimation method (ML) was employed. As a baseline measure, three competing measurement models were specified and

sequentially compared for each of the two-time points, separately. This approach verifies the best factorial structure and measurement quality of the instrument at each time point before evaluating temporal stability (Feldt et al., 2000). These separate and competing models were specified according to the traditional independent cluster model confirmatory factor analytical conventions where items were estimated to load onto their a priori theoretical factors and cross-loadings were constrained to zero (Wong and Wong, 2020)<fnref n="2" />.

To determine the best fitting measurement model at each time point and to mitigate the criticism of Hu and Bentler (1999) method of establishing model fit by solely looking at series of “cut-off points” and “standardized values” of fit indices, a sequential process of evaluation was implemented. As an initial step, the Hu and Bentler (1999) model fit criteria (c.f. Table 2) was used to determine data-model fit and to discriminate between measurement models for each time point. Thereafter, measurement quality was assessed through inspecting the standardized item loadings (λ > 0.40; *p* < 0.01), standard errors, item uniqueness (range between 0.1 and 0.9; *p* < 0.01), and the presence of multiple cross-loadings to further discriminate between models (Asparouhov and Muthén, 2009; Kline, 2011). Only models that showed both excellent fit and -measurement quality (with no items significantly loading on multiple factors) were retained for further analyses (McNeish and Hancock, 2018; McNeish et al., 2018; Shi et al., 2019).

Third, a longitudinal CFA (L-CFA) strategy was used to determine the temporal stability of the SUS's factorial structure. Here, the three measurement models from Time 1 were regressed on their corresponding counterparts in Time 2 (Von Eye, 1990). Again, these competing longitudinal measurement models were assessed for model fit/measurement quality and then systematically compared based on the same criteria as in the previous phase. As a first step in establishing temporal stability of the factorial models, two criteria needed to be met: (a) the regressive path between the factorial models of Time 1 and Time 2 were required to be large (Standardized β > 0.50) and statistically significant (*p* < 0.01) and (b) factorial models at Time 1 needed to declare at least 50% of the variance in its corresponding counterpart at Time 2 (Von Eye, 1990). The model that fit all the criteria was then retained for a more detailed item level inspection and further analyses.

Fourth, based on the best fitting L-CFA model, item-level descriptive statistics, standardized factor loadings, and internal consistency were investigated. Item related descriptive statistics were computed to provide a descriptive overview of each item in terms of means and standard deviations, inspect the corrected item-total correlations (CITC), and determine absolute normality (Skewness and Kurtosis). Based on Kim (2013)

<footnote n="1">¹Following the guidelines from the International Test Commission regarding the use and adaption of tests across cultures (Muñiz et al., 2013), before administration, the 14 items were piloted in a small group of master students to verify their clarity (*n* = 5). Based on feedback from the group, one item of the original instrument (STU_3 “I play to my strengths”) needed to be rephrased (“I pursue goals and activities that are aligned to my strengths”) in order to improve its comprehension within the Dutch context.</footnote>

<footnote n="2">²The Strengths Use Scale was found to be comprised of two factors, Affinity for Strengths and Strengths Use Behaviors, and it was important and necessary for us to test a second-order factorial model to assess the hierarchical nature of the SUS. After first finding support for the first-order factorial model of the SUS items loading on the two first-order latent factors (Affinity for Strengths, Strengths Use Behaviors), we found support for a second-order factorial model in which the two first-order factors load onto the second-order factor, Overall Strengths Use. This therefore suggests that the SUS can be useful for measuring overall strengths use.</footnote>
<table><caption>**TABLE 2** | Model fit statistics.</caption><thead><tr><th>Fit indices</th><th>Cut-off criterion</th><th>Sensitive to N</th><th>Penalty for model complexity</th></tr></thead><tbody><tr><td><strong>Absolute fit indices</strong></td><td></td><td></td><td></td></tr><tr><td>Chi-square (χ²)</td><td>Lowest comparative value between measurement models<br>Significant (ρ > 0.01)</td><td>Yes</td><td>Yes</td></tr><tr><td>χ²/df</td><td>&lt;3 = Excellent and &lt;5 = Acceptable</td><td>No</td><td>No</td></tr><tr><td><strong>Approximate fit indices</strong></td><td></td><td></td><td></td></tr><tr><td>Root-Means-Square Error of Approximation (RMSEA)</td><td>&lt;0.08 but &gt;0.01<br>90% CI Range doesn't include zero</td><td>Yes</td><td>Yes</td></tr><tr><td>Standardized Root Mean Square Residual (SRMR)</td><td>&lt;0.08 but &gt; 0.01</td><td>Yes</td><td>No</td></tr><tr><td><strong>Incremental fit indices</strong></td><td></td><td></td><td></td></tr><tr><td>Comparative Fit Index (CFI)</td><td>&gt;0.90 but &lt;0.99</td><td>No</td><td>Yes</td></tr><tr><td>Tucker-Lewis Index (TLI)</td><td>&gt;0.90 but &lt;0.99</td><td>No</td><td>Yes</td></tr><tr><td>Akaike Information Criterion (AIC)</td><td>Lowest value in comparative measurement models</td><td>No</td><td>No</td></tr><tr><td>Bayes Information Criterion (BIC)</td><td>Lowest value in comparative measurement models</td><td>No</td><td>No</td></tr></tbody></table>

Adapted from Kline (2011) and Wong and Wong (2020).

suggestion, absolute values for Skewness (<2) and Kurtosis (<2) were used as indicators of normality as our sample size was smaller than 500. The CITC represents the relationship of each item to the overall SUS, where correlations of less than r = 0.30 indicate that an item may not represent the overall factor (Zijlmans et al., 2019). Subsequently, point-estimate reliability (upper-bound; ρ > 0.80; Raykov, 2009), Mc Donald's Omega (ω > 0.80; Hayes and Coutts, 2020) and Cronbach's alpha (lower-bound; α > 0.70; Nunnally and Bernstein, 1994) for the best fitting model were computed to determine the internal consistency of the SUS and its subscales. Further, the average variance extracted (AVE) acts as an indicator for the average reliability of each individual indicator (item) in a scale, where a value over 50% is acceptable (Kline, 2011).

Fifth, second-order longitudinal measurement invariance (LMI) was implemented to determine whether the SUS is measured similarly at Time 1 and Time 2. LMI was assessed through applying increasingly restrictive equality constraints on the best fitting (second-order) L-CFA through estimating:

1. configural invariance (similar factor structures at baseline).

2. metric invariance for the first-order factorial model (similar factor loadings over time).

3. metric invariance for the second-order factorial model.

4. scalar invariance for the first-order factorial model (similar intercepts over time).

5. scalar invariance for the second-order factorial model.

6. strict invariance for the overall model (similar residual errors over time).

Invariance was established by comparing these ever-restrictive models on predefined criteria (Chen, 2007). A chi-square difference test was first computed but not used due to its sensitivity to minor parameter changes in small samples and model complexity (Cheung and Rensvold, 2002; Chen, 2007; Widaman et al., 2010). Instead, changes in RMSEA (Δ < 0.015), SRMR (Δ < 0.015), CFI (< 0.01), TLI (< 0.01), and

chi-square/df (<1) indicated invariance (Cheung and Rensvold, 2002; Widaman et al., 2010). For comparisons, the least restrictive model was compared to the increasingly constrained models in each sequential step of the estimation process. If invariance was established, latent mean differences between the time points could be computed. Here, the Time 1 mean score was constrained to zero and used as the reference group. Time 2 mean score was freely estimated. Should Time 2 latent mean score differs significantly from zero, it would indicate a significant difference between timestamps (Wickrama et al., 2016; Wong and Wong, 2020).

Finally, to establish concurrent and predictive validity, separate structural models were estimated with the best fitting L-CFA model as an exogenous factor and study engagement as the endogenous factor. For concurrent validity, Strengths Use at Time 1 was regressed on Study Engagement Time 1 and Strengths Use Time 2 regressed on Study Engagement Time 2. To establish predictive validity, Strengths Use Time 1 was regressed on Study Engagement Time 2. A significance level of p < 0.01 (99% confidence interval) for each regressive path.

## RESULTS

The results of the exploratory factor analyses, baseline competing measurement models, longitudinal factor analyses, item-level descriptive (and internal consistency), longitudinal measurement invariance, and concurrent/predictive validity are reported separately in this section. The results are presented in a tabulated format with brief subsequent interpretations.

### Exploratory Factor Analysis

To explore the factorial structure of the SUS an EFA approach was employed on the baseline data. First, factorizability was established through the KMO measure and Bartlett's test for sphericity. The results showed that the KMO value was larger than 0.60 (KMO = 0.94) and produced a significant chi-square
<table><caption>**TABLE 3** | EFA: Geomin rotated factor loadings and declared variance.</caption><thead><tr><th></th><th>Item</th><th>λ<sub>1</sub></th><th>λ<sub>2</sub></th><th>R<sup>2</sup> (%)</th></tr></thead><tbody><tr><td><strong>Affinity</strong></td><td></td><td></td><td></td><td>7.48</td></tr><tr><td>STU_1</td><td>I am regularly able to do what I do best</td><td>0.80</td><td>-0.01</td><td></td></tr><tr><td>STU_2</td><td>I pursue goals and activities that are aligned to my strengths</td><td>0.83</td><td>-0.01</td><td></td></tr><tr><td>STU_3</td><td>[Redacted]</td><td>0.48</td><td>0.21</td><td></td></tr><tr><td>STU_4</td><td>[Redacted]</td><td>0.53</td><td>0.25</td><td></td></tr><tr><td>STU_7</td><td>[Redacted]</td><td>0.58</td><td>0.07</td><td></td></tr><tr><td>STU_12</td><td>Most of my time is spent doing the things that I am good at doing</td><td>0.41</td><td>0.26</td><td></td></tr><tr><td><strong>Active use</strong></td><td></td><td></td><td></td><td>63.94</td></tr><tr><td>STU_5</td><td>I use my strengths everyday</td><td>0.19</td><td>0.59</td><td></td></tr><tr><td>STU_6</td><td>I use my strengths to get what I want out of life</td><td>0.27</td><td>0.53</td><td></td></tr><tr><td>STU_8</td><td>[Redacted]</td><td>0.21</td><td>0.54</td><td></td></tr><tr><td>STU_9</td><td>[Redacted]</td><td>-0.09</td><td>0.81</td><td></td></tr><tr><td>STU_10</td><td>I find it easy to use my strengths in the things I do</td><td>-0.02</td><td>0.81</td><td></td></tr><tr><td>STU_11</td><td>[Redacted]</td><td>0.05</td><td>0.78</td><td></td></tr><tr><td>STU_13</td><td>Using my strengths is something I am familiar with</td><td>0.13</td><td>0.65</td><td></td></tr><tr><td>STU_14</td><td>[Redacted]</td><td>-0.00</td><td>0.81</td><td></td></tr></tbody></table>

(p < 0.01). Meaningful factors could therefore be extracted, and we proceeded to estimate the EFA models.

As an initial measure, one to five factorial models were specified to be extracted. The results showed that two factors could be extracted with eigenvalues larger than 1. Further, only two models converged: A single first order factorial model ($\chi^2_{(360)} = 391.48$; df = 77; $\chi^2/df = 5.08$; CFI = 0.89; TLI = 0.87; RMSEA = 0.11 [0.097,0.118]; SRMR = 0.05; AIC= 12588.99; BIC = 12751.73; Eigenvalue: 7.55; $R^2 = 53.94\%$) and a two first order factorial model ($\chi^2_{(360)} = 228.96$; df = 64; $\chi^2/df = 3.58$; CFI = 0.94; TLI = 0.92; RMSEA = 0.08 [0.073,0.097]; SRMR = 0.03; AIC = 12452.47; BIC = 12665.59; Eigenvalue Factor 1 = 7.55; $R^2 = 53.94\%$; Eigenvalue Factor 2 = 1.05; $R^2 = 7.48\%$). Only the two first-order factorial model fitted the data. This model showed significantly better fit than the single first-order factorial model. The item loadings and declared variance for this model are presented in Table 3³. All items loaded larger than 0.40 onto their respective factors. The first factor was labeled Affinity for Strengths (“Affinity”) and the second factor as Strengths Use Behaviors (“Active Use”). The Geomin factorial correlation showed that Affinity and Active Use were strongly correlated (r = 0.73; p < 0.01).

## Cross-Sectional Factorial Validity: Competing Measurement Models for Time 1 and Time 2

A competing measurement modeling strategy was employed to establish the factorial validity of the SUS on each of the “cross-sectional” data points. Here, observed items were used as indicators of latent factors. No items were removed and error terms were permitted to correlate.

The following models were estimated separately at both Time 1 and Time 2:

* **Model 1 & Model 4:** A one-factor first-order factorial model was estimated where all 14 items loaded directly on to a single factor called “Overall Strengths Use.”

* **Model 2 & Model 5:** Two correlated first-order factor models were estimated for a factor labeled “Strengths Affinity” (comprised of items 1, 2, 3, 4, 7, 12) and “Active Use” (comprised out of items 5, 6, 8, 9, 10, 11, 13, 14).

* **Model 3 & 6:** A second-order factorial model comprised out of the two first-order factors specified in the previous model was specified to directly load onto overall Strengths Use.

**Table 4** presents the model fit indices for each of the estimated models. At *Time 1*, the results showed that only Models 2 and 3 fitted the data ($\chi^2_{(360)} = 267.48$; df = 76; $\chi^2/df = 3.52$; CFI = 0.93; TLI = 0.92; RMSEA = 0.08 [0.073,0.095]; SRMR = 0.04). Both models further fitted the data significantly better than Model 1 ($\Delta\chi^2 = -124.00$; $\Delta df = -1$; $\chi^2/df = -1.56$; $\Delta$CFI = 0.04; $\Delta$TLI = 0.05; $\Delta$RMSEA = -0.03; $\Delta$SRMR = -0.01; $\Delta$AIC: -122.00; $\Delta$BIC: -118.13).

The result showed a similar pattern at *Time 2*, only Models 5 and 6 fitted the data ($\chi^2_{(360)} = 328.40$; df = 76; $\chi^2/df = 4.32$; CFI = 0.92; TLI = 0.91; RMSEA = 0.10 [0.087,0.108]; SRMR = 0.04). Both models fitted the data significantly better than Model 4 ($\Delta\chi^2 = -34.10$; $\Delta df = -1$; $\chi^2/df = -0.56$; $\Delta$CFI = 0.03; $\Delta$TLI = 0.02; $\Delta$RMSEA = -0.00; $\Delta$SRMR = 0.00; $\Delta$AIC: -31.41; $\Delta$BIC: -28.23).

In respect of measurement quality, all models at both *Time 1* and *Time 2* showed acceptable levels with standardized factor loadings ($\lambda > 0.40$; p < 0.01), standard errors, and item uniqueness ($\delta < 0.10$ but > 0.90; p < 0.01) meeting the classification criteria (Asparouhov and Muthén, 2009; Kline, 2011).

<footnote n="3">³For copyright purposes, several items were redacted. Items are, however, numbered and presented in the same order as in Govindji and Linley (2007) and Wood et al. (2011).</footnote>
<table><caption>TABLE 4 | Cross-sectional confirmatory factor analyses: measurement model fit statistics for time 1 and time 2.</caption><thead><tr><th>Model</th><th>Description</th><th>χ<sup>2</sup></th><th>df</th><th>χ<sup>2</sup> / df</th><th>CFI</th><th>TLI</th><th>RMSEA</th><th>SRMR</th><th>AIC</th><th>BIC</th><th>aBIC</th><th>Meets criteria</th></tr></thead><tbody><tr><td colspan="13"><strong>Time 1</strong></td></tr><tr><td>Model 1</td><td>One-factor model</td><td>391.48</td><td>77</td><td>5.08</td><td>0.89</td><td>0.87</td><td>0.11</td><td>[0.097, 0.118]</td><td>0.05</td><td>12588.99</td><td>12751.74</td><td>12618.50</td><td>No</td></tr><tr><td>Model 2</td><td>Two-factor model</td><td>267.48</td><td>76</td><td>3.52</td><td>0.93</td><td>0.92</td><td>0.08</td><td>[0.073, 0.095]</td><td>0.04</td><td>12466.99</td><td>12633.61</td><td>12497.20</td><td>Yes</td></tr><tr><td>Model 3</td><td>Second-order factor model</td><td>267.48</td><td>76</td><td>3.52</td><td>0.93</td><td>0.92</td><td>0.08</td><td>[0.073, 0.095]</td><td>0.04</td><td>12466.99</td><td>12633.61</td><td>12497.20</td><td>Yes</td></tr><tr><td colspan="13"><strong>Time 2</strong></td></tr><tr><td>Model 4</td><td>One-factor model</td><td>362.50</td><td>77</td><td>4.71</td><td>0.91</td><td>0.89</td><td>0.10</td><td>[0.092, 0.114]</td><td>0.04</td><td>11526.02</td><td>11688.17</td><td>11554.93</td><td>Partially</td></tr><tr><td>Model 5</td><td>Two-factor model</td><td>328.41</td><td>76</td><td>4.32</td><td>0.92</td><td>0.91</td><td>0.10</td><td>[0.087, 0.108]</td><td>0.04</td><td>11493.92</td><td>11659.94</td><td>11523.52</td><td>Yes</td></tr><tr><td>Model 6</td><td>Second-order factor model</td><td>328.41</td><td>76</td><td>4.32</td><td>0.92</td><td>0.91</td><td>0.10</td><td>[0.087, 0.108]</td><td>0.04</td><td>11493.92</td><td>11659.94</td><td>11523.52</td><td>Yes</td></tr></tbody></table>

χ², Chi-square; df, degrees of freedom; TLI, Tucker-Lewis Index; CFI, Comparative Fit Index; RMSEA, Root Mean Square Error of Approximation [90%CI]; SRMR, Standardised Root Mean Square Residual; AIC, Akaike Information Criterion; BIC, Bayes Information Criterion; aBIC, Adjusted Bayes Information Criterion.

## Longitudinal Factor Analyses: Longitudinal Factorial Validity and Temporal Stability

The next step in the process was to determine the stability of the SUS over time using L-CFA. In each L-CFA model, the corresponding measurement model specified in Time 1 was regressed on Time 2. The following models were tested:

* **Model 7:** The single, first-order factor (with all 14 items loading directly on to such) of Time 1 was regressed on the single first-order factor of Time 2.

* **Model 8:** The two first-order factor models of “Strengths Affinity” (comprised of items 1, 2, 3, 4, 7, 12) and “Active Use” (comprised out of items 5, 6, 8, 9, 10, 11, 13, 14) at Time 1 was regressed onto their corresponding Strengths Affinity and Proactive Use factorial counterparts. Covariances between the factors at each time point was permitted.

* **Model 9:** The second-order factorial model of Time 1 was regressed on that of Time 2 was regressed. Both models comprised out of the two first-order factors specified in the previous model. Covariances between the factors at each time point was not permitted. Error terms on Item 14 and 11 were permitted to covary at Time 2.

The results summarized in Table 5 indicated that only Model 9, the second-order longitudinal factorial model, fitted the data ($\chi^2_{(360)} = 974.93$; $df = 344$; $\chi^2/df = 2.83$; CFI = 0.90; TLI = 0.90; RMSEA = 0.07 [0.066,0.077]$; SRMR = 0.04). Model 9 also fitted the data significantly better than Model 7 ($\Delta\chi^2 = -224.31$; $\Delta df = -5$; $\chi^2/df = -0.60$; $\Delta CFI = 0.03$; $\Delta TLI = 0.04$; $\Delta RMSEA = -0.01$; $\Delta SRMR = 0.00$; $\Delta AIC = -214.20$; $\Delta BIC = -194.77$) and Model 8 ($\Delta\chi^2 = -53.58$; $\Delta df = -2$; $\chi^2/df = -0.14$; $\Delta CFI = 0.00$; $\Delta TLI = 0.01$; $\Delta RMSEA = 0.00$; $\Delta SRMR = 0.00$; $\Delta AIC = -49.58$; $\Delta BIC = -41.81$). All longitudinal models showed acceptable levels of measurement quality with standardized factor loadings ($\lambda > 0.40$; $p < 0.01$), standard errors, and item uniqueness ($\delta > 0.10$ but $< 0.9$; $p < 0.01$) exceeding the specified thresholds (Asparouhov and Muthén, 2009; Kline, 2011).

Further, to assess the final two assumptions for L-CFA, the regressive paths and covariances, as well as the variance declared by factorial models of Time 1 in Time 2, were estimated and summarized in Table 6. Although all the factors at Time 1 statistically significantly predicted the factors in Time 2, the results showed that only Model 9 met both the significance and variance criteria. The second-order factorial Strengths Use factor at Time 1 statistically significantly predicted 51% of the variance of Strengths Use in Time 2 with a large effect ($\beta = 0.71$; $S.E = 0.03$; $p < 0.01$). Therefore, only Model 9 was retained for further analyses.

## Longitudinal Factor Loadings, Item Level Descriptive and Internal Consistency

Next, item-level descriptive statistics (means, standard deviations, skewness, kurtosis, CICT), standardized factor loadings, the Average Value Explained (AVE) and the level of internal consistency was computed for the second-order longitudinal factor
<table><caption>TABLE 5 | Longitudinal confirmatory factor analyses: measurement model fit statistics for time 1 and time 2.</caption><thead><tr><th>Model</th><th>Description</th><th>χ<sup>2</sup></th><th>df</th><th>χ<sup>2</sup> / df</th><th>CFI</th><th>TLI</th><th>RMSEA</th><th>SRMR</th><th>AIC</th><th>BIC</th><th>aBIC</th><th>Meets criteria</th></tr></thead><tbody><tr><td>Model 7</td><td>One-factor models</td><td>1199.14</td><td>349</td><td>3.44</td><td>0.87</td><td>0.86</td><td>0.08</td><td>0.05</td><td>23941.81</td><td>24272.13</td><td>24002.47</td><td>No</td></tr><tr><td>Model 8</td><td>Two-factor models</td><td>1028.51</td><td>346</td><td>2.97</td><td>0.90</td><td>0.89</td><td>0.07</td><td>0.05</td><td>23777.19</td><td>24119.17</td><td>23839.98</td><td>Partially</td></tr><tr><td>Model 9</td><td>Second-order factor models</td><td>974.93</td><td>344</td><td>2.83</td><td>0.90</td><td>0.90</td><td>0.07</td><td>0.05</td><td>23727.61</td><td>24077.36</td><td>23791.83</td><td>Yes</td></tr></tbody></table>

χ², Chi-square; df, degrees of freedom; TLI, Tucker-Lewis Index; CFI, Comparative Fit Index; RMSEA, Root Mean Square Error of Approximation [90%CI]; SRMR, Standardised Root Mean Square Residual; AIC, Akaike Information Criterion; BIC, Bayes Information Criterion; aBIC, Adjusted Bayes Information Criterion.

model (Model 9). Table 7 provided a summary for the results.

The results of the item level descriptive statistics show that all items were normally distributed (Skewness and Kurtosis < +2; −2: Kim, 2013), that each item was clearly associated with the overall factor being assessed (CITC r > 0.30: Zijlmans et al., 2019) and that each sub-factor and overall strengths-use scale showed to be reliable at both the upper- (ρ > 0.80; ω > 0.80) and lower-bound level of internal consistency (α > 0.70) at both time points.

All items on Affinity and Active Use loaded statistically significantly on their respective factors at both time points with standardized factor loadings ranging from 0.56 to 0.81 (p < 0.01). The AVE for Affinity was acceptable, with 0.50 reported at Time 1 and 0.54 at Time 2. Similarly, the AVE for Active Use at Time 1 (AVE = 0.58) and Time 2 (AVE = 0.58) exceeded the 0.50 threshold.

Further, both the first-order Affinity (Time 1: λ = 0.90, SE = 0.03 p < 0.01; Time 2 = λ = 0.98 SE = 0.02; p < 0.01) and Active Use factors (Time 1: λ = 0.94, SE = 0.03, p < 0.01; Time 2: λ = 0.97, SE = 0.02, p < 0.01) loaded statistically significantly onto the second-order Strengths Use factor. The second-order longitudinal factorial model therefore showed to have an excellent level of measurement quality and can therefore be subjected to more robust assessments of longitudinal stability over time.

## Longitudinal Measurement Invariance and Mean Comparisons

Next, longitudinal measurement invariance (LMI) was tested to determine the factorial equivalence of the SUS over time. The results, summarized in Table 8, showed that all invariance models fitted the data based on the criteria mentioned in Table 2 and that longitudinal measurement invariance of the SUS could be established between the different time points. No significant differences in terms of RMSEA (Δ < 0.015), SRMR (Δ < 0.015), CFI (< 0.010), TLI (< 0.010), and χ²/df (<1) between the configural, metric, scalar, and strict invariance models were found (Cheung and Rensvold, 2002; Widaman et al., 2010; Wong and Wong, 2020). Therefore, the SUS showed to be a consistent measure over time and that meaningful mean comparisons between Time 1 and Time 2 can be made.

Further, to compare latent means on the first- and second-order factors of the SUS, all mean scores at Time 1 were constrained to zero within the strict invariance model. Affinity, Active Use, and Overall Strengths Use at Time 2 were then freely estimated. For the first-order factors, the results showed that Affinity (Δ ̅x = −0.7; SE = 0.04; p = 0.10) and Active Strengths Use (Δ ̅x = 0.7; SE = 0.05; p = 0.11) at Time 2 did not meaningfully differ from Time 1. Similarly, at a second-order factorial level, Overall Strengths Use at Time 2 (Δ ̅x = 0.0; SE = 0.04; p = 0.908) did also not meaningfully differ from Time 1.

## Concurrent and Predictive Validity

To establish concurrent and predictive validity, separate structural models were estimated with the second-order Strengths Use models specified as an exogenous factor and Study Engagement (as a second-order factor made up of three
<table><caption>TABLE 6 | Longitudinal confirmatory factor analyses: regressive paths and covariances between time 1 and time 2.</caption><thead><tr><th rowspan="2">Model</th><th rowspan="2">Relational path</th><th colspan="6">Standardized</th><th rowspan="2">Meets criteria</th></tr><tr><th>β</th><th>r</th><th>S.E</th><th>t-value</th><th>p</th><th>R<sup>2</sup></th></tr></thead><tbody><tr><td>Model 7</td><td>Strengths use time 1 →</td><td>0.68</td><td>-</td><td>0.03</td><td>20.63</td><td>0.00</td><td>0.46</td><td>Partially</td></tr><tr><td rowspan="4">Model 8</td><td>Affinity time 1 →</td><td>0.66</td><td>-</td><td>0.04</td><td>17.22</td><td>0.00</td><td>0.44</td><td rowspan="4">Partially</td></tr><tr><td>Active use time 1 →</td><td>0.63</td><td>-</td><td>0.04</td><td>16.71</td><td>0.00</td><td>0.40</td></tr><tr><td>Affinity time 1 ↔</td><td>-</td><td>0.88</td><td>0.02</td><td>46.61</td><td>0.00</td><td>-</td></tr><tr><td>Affinity time 2 ↔</td><td>-</td><td>0.95</td><td>0.02</td><td>38.77</td><td>0.00</td><td>-</td></tr><tr><td>Model 9</td><td>Strengths use time 1 →</td><td>0.71</td><td>-</td><td>0.03</td><td>20.84</td><td>0.00</td><td>0.51</td><td>Yes</td></tr></tbody></table>

→Regression, ↔Covariance.

first-order factors: Vigor, Dedication, and Absorption) specified as endogenous factors. The results for both concurrent and predictive validity are summarized in Table 9.

For concurrent validity, Strengths Use at Time 1 was first was regressed on Study Engagement at Time 1. The model showed adequate fit ($\chi^2_{(360)} = 595.83$; $df = 225$; $\chi^2/df = 2.65$; CFI = 0.92; TLI = 0.91; RMSEA = 0.06 [0.061,0.075]; SRMR = 0.06; AIC = 20707.47; BIC = 20994.22). Strengths Use at Time 1 was directly associated with Study Engagement at Time 1 ($\beta = 0.49$; S.E = 0.05; $p < 0.01$; $R^2 = 0.24$). Similarly, Strengths Use at Time 2 was also directly associated with Study Engagement at Time 2 ($\beta = 0.58$; S.E = 0.04; $p < 0.01$; $R^2 = 0.33$). This model also showed adequate fit ($\chi^2_{(360)} = 689.80$; $df = 225$; $\chi^2/df = 3.07$; CFI = 0.91; TLI = 0.90; RMSEA = 0.08 [0.070,0.083]; SRMR = 0.06; AIC = 19403.58; BIC = 19689.28).

For predictive validity, Strengths Use at Time 1 was regressed on Study Engagement at Time 2. This model showed adequate fit ($\chi^2_{(360)} = 576.37$; $df = 225$; $\chi^2/df = 3.07$; CFI = 0.93; TLI = 0.91; RMSEA = 0.07 [0.069,0.073]; SRMR = 0.06; AIC = 20423.66; BIC = 20711.24). Here, Strengths Use at Time 1 predicted 22% of the variance in Study Engagement at Time 2 ($\beta = 0.47$; S.E = 0.05; $p < 0.01$; $R^2 = 0.24$). Both concurrent and predictive validity of the SUS could therefore be established.

## DISCUSSION

This study aimed to investigate the psychometric properties, longitudinal invariance, and criterion validity of the SUS within a Dutch student population. Longitudinal confirmatory factor analysis showed that a second-order factorial model, comprised of two first-order factors (*Affinity for Strengths* and *Strengths Use Behaviors*), fitted the data best. Further, this model showed support for strict longitudinal measurement invariance over 3 months with similar factorial structures, -factor loadings, item intercepts, and item uniqueness. Further, the SUS produced high levels of internal consistency at both the lower- and upper bound limits at both time stamps. Mean comparisons showed that neither overall strengths use, nor its two components, differed between Time 1 and Time 2. This confirmed the stability of the SUS over time. Finally, strengths use was related to study engagement at both time points. Strengths use at Time 1 also

predicted study engagement at Time 2. Therefore, supporting the assumptions of criterion validity.

## The Psychometric Properties of the Strengths Use Scale

Longitudinal factor analyses showed that a second-order factorial model of overall strengths use, comprising two first-order factors called *Affinity for Strengths* and *Strengths Use Behaviors*, fitted the data. *Affinity for Strengths* comprised six items related to opportunities where individuals could live out or apply their strengths. These opportunities related to activities that individuals are drawn to and that are naturally aligned to their strengths (Wood et al., 2011; Van Woerkom et al., 2016a). Individuals seek out activities where they can both live out- and pursue goals aligned to their strengths. They further show a natural affinity for mastering new skills/hobbies where these strengths are required (Govindji and Linley, 2007).

On the other hand, active *Strengths Use Behaviors* was measured by eight items related to the behaviors' individuals exhibit when applying strengths in everyday life. These behaviors related to actions employed by individuals to actively develop and apply their strengths to achieve life goals. Here, individuals can actively deploy their strengths to get what they want out of life (Govindji and Linley, 2007).

This two-factorial permutation of the SUS contrasts with Govindji and Linley (2007) and Wood et al. (2011), who reported strengths use as a single, first-order factor. Although our findings contrast with these authors' empirical results, it is in line with the original theoretical tenet on which the instrument was built. Govindji and Linley (2007) argued that strengths use is a function of the organismic value process and the self-concordant goal theory (from which items of the SUS was generated). According to Joseph and Linley (2005), the organismic value process suggests that strengths are psychological traits that individuals are inherently driven to use, develop, and apply (i.e., behaviors). Further, individuals express an inherent desire to live by their strengths and are unconsciously attracted to and show an affinity for activities/hobbies, studies, or work that are aligned to their strengths (i.e., affinity) (Wood et al., 2011; Huber et al., 2017). Therefore, our results are more closely aligned to the original theoretical ideas underpinning strengths use as proposed by Govindji and Linley (2007), rather than their empirical results.
<table><caption>TABLE 7 | Item level descriptive statistics, standardized factor loadings, average value explained, and internal consistency for the longitudinal model 9.</caption><thead><tr><th rowspan="2">Factor</th><th rowspan="2">Item</th><th colspan="10">Time 1–Second-order strengths use model (model 9)</th><th colspan="10">Time 2–Second-order strengths use model (model 9)</th></tr><tr><th>x̄</th><th>σ</th><th>Skewness</th><th>Kurtosis</th><th>CITC</th><th>λ</th><th>S.E.</th><th>δ</th><th>AVE</th><th>ρ</th><th>α</th><th>ω</th><th>x̄</th><th>σ</th><th>Skewness</th><th>Kurtosis</th><th>CITC</th><th>λ</th><th>S.E.</th><th>δ</th><th>AVE</th><th>ρ</th><th>α</th><th>ω</th></tr></thead><tbody><tr><td rowspan="6">Affinity</td><td>STU_1</td><td>5.20</td><td>1.05</td><td>-0.98</td><td>1.82</td><td>0.67</td><td>0.77</td><td>0.03</td><td>0.41</td><td>-</td><td>-</td><td>-</td><td>0.50</td><td>0.86</td><td>0.85</td><td>0.85</td><td>5.13</td><td>1.11</td><td>-0.73</td><td>0.23</td><td>0.73</td><td>0.78</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_2</td><td>5.24</td><td>1.02</td><td>-0.70</td><td>0.85</td><td>0.70</td><td>0.79</td><td>0.02</td><td>0.38</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.20</td><td>0.90</td><td>-0.55</td><td>0.19</td><td>0.72</td><td>0.79</td><td>0.02</td><td>0.39</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_3</td><td>5.59</td><td>0.81</td><td>-0.65</td><td>0.90</td><td>0.61</td><td>0.67</td><td>0.03</td><td>0.56</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.44</td><td>0.99</td><td>-0.73</td><td>0.53</td><td>0.71</td><td>0.76</td><td>0.03</td><td>0.43</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_4</td><td>5.38</td><td>0.93</td><td>-0.66</td><td>0.79</td><td>0.70</td><td>0.75</td><td>0.03</td><td>0.43</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.26</td><td>0.88</td><td>-0.63</td><td>0.45</td><td>0.74</td><td>0.78</td><td>0.02</td><td>0.39</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_7</td><td>4.77</td><td>1.62</td><td>-0.43</td><td>-0.15</td><td>0.56</td><td>0.63</td><td>0.04</td><td>0.61</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>4.92</td><td>1.28</td><td>-0.63</td><td>0.51</td><td>0.62</td><td>0.65</td><td>0.03</td><td>0.57</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_12</td><td>4.68</td><td>1.53</td><td>-0.36</td><td>-0.36</td><td>0.60</td><td>0.63</td><td>0.04</td><td>0.60</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>4.89</td><td>1.13</td><td>-0.53</td><td>0.36</td><td>0.64</td><td>0.65</td><td>0.03</td><td>0.58</td><td>-</td><td>-</td><td>-</td></tr><tr><td rowspan="9">Active Use</td><td>STU_5</td><td>4.94</td><td>1.35</td><td>-0.56</td><td>0.36</td><td>0.71</td><td>0.75</td><td>0.03</td><td>0.44</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.58</td><td>0.92</td><td>0.92</td><td>0.92</td><td>5.04</td><td>1.28</td><td>-0.51</td><td>0.19</td><td>0.75</td><td>0.78</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_6</td><td>5.22</td><td>1.29</td><td>-0.69</td><td>0.71</td><td>0.73</td><td>0.76</td><td>0.03</td><td>0.42</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.31</td><td>1.18</td><td>-0.61</td><td>0.36</td><td>0.74</td><td>0.77</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_8</td><td>5.05</td><td>1.23</td><td>-0.48</td><td>-0.04</td><td>0.68</td><td>0.72</td><td>0.03</td><td>0.49</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.14</td><td>1.10</td><td>-0.30</td><td>-0.03</td><td>0.74</td><td>0.77</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_9</td><td>5.17</td><td>1.41</td><td>-0.82</td><td>0.87</td><td>0.66</td><td>0.72</td><td>0.03</td><td>0.49</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.31</td><td>1.19</td><td>-0.63</td><td>0.30</td><td>0.70</td><td>0.74</td><td>0.03</td><td>0.45</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_10</td><td>5.10</td><td>1.41</td><td>-0.71</td><td>0.29</td><td>0.72</td><td>0.78</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.18</td><td>1.03</td><td>-0.42</td><td>0.13</td><td>0.74</td><td>0.78</td><td>0.02</td><td>0.40</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_11</td><td>5.10</td><td>1.20</td><td>-0.65</td><td>0.65</td><td>0.75</td><td>0.81</td><td>0.02</td><td>0.35</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.11</td><td>1.22</td><td>-0.51</td><td>0.10</td><td>0.74</td><td>0.76</td><td>0.03</td><td>0.42</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_13</td><td>5.22</td><td>1.19</td><td>-0.63</td><td>0.43</td><td>0.71</td><td>0.74</td><td>0.03</td><td>0.45</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.28</td><td>1.10</td><td>-0.58</td><td>0.37</td><td>0.72</td><td>0.75</td><td>0.03</td><td>0.44</td><td>-</td><td>-</td><td>-</td></tr><tr><td>STU_14</td><td>5.03</td><td>1.19</td><td>-0.45</td><td>0.04</td><td>0.74</td><td>0.80</td><td>0.02</td><td>0.35</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>5.18</td><td>1.03</td><td>-0.40</td><td>0.08</td><td>0.77</td><td>0.78</td><td>0.02</td><td>0.39</td><td>-</td><td>-</td><td>-</td></tr><tr><td rowspan="2">Strength-Use</td><td>Affinity</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.90</td><td>0.03</td><td>0.19</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.85</td><td>0.92</td><td>0.93</td><td>0.93</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.95</td><td>0.97</td><td>0.94</td><td>0.94</td></tr><tr><td>Active Use</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.94</td><td>0.03</td><td>0.12</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>0.98</td><td>0.02</td><td>0.04</td><td>-</td><td>-</td><td>-</td></tr></tbody></table>

x̄, Mean; σ, Standard deviation; CICT, Corrected item total correlation; λ, Standardized factor loadings; S.E., Standard Error; δ, Item Uniqueness; ρ, Composite Reliability; α, Cronbach's Alpha; ω: McDonald's Omega.
<table><caption>TABLE 8 | Longitudinal measurement invariance for the second-order strengths use model (model 9).</caption><thead><tr><th>Model</th><th>χ<sup>2</sup></th><th>df</th><th>χ<sup>2</sup> / df</th><th>CFI</th><th>TLI</th><th>RMSEA</th><th>SRMR</th><th>Model comparison</th><th>Δχ<sup>2</sup></th><th>Δχ<sup>2</sup> / df</th><th>ΔCFI</th><th>ΔTLI</th><th>ΔRMSEA</th><th>ΔSRMR</th><th>Meets criteria</th></tr></thead><tbody><tr><td>M1 Configural invariance</td><td>850.49</td><td>330</td><td>2.58</td><td>0.921</td><td>0.909</td><td>0.066</td><td>[0.061, 0.072]</td><td>0.043</td><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td>Yes</td></tr><tr><td>M2 Metric invariance: first-order</td><td>868.17</td><td>342</td><td>2.54</td><td>0.919</td><td>0.911</td><td>0.065</td><td>[0.060, 0.071]</td><td>0.052</td><td>M2 vs. M1</td><td>17.68</td><td>-0.039</td><td>-0.002</td><td>0.002</td><td>0.001</td><td>0.009</td></tr><tr><td>M3 Metric invariance: second-order</td><td>879.19</td><td>343</td><td>2.56</td><td>0.918</td><td>0.909</td><td>0.066</td><td>[0.061, 0.071]</td><td>0.053</td><td>M3 vs. M2</td><td>11.02</td><td>0.025</td><td>-0.001</td><td>-0.002</td><td>0.001</td><td>0.001</td></tr><tr><td>M4 Scalar invariance: first-order</td><td>917.75</td><td>356</td><td>2.58</td><td>0.914</td><td>0.909</td><td>0.066</td><td>[0.061, 0.071]</td><td>0.057</td><td>M4 vs. M3</td><td>38.56</td><td>0.015</td><td>-0.004</td><td>0.000</td><td>0.000</td><td>0.004</td></tr><tr><td>M5 Scalar invariance: second-order</td><td>927.51</td><td>355</td><td>2.61</td><td>0.912</td><td>0.907</td><td>0.067</td><td>[0.062, 0.072]</td><td>0.057</td><td>M5 vs. M4</td><td>9.76</td><td>0.035</td><td>-0.002</td><td>-0.002</td><td>0.001</td><td>0.000</td></tr><tr><td>M6 Strict invariance</td><td>942.64</td><td>358</td><td>2.63</td><td>0.910</td><td>0.905</td><td>0.067</td><td>[0.062, 0.073]</td><td>0.060</td><td>M6 vs. M5</td><td>15.13</td><td>0.020</td><td>-0.002</td><td>-0.002</td><td>0.000</td><td>0.003</td></tr></tbody></table>

χ², Chi-square; df, degrees of freedom; TLI, Tucker-Lewis Index; CFI, Comparative Fit Index; RMSEA, Root Mean Square Error of Approximation [90%CI]; SRMR, Standardised Root Mean Square Residual.

On the factorial level, the results showed that all items loaded significantly and sufficiently on their respective factors at both time points. All standardized factor loadings loaded significantly on their respective factors and ranged from 0.63 to 0.81 at Time 1 and 0.65 and 0.78 at Time 2. This exceeds the suggested cut-off criteria of 0.40, as Asparouhov and Muthén (2009) and Kline (2011) suggested. Further, no cross-loadings were present, item uniqueness was acceptable (>0.10 but <0.90; *p* < 0.01), and the average variance extracted was more than 50% for both factors at both time points (Asparouhov and Muthén, 2009; Kline, 2011). Further, all items showed a corrected item-total correlation coefficient larger than 0.3 (ranging from 0.56 to 0.77), implying that all items belong to their respective factors. This contrasts with other studies where a single factor of strengths use was reported. In the majority of international studies, several modifications to the SUS scale (such as correlating error terms, and item parceling) were required to enhance model fit and to increase measurement quality (c.f. Wood et al., 2011; Huber et al., 2017; Bu and Duan, 2020; Vuorinen et al., 2020). Enhancing model fit through statistical modification artificially inflates data-model fit but does not address the theoretical reasoning why the instrument did not perform as intended (McNeish et al., 2018). These modifications to the instrument also change the theoretical foundation on which the instrument is built, making comparisons to other studies improbable. Given that no modifications were made to artificially inflate model fit or measurement quality within the current sample, it would seem as though the two-factor model shows more promise.

Finally, the level of internal consistency at both the lower- and upper bound levels for all constructs at both time points suggest that the SUS was a reliable measure of strengths use. This is inline with other findings that showed high levels of internal consistency for the overall strengths use factor in the USA (Govindji and Linley, 2007; Wood et al., 2011), Germany (Huber et al., 2017), China (Bu and Duan, 2020), Finland (Vuorinen et al., 2020), South Africa (Mahomed and Rothmann, 2020), and the U.K. (McTiernan et al., 2020). The second-order factorial model could therefore be used as a reliable measure for Affinity for Strengths and Strengths Use Behaviors within the current context.

## Longitudinal Measurement Invariance and Factor Mean Comparisons

The results further showed that strict longitudinal measurement invariance of the SUS could be established over 3 months. Both the components (Affinity for Strengths and Strengths Use Behaviors) and overall strengths use factorial model was therefore measured (and interpreted) equally across time. This implies that the SUS showed similar factor structures, factor loadings, intercepts, and residual errors over time. Therefore, the data provide support for the stability of the SUS over time. When strengths use is assessed at two different time points, the mean difference indicates actual changes over time (Wong and Wong, 2020), rather than changes in the meaning of the constructs (Duncan et al., 2013). Meaningful comparisons between means
<table><caption>TABLE 9 | Concurrent and predictive validity of the second-order strengths use model on study engagement.</caption><thead><tr><th rowspan="2">Model</th><th rowspan="2"></th><th rowspan="2">Regressive path</th><th colspan="5">Standardized</th><th rowspan="2">Validity established</th></tr><tr><th>β</th><th>S.E</th><th>t-value</th><th>p</th><th>R<sup>2</sup></th></tr></thead><tbody><tr><td rowspan="2">Concurrent validity</td><td>Strengths use time 1</td><td>→</td><td>Study engagement time 1</td><td>0.49</td><td>0.05</td><td>9.58</td><td>0.00</td><td>0.24</td><td>Yes</td></tr><tr><td>Strengths use time 2</td><td>→</td><td>Study engagement time 2</td><td>0.58</td><td>0.04</td><td>13.54</td><td>0.00</td><td>0.33</td><td>Yes</td></tr><tr><td>Predictive validity</td><td>Strengths use time 1</td><td>→</td><td>Study engagement time 2</td><td>0.47</td><td>0.05</td><td>9.18</td><td>0.00</td><td>0.22</td><td>Yes</td></tr></tbody></table>

→Regression.

and growth trajectories can, therefore, be made over time (Duncan et al., 2013).

No mean differences in neither strengths use, nor its components were reported within the current study. This shows that strengths use remained relatively stable over time (Duncan et al., 2013). This is in line with the assumption proposed by Peterson and Seligman (2004) and Govindji and Linley (2007) that strengths are considered psychological traits and that both the trait and its active use remain relatively stable over time. The stability in both the affinity for and active use of strengths would remain unchanged unless individuals are exposed to- or are engaging in strengths-based developmental initiatives (Seligman, 2012; Huber et al., 2017).

These findings are also relevant for long-term studies on strengths use like within intervention research. When employing longitudinal analytical strategies such as Latent Growth Modeling, where there are multiple measurement occasions, the input matrix of factors is large (Widaman et al., 2010). This leads to convergent problems and/or results in various statistical artifacts, which affects the interpretation of the results (Duncan et al., 2013; Wong and Wong, 2020). To reduce the complexity of these models, researchers would either parcel items or create mean scores to simplify the measurement models at the different time points within the study (Widaman et al., 2010). However, item parceling affects measurement invariance assessments at an item level, producing biased results (Meade and Kroustalis, 2006). Item parceling in longitudinal research should only be considered if there is a strong theoretical argument for such or when strict longitudinal measurement invariance has previously been established (Widaman et al., 2010; Duncan et al., 2013). Therefore, establishing strict longitudinal measurement invariance in the current study supports other researchers to parcel items on the scale when used in similar populations. However, these findings would need to be replicated in other populations to establish firmer conclusions.

## The Relationship Between Strengths Use and Study Engagement

The final objective of the paper was to establish criterion validity through relating Strengths Use to Study Engagement. First, concurrent validity was established by showing that Strengths Use at both Time 1 and Time 2 was positively related to engagement at the same time stamps. Further, predictive validity was established by showing that Strengths Use at Time 1 predicted Study Engagement at Time 2. The results imply that when a student can activate his/her strengths during their studies, it would lead to higher levels of study-related engagement. According to

Van Woerkom et al. (2016b) this is because when individuals use their strengths, it aids them to live more authentically and therefore acts as an energizing mechanism. When students use their strengths during their studies, it leads to more inspiration, enthusiasm, excitement, and dedication to their study-related content (Seligman, 2012). Active strengths use therefore, has an invigorating effect (Huber et al., 2017). The results are aligned to several studies showing that higher levels of active strengths use lead to increased study and work-related engagement (Ouweneel et al., 2011; Seligman, 2012; Stander et al., 2015; Kwok and Fang, 2020). The SUS can therefore, be used as a measure to predict study engagement.

## Limitations and Recommendations

Although the study provides some unique insights, it is not without its limitations. First, the sample is relatively small and drawn from a single Dutch student population from a single Dutch University. This implies that the results may not be generalizable to other contexts or even institutions. It is suggested that the study be replicated in other educational contexts to further investigate the viability of the SUS as a measure of strengths use. Second, the interpretation of what is considered a strength was left to the participant. Therefore it is questionable if the SUS in deed measures “natural capacities coming from within that we yearn to use, that enable authentic expression, energize us and belong to positive traits and/or psychological capacities/talents refined with knowledge and skills” as articulated by Govindji and Linley (2007, p. 147). Although considered a strength of the instrument to measure strengths use in a general way, without providing a clear definition of what a strength is, could possibly lead to statistical artifacts within the data. This is because participants could understand strengths use as character strengths, talents, skills, abilities, or any other behavior pertaining to doing someone really well. It is suggested that the definition of a strength, as articulated by Govindji and Linley (2007), be included in the instructions to participants in the future. Further, it is suggested that a qualitative, open-ended question be added to the SUS requesting participants to both describe their definition of a strength, and provide 3 practical examples of their own strengths. This would aid in standardization in interpretation between participants.

Third, only student engagement was used as a metric to investigate criterion validity. Given that student engagement is a single (self-report) factor, future research should consider including “hard” or “objective” criterions such as academic performance or academic throughput. Fourth, the sample
consisted out of predominantly males. Future studies should aim to include a more even distribution in terms of gender. Fifth, future research should investigate the convergent and discriminant validity of the SUS. Evidence for convergent validity could be tested by comparing the SUS with a measure of personal resilience, the 10-item Connor-Davidson Resilience Scale (CD-RISC) (Campbell-Sills and Stein, 2007). Evidence for discriminant validity could be tested by differentiating the SUS from a measure of personal emotional intelligence (e.g., the 16-item Wong and Law Emotional Intelligence Scale; Wong and Law, 2002). Additionally, future research should also investigate the correlation between the quantitative responses on the SUS with qualitative perceptions about the connotation they gave to strengths use when they responded to the items. This relates to what Alexandrova (2017) refers to as tracking the measurement of a construct as it is understood and endorsed by the respondent.

Sixth, it is suggested that more diverse population groups be considered for future validation studies. The SUS would benefit from a large scale cross-cultural validation study to determine if strengths use is seen and measured the same between cultures. Finally, future research should investigate the psychometric properties of a short-form SUS for rapid use by researchers and practitioners.

## CONCLUSION

Strengths use is a crucial factor to consider when designing both educational programmes and positive psychological interventions at universities. The current study shows support for the use of the SUS as a practical means to assess strengths use and to track the effectiveness of strengths use interventions within higher education environments.

## DATA AVAILABILITY STATEMENT

The data employed in this study is available upon reasonable request from suitably qualified individuals and will be provided

without undue reservations. Data management is aligned to the requirements of the General Data Protection Regulation.

## ETHICS STATEMENT

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Secondary data were employed in this study and the APA guidelines on Ethical Research practices were adhered to. All procedures performed in this study were in accordance with the ethical standards of the institutional requirements and in line with the Declaration of Helsinki. Written, informed consent was obtained from all participants before being permitted to complete the questionnaires. Participation in the study was entirely voluntary, participants were informed of their rights and responsibilities, and that they had the right to withdraw at any time. Given the nature of the study, no ethical clearance was required by the institution.

## AUTHOR CONTRIBUTIONS

All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.

## ACKNOWLEDGMENTS

We would like to extend our appreciation for the Associate Editor (Prof. Jeff Klibert) and the two reviewers that aided us in enhancing the quality of this manuscript. We particularly appreciate their empowering and developmental approach toward their feedback.

## SUPPLEMENTARY MATERIAL

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.676153/full#supplementary-material

## REFERENCES

* Alexandrova, A. (2017). *A Philosophy for the Science of Wellbeing*. New York, NY: Oxford University Press. doi: 10.1093/oso/9780199300518.001.0001

* Asparouhov, T., and Muthén, B. (2009). Exploratory structural equation modeling. *Struct. Eq. Model*. 16, 397-438. doi: 10.1080/10705510903008204

* Basson, M. J., and Rothmann, S. (2019). Pathways to flourishing among pharmacy students: the role of study demands and lecturer support. *J. Psychol. Afr.* 29, 338-345. doi: 10.1080/14330237.2019.1647953

* Bergin, A., and Pakenham, K. (2015). Law student stress: relationships between academic demands, social isolation, career pressure, study/life imbalance and adjustment outcomes in law students. *Psychiatry Psychol. Law* 22, 388-406. doi: 10.1080/13218719.2014.960026

* Bhatnagar, V. R. (2020). Conceptualizing employee strengths at work and scale development. *Manag. Res. Rev.* 43, 1273-1288. doi: 10.1108/MRR-08-2019-0367

* Blanco, C., Okuda, M., Wright, C., Hasin, D. S., Grant, B. F., Liu, S. M., et al. (2008). Mental health of college students and their non-college-attending peers: results from the national epidemiologic study on alcohol and related

conditions. *Arch. Gen. Psychiatry* 65, 1429-1437. doi: 10.1001/archpsyc.65.12.1429

* Bu, H., and Duan, W. (2020). Strength-based flourishing intervention to promote resilience in individuals with physical disabilities in disadvantaged communities: a randomized controlled trial. *Res. Soc. Work Pract.* 31, 53-64. doi: 10.1177/1049731520959445

* Cadime, I., Lima, S., Pinto, A. M., and Ribeiro, I. (2016). Measurement invariance of the Utrecht work engagement scale for students: a study across secondary school pupils and university students. *Eur. J. Dev. Psychol.* 13, 254-264. doi: 10.1080/17405629.2016.1148595

* Campbell-Sills, L., and Stein, M. B. (2007). Psychometric analysis and refinement of the connor-davidson resilience scale (CD-RISC): validation of a 10-item measure of resilience. *J. Trauma. Stress* 20, 1019-1028. doi: 10.1002/jts.20271

* Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. *Struct. Eq. Model.* 14, 464-504. doi: 10.1080/10705510701301834

* Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. *Struct. Eq. Model.* 9, 233-255. doi: 10.1207/S15328007SEM0902_5
Duan, W., Li, J., and Mu, W. (2018). Psychometric characteristics of strengths knowledge scale and strengths use scale among adolescents. *J. Psychoeduc. Assess.* 36, 756–760. doi: 10.1177/0734282917705593

Dubreuil, P., Forest, J., and Courcy, F. (2014). From strengths use to work performance: the role of harmonious passion, subjective vitality, and concentration. *J. Posit. Psychol.* 9, 335–349. doi: 10.1080/17439760.2014.898318

Dubreuil, P., Forest, J., Gillet, N., Fernet, C., Thibault-Landry, A., Crevier-Braud, L., et al. (2016). Facilitating wellbeing and performance through the development of strengths at work: results from an intervention program. *Int. J. Appl. Posit. Psychol.* 1, 1–19. doi: 10.1007/s41042-016-0001-8

Duncan, T. E., Duncan, S. C., and Strycker, L. A. (2013). *An Introduction to Latent Variable Growth Curve Modeling: Concepts, Issues, and Application*. New York, NY: Routledge Academic. doi: 10.4324/9780203879962

Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., et al. (2018). Internet-and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health. *Eur. Psychol.* 23, 167–187. doi: 10.1027/1016-9040/a000318

Feldt, T., Leskinen, E., Kinnunen, U., and Mauno, S. (2000). Longitudinal factor analysis models in the assessment of the stability of sense of coherence. *Pers. Individ. Dif.* 28, 239–257. doi: 10.1016/S0191-8869(99)00094-X

Forest, J., Mageau, G. A., Crevier-Braud, L., Bergeron, É., Dubreuil, P., and Lavigne, G. L. (2012). Harmonious passion as an explanation of the relation between signature strengths' use and wellbeing at work: test of an intervention program. *Hum. Relat.* 65, 1233–1252. doi: 10.1177/0018726711433134

Fredrickson, B. L. (2001). The role of positive emotions in positive psychology: the broaden-and-build theory of positive emotions. *Am. Psychol.* 56:218. doi: 10.1037/0003-066X.56.3.218

Govindji, R., and Linley, P. A. (2007). Strengths use, self-concordance and wellbeing: implications for strengths coaching and coaching psychologists. *Int. Coach. Psychol. Rev.* 2, 143–153. doi: 10.1037/t54221-000

Hayes, A. F., and Coutts, J. J. (2020). Use omega rather than Cronbach's alpha for estimating reliability. *But... Commun. Methods Measures* 14, 1–24. doi: 10.1080/19312458.2020.1718629

Houghton, S., Lawrence, D., Hunter, S. C., Rosenberg, M., Zadow, C., Wood, L., et al. (2018). Reciprocal relationships between trajectories of depressive symptoms and screen media use during adolescence. *J. Youth Adolesc.* 47, 2453–2467. doi: 10.1007/s10964-018-0901-y

Hu, L., and Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. *Struct. Eq. Model.* 6, 1–55. doi: 10.1080/10705519909540118

Huber, A., Webb, D., and Höfer, S. (2017). The German version of the strengths use scale: the relation of using individual strengths and wellbeing. *Front. Psychol.* 8:637. doi: 10.3389/fpsyg.2017.00637

IBM SPSS (2019). *IBM SPSS Software Version 26*. IBM Press. doi: 10.4135/9781483385655.n2

Joseph, S., and Linley, P. A. (2005). Positive adjustment to threatening events: An organismic valuing theory of growth through adversity. *Rev. Gen. Psychol.* 9, 262–280. doi: 10.1037/1089-2680.9.3.262

Kaiser, H. F., and Rice, J. (1974). Little jiffy, mark IV. *Educ. Psychol. Meas.* 34, 111–117. doi: 10.1177/00131644740340015

Kienfie Liau, A., Chow, D., Tan, T. K., and Senf, K. (2011). Development and validation of the personal strengths inventory using exploratory and confirmatory factor analyses. *J. Psychoeduc. Assess.* 29, 14–26. doi: 10.1177/0734282910365648

Kim, H. Y. (2013). Statistical notes for clinical researchers: assessing normal distribution (2) using skewness and kurtosis. *Restor. Dentist. Endod.* 38, 52–54. doi: 10.5395/rde.2013.38.1.52

Kline, R. B. (2011). *Principles and Practices of Structural Equation Modelling*. 3rd Edn. New York, NY: Gilford Press.

Kwok, S. Y., and Fang, S. (2020). A cross-lagged panel study examining the reciprocal relationships between positive emotions, meaning, strengths use and study engagement in primary school students. *J. Happiness Stud.* 22, 1033–1053. doi: 10.1007/s10902-020-00262-4

Lesener, T., Pleiss, L. S., Gusy, B., and Wolter, C. (2020). The study demands-resources framework: an empirical introduction. *Int. J. Environ. Res. Public Health* 17:5183. doi: 10.3390/ijerph17145183

Linley, A., Willars, J., and Biswas-Diener, R. (2010). *The Strengths Book: Be Confident, be Successful, and Enjoy Better Relationships by Realizing the Best of You*. Coventry: CAPP.

Linley, P. A., and Harrington, S. (2006). Strengths coaching: a potential-guided approach to coaching psychology. *Int. Coach. Psychol. Rev.* 1, 37–46.

Littman-Ovadia, H., Lavy, S., and Boiman-Meshita, M. (2017). When theory and research collide: examining correlates of signature strengths use at work. *J. Happiness Stud.* 18, 527–548. doi: 10.1007/s10902-016-9739-8

Mahomed, F. E. (2019). *Thriving of academics in higher education institutions: a strengths-based approach* (Doctoral dissertation). Vanderbijlpark: North-West University.

Mahomed, F. E., and Rothmann, S. (2020). Strength use, training and development, thriving, and intention to leave: the mediating effects of psychological need satisfaction. *South Afr. J. Psychol.* 50, 24–38. doi: 10.1177/00812463198 49030

Matsuguma, S., and Niemiec, R. M. (2020). Hikikomori from the perspective of overuse, underage, and optimal use of character strengths. *Int. J. Appl. Posit. Psychol.* 1, 1–13. doi: 10.1007/s41042-020-00047-3

McGrath, R. E. (2015). Character strengths in 75 nations: an update. *J. Posit. Psychol.* 10, 41–52. doi: 10.1080/17439760.2014.888580

McNeish, D., An, J., and Hancock, G. R. (2018). The thorny relation between measurement quality and fit index cut-offs in latent variable models. *J. Pers. Assess.* 100, 43–52. doi: 10.1080/00223891.2017.1281286

McNeish, D., and Hancock, G. R. (2018). The effect of measurement quality on targeted structural model fit indices: a comment on Lance, Beck, Fan, and Carter 2016. *Psychol. Methods* 23, 184–190. doi: 10.1037/met0000157

McTiernan, K., Gullon-Scott, F., and Dudley, R. (2020). An exploration of strength use and its relationship with life satisfaction, positive self-beliefs and paranoid ideation. *Int. J. Wellbeing* 10, 53–70. doi: 10.5502/ijw.v10i2.883

Meade, A. W., and Kroustalis, C. M. (2006). Problems with item parceling for confirmatory factor analytic tests of measurement invariance. *Organ. Res. Methods* 9, 369–403. doi: 10.1177/1094428105283384

Miglianico, M., Dubreuil, P., Miquelon, P., Bakker, A. B., and Martin-Krumm, C. (2020). Strength use in the workplace: a literature review. *J. Happiness Stud.* 21, 737–764. doi: 10.1007/s10902-019-00095-w

Muñiz, J., Elosua, P., and Hambleton, R. K. (2013). International test commission guidelines for test translation and adaption: second edition. *Psicothema* 25, 151–157. doi: 10.7334/psicothema2013.24

Muthén, L. K., and Muthén, B. O. (2020). *Mplus (Version 8.4).* [Statistical software]. Los Angeles, CA: Muthén and Muthén.

Nunnally, J. C., and Bernstein, I. H. (1994). *Psychometric Theory, 3rd Edn*. New York, NY: McGraw-Hill.

Ouweeneel, E., Le Blanc, P. M., and Schaufeli, W. B. (2011). Flourishing students: a longitudinal study on positive emotions, personal resources, and study engagement. *J. Posit. Psychol.* 6, 142–153. doi: 10.1080/17439760.2011.558847

Peterson, C., Park, N., and Seligman, M. E. (2006). Greater strengths of character and recovery from illness. *J. Posit. Psychol.* 1, 17–26. doi: 10.1080/17439760500372739

Peterson, C., and Seligman, M. E. P. (2004). *Character Strengths and Virtues: A Handbook and Classification*. New York, NY: Oxford University Press.

Price, L. (2017). *Psychometric Methods. Theory into Practice*. New York, NY: Guilford Press.

Proyer, R. T., Gander, F., Wellenzohn, S., and Ruch, W. (2015a). Strengths-based positive psychology interventions: a randomized placebo-controlled online trial on long-term effects for a signature strengths- vs. a lesser strengths-intervention. *Front. Psychol.* 6:456. doi: 10.3389/fpsyg.2015.00456

Proyer, R. T., Wellenzohn, S., Gander, F., and Ruch, W. (2015b). Toward a better understanding of what makes positive psychology interventions work: predicting happiness and depression from the person × intervention fit in a follow-up after 3.5 years. *Appl. Psychol. Health Wellbeing* 7, 108–128. doi: 10.1111/aphw.12039

Quinlan, D., Swain, N., and Vella-Brodrick, D. A. (2012). Character strengths interventions: building on what we know for improved outcomes. *J. Happiness Stud.* 13, 1145–1163. doi: 10.1007/s10902-011-9311-5

Rashid, T., Louden, R., Wright, L., Chu, R., Maharaj, A., Hakim, I., et al. (2017). "Flourish: a strengths-based approach to building student resilience," in *Positive Psychology Interventions in Practice*, ed C. Proctor (Cham: Springer), 29–45. doi: 10.1007/978-3-319-51787-2_3
Rath, T. (2007). *StrengthsFinder 2.0*. New York, NY: Simon and Schuster.

Raykov, T. (2009). Evaluation of scale reliability for unidimensional measures using latent variable modeling. *Meas. Eval. Counsel. Dev.* 42, 223-232. doi: 10.1177/0748175609344096

Richter, S., Van Zyl, L.E., Roll, L.C, and Stander, M. W. (2020). Positive psychological coaching tools: a systematic literature review. *Front. Psychol.* 11:793. doi: 10.3389/fpsyg.2020.00793

Roll, L. C., Van Zyl, L. E., and Griep, Y. (2019). "Brief positive psychological interventions within multi-cultural organizational contexts: a systematic literature review," in *Theoretical Approaches to Multi-Cultural Positive Psychological Interventions*, eds L. E. van Zyl, and S. Rothmann (Cham: Springer), 523-544. doi: 10.1007/978-3-030-20583-6_24

Ruch, W., Weber, M., and Park, N. (2014). Character strengths in children and adolescents. *Eur. J. Psychol. Assess.* 30, 57-64. doi: 10.1027/1015-5759/a000169

Schaufeli, W. B., Bakker, A. B., and Salanova, M. (2006). The measurement of work engagement with a short questionnaire: a cross-national study. *Educ. Psychol. Meas.* 66, 701-716. doi: 10.1177/0013164405282471

Schaufeli, W. B., Salanova, M., González-Romá, V., and Bakker, A. B. (2002). The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. *J. Happiness Stud.* 3, 71-92. doi: 10.1023/A:1015630930326

Schutte, N. S., and Malouff, J. M. (2018). Mindfulness and connectedness to nature: a meta-analytic investigation. *Pers. Individ. Dif.* 127, 10-14. doi: 10.1016/j.paid.2018.01.034

Seligman, M. E. (2012). *Flourish: A Visionary New Understanding of Happiness and Wellbeing*. New York, NY: Simon and Schuster.

Seligman, M. E., and Csikszentmihalyi, M. (2014). "Positive psychology: an introduction," in *Flow and the Foundations of Positive Psychology*, eds M. Csikszentmihalyi (Dordrecht: Springer), 279-298. doi: 10.1007/978-94-017-9088-8_18

Seligman, M. E. P., Steen, T. A., Park, N., and Peterson, C. (2005). Positive psychology progress: empirical validation of interventions. *Am. Psychol.* 60, 410-421. doi: 10.1037/0003-066X.60.5.410

Shi, D., Lee, T., and Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. *Educ. Psychol. Meas.* 79, 310-334. doi: 10.1177/0013164418783503

Snow, N. E. (2019). Positive psychology, the classification of character strengths and virtues, and issues of measurement. *J. Posit. Psychol.* 14, 20-31. doi: 10.1080/17439760.2018.1528376

Stander, F. W., Diedericks, E., Mostert, K., and De Beer, L. T. (2015). Proactive behaviour towards strength use and deficit improvement, hope and efficacy as predictors of life satisfaction amongst first-year university students. *S.A. J. Indus. Psychol.* 41, 1-10. doi: 10.4102/sajip.v4i1.1248

Van Woerkom, M., Mostert, K., Els, C., Bakker, A. B., De Beer, L. T., and Rothmann, S. (2016a). Strengths use and deficit correction in organizations: development and validation of a questionnaire. *Eur. J. Work Organ. Psychol.* 25, 1-16. doi: 10.1080/1359432X.2016.1193010

Van Woerkom, M., Oerlemans, W., and Bakker, A. B. (2016b). Strengths use and work engagement: a weekly diary study. *Eur. J. Work Organ. Psychol.* 25, 384-397. doi: 10.1080/1359432X.2015.1089862

Van Zyl, L. E. (2014). *Research Methodology for the Economic and Management Sciences*. London: Pearson.

Van Zyl, L. E., Efendic, E., Rothmann, S., and Shankland, R. (2019). "Best-practice guidelines for positive psychological intervention research design," in *Positive Psychological Intervention Design and Protocols for Multi-Cultural Contexts*, eds L. E. van Zyl, and S. Rothmann Sr. (Cham: Springer), 1-32. doi: 10.1007/978-3-030-20020-6_1

Van Zyl, L. E., and Rothmann, S. (2019). *Positive Psychological Intervention Design and Protocols for Multi-Cultural Contexts*. Cham: Springer International Publishing. doi: 10.1007/978-3-030-20020-6

Von Eye, A. (Ed.). (1990). *Statistical Methods in Longitudinal Research: Principles and Structuring Change (Vol. 1)*. New York, NY: Elsevier Press.

Vuorinen, K., Hietajärvi, L., and Uusitalo, L. (2020). Students' usage of strengths and general happiness are connected via school-related factors. *Scand. J. Educ. Res.* 1-13. doi: 10.1080/00313831.2020.1755361

White, C. A. (2016). *Meta-analyses of positive psychology interventions on wellbeing and depression: reanalyses and replication* (Doctoral dissertation). Kelowna, BC: University of British Columbia.

White, C. A., Uttl, B., and Holder, M. D. (2019). Meta-analyses of positive psychology interventions: the effects are much smaller than previously reported. *PLoS ONE* 14:e0216588. doi: 10.1371/journal.pone.0216588

Wickrama, K. K., Lee, T. K., O'Neal, C. W., and Lorenz, F. O. (2016). *Higher-Order Growth Curves and Mixture Modeling With Mplus: A Practical Guide*. London. Routledge Publications. doi: 10.4324/9781315642741

Widaman, K. F., Ferrer, E., and Conger, R. D. (2010). Factorial invariance within longitudinal structural equation models: measuring the same construct across time. *Child Dev. Persp.* 4, 10-18. doi: 10.1111/j.1750-8606.2009.00110.x

Wong, C., and Law, K. S. (2002). Wong and law emotional intelligence scale. *Psychtests*. doi: 10.1037/t07398-000

Wong, J., and Wong, X. (2020). *Structural Equation Modelling: Applications Using Mplus (2nd Edn.).* Chichester: Wiley and Sons.

Wood, A. M., Linley, P. A., Maltby, J., Kashdan, T. B., and Hurling, R. (2011). Using personal and psychological strengths leads to increases in wellbeing over time: a longitudinal study and the development of the strengths use questionnaire. *Pers. Ind. Diff.* 50, 15-19. doi: 10.1016/j.paid.2010.08.004

Zijlmans, E. A., Tijmstra, J., van der Ark, L. A., and Sijtsma, K. (2019). Item-score reliability as a selection tool in test construction. *Front. Psychol.* 9:2298. doi: 10.3389/fpsyg.2018.02298

**Conflict of Interest:** The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Copyright © 2021 van Zyl, Arijs, Cole, Glińska-Newes, Roll, Rothmann, Shankland, Stavros and Verger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.