# Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages

Olatz Lopez-Fernandez, Daria Kuss, Halley Pontes, Mark Griffiths, Christopher Dawes, Lucy Justice, Niko Männikkö, Maria Kääriäinen, Hans-Jürgen Rumpf, Anja Bischof, et al.

<figure><img src="image_1.png" /></figure>

## To cite this version:

Olatz Lopez-Fernandez, Daria Kuss, Halley Pontes, Mark Griffiths, Christopher Dawes, et al. Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages. International Journal of Environmental Research and Public Health, 2018, 15 (6), pp.1213. 10.3390/ijerph15061213. [https://doi.org/10.3390/ijerph15061213](https://doi.org/10.3390/ijerph15061213).

HAL Id: hal-04139712

https://hal.science/hal-04139712

Submitted on 8 Sep 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
# Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages

Olatz Lopez-Fernandez, Daria Kuss, Halley Pontes, Mark Griffiths, Christopher Dawes, Lucy Justice, Niko Männikkö, Maria Kääriäinen, Hans-Jürgen Rumpf, Anja Bischof, et al.

<figure><img src="image_3.png" /></figure>

## To cite this version:

Olatz Lopez-Fernandez, Daria Kuss, Halley Pontes, Mark Griffiths, Christopher Dawes, et al. Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages. International Journal of Environmental Research and Public Health, 2018, 15 (6), pp.1213. 10.3390/ijerph15061213. [https://hal.science/hal-03869875](https://hal.science/hal-03869875)

HAL Id: hal-03869875

https://hal.science/hal-03869875

Submitted on 5 Jun 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_4.png" /></figure>
<figure><img src="image_5.png" /></figure>

Article

# Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages

Olatz Lopez-Fernandez ¹,²,* ID, Daria J. Kuss ¹ ID, Halley M. Pontes ¹, Mark D. Griffiths ¹ ID,
Christopher Dawes ¹ ID, Lucy V. Justice ¹ ID, Niko Männikkö ³, Maria Kääriäinen ⁴,
Hans-Jürgen Rumpf ⁵, Anja Bischof ⁵, Ann-Kathrin Gässler ⁵, Lucia Romo ⁶, Laurence Kern ⁷,
Yannick Morvan ⁶, Amélie Rousseau ⁸, Pierluigi Graziani ⁹,¹⁰, Zsolt Demetrovics ¹¹,
Orsolya Király ¹¹ ID, Adriano Schimmenti ¹² ID, Alessia Passanisi ¹², Bernadeta Lelonek-Kuleta ¹³,
Joanna Chwaszcz ¹⁴, Mariano Chóliz ¹⁵, Juan José Zacarés ¹⁶, Emilia Serra ¹⁶, Magali Dufour ¹⁷,
Lucien Rochat ¹⁸, Daniele Zullino ¹⁹,²⁰, Sophia Achab ¹⁹,²⁰, Nils Inge Landrø ²¹, Eva Suryani ²² ID,
Julia M. Hormes ²³, Javier Ponce Terashima ²⁴ and Joël Billieux ²,²⁰,²⁵ ID

¹ International Gaming Research Unit, Psychology Department, Nottingham Trent University, Nottingham NG1 4FQ, UK; daria.kuss@ntu.ac.uk (D.J.K.); halleypontes@gmail.com (H.M.P.); mark.griffiths@ntu.ac.uk (M.D.G.); lpxcad@nottingham.ac.uk (C.D.); lucy.justice@ntu.ac.uk (L.V.J.)

² Laboratory for Experimental Psychopathology, Psychological Sciences Research Institute, Université Catholique de Louvain, 1348 Louvain-la-Neuve, Belgium; joel.billieux@uni.lu

³ Department of Social Services and Rehabilitation, Oulu University of Applied Sciences, 90220 Oulu, Finland; niko.mannikko@oamk.fi

⁴ Research Unit of Nursing Science and Health Management, University of Oulu and Oulu University Hospital, 90014 Oulu, Finland; maria.kaariainen@oulu.fi

⁵ Department for Psychiatry and Psychotherapy, University of Lübeck, 23538 Lübeck, Germany; Hans-Juergen.Rumpf@uksh.de (H.-J.R.); Anja.Bischof@uksh.de (A.B.); akgaessler@outlook.de (A.-K.G.)

⁶ EA 4430 Clinique Psychanalyse Développement (CLIPSYD), Université Paris Nanterre, France; U894 Centre de Psychiatrie et Neurosciences, (CPN), Inserm, 92000 Paris, France; romodesprez@gmail.com (L.R.); ymorvan@parisnanterre.fr (Y.M.)

⁷ EA 2931, Centre de Recherches sur le Sport et le Mouvement (CESRM), Université Paris Nanterre, 92000 Nanterre, France; laurence.kern@gmail.com

⁸ Psychology Department, PSITEC EA 4074, Université Lille Nord de France, 59650 Villeneuve d'Ascq, France; amelie.rousseau@univ-lille3.fr

⁹ LPS EA 849, Aix-Marseille University, 13007 Marseille, France; pierluigi.graziani@free.fr

¹⁰ Psychologie, Langues, Lettres et Histoire Département, University of Nîmes, 30000 Nîmes, France; pierluigi.graziani@free.fr

¹¹ Institute of Psychology, ELTE Eötvös Loránd University, 1064 Budapest, Hungary; demetrovics@t-online.hu (Z.D.); orsolya.papay@gmail.com or kiraly.orsolya@ppk.elte.hu (O.K.)

¹² Faculty of Human and Social Sciences, UKE—Kore University of Enna, Cittadella Universitaria, 94100 Enna, Italy; adriano.schimmenti@unikore.it (A.S.); alessia.passanisi@unikore.it (A.P.)

¹³ Department of Family Science and Social Work, Katolicki Uniwersytet Lubelski Jana Pawła II, 20-950 Lublin, Poland; bernadetalelonek@kul.lublin.pl

¹⁴ Department of Psychology, Katolicki Uniwersytet Lubelski Jana Pawła II, 20-950 Lublin, Poland; chwaszcz@kul.pl

¹⁵ Department of Basic Psychology, University of Valencia, 46010 Valencia, Spain; Mariano.Choliz@uv.es

¹⁶ Department of Developmental and Educational Psychology, University of Valencia, 46010 Valencia, Spain; Juan.J.Zacares@uv.es (J.J.Z.); Emilia.Serra@uv.es (E.S.)

¹⁷ Service de Toxicomanie, Faculte de medicine Université de Sherbrooke, Longueuil, Qc, J4K 0A8, Canada; magali.dufour@usherbrooke.ca

¹⁸ Department of Psychology and Educational Sciences, University of Geneva, 1205 Geneva, Switzerland; Lucien.Rochat@unige.ch

¹⁹ Department of Psychiatry—Research Unit Addictive Disorders, University of Geneva, 1205 Geneva, Switzerland; Daniele.Zullino@hcuge.ch (D.Z.); Sophia.Achab@hcuge.ch (S.A.)
Received: 14 May 2018; Accepted: 5 June 2018; Published: 8 June 2018

<figure><img src="image_6.png" /></figure>

check for
updates

**Abstract:** The prevalence of mobile phone use across the world has increased greatly over the past two decades. Problematic Mobile Phone Use (PMPU) has been studied in relation to public health and comprises various behaviours, including dangerous, prohibited, and dependent use. These types of problematic mobile phone behaviours are typically assessed with the short version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV). However, to date, no study has ever examined the degree to which the PMPU scale assesses the same construct across different languages. The aims of the present study were to (i) determine an optimal factor structure for the PMPUQ-SV among university populations using eight versions of the scale (i.e., French, German, Hungarian, English, Finnish, Italian, Polish, and Spanish); and (ii) simultaneously examine the measurement invariance (MI) of the PMPUQ-SV across all languages. The whole study sample comprised 3038 participants. Descriptive statistics, correlations, and Cronbach's alpha coefficients were extracted from the demographic and PMPUQ-SV items. Individual and multigroup confirmatory factor analyses alongside MI analyses were conducted. Results showed a similar pattern of PMPU across the translated scales. A three-factor model of the PMPUQ-SV fitted the data well and presented with good psychometric properties. Six languages were validated independently, and five were compared via measurement invariance for future cross-cultural comparisons. The present paper contributes to the assessment of problematic mobile phone use because it is the first study to provide a cross-cultural psychometric analysis of the PMPUQ-SV.

**Keywords:** mobile phone use; smartphone use; Problematic Mobile Phone Use; Problematic Mobile Phone Use Questionnaire; psychometric testing; measurement invariance

# 1. Introduction

Mobile phones have become a ubiquitous technology and their use is widespread internationally. However, there appear to be differences in terms of technology use across various geographical regions according to the International Telecommunication Union (ITU). Recently, ITU Facts and Figures 2017 [1] demonstrated that mobile phone use has experienced the largest growth compared with other technologies over the last two decades. More specifically, worldwide mobile phone subscriptions per 100 inhabitants were 15.5 in 2001, 76.6 in 2010, and 103.5 in 2017. At the same time, subscriptions for landline telephones were 16.6 in 2001, 17.8 in 2010, and 13 in 2017. According to a study by ProQuest [2], the number of scientific papers and reports published on this topic has grown markedly. The study examined 26 scientific databases simultaneously (e.g., PsycINFO) using the search terms "mobile phone" or "cell* phone" and "smartphone". It was reported that 490 academic outputs were

<footnote n="20">20 Department of Mental Health and Psychiatry—Addiction Division, University Hospitals of Geneva, 1205 Geneva, Switzerland</footnote>

<footnote n="21">21 Clinical Neuroscience Research Group, Department of Psychology, University of Oslo, 0317 Oslo, Norway; n.i.landro@psykologi.uio.no</footnote>

<footnote n="22">22 Department Psychiatry and Behavior, School of Medicine and Health Science, Atma Jaya Catholic University of Indonesia, Jakarta 14440, Indonesia; eva.suryani@atmajaya.ac.id or amyeva511@gmail.com</footnote>

<footnote n="23">23 Department of Psychology, University at Albany State University of New York, Albany, NY, USA; jhormes@albany.edu</footnote>

<footnote n="24">24 University Hospitals Cleveland Medical Center/Case Western Reserve University, Cleveland, OH 44106, USA; javier@incaas.org</footnote>

<footnote n="25">25 Addictive and Compulsive Behaviours Lab (ACB-lab), Institute for Health and Behaviour, University of Luxembourg, 4366 Esch-sur-Alzette, Luxembourg</footnote>

<footnote>* Correspondence: olatz.lopez-fernandez@ntu.ac.uk or lopez.olatz@gmail.com; Tel.: +44-(0)-115-848-2977</footnote>
published in 2001, 3225 in 2010, and 8224 in 2017 (these results referred to scholarly peer-reviewed journal articles, as well as trade journals, magazines, conference proceedings, and other reports).

Negative aspects related to mobile phone use are often conceptualised within the umbrella term of Problematic Mobile Phone Use (PMPU; [3,4]). According to Billieux and colleagues [4–7], PMPU can be understood as a heterogeneous and multidimensional construct involving the potential negative effects of mobile phone use. Accordingly, these authors formulated an integrative pathway model to account for the various types of problematic mobile phone use (i.e., dangerous, prohibited/antisocial, and dependent). Based on this model, each pathway to mobile phone overuse (i.e., extraversion pathway, reassurance-seeking pathway, impulsive pathway) is underlain by specific psychosocial factors and individual differences. Although maladaptive mobile phone use was initially considered a public health issue in child and adolescent populations [8–11], over the past decade, mobile phone use has been considered to involve potential risks for all populations across the different dimensions of problematic use, namely dangerous, prohibited, or dependent use [4].

Regarding general health issues traditionally associated with mobile phone use, several studies have shown significant associations between mobile phone use and users' lifestyles and wellbeing. For example, Ezoe and colleagues [11] found that PMPU among Japanese female college students was associated with poor sleep, low physical activity, decreased work performance, and skipping breakfast. Similarly, Gallimberti and colleagues [12] observed that reading books, higher school marks, and longer hours of sleep were associated with low PMPU in Italian adolescents. Conversely, and in line with previous studies, other authors have reported PMPU to be positively associated with stress, depression, sleep disturbances, extraversion, female gender, young age, and poor academic or professional competence or performance [13–22]. Furthermore, Yang and colleagues [13] investigated the health and psychological problems associated with mobile phone use in adolescent Southern Taiwanese students and found that PMPU was associated with aggression, insomnia, smoking, suicidal tendencies, and low self-esteem.

For instance, two studies analysing young Swedish adults' perceptions of the need of being available at all times via their mobile phones [14,15] reported that mobile phone use was positively associated with stress, depression, and sleep disorders. Similarly, a recent systematic review carried out by Elhai and colleagues [16] found that PMPU was usually related to depression, anxiety, chronic stress, and low self-esteem. However, only depression and anxiety were consistently related to this problematic use, with medium and small effect sizes, respectively. In another paper, the same authors even stated that while depression was inversely associated with social PMPU (e.g., social networking, messaging), anxiety was positively related to problematic use as a process or being consumption-based (e.g., news consumption, entertainment, relaxation) [17].

Associated behaviours, such as dependency and/or compulsiveness, have also been reported when individuals check their phone display, and even when not interacting with their mobile phone directly. This is because auditory and/or tactile notifications prompt thoughts that affect attention, and which negatively impact on performance [18] (a phenomenon coined as 'technoference'; such use of mobile phones results in conflicts in interpersonal relationships and decreased wellbeing [19]). In addition to this, physical reactions, such as headaches and heat sensations, have been reported. In the same vein, Bickham and colleagues [20] found associations between PMPU and depression in North American adolescents. In sum, the existing evidence on smartphone use suggests a clear association between PMPU and decreased wellbeing, especially in young populations worldwide.

In relation to dangerous mobile phone use, PMPU has initially been negatively associated with safety behaviours [1,2], such as using mobile phones when driving, cycling, or walking. The importance of this factor is supported by the development of specific policies and regulations related to mobile phone use (i.e., to prevent road accidents). A study conducted in China [21] assessed unintentional injuries (i.e., road traffic injuries, pedestrian collisions, and falls) due to mobile phone use and psychopathological symptoms in adolescence. The most prevalent injury was collisions (followed by falls and other injuries), where adolescents experienced PMPU, as well as negative
emotional, behavioural, and social adaptation symptoms. Another study from the United States (US) [22] reviewed the associations between motor vehicle crashes and PMPU in adolescents because drivers between 16 and 19 years in the US are the most likely to die as a consequence of distractions caused by mobile phones. The review evidenced that half of all adolescents texted on their mobile phone while driving.

Prohibition of mobile phone use (or its regulation) is another specific aspect of PMPU, and is usually associated with legal or public regulations. However, some individuals do not abstain from using phones in such circumstances (i.e., public spaces, such as libraries, cinemas, or theatres). According to Takao and colleagues [23], personality traits may be associated with these types of behaviours, such as self-monitoring (i.e., traits related to the tendency to control and regulate the public self) and approval motivations (i.e., the need for favourable evaluations from others). Both are associated with an extraverted personality, as indicated by previous research [14] because individuals with the extraversion trait are sensitive to social cues and peer pressure, which involves being prone to risk behaviours when using mobile phones constantly, even when their use is banned. This aspect of problematic mobile phone use can also be related to the fact that individuals use mobile phones in a way that interferes with social situations. A prototypical example is the act of snubbing someone in a social setting by using one's mobile phone instead of interacting, a phenomenon referred to as "phubbing" [24,25].

The most studied type of negative outcome associated with mobile phone use is dependence, also conceptualised as a genuine addictive behaviour by some researchers [9,26]. The introduction of the internet and instant messaging (IM) on mobile phones (i.e., smartphones) has been associated with mobile phone dependence [21]. Moreover, it has also been associated with sociability levels of mobile phone users [27–29] and peer pressure [28]. However, studies examining peer pressure have reported slightly contradictory findings [29], where PMPU has not necessarily been associated with peer support or social acceptance. Therefore, it appears there is a potential association between mobile phone dependence (especially texting) and levels of sociability in adolescent and young adult populations [27,28,30]. Other factors usually associated with this type of problematic use include emotional symptoms (e.g., stress, anxiety, and depression [31–33]), reward seeking [26], and heightened impulsivity [2,26]. Moreover, specific mobile phone use patterns have also been associated with dependent use, except for some entertainment uses, such as downloading or playing mobile games [26,34,35], or using the mobile phone for travel bookings, online payments, and online shopping [34].

In sum, on the one hand, a few authors have claimed that the negative nature of dependent mobile phone use is not always severe, such as Chung [36], who argued that levels of dependence in South Korean female adolescent mobile phone users (i.e., withdrawal, maladjustment, tolerance, obsession, and flashiness) are associated with high levels of interpersonal solidarity (i.e., shared sentiments, intimacy, and similarities). Similarly, other scholars [37] have alerted researchers concerning the risk of overpathologizing everyday life behaviours in the context of behavioural addictions research, such as PMPU. On the other hand, Chóliz [38] has claimed that mobile phone addiction is a clinically relevant condition. Therefore, further research is warranted to assess the underlying motivations behind dependent use.

In relation to the cross-cultural assessment of PMPU, only a few studies have been conducted [39,40]. A number of different scales have been used [5,22,41,42], and according to a literature review by Pedrero and colleagues [42], the 'gold standard' scale is the Mobile Phone Problem Use Scale (MPPUS [3]). Unfortunately, the MPPUS is a unidimensional scale, which is problematic given the hypothesized multi-dimensional nature of PMPU. Moreover, the structural validity of the MPPUS was only tested with exploratory factor analysis (EFA), and needs to be confirmed in further studies using confirmatory factor analysis (CFA) and measurement invariance (MI). Another contemporary instrument to assess PMPU is the Problematic Mobile Phone Use Questionnaire (PMPUQ; [4]), which allows the measurement of the multi-dimensional nature of PMPU and was validated through
the conjoint use of EFAs and CFAs. The scale assesses the three aforementioned specific types of PMPU. It was initially developed with a four-factor solution, but was recently reduced to a shorter version with three factors (dangerous use, prohibited use, and dependence) and updated to contemporary smartphone use (PMPUQ-SV; [33,35,43]). The fourth factor, related to the occurrence of financial problems, was removed due to the evolution of smartphones (i.e., smartphones being relatively cheap to use compared to when they were first introduced).

Subsequent studies—including some cross-cultural ones [33,35]—have evaluated the factor structure of the PMPUQ in its long or short versions via exploratory [35,43] and confirmatory [33,43,44] approaches in different populations (e.g., young adults [33,43], adults [35,43,44]), and different European languages, especially English [33,35,43,44]. However, psychometric results have been contradictory because some studies have reported adequate properties [33,35], while others have not [43,44]. Finally, to the best of the authors’ knowledge, no previous study has tested MI to establish the cross-validity of any of the PMPU scales (i.e., unidimensional or multidimensional) simultaneously across different languages using confirmatory approaches. This is a necessary step to move the field forward in order to establish cross-cultural MI of a scale to guarantee reliable and comparative findings across countries and languages.

The aim of the present study was to test the psychometric properties and measurement invariance of eight versions of the PMPUQ-SV. The languages selected were German, French, English, Finnish, Spanish, Italian, Polish, and Hungarian. A number of non-European countries using the same languages agreed to join the data collection in this first study. In addition to being able to perform future cross-cultural studies, there are a number of reasons for carrying out the present study to validate the PMPUQ-SV in several languages. Firstly, there is little empirical evidence regarding PMPU as a multidimensional construct, especially in adulthood. Secondly, PMPU has almost exclusively been investigated in relation to its addictive use rather than considering other potential problems (such as dangerous or prohibited use). Thirdly, the PMPUQ has been previously tested mostly using exploratory and confirmatory approaches, with no consistent results across different languages (e.g., English), but its MI across different languages remains to be investigated. Consequently, the present study investigated the multidimensional construct of PMPU across specific types of problematic mobile phone use described via the multi-group validation of the PMPUQ-SV across languages. Thus, the objectives were to (i) determine an optimal factor structure for the PMPUQ-SV among university populations using eight languages; and (ii) simultaneously examine the MI of the PMPUQ-SV across all languages in order to assess the linguistic comparability across the eight versions of the scale independently.

Therefore, the main purpose of the present study was to ascertain if the PMPUQ-SV is an
appropriate psychometric tool for cross-cultural research. To the best of the authors’ knowledge,
this is the first study to investigate the three-factor model in a multinational sample and the first to
conduct MI on a multidimensional model of the PMPU across multiple linguistic scale versions. Thus,
the present study will help fill an important gap in the field of PMPU and make a contribution to the
research area because it comprises robust cross-cultural research examining mobile phone use and its
associated problems.

**2. Materials and Methods**

2.1. *Participants and Procedure*

A total of 5209 respondents participated in the study, which builds upon the Tech Use Disorders (TUD; [45]) project. The items examined in the present study were part of a longer online survey including other questions (e.g., other scales concerning use of technology or personality traits). Participants were not forced to answer questions (because the survey was completely voluntarily). After cleaning the dataset (e.g., removing missing values), a sample of 3038 participants remained. The sample included adults engaged in higher education environments in 2015. The ethics committee
of the Psychological Science Research Institute of the Université Catholique de Louvain (Belgium) approved the study protocol in 2014. Participants provided informed consent and voluntarily participated following an assurance of confidentiality and anonymity. The invitation to participate in the online survey (hosted on Qualtrics) used two recruitment strategies: (i) the present authors inviting undergraduates to participate via their respective universities during their 2015 and 2016 lectures; and (ii) via electronic invitations in academic online environments (e.g., university emails, university research participant pools, university social networks, and university virtual learning environments). Missing data were treated with pairwise deletion to maximise the statistical power, and cases were considered to be missing at random (MAR). This left a total sample size of 3038 participants with some not included for several reasons (e.g., young participants were not yet drivers, etc.). The sample breakdown by each respective language is shown in Table 1, alongside key socio-demographic data and reliability estimations.

Consequently, a total of eight languages were included in the present study (see Table 1), which were provided by 14 countries participating in the present study via their respective academic environments: German (i.e., Germany: 12.61% of the sample), French (i.e., Belgium: 16.06%; France: 10.60%; Switzerland: 3.39%; Canada: 5.13%; others who filled in the French adaptation chose not to report their country: 0.23%), English (i.e., United Kingdom (UK): 1.81%, Norway: 1.71%; US: 0.13%; Indonesia: 0.20%), Finnish (i.e., Finland: 14.78%), Spanish (i.e., Spain: 5.13%), Italian (i.e., Italy: 9.48%), Polish (i.e., Poland: 8.49%), and Hungarian (Hungary: 10.24%).

## 2.2. Instrument

To assess potential PMPU, the 15-item PMPUQ-SV [33,35,43] was adapted from English into the other seven languages using a standard translation and back-translation method [46], except for French (as it was the original language [4]) (see Appendix A). Each subscale comprised five items, which were scored from 1 ('I strongly agree') to 4 ('I strongly disagree'), except for the items that were reverse scored [35] (see Table 1 for descriptive item scores). Overall scores ranged from 15 to 60, with higher scores indicating more potential problems due to mobile phone use. The Cronbach's alphas of the PMPUQ-SV across all languages ranged from 0.56 (English version; prohibited use) to 0.90 in the present study (German version: dependence; French version: dependence; English version: dangerous use).
<table><caption>**Table 1.** Demographic Information and item scores across all eight adaptations of the PMPUQ-SV.</caption><thead><tr><th></th><th>All</th><th>German</th><th>French</th><th>English</th><th>Finnish</th><th>Spanish</th><th>Italian</th><th>Polish</th><th>Hungarian</th></tr></thead><tbody><tr><td>N</td><td>3038</td><td>383</td><td>1076</td><td>117</td><td>449</td><td>156</td><td>288</td><td>258</td><td>311</td></tr><tr><td>Women (N (%))</td><td>2193 (72%)</td><td>262 (68%)</td><td>829 (77%)</td><td>89 (76%)</td><td>308 (69%)</td><td>123 (79%)</td><td>190 (66%)</td><td>187 (72%)</td><td>205 (66%)</td></tr><tr><td>Age in (Yrs; mean (SD))</td><td>26.505 (9.395)</td><td>25.204 (6.602)</td><td>25.22 (10.034)</td><td>27.735 (11.319)</td><td>28.296 (9.06)</td><td>28.045 (11.642)</td><td>28.576 (9.555)</td><td>25.279 (6.965)</td><td>27.833 (9.032)</td></tr><tr><td>PMPUQ Score (mean (SD))</td><td>27.156 (6.869)</td><td>26.976 (6.547)</td><td>27.005 (7.177)</td><td>28.145 (5.564)</td><td>26.938 (6.584)</td><td>28.5 (6.696)</td><td>29.59 (6.533)</td><td>28.961 (6.399)</td><td>23.539 (6.159)</td></tr><tr><td colspan="10"><strong>Cronbach's α</strong></td></tr><tr><td>Dangerous use</td><td>0.84</td><td>0.88</td><td>0.81</td><td>0.90</td><td>0.87</td><td>0.86</td><td>0.86</td><td>0.77</td><td>0.89</td></tr><tr><td>Prohibited use</td><td>0.69</td><td>0.65</td><td>0.74</td><td>0.56</td><td>0.62</td><td>0.66</td><td>0.68</td><td>0.66</td><td>0.75</td></tr><tr><td>Dependent use</td><td>0.88</td><td>0.90</td><td>0.90</td><td>0.83</td><td>0.85</td><td>0.85</td><td>0.84</td><td>0.82</td><td>0.89</td></tr><tr><td colspan="10"><strong>Item Scores (mean (SD))</strong></td></tr><tr><td>1. Easy not to use mobile</td><td>2.359 (1.034)</td><td>2.460 (0.991)</td><td>2.352 (1.095)</td><td>2.462 (0.915)</td><td>2.341 (1.030)</td><td>2.455 (0.905)</td><td>2.581 (0.921)</td><td>2.391 (1.009)</td><td>1.971 (0.991)</td></tr><tr><td>2. Use mobile when driving <sup>R</sup></td><td>1.569 (0.869)</td><td>1.525 (0.789)</td><td>1.402 (0.784)</td><td>1.393 (0.754)</td><td>1.933 (0.968)</td><td>1.549 (0.930)</td><td>1.874 (0.904)</td><td>1.721 (0.917)</td><td>1.354 (0.773)</td></tr><tr><td>3. Don't use when forbidden</td><td>1.737 (0.943)</td><td>1.593 (0.866)</td><td>1.830 (0.981)</td><td>1.632 (0.826)</td><td>1.506 (0.869)</td><td>1.821 (0.962)</td><td>1.839 (0.936)</td><td>2.128 (1.003)</td><td>1.508 (0.823)</td></tr><tr><td>4. Difficult not to use mobile <sup>R</sup></td><td>2.179 (0.965)</td><td>2.285 (0.892)</td><td>2.214 (1.039)</td><td>2.308 (0.825)</td><td>2.049 (0.941)</td><td>2.393 (0.884)</td><td>2.345 (0.889)</td><td>2.236 (0.926)</td><td>1.772 (0.867)</td></tr><tr><td>5. Avoid using on motorway</td><td>1.417 (0.866)</td><td>1.324 (0.752)</td><td>1.467 (0.931)</td><td>1.308 (0.760)</td><td>1.379 (0.755)</td><td>1.319 (0.825)</td><td>1.360 (0.751)</td><td>1.721 (1.123)</td><td>1.296 (0.755)</td></tr><tr><td>6. Using mobile in library</td><td>2.354 (1.037)</td><td>2.590 (0.988)</td><td>2.423 (1.086)</td><td>2.624 (0.953)</td><td>2.336 (0.998)</td><td>2.757 (0.918)</td><td>2.205 (0.986)</td><td>2.031 (0.994)</td><td>1.965 (0.927)</td></tr><tr><td>7. Easy to live without mobile</td><td>2.473 (0.995)</td><td>2.527 (0.900)</td><td>2.377 (1.052)</td><td>2.778 (0.862)</td><td>2.715 (0.993)</td><td>2.653 (0.855)</td><td>2.784 (0.854)</td><td>2.442 (0.937)</td><td>1.929 (0.902)</td></tr><tr><td>8. Dangerous situations <sup>R</sup></td><td>1.721 (0.965)</td><td>1.574 (0.782)</td><td>1.828 (1.102)</td><td>1.410 (0.697)</td><td>1.686 (0.846)</td><td>1.730 (0.996)</td><td>1.839 (0.929)</td><td>2.070 (1.011)</td><td>1.302 (0.636)</td></tr><tr><td>9. Use mobile when forbidden <sup>R</sup></td><td>1.581 (0.806)</td><td>1.655 (0.753)</td><td>1.440 (0.754)</td><td>1.701 (0.757)</td><td>1.579 (0.804)</td><td>1.822 (0.900)</td><td>1.909 (0.954)</td><td>1.694 (0.829)</td><td>1.431 (0.701)</td></tr><tr><td>10. Lost without mobile <sup>R</sup></td><td>2.205 (0.986)</td><td>2.016 (0.859)</td><td>2.213 (1.056)</td><td>2.607 (0.909)</td><td>2.245 (0.953)</td><td>2.160 (0.980)</td><td>2.345 (0.932)</td><td>2.395 (0.945)</td><td>1.939 (0.930)</td></tr><tr><td>11. Driving danger mobile <sup>R</sup></td><td>1.379 (0.762)</td><td>1.295 (0.600)</td><td>1.437 (0.886)</td><td>1.248 (0.642)</td><td>1.425 (0.738)</td><td>1.299 (0.638)</td><td>1.529 (0.827)</td><td>1.434 (0.715)</td><td>1.125 (0.448)</td></tr><tr><td>12. Public transport</td><td>1.462 (0.711)</td><td>1.496 (0.647)</td><td>1.369 (0.709)</td><td>1.530 (0.566)</td><td>1.410 (0.751)</td><td>1.542 (0.668)</td><td>1.586 (0.684)</td><td>1.659 (0.869)</td><td>1.476 (0.621)</td></tr><tr><td>13. Hard to turn off mobile <sup>R</sup></td><td>1.999 (0.980)</td><td>1.984 (0.880)</td><td>1.911 (1.023)</td><td>2.325 (0.936)</td><td>1.795 (0.920)</td><td>2.278 (0.978)</td><td>2.399 (0.948)</td><td>2.019 (0.906)</td><td>1.994 (0.987)</td></tr><tr><td>14. Driving concentration <sup>R</sup></td><td>1.247 (0.597)</td><td>1.188 (0.459)</td><td>1.171 (0.505)</td><td>1.231 (0.578)</td><td>1.332 (0.703)</td><td>1.306 (0.651)</td><td>1.482 (0.787)</td><td>1.415 (0.755)</td><td>1.087 (0.353)</td></tr><tr><td>15. Use mobile in silent place</td><td>1.496 (0.749)</td><td>1.457 (0.620)</td><td>1.578 (0.851)</td><td>1.590 (0.697)</td><td>1.287 (0.594)</td><td>1.558 (0.769)</td><td>1.538 (0.672)</td><td>1.605 (0.813)</td><td>1.373 (0.659)</td></tr></tbody></table>

Note: R = reverse coded; PMPUQ-SV: Problematic mobile phone use questionnaire short version.
## 2.3. Analysis

### 2.3.1. Understanding Measurement Invariance

To investigate whether the PMPUQ-SV is psychometrically valid for use across different languages, an analysis of MI was conducted using multigroup confirmatory factor analysis (MGCFA). MI establishes whether various aspects of the latent structure of a model remain stable across multiple groups, being run in an iterative manner with a set of increasingly constrained confirmatory factor analyses (CFAs). Comparison tests are then undertaken to determine if reliable differences exist between these models [47], which would suggest groups have reliable variations at those specific levels. The first step in this procedure was to conduct individual CFAs in each language group and investigate model fit. Following this, a set of constrained and planned models were implemented as follows. Constraints are given in square brackets and are cumulative throughout:

* A test of configural (or 'pattern', (groups)) invariance that investigates whether the same number of factors and their respective items are the same across groups (i.e., does the specified CFA structure replicate across the groups tested?). Support for configural invariance would suggest that the three-factor solution of the PMPUQ-SV and respective items per factor are valid across groups.

* A test of metric (or 'weak', (loadings)) invariance that estimates whether the factor loading strengths are equivalent across groups. Metric invariance suggests that participants understand and respond to items in the same way across groups.

* A test of scalar invariance (or strong invariance, (thresholds)) investigates if group differences in factor means are unbiased [48], meaning latent scores can be compared across groups.

* A test of strict invariance (residuals) estimates whether observed items have the same residuals, meaning that items have the same measurement error terms across groups.

* An additional fifth model of strict invariance and equally constrained (means) tests if the entire mean structure is invariant. If supported, this suggests that the means of both the latent variables and observed variables are invariant across groups.

### 2.3.2. Ordinal Data Analysis

Given that all PMPUQ-SV items are assessed on ordinal scales, models that could support non-continuous item analyses were employed [49]. Therefore, multigroup analyses were run using the R program with RStudio [50] using the Lavaan [51], Psych [52], and SemTools [53] packages, all of which have options for assessing ordinal data in a CFA framework (see [54] for a tutorial). Accordingly, thresholds rather than intercepts were constrained. In all CFA models, correlation matrices used were polychoric and model fit statistics were estimated using diagonally weighted least squares scale-shifted (DWLSSS). DWLSSS has been found to be a more effective estimation method for ordinal data than maximum likelihood [55,56], the default estimation for most statistical software.

## 3. Results

### 3.1. Factor Structures

As the PMPUQ-SV is a relatively new scale and its first aim was to assess its psychometric properties to ascertain potential reasons concerning previous contradictory results [33,35,43,44], cut-off points for all indices were taken prudently. Firstly, individual CFAs were performed for the overall sample and individually in each language. The correlation matrix and factor loadings of PMPUQ-SV items across all linguistic versions can be found in Tables 2 and 3, respectively. Cut-off values for fit indices were applied as follows (although caution must be taken as these cut-off values appear to result in lower Type II error rates (with acceptable costs of Type-I error rates [57–61])): a Comparative Fit Index (CFI) between 0.90 and 0.95 is indicative of acceptable fit relative to the independent model, and from 0.95 is considered a good fit; Tucker Lewis Index (TLI) values greater than 0.90 have been
used as acceptable fit models in the past, but since 2000, this has been increased to approximately 0.95 indicating good fit; Root Mean Square Error of Approximation (RMSEA) values less than or equal to 0.05 can be considered as good fit, values between 0.05 and 0.08 are acceptable, and greater than 0.08 could be considered a mediocre fit, but higher than 0.10 are considered a poor fit (ideally, if the RMSEA is greater than 0.05, the fit of the model is 'close' (i.e., such a model has a specification error, but this is not large; then sample size is a critical factor)); Standardised Root Mean Square Residual (SRMR) values must be less than 0.08 or close to 0.09 (or 0.10), as it is the most sensitive index to models with misspecified factor loadings, and a combination rule has been suggested (i.e., if the RMSEA is greater than 0.05 or close to 0.06, then the SRMR should be greater than 0.06, or close to 0.09–0.10, as it is usually acceptable for sample sizes that are equal to or less than 250 [59]). However, although reported here for the sake of transparency, χ² was not used to assess model fit, as it has been found to artificially inflate with an increasing sample size [62].

As can be seen in Table 4, the PMPUQ-SV in German, French, and English yielded good model fit statistics, whilst Hungarian and Finnish versions yielded adequate model fit statistics using less conservative cut-off scores. The Spanish version was almost acceptable, while the Italian and Polish versions had poor fit and were thus not carried forward for MI testing. Including the Italian and Polish versions would likely lead to the multigroup analysis immediately failing because the models already differ between the validated and non-validated languages in terms of factor numbers or structure. The English version was also removed because the highest response score for Item 12 (public transport) was not endorsed by any participants (with Lavaan requiring at least one response per level as a prerequisite).
<table><caption>**Table 2.** Correlation matrix of the 15 PMPUQ-SV items across all language adaptations.</caption><thead><tr><th></th><th colspan="15">Item Number</th></tr><tr><th></th><th>1</th><th>2</th><th>3</th><th>4</th><th>5</th><th>6</th><th>7</th><th>8</th><th>9</th><th>10</th><th>11</th><th>12</th><th>13</th><th>14</th><th>15</th></tr></thead><tbody><tr><th>1</th><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>2</th><td>0.19 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>3</th><td>0.25 ***</td><td>0.22 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>4</th><td>0.58 ***</td><td>0.19 ***</td><td>0.30 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>5</th><td>0.09 ***</td><td>0.51 ***</td><td>0.33 ***</td><td>0.05 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>6</th><td>0.36 ***</td><td>0.07 ***</td><td>0.33 ***</td><td>0.33 ***</td><td>0.14 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>7</th><td>0.78 ***</td><td>0.22 ***</td><td>0.28 ***</td><td>0.56 ***</td><td>0.11 ***</td><td>0.39 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>8</th><td>0.19 ***</td><td>0.45 ***</td><td>0.31 ***</td><td>0.32 ***</td><td>0.35 ***</td><td>0.14 ***</td><td>0.20 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>9</th><td>0.23 ***</td><td>0.44 ***</td><td>0.51 ***</td><td>0.42 ***</td><td>0.31 ***</td><td>0.29 ***</td><td>0.29 ***</td><td>0.52 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>10</th><td>0.56 ***</td><td>0.13 ***</td><td>0.22 ***</td><td>0.56 ***</td><td>0.02</td><td>0.25 ***</td><td>0.63 ***</td><td>0.25 ***</td><td>0.32 ***</td><td>-</td><td></td><td></td><td></td><td></td><td></td></tr><tr><th>11</th><td>0.12 ***</td><td>0.57 ***</td><td>0.24 ***</td><td>0.22 ***</td><td>0.41 ***</td><td>0.02</td><td>0.13 ***</td><td>0.53 ***</td><td>0.40 ***</td><td>0.19 ***</td><td>-</td><td></td><td></td><td></td><td></td></tr><tr><th>12</th><td>0.08 ***</td><td>0.06 ***</td><td>0.18 ***</td><td>0.04 *</td><td>0.19 ***</td><td>0.12 ***</td><td>0.10 ***</td><td>0.08 ***</td><td>0.12 ***</td><td>0.01</td><td>0.08 ***</td><td>-</td><td></td><td></td><td></td></tr><tr><th>13</th><td>0.53 ***</td><td>0.15 ***</td><td>0.27 ***</td><td>0.56 ***</td><td>0.05 *</td><td>0.23 ***</td><td>0.54 ***</td><td>0.25 ***</td><td>0.37 ***</td><td>0.62 ***</td><td>0.20 ***</td><td>0.09 ***</td><td>-</td><td></td><td></td></tr><tr><th>14</th><td>0.15 ***</td><td>0.67 ***</td><td>0.32 ***</td><td>0.23 ***</td><td>0.49 ***</td><td>0.06 *</td><td>0.18 ***</td><td>0.56 ***</td><td>0.53 ***</td><td>0.20 ***</td><td>0.68 ***</td><td>0.20 ***</td><td>0.30 ***</td><td>-</td><td></td></tr><tr><th>15</th><td>0.25 ***</td><td>0.08 ***</td><td>0.41 ***</td><td>0.25 ***</td><td>0.22 ***</td><td>0.41 ***</td><td>0.28 ***</td><td>0.22 ***</td><td>0.33 ***</td><td>0.20 ***</td><td>0.15 ***</td><td>0.38 ***</td><td>0.27 ***</td><td>0.21 ***</td><td>-</td></tr></tbody></table>

Note: All correlations are polychoric and *p*-values are FDR corrected for multiple comparisons, \* *p* < 0.05, \*\*\* *p* < 0.001; PMPUQ-SV: Problematic mobile phone use questionnaire short version.
<table><caption>**Table 3.** Factor loadings of the PMPUQ-SV items across all languages.</caption><thead><tr><th rowspan="2"></th><th colspan="3">Factor Loadings</th></tr><tr><th>Dangerous Use</th><th>Prohibited Use</th><th>Dependent Use</th></tr></thead><tbody><tr><td>14. Driving concentration</td><td>0.88</td><td></td><td></td></tr><tr><td>11. Driving danger mobile</td><td>0.74</td><td></td><td></td></tr><tr><td>2. Use mobile when driving</td><td>0.73</td><td></td><td></td></tr><tr><td>8. Dangerous situations</td><td>0.73</td><td></td><td></td></tr><tr><td>5. Avoid using on motorway</td><td>0.57</td><td></td><td></td></tr><tr><td>9. Use mobile when forbidden</td><td></td><td>0.80</td><td></td></tr><tr><td>3. Don't use when forbidden</td><td></td><td>0.63</td><td></td></tr><tr><td>15. Use mobile in silent place</td><td></td><td>0.55</td><td></td></tr><tr><td>6. Using mobile in library</td><td></td><td>0.52</td><td></td></tr><tr><td>12. Public transport</td><td></td><td>0.26</td><td></td></tr><tr><td>7. Easy to live without mobile</td><td></td><td></td><td>0.87</td></tr><tr><td>1. Easy not to use mobile</td><td></td><td></td><td>0.84</td></tr><tr><td>10. Lost without mobile</td><td></td><td></td><td>0.74</td></tr><tr><td>4. Difficult not to use mobile</td><td></td><td></td><td>0.73</td></tr><tr><td>13. Hard to turn off mobile</td><td></td><td></td><td>0.72</td></tr></tbody></table>

Note: PMPUQ-SV: Problematic mobile phone use questionnaire short version.

<table><caption>**Table 4.** Individual confirmatory factor analyses across all samples and for each language of the PMPUQ-SV 3.2. Measurement invariance.</caption><thead><tr><th>Version</th><th>n</th><th>df</th><th>χ<sup>2</sup></th><th>p</th><th>CFI</th><th>TLI</th><th>RMSEA</th><th>RMSEA 90% CI</th><th>pClose</th><th>SRMR</th></tr></thead><tbody><tr><td>All languages</td><td>3038</td><td>87</td><td>1858.371</td><td>&lt;0.001</td><td>0.947</td><td>0.936</td><td>0.082</td><td>0.079-0.085</td><td>&lt;0.000</td><td>0.074</td></tr><tr><td>German</td><td>383</td><td>87</td><td>231.642</td><td>&lt;0.001</td><td>0.972</td><td>0.966</td><td>0.066</td><td>0.056-0.076</td><td>&lt;0.000</td><td>0.069</td></tr><tr><td>French</td><td>1076</td><td>87</td><td>589.755</td><td>&lt;0.001</td><td>0.973</td><td>0.968</td><td>0.073</td><td>0.068-0.079</td><td>&lt;0.000</td><td>0.075</td></tr><tr><td>English</td><td>117</td><td>87</td><td>108.124</td><td>=0.062</td><td>0.976</td><td>0.972</td><td>0.046</td><td>0.000-0.072</td><td>&lt;0.000</td><td>0.106</td></tr><tr><td>Finnish</td><td>449</td><td>87</td><td>383.929</td><td>&lt;0.001</td><td>0.924</td><td>0.908</td><td>0.087</td><td>0.078-0.096</td><td>&lt;0.000</td><td>0.092</td></tr><tr><td>Spanish</td><td>156</td><td>87</td><td>186.553</td><td>&lt;0.001</td><td>0.940</td><td>0.928</td><td>0.086</td><td>0.069-0.103</td><td>=0.001</td><td>0.115</td></tr><tr><td>Italian</td><td>288</td><td>87</td><td>337.184</td><td>&lt;0.001</td><td>0.915</td><td>0.897</td><td>0.100</td><td>0.089-0.111</td><td>&lt;0.000</td><td>0.108</td></tr><tr><td>Polish</td><td>258</td><td>87</td><td>303.358</td><td>&lt;0.001</td><td>0.880</td><td>0.856</td><td>0.098</td><td>0.086-0.111</td><td>&lt;0.000</td><td>0.112</td></tr><tr><td>Hungarian</td><td>311</td><td>87</td><td>236.557</td><td>&lt;0.001</td><td>0.954</td><td>0.945</td><td>0.074</td><td>0.063-0.086</td><td>&lt;0.000</td><td>0.103</td></tr></tbody></table>

Note: PMPUQ-SV = Problematic mobile phone use questionnaire short version; χ² = Chi-square value, CFI = comparative fit index, TLI = Tucker-Lewis index, RMSEA = root mean squared error of approximation, pClose = provides a one-sided test of the null hypothesis that the RMSEA is equal to 0.05 in the population, SRMR = standardized root mean square residual.

To test for MI across languages, a series of MGCFAs with increasing constraints were conducted. The degree of difference (Δ) between the pairs of nested models was assessed using ΔCFI, ΔRMSEA, and ΔSRMR, as recommended by Chen [63], with respective cut-off values of ≤0.01, ≤0.015, and ≤0.03 for metric invariance and ≤0.01 for scalar invariance [64]. Satorra-Bentler χ² difference tests were also calculated between the nested models, although again, these have been found to produce unreliable estimates for large sample sizes, and therefore need to be interpreted with caution. Successive models were only calculated if the previous less constrained invariance in the hierarchy was at least partially supported.

Configural invariance was supported because the majority of fit indices were adequate, and so the next levels of constraint were investigated. Satorra-Bentler tests between all subsequent MI models were reliably different (p < 0.001; see Table 5), suggesting that each successive model had a poorer fit than the previous one (this provides evidence against invariance). At each stage, the changes in fit indices were inspected to assess whether this conclusion could be supported. Across all models, the changes in all fit indices were well below the pre-specified cut-off Δ-values, with the exception of ΔCFI for the scalar, strict, and mean models, which exceeded the ≤0.01 threshold at 0.012, 0.014, and 0.012, respectively. Considering the excellent values for the remaining fit indices at each stage, overall, the MI results provide evidence for metric invariance and partial evidence for scalar, strict, and mean invariance.
<table><caption>**Table 5.** Measurement invariance procedure conducted between German, French, Finnish, Spanish, and Hungarian for PMPUQ-SV.</caption><thead><tr><th>Invariance</th><th>df</th><th>χ<sup>2</sup></th><th>p</th><th>CFI</th><th>TLI</th><th>RMSEA</th><th>RMSEA 90% CI</th><th>pClose</th><th>SRMR</th><th>Δχ<sup>2</sup></th><th>Δdf</th><th>ΔRMSEA</th><th>ΔCFI</th><th>ΔSRMR</th></tr></thead><tbody><tr><td>Configural</td><td>435</td><td>1567</td><td>&lt;0.001</td><td>0.964</td><td>0.956</td><td>0.074</td><td>0.070-0.078</td><td>&lt;0.001</td><td>0.084</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Config vs. metric ***</td><td>483</td><td>1654</td><td>&lt;0.001</td><td>0.962</td><td>0.959</td><td>0.072</td><td>0.068-0.075</td><td>&lt;0.001</td><td>0.093</td><td>133</td><td>24</td><td>0.002</td><td>0.001</td><td>0.009</td></tr><tr><td>Metric</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Metric vs. Scalar ***</td><td>591</td><td>2154</td><td>&lt;0.001</td><td>0.950</td><td>0.955</td><td>0.075</td><td>0.071-0.078</td><td>&lt;0.001</td><td>0.087</td><td>165</td><td>54</td><td>0.003</td><td>0.012</td><td>0.006</td></tr><tr><td>Scalar</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Scalar vs. Strict ***</td><td>651</td><td>2643</td><td>&lt;0.001</td><td>0.936</td><td>0.948</td><td>0.080</td><td>0.077-0.084</td><td>&lt;0.001</td><td>0.095</td><td>272</td><td>30</td><td>0.005</td><td>0.014</td><td>0.008</td></tr><tr><td>Strict</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Strict vs. Means ***</td><td>663</td><td>3038</td><td>&lt;0.001</td><td>0.924</td><td>0.939</td><td>0.087</td><td>0.084-0.090</td><td>&lt;0.001</td><td>0.097</td><td>345</td><td>6</td><td>0.007</td><td>0.012</td><td>0.002</td></tr><tr><td>Means</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>

Note: PMPUQ-SV: Problematic mobile phone use questionnaire short version; Satorra-Bentler Δχ² Tests: Config vs. Metric: X²(5) = 23.930, *p* < 0.001, Metric vs Scalar: X²(11) = 29.202, *p* < 0.001, Scalar vs Strict: X²(7) = 69.105, *p* < 0.001, Strict vs Means: X²(1) = 28.590, *** *p* < 0.001.
## 3.2. Response Rates

Finally, in order to explore potential reasons for the violated ΔCFI for the fifth (means) model and if any items could be flagged up for refinement in future iterations, the response rates for each item were investigated across all different linguistic versions. As can be seen in Table 6, across all items for all languages, 75.2% of responses were in the ‘disagree’ or ‘strongly disagree’ categories. However, as items were reversed (i.e., 2, 4, 8, 9, 10, 11, 13, and 14), it should be interpreted that, for example, strongly agreeing on Item 14 (i.e., ‘I use my mobile phone while driving, even in situations that require a lot of concentration’) is more indicative of PMPU (i.e., dangerous use), but strongly agreeing on Item 12 (i.e., ‘When using my mobile phone on public transport, I try not to talk too loud’) is less indicative of PMPU (i.e., prohibited use). Moreover, a pair of items (i.e., Item 12 and Item 14) showed a particularly skewed response pattern with less than 7.6% and 4.9%, respectively, of respondents endorsing PMPU, to some degree, with both statements. Response patterns such as these may suggest that participants were not able to identify with these behaviours and that particular items that comprise the PMPUQ-SV may not be able to adequately discriminate respondents into distinct groups (i.e., as the vast majority of respondents reject these items). Taken together, the MI results illustrate that some of the items of the PMPUQ-SV with more skewed response patterns may prove consistently difficult to identify with across French, German, Hungarian, Finnish, and Spanish respondents.

<table><caption>**Table 6.** Item response rates per response category across all languages for PMPUQ-SV.</caption><thead><tr><th rowspan="2">Factor</th><th rowspan="2">Item</th><th colspan="4">All Languages</th></tr><tr><th>Strongly Agree (%)</th><th>Agree (%)</th><th>Disagree (%)</th><th>Strongly Disagree (%)</th></tr></thead><tbody><tr><td rowspan="5">Dangerous</td><td>14. Driving concentration <sup>R</sup></td><td>1.8</td><td>3.1</td><td>13.1</td><td>82.0</td></tr><tr><td>11. Driving danger mobile <sup>R</sup></td><td>4.2</td><td>4.5</td><td>16.1</td><td>75.1</td></tr><tr><td>2. Use mobile when driving <sup>R</sup></td><td>4.7</td><td>11.4</td><td>20.0</td><td>63.9</td></tr><tr><td>8. Dangerous situations <sup>R</sup></td><td>8.1</td><td>12.3</td><td>23.3</td><td>56.3</td></tr><tr><td>5. Avoid using on motorway</td><td>77.3</td><td>10.2</td><td>6.1</td><td>6.4</td></tr><tr><td rowspan="5">Prohibited</td><td>9. Use mobile where forbidden <sup>R</sup></td><td>3.4</td><td>10.2</td><td>27.7</td><td>58.8</td></tr><tr><td>3. Don't use when forbidden</td><td>55.1</td><td>22.2</td><td>16.7</td><td>6.0</td></tr><tr><td>15. Use mobile in silent place</td><td>63.0</td><td>27.2</td><td>6.9</td><td>2.9</td></tr><tr><td>6. Using mobile in library</td><td>27.7</td><td>23.7</td><td>34.0</td><td>14.6</td></tr><tr><td>12. Public transport</td><td>64.1</td><td>28.3</td><td>5.0</td><td>2.6</td></tr><tr><td rowspan="5">Dependent</td><td>7. Easy to live without mobile</td><td>21.4</td><td>25.6</td><td>37.5</td><td>15.6</td></tr><tr><td>1. Easy not to use mobile</td><td>26.6</td><td>26.1</td><td>31.9</td><td>15.3</td></tr><tr><td>10. Lost without mobile <sup>R</sup></td><td>11.2</td><td>27.3</td><td>32.3</td><td>29.2</td></tr><tr><td>4. Difficult not to use mobile <sup>R</sup></td><td>9.7</td><td>28.0</td><td>32.8</td><td>29.5</td></tr><tr><td>13. Hard to turn off mobile <sup>R</sup></td><td>9.4</td><td>19.8</td><td>32.1</td><td>38.7</td></tr><tr><td colspan="2">Mean *</td><td>51.2</td><td>24.0</td><td>17.0</td><td>7.7</td></tr></tbody></table>

Note: PMPUQ-SV: Problematic mobile phone use questionnaire short version; R = reverse coded for questionnaire validations, but actual score given here. * = mean when items 14, 11, 2, 8, 9, 10, 4, and 13 are reversed.

## 4. Discussion

The objectives of the present study were to determine an optimal factor structure for the PMPUQ-SV among university populations using eight different language versions, and to examine the MI of the PMPUQ-SV across all linguistic versions and across the eight versions. Taken together, the findings suggest that the PMPUQ-SV is a potentially appropriate psychometric tool to screen for
prohibited, dangerous, and dependent mobile phone use in adults from countries using these languages (e.g., Europe and America). However, its psychometric properties can be nuanced depending on the respective language. Despite this, there are several potential reasons for adopting this tool. First, it is a very good psychometric tool for French and German mobile phone users, as its fit indices showed good fit in comparison with the other languages (i.e., $CFI_{French and German} = 0.97$; $TLI_{French and German} = 0.97$; $RMSEA_{French and German} = 0.07$; $SRMR_{French} = 0.07$, $SRMR_{German} = 0.08$). Second, in psychometric terms, the English and Hungarian versions were considered robust and the Finnish and Spanish versions were considered acceptable. However, the Italian and Polish versions did not meet the psychometric requirements.

## 4.1. Main Findings

Using the overall sample, the PMPUQ-SV performed well across its three theoretical factors in terms of their internal consistency, factor loadings, and CFA results. Only two elements were close to the limit of being psychometrically acceptable [59]. More specifically, the Cronbach's alpha for prohibited use was low because it is a coefficient sensitive to the number of items (i.e., the subscale only had five items), and it demonstrated that there was no poor interrelatedness between items or heterogeneous constructs, except for Item 6 (i.e., 'I don't use my mobile phone in a library') relating to prohibited use. This item does not load strongly enough and could perhaps be dropped in future PMPUQ versions. Furthermore, as evidence for metric invariance demonstrated, factor loadings were similar across the MI groups, so Item 6 was poor across countries. In fact, reliabilities were quite poor for prohibited mobile phone use [65].

It was also demonstrated that the RMSEA value was not ideal [59,60]. The French and German versions were psychometrically excellent, although the latter had the same issue with an acceptable reliability for prohibited use. Consequently, more in-depth research is needed to explore the phenomenology of this specific aspect of PMPU. Similarly, the English and Hungarian versions fitted the model well, although the reliability of the English version using Cronbach's alpha was only acceptable [66]. In addition, the Finnish and Spanish versions can be argued to be acceptable with restrictions due to their mediocre TLI, RMSEA, and SRMS values.

In sum, half of the linguistic versions tested in the present study fitted the proposed model well (i.e., ordered by their respective goodness of fit: French, German, Hungarian, and English). However, two require future testing (i.e., Finnish and Spanish) and the other two (i.e., Polish and Italian) require further review in relation to potentially different mobile phone use patterns in some countries and/or to methodological aspects (e.g., the translation and back-translation method applied), because both had large enough sample sizes to test its factor structure using a confirmatory approach. Regarding the English version, previous studies using this tool have also shown other psychometric weaknesses in relation to its reliability (e.g., in other studies, the $\alpha$ for prohibited use was 0.59 [35], and the $\alpha$ for the dangerous subscale was 0.67 [35], or 0.42 [43]), which are in line with the present findings regarding the limited internal consistency for prohibited use. Consequently, this needs to be cautiously interpreted due to the short length of this particular subscale. However, in relation to previous studies using the full PMPUQ or its short version, its factor structure usually corroborated the underlying theoretical model, except for the English studies, which reported a two-factor solution [43,44].

The lower loadings achieved in the overall sample for one of the items on the dangerous use subscale (i.e., 'I try to avoid using my mobile phone when driving on the motorway'), and four items on the prohibited use subscale (e.g., 'When using my mobile phone on public transport, I try not to talk too loud'), could be due to two reasons. First, mobile phone users are probably in a more pre-contemplative stage (i.e., they may not consider their mobile phone behaviour as problematic when asked about it, possibly denying or resisting this possibility), which is in line with research on compulsive internet use and other addictive behaviours [67,68]. Second, some items may not have been appropriate in the present day and age. For instance, 'I don't use my mobile phone in a library', which appeared appropriate in the present study because university samples were used, but (i) not all respondents may use libraries
given the ease in which reading materials can be accessed remotely; and (ii) those who are library
users can access their mobile phones using silent option modes (e.g., for checking the time or *Facebook*
notifications, using IM, navigating, or listening to music through headphones).

When looking at the descriptive findings, the study also demonstrated that there appeared to be
common usage patterns and preferences in relation to mobile phones for dangerous and prohibited use
in the respective language versions. Items related to dangerous and prohibited use were very extreme
(either strongly agree or disagree on the Likert scales), whereas items related to dependent use were
more evenly spread across the response categories (from strongly agree to strongly disagree on the
Likert scales). This may explain why a lower internal consistency was found for prohibited use, as well
as the fact that the subscale only had five items. Underlying cultural differences may also explain
this (e.g., English-speaking participants may have the most diversity in response to Item 12 (the item
with lowest loadings on the prohibited use factor); for example, some cultures do not appear to mind
talking on a bus, whereas other cultures do not like it at all). The study also demonstrated, in reference
to the response patterns in Table 6, that participants endorsed much fewer PMPU behaviors when
responding to items on the dangerous (M = 5.025) and prohibited factors (M = 5.9), relative to the
dependency factor (M = 12.24). Furthermore, in a previous study [43], Item 12 was excluded from the
analysis, because it did not share variance in the body of items.

The results in the present study also demonstrated that cultural differences in self-reported mobile
phone usage patterns and contextual factors must be investigated in greater depth (e.g., driving
regulations in the countries where the study was conducted). The PMPUQ-SV may be a good tool
to initially screen for potential PMPU among adult mobile phone users in some languages (French,
German, Hungarian, English, Finnish, and Spanish) if tested independently per country. However,
the scale is only useful for mobile phone users who drive vehicles. Consequently, dangerous use is only
associated with driving behaviour, instead of other dangers when using mobile phones (e.g., crossing
the road). In future developments of the PMPU, it is recommended that the construct should not
only be assessed with items related to driving behaviour [3,4,25] because other dangerous behaviours
also exist and have been reported in recent research regarding safety, which can be included in
future iterations (e.g., collisions or injuries when cycling or walking [24], such as ‘I use my mobile
phone whilst crossing the road’ [43]), especially if new scales are going to be tested using children,
adolescents, or adults that are not drivers. Conversely, in countries like the US where driving is
permitted during mid-adolescence [25], items addressing driving behaviours when using mobile
phones are recommended (e.g., PMPUQ-SV). In other words, while almost all European countries
allow driving individuals to drive from the age of 17 or 18 years old, in other countries, the ages at
which individuals can drive are lower, such as 14–16 years old.

Regarding the strongest MI results, only the French, German, Hungarian, Finnish, and Spanish
results can be compared when using these versions in a cross-cultural study [68] because it was only in
these countries that configural and metric invariances resulted in obtaining the expected value [63,64].
However, the other types of invariance (i.e., scalar, strict, and mean models) slightly exceeded the
threshold, but the model can still be considered tenable. In sum, the present findings suggest that
the factor structure, loadings and intercepts, and residuals of the PMPUQ-SV are invariant across the
French, German, Hungarian, Finnish, and Spanish language versions. Therefore, the present study
provides evidence for the equality of meaning of the problematic mobile phone use construct in five
out of eight languages, further providing confidence in future use of the PMPUQ-SV in cross-cultural
research on PMPU. For instance, among some of the countries where the TUD project [45] was
developed (i.e., Belgium, France, Switzerland, Canada, Germany, Hungary, Finland, and Spain),
it appears that cross-cultural data can be reliably compared.

## 4.2. *Limitations*

The main potential limitations of the present study are the sampling and characteristics of the
participants (i.e., convenience community-based self-selected samples), who were adults studying
or working in universities (or who were related to those who study or work in higher education institutions). Nevertheless, a large sample was collected during the same period (i.e., in 2015), using similar strategies, and the same online survey, in order to guarantee the standardization of the procedures for collecting reliable data from the three specific aspects of PMPU. The data were also self-reported and are therefore subject to well-known biases and limitations that are inherent within such a methodology. The purpose of the present study was to evaluate the cross-cultural robustness of the PMPUQ-SV to facilitate the development of future epidemiological studies across different cultures as these studies can help better ascertain the potential problems on the phenomenology of maladaptive mobile phone use from a psycho-sociological perspective. The PMPUQ-SV is appropriate for specific types of mobile phone users and has partially been cross-validated, but still presents some weaknesses which need to be studied in future research (i.e., reliability and language adaptability).

### 4.3. *Future Research Directions*

PMPU is still open to debate in relation to its potential health and educational harms in individuals' daily lives. For instance, it is not clear if PMPU results from a contemporary psychosocial problem (facilitated through this technology and the online behaviours associated with it in individuals' daily lives) or from other potentially addictive technological behaviours [37]). PMPU is situated somewhere on the continuum between the absence of problems to severe problems, ranging from a normal daily behaviour to potentially dysfunctional behaviours (or as the consequence of an existing disorder [38]). Furthermore, mobile phones are being increasingly used by adolescents and young adults worldwide [1], and given that they are usually utilized mainly for communicative purposes (i.e., information and maintenance of social relationships), some degree of constant use is expected in Eastern and Western societies.

In recent years, research on PMPU has bloomed in East Asian countries, where the condition is often viewed and classified as an addictive behaviour. Recent studies conducted in this region have indicated the moderating and mediating roles of several sociodemographic factors (e.g., gender), usage patterns (e.g., history of mobile phone use), and psychological variables (e.g., personality traits, emotion regulation skills) [69–73]. Most of this research focused on addictive usage patterns (with scales such as the Mobile Phone Addiction Index [74]), and it would thus be relevant to adapt the PMPUQ-SV to these contexts to provide a tool able to measure different types of PMPU. Such adaptation would also allow for interesting cross-cultural studies to be conducted between, for example, Asian and European countries.

One of the first literature reviews that examined both problematic internet and mobile phone use between 1991 and 2005 using five scientific databases determined, at that time, that mobile phone addiction symptoms were less consistently reported than internet addiction symptoms [75]. Sanchez-Carbonell and colleagues stated in 2008 that the use of synchronous apps (such as chatting apps and online games) might increase the likelihood of developing an addictive behaviour, due to the time lapse between engaging in the act and receiving a reward. A recent longitudinal study [30] partially confirmed this hypothesis (especially in relation to social networking apps and messaging services such as WhatsApp and Facebook). However, recent research on PMPU has not provided this evidence yet [35], in comparison with other internet-related problems, such as gaming, which appears to be the most prevalent because of the immediate rewards [76]. A recent review of cell-phone addiction [77] concluded (irrespective of whether or not it is a genuine addiction) that mobile phones give rise to problems that increasingly affect daily life. For instance, even with the risk of unlimited use (due to the affordability of contracts), the conceptualisation of this problematic mobile phone behaviour is still debated. In general, there is still an overlap in definitions of problematic behaviours related to online activities, including PMPU, Internet addiction, gaming disorder, social network use disorder, and others. Future studies are needed to gather evidence on how a nomenclature can progress and improve.
**5. Conclusions**

The present study is the first to ascertain that the PMPUQ-SV is an appropriate psychometric tool for cross-cultural comparisons to determine future prevalence estimates of multidimensional PMPU (i.e., dangerous, prohibited, and dependent mobile phone use). This is the first study that has investigated PMPU in an international sample, conducting MGCFAs and MI on a multidimensional model of the PMPUQ-SV across multiple language versions. An optimal factor structure (i.e., three-factor model) was found for the PMPUQ-SV among different university populations using six language versions (French, German, Hungarian, English, Finnish, and Spanish), and the MI of the PMPUQ-SV was examined across eight linguistic versions. The results indicate that five of the language variants (i.e., French, German, Finnish, Spanish, and Hungarian) are comparable for future cross-cultural studies. The PMPUQ-SV has been validated for almost all languages tested in order to be used independently in countries using these languages, and parts of these versions can be used for cross-cultural comparisons. The present study contributes to the behavioural addictions field by cross-validating results that can be used for future cross-cultural research on PMPU.

**Author Contributions:** Conceptualization: O.L.-F. Data curation: O.L.-F.; Formal analysis: C.D. and L.V.J. Funding acquisition: O.L.-F., J.B. Investigation: O.L.-F., D.J.K., H.M.P., M.F.G., N.M., M.K., H.-J.R., A.B., A.-K.G., L.R., L.K., Y.M., A.R., P.G., Z.D., O.K., A.S., A.P., B.L.-K., J.C., M.C., J.J.Z., E.S. (Emilia Serra), M.D., L.R., D.Z., S.A., N.I.L., E.S. (Eva Suryani), J.M.H., J.P.T., and J.B.; Methodology, O.L.-F.; Project administration: O.L.-F. Resources: O.L.-F. Supervision: O.L.-F. and J.B. Writing—original draft: O.L.-F. Writing, review and editing: O.L.-F., D.J.K., H.M.P., M.D.G., C.D., L.V.J., N.M., M.K., H.-J.R., A.B., A.-K.G., L.R., L.K., Y.M., A.R., P.G., Z.D., O.K., A.S., A.P., B.L.-K., J.C., M.C., J.J.Z., E.S. (Emilia Serra), M.D., L.R., D.Z., S.A., N.I.L., E.S. (Eva Suryani), J.M.H., J.P.T., and J.B.

**Acknowledgments:** The present study was supported, first, by the European Commission ("Tech Use Disorders"; FP7-PEOPLE-2013- IEF-627999) through a Marie Curie postdoctoral grant awarded to O.L.-F. (supervisor: J.B.). Second, by the Psychology Department QR Funding at Nottingham Trent University, through a Kickstarter bid grant (2017) awarded to O.L.-F. to develop studies on 'Internet and mobile phone addiction: Cross-cultural epidemiological studies'. O.L.-F. also acknowledges the support of Kim Hoffman from the International Center for Advanced Research and Applied Science (INCAAS), Peru; Carmen Margarita Ilizarbe Pizarro, Universidad Antonio Ruiz de Montoya, Peru; and Katarzyna Gajewska from the Polish Foundation for Humanitarian Aid 'Res Humanae', Poland. The Hungarian part of the study was supported by the Hungarian Scientific Research Fund (grant number: K111938; KKP126835). O.K. acknowledges the support of the ÜNKP-17-4 New National Excellence Program of the Ministry of Human Capacities.

**Conflicts of Interest:** The authors declare no conflict of interest.

**Appendix A**

**English**

In relation with your mobile phone/smartphone, please answer these questions on a scale from 1 to 4, the numbers corresponding to: 1 "Strongly agree", 2 "Agree", 3 "Disagree", 4 "Strongly disagree"
The statement suits you:

1. It is easy for me to spend all day not using my mobile phone.

2. I use my mobile phone while driving.

3. I don't use my mobile phone when it is completely forbidden to use it.

4. Is it hard for me not to use my mobile phone when I feel like it.

5. I try to avoid using my mobile phone when driving on the motorway.

6. I don't use my mobile phone in a library.

7. I can easily live without my mobile phone.

8. I use my mobile phone in situations that would qualify as dangerous.

9. I use my mobile phone where it is forbidden to do so.

10. I feel lost without my mobile phone.

11. While driving, I find myself in dangerous situations because of my mobile phone use.

12. When using my mobile phone on public transport, I try not to talk too loud.

13. It is hard for me to turn my mobile phone off.
14. I use my mobile phone while driving, even in situations that require a lot of concentration.

15. I try to avoid using mobile phone where people need silence.

## French

Concernant votre téléphone portable/smartphone, veuillez répondre à ces questions selon une échelle allant de 1 à 4, ces chiffres correspondant à : 1 "Tout à fait ", 2 "Plutôt bien ", 3 "Plutôt mal", 4 "Pas du tout "

L'énoncé vous correspond:

1. Il est facile pour moi de passer toute une journée sans utiliser mon téléphone portable.

2. Je téléphone en conduisant.

3. Je n'utilise pas mon téléphone portable dans des lieux où il est formellement interdit de le faire.

4. Il m'est difficile de ne pas utiliser mon téléphone portable lorsque j'en ai envie.

5. J'évite d'utiliser mon téléphone portable quand je conduis sur l'autoroute.

6. Je n'utilise pas mon téléphone portable quand je suis dans une bibliothèque.

7. Je peux facilement me passer de mon téléphone portable.

8. Je me sers de mon téléphone portable dans des situations que je peux qualifier de «dangereuses».

9. Je me sers de mon téléphone portable dans des lieux où la loi l'interdit.

10. Je me sens perdu quand je n'ai pas mon téléphone portable.

11. En conduisant, je me retrouve en situation délicate alors que j'utilise mon téléphone portable.

12. Quand je téléphone dans les transports publics, je fais attention à ne pas parler trop fort.

13. Il est pénible pour moi d'éteindre mon téléphone portable.

14. En conduisant, j'utilise mon téléphone portable dans des situations qui demandent une concentration importante.

15. J'évite d'utiliser mon téléphone portable dans des endroits où il faut être silencieux.

## German

Bitte beantworten Sie die nächsten Fragen in Bezug auf Ihr Smartphone/Handy auf einer Skala von 1 bis 4, die Zahlen entsprechend: 1 "Stimme sehr zu", 2 "Stimme zu", 3 "Stimme nicht zu", 4 "Stimme überhaupt nicht zu"

Wählen Sie die Aussage, die am besten zu Ihnen passt:

1. Es fällt mir leicht, den Tag zu verbringen, ohne mein Handy zu benutzen.

2. Ich benutze mein Handy, während ich Auto fahre.

3. Ich gebrauche mein Handy nicht, wenn es absolut verboten ist es zu benutzen.

4. Es fällt mir schwer mein Handy nicht zu verwenden, wenn mir danach ist.

5. Ich versuche zu vermeiden, mein Handy während der Autobahnfahrt zu benutzen.

6. Ich benutze mein Handy nicht in einer Bibliothek.

7. Ohne mein Handy kann ich problemlos leben.

8. Ich benutze mein Handy in Situationen, die als gefährlich gelten würden.

9. Ich verwende mein Handy an Orten, an denen die Nutzung verboten ist.

10. Ohne mein Handy fühle ich mich verloren.

11. Während ich Auto fahre, bringe ich mich in gefährliche Situationen, weil ich gleichzeitig mein Handy benutze.

12. Bei der Verwendung meines Mobiltelefons in öffentlichen Verkehrsmitteln versuche ich nicht zu laut zu sprechen.

13. Es fällt mir schwer, mein Handy auszuschalten.

14. Ich benutze mein Handy während der Autofahrt, selbst in Situationen, die viel Aufmerksamkeit erfordern.
15. Ich versuche meine Handynutzung in Situationen zu vermeiden, in denen Menschen Ruhe brauchen.

## Hungarian

Kérjük, válaszold meg az alábbi kérdéseket a mobiltelefonod használatával kapcsolatban egy egytől négyig terjedő skálán, ahol: 1 "Teljesen egyetértek", 2 "Egyetértek", 3 "Nem értek egyet", 4 "Egyáltalán nem értek egyet"

Mennyire értesz egyet az alábbi állításokkal?

1. Könnyű számomra egy egész napot eltölteni anélkül, hogy használnám a mobilomat.

2. Használom a mobilomat vezetés közben.

3. Nem használom a mobilomat olyankor, amikor ez egyértelműen tilos.

4. Nehezemre esik, hogy ne használjam a mobilomat bármikor, amikor csak kedvem van hozzá.

5. Igyekszem nem használni a mobilomat, amikor autópályán vezetek.

6. Nem használom a mobilomat, ha könyvtárban vagyok.

7. Jól elvagyok a mobilom nélkül.

8. Olyan helyzetekben is használom a mobilomat, amikor az mások szerint veszélyes lehet.

9. Olyan helyen is használom a mobilomat, ahol ez tilos.

10. Elveszettnek érzem magam a mobilom nélkül.

11. Sokszor veszélyes helyzetekben találom magam vezetés közben a mobilhasználatom miatt.

12. Amikor tömegközlekedési eszközön használom a mobilomat, igyekszem nem túl hangosan beszélni.

13. Nehezemre esik kikapcsolni a mobilomat.

14. Még olyan helyzetekben is használom a mobilomat vezetés közben, amik nagy koncentrációt igényelnek.

15. Igyekszem nem használni a mobilomat olyan helyeken, ahol másoknak csendre van szükségük.

## Finnish

Alla väittämiä matka-/älypuhelimenne käytöstä. Vastatkaa seuraaviin väittämiin valitsemalla itseänne parhaiten kuvaava vaihtoehto asteikolla 1–4: 1 ”Täysin samaa mieltä”, 2 ”Jokseenkin samaa mieltä”, 3 ”Jokseenkin eri mieltä”, 4 ”Täysin eri mieltä”

1. Minulle on helppoa olla koko päivä käyttämättä matkapuhelintani.

2. Käytän matkapuhelinta autolla ajaessani.

3. En käytä matkapuhelintani silloin, kun sen käyttö on ehdottomasti kielletty.

4. On vaikeaa olla käyttämättä matkapuhelinta silloin kun haluaisin käyttää sitä.

5. Yritän välttää matkapuhelimen käyttöä moottoritiellä ajaessani.

6. En käytä matkapuhelinta kirjastossa.

7. Voin helposti elää ilman matkapuhelinta.

8. Käytän matkapuhelintani tilanteissa, jotka voidaan luokitella vaarallisiksi.

9. Käytän matkapuhelintani silloinkin, kun sen käyttö on kielletty.

10. Tunnen olevani hukassa ilman matkapuhelintani.

11. Ajaessani huomaan olevani vaarallisissa tilanteissa matkapuhelimen käyttöni seurauksena.

12. Käyttäessäni matkapuhelinta joukkoliikennevälineissä yritän olla puhumatta kovalla äänellä.

13. Minulle tuottaa vaikeuksia laittaa matkapuhelimeni pois päältä.

14. Käytän matkapuhelinta ajaessani autolla myös tilanteissa, jotka vaativat erityistä tarkkaavaisuutta.

15. Yritän välttää matkapuhelimen käyttöä tilanteissa, joissa tarvitaan hiljaisuutta.
## Italian

Per favore, indica quanto ciascuna affermazione è adatta a descrivere l'uso che fai del tuo cellulare/ smartphone, su una scala da 1 a 4. I numeri corrispondono a: 1. "Fortemente d'accordo", 2. "D'accordo", 3. "In disaccordo", 4. "Fortemente in disaccordo"

1. E' facile per me trascorrere tutto il giorno senza utilizzare il cellulare.

2. Utilizzo il cellulare mentre guido.

3. Non uso il cellulare quando è assolutamente proibito usarlo.

4. E' difficile per me non utilizzare il cellulare quando mi sento di farlo.

5. Cerco di evitare di utilizzare il cellulare quando guido in autostrada.

6. Non uso il cellular in biblioteca.

7. Posso vivere facilmente senza il cellulare.

8. Uso il cellulare in situazioni che potrebbero essere considerate pericolose.

9. Uso il cellulare dove è proibito farlo.

10. Mi sento perso senza il cellulare.

11. Quando guido mi ritrovo in situazioni pericolose perchè utilizzo il cellulare.

12. Quando uso il cellulare su un mezzo di traporto pubblico, cerco di non parlare troppo forte.

13. E' difficile per me spegnere il cellulare.

14. Uso il cellulare quando guido, anche in situazioni che richiedono molta concentrazione.

15. Cerco di evitare di usare il cellulare nei posti in cui la gente ha bisogno di silenzio.

## Spanish

En relación con su móvil/smartphone, responda por favor a estas cuestiones en una escala de valoración del 1 al 4, los números corresponden a: 1 "Muy de acuerdo", 2 "De acuerdo", 3 "En desacuerdo", 4 "Muy en desacuerdo"

La declaración que más le convenga:

1. Es fácil para mí pasar todo el día sin usar el móvil.

2. Uso el móvil mientras conduzco.

3. Yo no uso el móvil cuando está completamente prohibido.

4. Es difícil para mí no usar el móvil cuando quiero usarlo.

5. Trato de evitar el uso del móvil cuando conduzco por la autopista.

6. No uso el móvil en una biblioteca.

7. Puedo vivir fácilmente sin mi móvil.

8. Uso el móvil en situaciones que podrían considerarse peligrosas.

9. Uso el móvil donde está prohibido utilizarlo.

10. Me siento perdido sin el móvil.

11. Me he encontrado en situaciones peligrosas debido al uso del móvil mientras conducía.

12. Cuando uso el móvil en el transporte público, trato de no hablar demasiado alto.

13. Es difícil para mí apagar el móvil.

14. Uso el móvil durante la conducción, incluso en situaciones que requieren mucha concentración.

15. Trato de evitar el uso del móvil en lugares en que la gente necesita silencio (o se ruega silencio).

## Polish

Proszę odpowiedzieć na pytania dotyczące Pana(i) telefonu/smartfona, posługując się skala,
w której kolejne cyfry od 1 do 4 znaczą: 1 "Całkowicie", 2 "Raczej tak", 3 "Raczej nie", 4 "Wcale"
Stwierdzenie odpowiadające Panu(i):

1. Łatwo mi spędzić cały dzień bez używania mojego telefonu komórkowego.
2. Rozmawiam przez telefon prowadząc samochód.

3. Nie używam telefonu w miejscach, w których formalnie jest to zakazane.

4. Trudno mi się powstrzymać od używania mojego telefonu komórkowego, kiedy mam na to ochotę.

5. Staram się nie używać telefonu, kiedy prowadzę saochód na autostradzie.

6. Nie używam telefonu kiedy jestem w bibliotece.

7. Z łatwością mogę obejść się bez mojego telefonu.

8. Używam mojego telefonu w sytuacjach, które uważam za « niebezpieczne ».

9. Używam mojego telefonu w miejscach, w których prawo tego zakazuje.

10. Czuję się zagubiony, gdy nie mam ze sobą mojego telefonu.

11. Prowadząc, zdarza mi się znaleźć w trudnej sytuacji podczas gdy używam telefonu komórkowego.

12. Kiedy rozmawiam przez telefon w środkach komunikacji publicznej, zwracam uwagę by nie rozmawiać zbyt głośno.

13. Źle się czuję, kiedy wyłączam mój telefon, nie lubię tego.

14. Prowadząc samochód używam telefonu w sytuacjach, które wymagają szczególnej koncentracji.

15. Unikam używania telefonu w miejscach, w których należy zachować ciszę.

## References

1. International Telecommunication Union (ITU). ITU Committed to Connecting the World: ICT Facts and Figures 2017—Global ICT Developments. Available online: https://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx (accessed on 7 March 2018).

2. ProQuest. Search—All Databases. Available online: https://search.proquest.com/results/3E9BFDEC5154401PQ/1?accountid=14693 (accessed on 26 January 2018).

3. Bianchi, A.; Phillips, J.G. Psychological predictors of problem mobile phone use. *Cyberpsychol. Behav.* **2005**, *8*, 39–51. [CrossRef] [PubMed]

4. Billieux, J.; Van der Linden, L.; Rochat, L. The role of impulsivity in actual and problematic use of the mobile phone. *Appl. Cogn. Psychol.* **2008**, *26*, 1195–1210. [CrossRef]

5. Billieux, J. Problematic use of the mobile phone: A literature review and a pathways model. *Curr. Psychiatry Rev.* **2012**, *8*, 299–307. [CrossRef]

6. Lopez-Fernandez, O.; Kuss, D.J.; Griffiths, M.D.; Billieux, J. The conceptualization and assessment of problematic mobile phone use. In *Encyclopedia of Mobile Phone Behavior* (Volumes 1, 2, & 3); Yan, Z., Ed.; IGI Global: Hershey, PA, USA, 2015; pp. 591–606. ISBN 9781466682399.

7. Billieux, J.; Maurage, P.; Lopez-Fernandez, O.; Kuss, D.J.; Griffiths, M.D. Can disordered mobile phone use be considered a behavioral addiction? An update on current evidence and a comprehensive model for future research. *Curr. Addict. Rep.* **2015**, *2*, 156–162. [CrossRef]

8. Martinotti, G.; Villella, C.; Di Thiene, D.; Di Nicola, M.; Bria, P.; Conte, G.; Cassano, M.; Petruccelli, F.; Corvasce, N.; Janiri, L.; et al. Problematic mobile phone use in adolescence: A cross-sectional study. *J. Public Health* **2011**, *19*, 545–551. [CrossRef]

9. Chóliz, M. Mobile-phone addiction in adolescence: The test of mobile phone dependence (TMD). *Prog. Health Sci.* **2012**, *2*, 33–44. [CrossRef]

10. López-Fernandez, O.; Honrubia-Serrano, M.L.; Freixa-Blanxart, M. Spanish adaptation of the “mobile phone problem use scale” for adolescent population. *Adicciones* **2012**, *24*, 123–130. [CrossRef] [PubMed]

11. Ezoe, S.; Toda, M.; Yoshimura, K.; Naritomi, A.; Den, R.; Morimoto, K. Relationships of personality and lifestyle with mobile phone dependence among female nursing students. *Soc. Behav. Personal.* **2009**, *37*, 231–238. [CrossRef]

12. Gallimberti, L.; Buja, A.; Chindamo, S.; Terraneo, A.; Marini, E.; Rabensteiner, A.; Vinelli, A.; Gomez Perez, L.J.; Baldo, V. Problematic cell phone use for text messaging and substance abuse in early adolescence (11- to 13-year-olds). *Eur. J. Pediatr.* **2016**, *175*, 355–364. [CrossRef] [PubMed]
13. Yang, Y.; Yen, J.; Ko, C.; Cheng, C.; Yen, C. The association between problematic cellular phone use and risky behaviors and low self-esteem among Taiwanese adolescents. *BMC Public Health* **2010**, *10*. [CrossRef] [PubMed]

14. Thomée, S.; Dellve, L.; Härenstam, A.; Hagberg, M. Perceived connections between information and communication technology use and mental symptoms among young adults—A qualitative study. *BMC Public Health* **2010**, *10*, 66. [CrossRef] [PubMed]

15. Thomée, S.; Härenstam, A.; Hagberg, M. Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults—A prospective cohort study. *BMC Public Health* **2011**, *11*, 66. [CrossRef] [PubMed]

16. Elhai, J.D.; Dvorak, R.D.; Levine, J.C.; Hall, B.J. Problematic smartphone use: A conceptual overview and systematic review of relations with anxiety and depression psychopathology. *J. Affect. Disord.* **2017**, *207*, 251–259. [CrossRef] [PubMed]

17. Elhai, J.D.; Levine, J.C.; Dvorak, R.D.; Hall, B.J. Non-social features of smartphone use are most related to depression, anxiety and problematic smartphone use. *Comput. Hum. Behav.* **2017**, *69*, 75–82. [CrossRef]

18. Stothart, C.; Mitchum, A.; Yehnert, C. The attentional cost of receiving a cell phone notification. *J. Exp. Psychol. Hum. Percept. Perform.* **2015**, *41*, 893–897. [CrossRef] [PubMed]

19. McDaniel, B.T.; Coyne, S.M. "Technoference": The interference of technology in couple relationships and implications for women's personal and relational well-being. *Psychol. Pop. Media Cult.* **2016**, *5*, 85–98. [CrossRef]

20. Bickham, D.S.; Hswen, Y.; Rich, M. Media use and depression: Exposure, household rules, and symptoms among young adolescents in the USA. *Int. J. Public Health* **2015**, *60*, 147–155. [CrossRef] [PubMed]

21. Tao, S.; Wu, X.; Wan, Y.; Zhang, S.; Hao, J.; Tao, F. Interactions of problematic mobile phone use and psychopathological symptoms with unintentional injuries: A school-based sample of Chinese adolescents. *BMC Public Health* **2016**, *16*, 88. [CrossRef] [PubMed]

22. Delgado, M.K.; Wanner, K.J.; McDonald, C. Adolescent cellphone use while driving: An overview of the literature and promising future directions for prevention. *Media Commun.* **2016**, *4*, 79–89. [CrossRef] [PubMed]

23. Takao, M.; Takahashi, S.; Kitamura, M. Addictive personality and problematic mobile phone use. *Cyberpsychol. Behav.* **2009**, *12*, 501–507. [CrossRef] [PubMed]

24. Chotpitayasunondh, V.; Douglas, K.M. How "phubbing" becomes the norm: The antecedents and consequences of snubbing via smartphone. *Comput. Hum. Behav.* **2016**, *63*, 9–18. [CrossRef]

25. Roberts, J.A.; David, M.E. My life has become a major distraction from my cell phone: Partner phubbing and relationship satisfaction among romantic partners. *Comput. Hum. Behav.* **2016**, *54*, 134–141. [CrossRef]

26. Kim, Y.; Jeong, J.-E.; Cho, H.; Jung, D.-J.; Kwak, M.; Rho, M.J.; Yu, H.; Kim, D.-J.; Choi, I.Y. Personality factors predicting smartphone addiction predisposition: Behavioral inhibition and activation systems, impulsivity, and self-control. *PLoS ONE* **2016**, *11*, e0159788. [CrossRef] [PubMed]

27. Lin, T.T.C.; Chiang, Y.; Jiang, Q. Sociable people beware? Investigating smartphone versus nonsmartphone dependency symptoms among young Singaporeans. *Soc. Behav. Personal.* **2015**, *43*, 1209–1216. [CrossRef]

28. Foerster, M.; Roser, K.; Schoeni, A.; Röösli, M. Problematic mobile phone use in adolescents: Derivation of a short scale MPPUS-10. *Int. J. Public Health* **2015**, *60*, 277–286. [CrossRef] [PubMed]

29. Roser, K.; Schoeni, A.; Foerster, M.; Röösli, M. Problematic mobile phone use of Swiss adolescents: Is it linked with mental health or behaviour? *Int. J. Public Health* **2016**, *61*, 307–315. [CrossRef] [PubMed]

30. Carbonell, X.; Chamarro, A.; Oberst, U.; Rodrigo, B.; Prades, M. Problematic Use of the Internet and Smartphones in University Students: 2006–2017. *Int. J. Environ. Res. Public Health* **2018**, *15*, 475. [CrossRef] [PubMed]

31. Long, J.; Liu, T.Q.; Liao, Y.H.; Qi, C.; He, H.Y.; Chen, S.B.; Billieux, J. Prevalence and correlates of problematic smartphone use in a large random sample of Chinese undergraduates. *BMC Psychiatry* **2016**, *16*, 408. [CrossRef] [PubMed]

32. Andreassen, C.S.; Billieux, J.; Griffiths, M.D.; Kuss, D.J.; Demetrovics, Z.; Mazzoni, E.; Pallesen, S. The relationship between addictive use of social media and video games and symptoms of psychiatric disorders: A large-scale cross-sectional study. *Psychol. Addict. Behav.* **2016**, *30*, 252–262. [CrossRef] [PubMed]
33. Lopez-Fernandez, O.; Kuss, D.J.; Romo, L.; Morvan, Y.; Kern, L.; Graziani, P.; Rousseau, A.; Rumpf, H.J.; Bischof, A.; Gässler, A.K.; et al. Self-reported dependence on mobile phones in young adults: A European cross-cultural empirical survey. *J. Behav. Addict.* **2017**, *6*, 168–177. [CrossRef] [PubMed]

34. Jiang, Z.; Zhao, X. Self-control and problematic mobile phone use in Chinese college students: The mediating role of mobile phone use patterns. *BMC Psychiatry* **2016**, *16*, 416. [CrossRef] [PubMed]

35. Lopez-Fernandez, O.; Männikkö, N.; Kääriäinen, M.; Griffiths, M.D.; Kuss, D.J. Mobile gaming and problematic smartphone use: A comparative study between Belgium and Finland. *J. Behav. Addict.* **2018**, *9*, 1–12. [CrossRef] [PubMed]

36. Chung, N. Korean adolescent girls' addictive use of mobile phones to maintain interpersonal solidarity. *Soc. Behav. Personality* **2011**, *39*, 1349–1358. [CrossRef]

37. Billieux, J.; Schimmenti, A.; Khazaal, Y.; Maurage, P.; Heeren, A. Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research. *J. Behav. Addict.* **2015**, *4*, 119–123. [CrossRef] [PubMed]

38. Chóliz, M. Mobile phone addiction: A point of issue. *Addiction* **2010**, *105*, 373–374. [CrossRef] [PubMed]

39. Baron, N.S.; af Segerstad, Y.H. Cross-cultural patterns in mobile-phone use: Public space and reachability in Sweden, the USA and Japan. *New Media Soc.* **2010**, *12*, 13–34. [CrossRef]

40. Lopez-Fernandez, O. Short version of the Smartphone Addiction Scale adapted to Spanish and French: Towards a cross-cultural research in problematic mobile phone use. *Addict. Behav.* **2017**, *64*, 275–280. [CrossRef] [PubMed]

41. Lopez-Fernandez, O.; Honrubia-Serrano, M.L.; Freixa-Blanxart, M.; Gibson, W. Prevalence of problematic mobile phone use in British adolescents. *Cyberpsycho. Behav. Soc. Netw.* **2014**, *17*, 91–98. [CrossRef] [PubMed]

42. Pedrero, E.J.; Rodriguez Monje, M.T.; Ruiz Sanchez De León, J.M. Mobile phone abuse or addiction. A review of the literature. *Adicciones* **2012**, *24*, 139–152. [CrossRef]

43. Kuss, D.J.; Harkin, L.; Kanjo, E.; Billieux, J. Problematic Smartphone Use: Investigating Contemporary Experiences Using a Convergent Design. *Int. J. Environ. Res. Public Health* **2018**, *15*, 142. [CrossRef] [PubMed]

44. Kuss, D.J.; Kanjo, E.; Crook-Rumsey, M.; Kibowski, F.; Wang, Y.W.; Sumich, A. Problematic Mobile Phone Use and Addiction Across Generations: The Roles of Psychopathological Symptoms and Smartphone Use. *J. Technol. Behav. Sci.* **2018**. [CrossRef]

45. Tech Use Disorders. Technological Use Disorders: European Cross-Cultural Longitudinal and Experimental Studies for Internet and Smartphone Problem Uses, 12 July 2017. Available online: http://cordis.europa.eu/project/rcn/189961_en.html (accessed on 14 July 2017).

46. Beaton, D.E.; Bombardier, C.; Guillemin, F.; Ferraz, M.B. Guidelines for the process of cross-cultural adaptation of self-report measures. *Spine* **2000**, *25*, 3186–3191. [CrossRef] [PubMed]

47. Van de Schoot, R.; Lugtig, P.; Hox, J. A checklist for testing measurement invariance. *Eur. J. Dev. Psychol.* **2012**, *9*, 486–492. [CrossRef]

48. Gregorich, S.E. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. *Med. Care* **2006**, *44*, S78–S94. [CrossRef] [PubMed]

49. Kim, E.S.; Yoon, M. Testing measurement invariance: A comparison of multiple-group categorical CFA and IRT. *Struct. Equ. Model.* **2011**, *18*, 212–228. [CrossRef]

50. RStudio Team. RStudio: Integrated Development for R; RStudio, Inc.: Boston, MA, USA, 2015; Available online: http://www.rstudio.com/ (accessed on 7 March 2018).

51. Rosseel, Y. Lavaan: An R package for structural equation modeling and more. Version 0.5-12 (BETA). *J. Stat. Softw.* **2012**, *48*, 1–36. [CrossRef]

52. Revelle, W. *Procedures for Personality and Psychological Research*; Northwestern University: Evanston, IL, USA, 2016; Available online: http://www.personality-project.org/revelle.html and https://cran.r-project.org/web/packages/psych/index.html; (accessed on 7 March 2018).

53. SemTools Contributors. SemTools: Useful Tools for Structural Equation Modelling. R Package Version 0.4-14. 2016. Available online: https://cran.r-project.org/web/packages/semTools/index.html and https://cran.r-project.org/web/packages/semTools/semTools.pdf (accessed on 7 March 2018).

54. Hirschfeld, G.; Von Brachel, R. Multiple-Group confirmatory factor analysis in R—A tutorial in measurement invariance with continuous and ordinal. *Pract. Assess. Res. Eval.* **2014**, *19*, 1–11. Available online: http://pareonline.net/getvn.asp?v=19&n=7 (accessed on 7 March 2018).
55. Mîndrilă, D. Maximum Likelihood (ML) and Diagonally Weighted Least Squares (DWLS) Estimation Procedures: A Comparison of Estimation Bias with Ordinal and Multivariate Non-Normal Data. 2010. Available online: http://infonomics-society.org/wp-content/uploads/ijds/published-papers/volume-1-2010/Maximum-Likelihood-ML-and-Diagonally-Weighted-Least-Squares-DWLS-Estimation-Procedures-A-Comparison-of-Estimation-Bias-with-Ordinal-and-Multivariate-Non-Normal-Data.pdf (accessed on 7 March 2018).

56. Muthén, L.K.; Muthén, B.O. *Mplus User's Guide*; Authors: Los Angeles, CA, USA, 2001; Available online: http://research.socialwork.wayne.edu/pdf/mplus-users-guide.pdf (accessed on 7 March 2018).

57. Flora, D.B.; Curran, P.J. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal Data. *Psychol. Methods* **2004**, *9*, 466–491. [CrossRef] [PubMed]

58. Hooper, D.; Coughlan, J.; Mullen, M. Structural equation modelling: Guidelines for determining model fit. *Electron. J. Bus. Res. Methods* **2008**, *6*, 53–60. Available online: http://arrow.dit.ie/buschmanart (accessed on 7 March 2018).

59. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. *Struct. Equ. Model.* **1999**, *6*, 1–55. [CrossRef]

60. Browne, M.; Cudeck, R. Alternative ways of assessing model fit. In *Testing Structural Equation Models*; Bollen, K.A., Long, J.S., Eds.; Sage Publications: Beverly Hills, CA, USA, 1993; pp. 111–136. ISBN 978-0803945074.

61. Van de Schoot, R.; Lugtig, P.; Hox, J. A checklist for testing measurement invariance, Eur. J. Dev. Psychol. **2012**, *9*, 486–492. [CrossRef]

62. Marsh, H.W.; Balla, J.R.; McDonald, R.P. Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. *Psychol. Bull.* **1988**, *103*, 391–410. [CrossRef]

63. Chen, F.F. Sensitivity of goodness of fit indexes to lack of measurement invariance. *Struct. Equ. Model.* **2007**, *14*, 464–504. [CrossRef]

64. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. *Struct. Equ. Model.* **2002**, *9*, 233–255. [CrossRef]

65. Tavakol, M.; Dennick, R. Making sense of Cronbach's alpha. *Int. J. Med. Educ.* **2011**, *2*, 53–55. [CrossRef] [PubMed]

66. Schmitt, N. Uses and abuses of coefficient alpha. *Psychol. Assess.* **1996**, *8*, 350–353. [CrossRef]

67. Khazaal, Y.; Chatton, A.; Atwi, K.; Zullino, D.; Khan, R.; Billieux, J. Arabic validation of the Compulsive Internet Use Scale (CIUS). *Subst. Abuse Treat. Prev. Policy* **2011**, *6*, 32. [CrossRef] [PubMed]

68. Prochaska, J.O.; DiClemente, C.C.; Norcross, J.C. In search of how people change. Applications to addictive behaviors. *Am. Psychol.* **1992**, *47*, 1102–1114. [CrossRef] [PubMed]

69. Jiang, Z.; Zhao, X. Brain behavioral systems, self-control and problematic mobile phone use: The moderating role of gender and history of use. *Personal. Individ. Differ.* **2017**, *106*, 111–116. [CrossRef]

70. Liu, Q.; Zhou, Z.; Niu, G.; Fan, C. Mobile phone addiction and sleep quality in adolescents: Mediation and moderation analyses. *Acta Psychol. Sin.* **2017**, *49*, 1524–1536. [CrossRef]

71. Lian, L. Alienation as mediator and moderator of the relationship between virtues and smartphone addiction among Chinese university students. *Int. J. Ment. Health Addict.* **2017**, *1–11*. [CrossRef]

72. Gao, T.; Li, J.; Zhang, H.; Gao, J.; Kong, Y.; Hu, Y.; Mei, S. The influence of alexithymia on mobile phone addiction: The role of depression, anxiety and stress. *J. Affect. Disord.* **2018**, *225*, 761–766. [CrossRef] [PubMed]

73. Zhang, Y.; Lu, G.; Liu, Y.; Zhou, Y. Mediating effect of self-identity on relationship between interpersonal adaptation and mobile phone addiction tendency in college students. *Chin. Ment. Health J.* **2017**, *31*, 568–572.

74. Leung, L. Linking psychological attributes to addiction and improper use of the mobile phone among adolescents in Hong Kong. *J. Child. Media* **2008**, *2*, 93–113. [CrossRef]

75. Sanchez-Carbonell, X.; Beranuy, M.; Castellana, M.; Chamarro, A.; Oberst, U. Internet and cell phone addiction: Passing fad or disorder? *Adicciones* **2008**, *20*, 149–159. [CrossRef] [PubMed]
76. Griffiths, M.D.; Nuyens, F. An overview of structural characteristics in problematic videogame playing. *Curr. Addict. Rep.* **2017**, *4*, 272–283. [CrossRef] [PubMed]

77. De-Sola Gutiérrez, J.; Rodríguez de Fonseca, F.; Rubio, G. Cell-Phone Addiction: A Review. *Front. Psychiatry* **2016**, *7*, 175. [CrossRef] [PubMed]

<figure><img src="image_7.png" /></figure>

© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).