# Development of a Web-Based Clinical Decision Support System for Drug Prescription: Non-Interventional Naturalistic Description of the Antipsychotic Prescription Patterns in 4345 Outpatients and Future Applications

Sofian Berrouiguet, Maria Luisa Barrigón, Sara A. Brandt, Santiago Ovejero-García, Raquel Álvarez-García, Juan Jose Carballo, Philippe Lenca, Philippe Courtet, Enrique Baca-Garcia

► To cite this version:

Sofian Berrouiguet, Maria Luisa Barrigón, Sara A. Brandt, Santiago Ovejero-García, Raquel Álvarez-García, et al. Development of a Web-Based Clinical Decision Support System for Drug Prescription: Non-Interventional Naturalistic Description of the Antipsychotic Prescription Patterns in 4345 Outpatients and Future Applications. PLoS ONE, 2016, 11 (10), pp.e0163796. 10.1371/journal.pone.0163796. http://dx.doi.org/10.1371/journal.pone.0163796

HAL Id: hal-01391499

https://hal.science/hal-01391499

Submitted on 26 May 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
<figure><img src="image_2.png" /></figure>

CrossMark

click for updates

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Berrouiguet S, Barrigón ML, Brandt SA, Ovejero-García S, Álvarez-García R, Carballo JJ, et al. (2016) Development of a Web-Based Clinical Decision Support System for Drug Prescription: Non-Interventional Naturalistic Description of the Antipsychotic Prescription Patterns in 4345 Outpatients and Future Applications. PLoS ONE 11 (10): e0163796. doi:10.1371/journal. pone.0163796

**Editor:** Therese van Amelsvoort, Maastricht University, NETHERLANDS

**Received:** February 26, 2016

**Accepted:** September 14, 2016

**Published:** October 20, 2016

**Copyright:** © 2016 Berrouiguet et al. This is an open access article distributed under the terms of the [Creative Commons Attribution License](http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** Data are from the MEmind study whose authors may be contacted at ebacgar2@yahoo.es.

**Funding:** The present study has been supported by the French embassy in Madrid (Spain), the Fondation de France and Instituto de Salud Carlos III co-founded by Fondo Europeo de Desarrollo Regional - FEDER (PI13/02200 grant).

RESEARCH ARTICLE

# Development of a Web-Based Clinical Decision Support System for Drug Prescription: Non-Interventional Naturalistic Description of the Antipsychotic Prescription Patterns in 4345 Outpatients and Future Applications

Sofian Berrouiguet¹,²*, Maria Luisa Barrigón³, Sara A. Brandt⁴, Santiago Ovejero-García³, Raquel Álvarez-García⁵, Juan Jose Carballo³, Philippe Lenca², Philippe Courtet⁶, MEmind Study Group¶, Enrique Baca-García⁷,⁸,⁹,¹⁰,¹¹,¹²

1 Department of Psychiatry and Emergency, Brest Medical University Hospital, Brest, France, 2 Logics in Uses, Social Science and Information Science department, Telecom Bretagne, Plouzané, France,

3 Department of Psychiatry at Fundación Jimenez Diaz Hospital, Madrid, Spain, 4 Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, United States of America,

5 Department of Psychiatry, University Hospital Rey Juan Carlos, Móstoles, Madrid, Spain, 6 INSERM U888, Department of Psychiatry, Montpellier University Hospital, Montpellier, France, 7 Department of Psychiatry, IIS-Jimenez Diaz Foundation, Madrid, Spain, 8 Department of Psychiatry, University Hospital Infanta Elena, Valdemoro, Spain, 9 Department of Psychiatry, University Hospital Rey Juan Carlos, Móstoles, Spain, 10 Department of Psychiatry, General Hospital of Villalba, Autonoma University, Madrid, Spain, 11 CIBERSAM, Madrid, Spain, 12 Columbia University, New York, NY, United States of America

¶ Membership of the MEmind Study Group is provided in the Acknowledgments

* sofian.berrouiguet@chu-brest.fr

## Abstract

### Purpose

The emergence of electronic prescribing devices with clinical decision support systems (CDSS) is able to significantly improve management pharmacological treatments. We developed a web application available on smartphones in order to help clinicians monitor prescription and further propose CDSS.

### Method

A web application (www.MEmind.net) was developed to assess patients and collect data regarding gender, age, diagnosis and treatment. We analyzed antipsychotic prescriptions in 4345 patients attended in five Psychiatric Community Mental Health Centers from June 2014 to October 2014. The web-application reported average daily dose prescribed for antipsychotics, prescribed daily dose (PDD), and the PDD to defined daily dose (DDD) ratio.
**Competing Interests:** The authors have declared that no competing interests exist.

## Results

The MEmind web-application reported that antipsychotics were used in 1116 patients out of the total sample, mostly in 486 (44%) patients with schizophrenia related disorders but also in other diagnoses. Second generation antipsychotics (quetiapine, aripiprazole and long-acting paliperidone) were preferably employed. Low doses were more frequently used than high doses. Long acting paliperidone and ziprasidone however, were the only two antipsychotics used at excessive dosing. Antipsychotic polypharmacy was used in 287 (26%) patients with classic depot drugs, clotiapine, amisulpride and clozapine.

## Conclusions

In this study we describe the first step of the development of a web application that is able to make polypharmacy, high dose usage and off label usage of antipsychotics visible to clinicians. Current development of the MEmind web application may help to improve prescription security via momentary feedback of prescription and clinical decision support system.

## Introduction

Since their first introduction in the 1950s, antipsychotic medications have been used to treat a growing array of conditions. While first approved as treatment for schizophrenia [1], their use has rapidly extended to other disorders. Currently, FDA-approved uses of typical antipsychotics include schizophrenia, bipolar disorder, psychotic disorders in general, agitation, hyperactivity, Tourette syndrome, generalized nonpsychotic anxiety, and severe behavioural problems [2]. The applicability of these drugs increased only further with the introduction of atypical antipsychotics [3]. These are now approved to treat conditions that range from autism to major depressive disorder (MDD) [4].

Nonetheless, off label use of antipsychotic drugs is still an extended practice. Prescribing antipsychotic drugs to treat unapproved conditions and employing excessive doses are two of the most common examples. In particular, antipsychotics have been regularly used to treat behavioural symptoms in elderly patients with dementia, despite conflicting evidence to support it [5]. In fact, the percentage of patients with FDA-unapproved disorders taking antipsychotics in the US has been estimated to range from 60% to 83% [6,7], with an estimated cost in 2008 of $6.0 billion [6].

Finally, many patients are treated with two or more antipsychotic drugs in combination, although its effectiveness remains to be demonstrated [8,9]. Antipsychotic polypharmacy refers to the co-prescription of more than one antipsychotic drug for an individual patient [10]. In outpatient settings, antipsychotic polypharmacy is somewhat less frequent when compared to inpatient populations, possibly due to lesser illness severity. However, in a large cohort in the US consisting of outpatients from three different health care settings, Sun et al. [11] reported that approximately one fifth of those with psychotic disorders were under a treatment schedule consisting of more than one antipsychotic drug. In Canada, Procyshyn et al. [12] reported an antipsychotic polypharmacy prevalence of 25.7% in outpatients. Furthermore, in a European outpatient setting, Novick et al. [9] reported polypharmacy in approximately one third of the patients, with a tendency for a slight increase during a one year follow up. A recent review further reported that among adults, off label prescription consisted of 40 to 75% of all antipsychotic prescriptions [13]. Antipsychotic polypharmacy is common. Evidence of efficacy
however, is limited to small randomized controlled clinical trials, case reports, and individual
clinician experience. At the same time, antipsychotic polypharmacy has been associated with
an increased risk of metabolic syndrome [14], higher healthcare costs [15], and possibly mor-
tality [16].

Over the last decade, medical prescription security has been supported by the emergence of electronic health records (EHRs) and clinical decision support systems (CDSS) that facilitate portability and processing of pertinent health information related to pharmacological treatment [17]. This has helped monitor prescription patterns that include off label use, polypharmacy and high dosage. Inter-institutional EHRs are used to further increase efficiency in medical services and provide complete and accurate medical information across providers in different institutions [18]. CDSS are made possible by digitalization of clinical data. Their purpose is to improve clinical management, methodological contributions, sensitivity and simulation tools in order to evaluate the clinical impact of the prescription decisions. The emergence of electronic prescribing devices with decision support systems significantly reduces error rates [19]. They also reveal an important source of epidemiological insight about how treatment is prescribed and taken, although these are extremely expensive and are not widely implemented. However, current EHRs often fall short of delivering readily available, compiled and tailored medical knowledge regarding the patient to the clinician [20]. The availability of handheld computing provides the opportunity to implement many of these gains to institutions where e-prescribing systems are not yet accessible. The increasing availability of smartphone technology permits the gathering of naturalistic data that can be processed immediately and provide instantaneous decision making assistance to clinicians.

A pioneer project in the 1980s programmed drug monitoring systems to identify evidence-
based medication practices in 11 New York State Institutions for Mental Health and Develop-
mental Disabilities. The results of the study showed that the surveillance techniques improved
prescribing practices [21]. EHRs are now used routinely and are a major source of structured
data. In a naturalistic, observational, retrospective, non-interventional study, Gavirina et al.
[22] were able to describe prescription habits in a sample of 1700 patients suffering from
schizophrenia. The data were gathered from computerized or e-medical records that were reg-
istered in the electronic medical record and implemented in all centers of the network that per-
formed the assessment.

However, these systems present some limits that are related to the methodology of such
studies; observational studies based on retrospective analysis of EHR data. For example routine
practice data are collected for billing or institutional purposes. The re-use of these data to
advance clinical research can be challenging [23]. The timing, quality, and comprehensiveness
of clinical data are often not consistent with research standards [24]. Accuracy (correctness) of
data relies on correct and careful documentation, which is often difficult to perform though
most EHR used in routine. Furthermore, due to the architecture of traditional EHR, data can-
not be processed instantaneously to deliver a CDSS, which requires a double task of de-identifi-
cation of the data, and statistical analysis out of the software core. Most studies describing
antipsychotic habits use retrospective methods [25]. By doing so, researchers and clinicians
miss the opportunity to process gathered data in the moment and use them for CDSS purposes.
The use of electronic records for decision support at a clinical level is still not widely reported.
EHRs are usually commercial software only accessible from computers having wired connec-
tion. This characteristic excludes systematic assessment of outpatients that are treated by pri-
mary care services or those that are hospitalized out of the mainstream care services.

Taking into consideration the strengths and pitfalls of each of these monitoring strategies,
we developed a web application that is able to adapt to any common routine follow-up strategy
and research protocol in medicine. The growth and popularity of mHealth apps (health-related
software applications), their ease of use and their cost of development compared to traditional
software make them particularly suitable for the task of prescription monitoring.

Our Hypothesis was that a web application developed for this study may be able to describe clinician prescriptions. The objective of this study was to describe, via the Memind web-appli-cation, the prescription patterns of antipsychotics in a naturalistic outpatient setting in five Psychiatric Community Mental Health Centers in Madrid, Spain. We focused primarily on off label uses and antipsychotic polypharmacy.

**Materials and Methods**

Study setting

Four thousand nine hundred and seventy-five patients received psychiatric care in five Psychi-
atric Community Mental Health Centers (Moncloa Mental Health Center, Arganzuela Mental
Health Center, Infanta Elena Hospital, Valdemoro Mostoles Hospital, Hospital 12 de Octubre
Hospital) part of the Psychiatry Department of Fundacion Jimenez Diaz in Madrid, Spain, dur-
ing the study period (from June 2014 to October 2014). This department is part of the National
Health Service and provides medical coverage financed by taxes to a catchment area of 800,000
people. Fifty-five clinicians of the Memind study group participated in the patient recruitment
process. Outpatients were assessed during routine medical visit by these clinicians. The clini-
cian also created a profile in the MEmind web application for each patient that met the inclu-
sion criteria and agreed to participate.

Patient inclusion and exclusion criteria

Inclusion criteria were either male or female outpatients, aged 18 or older, who gave written informed consent. Participants were excluded from the study if they were under the age of 18, incarcerated, under guardianship, enrolled in other trials, or were in emergency situations where their state of health did not allow for obtaining written informed consent.

Material

The web application was specifically developed for Android and OSX Smartphones, Tablets and the Mac and PC versions of Mozilla Firefox and Google Chrome. It is available in three lan-guages (English, French, Spanish). The web application has two distinct interfaces. The “elec-tronic health record” view is designed for use by health care providers during clinical rounds and medical or nursing visits. It has been designed to cover all the data acquired during a stan-dard psychiatric evaluation, including sociodemographic, diagnostic and pharmacological treatment information. Furthermore, it is based on commonly stored information in mental health management. A large customizable choice of relevant scales can be added by the care provider to the basic evaluation. The patient view was also developed and will allow patients to be monitored with ecological momentary assessment (EMA) tools in future studies. Patient had no access to this function for the present study.

Three different user profiles exist: 1) for patients; 2) for caregivers/family; and 3) for mental health professionals. For the purposes of this study we only used the mental health professional profile (Fig 1). During this study, patients did not have access to the web application. If they agreed to participate to the study, they only agreed to allow their clinician to enter their per-sonal data into the MEmind web application. The patients were still treated as usual.

Each patient was identified by a numeric code that ensures patient anonymity. This code is encrypted in the database that remained the same throughout all contact with patients cared for during the study.
<figure><img src="image_4.png" /><figcaption>Fig 1. The MEmind web application as viewed from an OSX tablet.</figcaption></figure>

doi:10.1371/journal.pone.0163796.g001

## Baseline assessment

For this study, variables collected for each patient profile were sex, age, diagnosis and treatment. Clinical diagnoses were made by psychiatrists or clinical psychologists, coded according to the ICD-10 [26] for mental disorders, and entered manually into the MEmind web-application. Diagnoses were assigned by the clinician, not automatically done by the application. Allocation of information was done by the clinician via the clinician interface of the web application.

## Outcomes measures

Pharmacological treatment was registered with our web tool and then classified according to the Anatomical Therapeutic Chemical (ATC) classification system and the defined daily dose (DDD) [27]. We calculated the average of daily dose prescribed for antipsychotics (N05A ATC code), Prescribed Daily Dose (PDD), and the PDD to DDD ratio. Although ATC classification includes lithium and antipsychotics under the N05A code, for the purpose of this study we only included antipsychotics. In order to compare dosages of the various antipsychotics we used a fixed unit of measurement based on dividing the prescribed daily dose (PDD) by the defined daily dose (DDD). A PDD/DDD ratio greater than 1.5 was defined as excessive dosing [12]. We performed double verification of the results using the SSPS version 22.0 package.

## Ethical considerations

The research was in compliance with the Code of Ethics of the World Medical Association (Declaration of Helsinki) and the standards established by the Institutional Review Board and granting agency. All the participants provided written informed consent, after the complete description of the study. Previously, the research protocol was approved by the local (Fundacion Jimenez Diaz) Ethics Committee.
<table><caption>Table 1. Prevalence of psychiatric disorders (n = 4975).</caption><thead><tr><th>Psychiatric disorder</th><th>N (4975)</th><th>%</th></tr></thead><tbody><tr><td>F0-F09 Organic, including symptomatic, mental disorders</td><td>85</td><td>2.0</td></tr><tr><td>F10-F19 Mental and behavioural disorders due to psychoactive substance use</td><td>314</td><td>7.2</td></tr><tr><td>F20-F29 Schizophrenia, schizotypal and delusional disorders</td><td>574</td><td>13.2</td></tr><tr><td>F30-F39 Mood [affective] disorders</td><td>1221</td><td>28.1</td></tr><tr><td>F40-F48 Neurotic, stress-related and somatoform disorders</td><td>1956</td><td>45.0</td></tr><tr><td>F50-F59 Behavioural syndromes associated with physiological disturbances and physical factors</td><td>176</td><td>4.1</td></tr><tr><td>F60-F69 Disorders of adult personality and behaviour</td><td>475</td><td>10.9</td></tr><tr><td>F70-F79 Mental retardation</td><td>41</td><td>0.9</td></tr><tr><td>F80-F89 Disorders of psychological development</td><td>10</td><td>0.2</td></tr><tr><td>F90-F98 Behavioural and emotional disorders with onset usually occurring in childhood and adolescence</td><td>74</td><td>1.7</td></tr><tr><td>F99-F99 Unspecified mental disorder</td><td>49</td><td>1.1</td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t001

# Results

## Diagnoses and sample characteristics

Out of the 4975 outpatients that received psychiatric care during study period, 4345 agreed to participate to the study. The distribution of psychiatric disorders attended in our outpatient units is shown in Table 1, and the distribution of the most common disorders according to age and gender is shown in Table 2.

Out of our total sample, 3640 patients had one psychiatric diagnosis, with anxiety and related disorders (F40-F49) being the more frequent diagnoses. The rest of the patients showed a co-morbid condition. Antipsychotics were used in 1116 patients (25% of total patients), 829 (74%) in monotherapy and 287 (26%) in poly-therapy (for detail see Table 3).

## Antipsychotic pattern use

Concerning diagnoses, as a simple diagnosis or comorbidity, out of the 1116 patients in which antipsychotics were prescribed, 44% of them (486 patients) were used in patients with

<table><caption>Table 2. Age and gender distribution of most common psychiatric disorders (n = 4354).</caption><thead><tr><th></th><th></th><th>Schizophrenia and other<br>psychoses (n = 574; 13.2%)</th><th>Mood disorders<br>(n = 1221; 28.1%)</th><th>Neurotic, stress related and<br>somatoform disorders (n = 1956;<br>45.0%)</th><th>Personality disorder<br>(n = 475; 10.9%)</th><th>Total<br>(n = 4345)</th></tr></thead><tbody><tr><td rowspan="4">Age n (%)</td><td>18–35<br>years</td><td>132 (23%)</td><td>146 (12%)</td><td>424 (21.7%)</td><td>114 (24.1%)</td><td>890 (20.5%)</td></tr><tr><td>35–50<br>years</td><td>232 (40.5%)</td><td>329 (27%)</td><td>733 (37.5%)</td><td>208 (43.6%)</td><td>1517<br>(34.9%)</td></tr><tr><td>50–65<br>years</td><td>160 (27.8%)</td><td>446 (36.5%)</td><td>561 (28.7%)</td><td>119 (25.1%)</td><td>1304 (30%)</td></tr><tr><td>&gt;65<br>years</td><td>50 (8.6%)</td><td>300 (24.5%)</td><td>238 (12.2%)</td><td>35 (7.3%)</td><td>634 (14.6%)</td></tr><tr><td rowspan="4">Gender n<br>(%)</td><td>p-value</td><td>&lt;0.001</td><td>&lt;0.001</td><td>&lt;0.001</td><td>&lt;0.001</td><td></td></tr><tr><td>Female</td><td>377 (65.6%)</td><td>855 (70.0%)</td><td>1330 (68.0%)</td><td>275 (57.9%)</td><td>1621 (62%)</td></tr><tr><td>Male</td><td>197 (34.4%)</td><td>366 (30.0%)</td><td>626 (32.0%)</td><td>200 (42.1%)</td><td>2724<br>(37.3%)</td></tr><tr><td>p-value</td><td>&lt;0.001</td><td>&lt;0.001</td><td>&lt;0.001</td><td>0.024</td><td></td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t002
<table><caption>Table 3. Antipsychotic monotherapy and polypharmacy according diagnosis (n = 1116).</caption><thead><tr><th>Diagnosis</th><th></th><th>Patient with specific diagnostic N (%)</th><th>Antipsychotic use</th><th>Antipsychotic monotherapy</th><th>Antipsychotic polypharmacy</th></tr></thead><tbody><tr><td rowspan="10">One diagnosis</td><td>F0-F09</td><td>44 (1.0%)</td><td>26 (2.3%)</td><td>23 (2.8%)</td><td>3 (1%)</td></tr><tr><td>F10-F19</td><td>111 (2.6%)</td><td>26 (2.3%)</td><td>24 (2.9%)</td><td>2 (0.7%)</td></tr><tr><td>F20-F29</td><td>476 (11.0%)</td><td>462 (41.4%)</td><td>305 (36.8%)</td><td>157 (54.7%)</td></tr><tr><td>F30-F39</td><td>966 (22.2%)</td><td>268 (24%)</td><td>204 (24.6%)</td><td>64 (22.2%)</td></tr><tr><td>F40-F49</td><td>1630 (37.5%)</td><td>82 (7.3%)</td><td>78 (9.4%)</td><td>4 (1.4%)</td></tr><tr><td>F50-F59</td><td>101 (2.3%)</td><td>9 (0.8%)</td><td>9 (1.1%)</td><td>0 (0%)</td></tr><tr><td>F60-F69</td><td>203 (4.7%)</td><td>69 (6.1%)</td><td>60 (7.2%)</td><td>9 (3.1%)</td></tr><tr><td>F70-F79</td><td>22 (0.5%)</td><td>13 (1.2%)</td><td>9 (1.1%)</td><td>4 (1.4%)</td></tr><tr><td>F90-F99</td><td>87 (2%)</td><td>7 (0.62%)</td><td>7 (0.8%)</td><td>0 (0%)</td></tr><tr><td rowspan="11">Comorbidity</td><td>F0-F09 + F30-F39</td><td>15 (0.3%)</td><td>11 (1%)</td><td>8 (1%)</td><td>3 (1.0%)</td></tr><tr><td>F10-F19 + F20-F29</td><td>23 (0.5%)</td><td>23 (2%)</td><td>11 (1.3%)</td><td>12 (4.2%)</td></tr><tr><td>F10-F19 + F30-F39</td><td>33 (0.8%)</td><td>12 (1%)</td><td>8 (1%)</td><td>4 (1.4%)</td></tr><tr><td>F10-F19 + F40-F49</td><td>36 (0.8%)</td><td>5 (0.4%)</td><td>5 (0.6%)</td><td>0 (0%)</td></tr><tr><td>F10-F19 + F60-F69</td><td>23 (0.5%)</td><td>9 (0.8%)</td><td>7 (0.8%)</td><td>2 (0.7%)</td></tr><tr><td>F20-F29 + F40-F49</td><td>13 (0.3%)</td><td>12 (1%)</td><td>10 (1.2%)</td><td>2 (0.7%)</td></tr><tr><td>F20-F29 + F60-F69</td><td>13 (0.3%)</td><td>12 (1%)</td><td>6 (0.7%)</td><td>6 (2.1%)</td></tr><tr><td>F30-F39 + F40-F49</td><td>47 (1.1%)</td><td>8 (0.7%)</td><td>6 (0.7%)</td><td>2 (0.7%)</td></tr><tr><td>F30-F39 + F50-F59</td><td>17 (0.4%)</td><td>1 (0.1%)</td><td>0 (0%)</td><td>1 (0.3%)</td></tr><tr><td>F30-F39 + F60-F69</td><td>83 (1.9%)</td><td>32 (2.9%)</td><td>22 (2.7%)</td><td>10 (3.5%)</td></tr><tr><td>F40-F49 + F40-F49</td><td>73 (1.7%)</td><td>10 (0.9%)</td><td>10 (1.2%)</td><td>0 (0%)</td></tr><tr><td>F40-F49 + F50-F59</td><td>32 (0.7%)</td><td>1 (0.1%)</td><td>1 (0.1%)</td><td>0 (0%)</td></tr><tr><td>F40-F49 + F60-F69</td><td>73 (1.7%)</td><td>18 (1.6%)</td><td>16 (1.9%)</td><td>2 (0.7%)</td></tr><tr><td>Other combinations</td><td></td><td>224 (5.2%)</td><td>0 (0%)</td><td>0 (0%)</td><td>0 (0%)</td></tr><tr><td colspan="2">TOTAL</td><td>4345</td><td>1116 (26%)</td><td>829 (19%)</td><td>287 (6.6%)</td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t003

schizophrenia and related disorders, 28% (309 patients) in affective disorders, 13% (140 patients) in personality disorders, and 136 (12%) in anxiety and related disorders. It is interesting to note that 14 patients with schizophrenia and related disorders did not receive antipsychotics (Table 3).

Out of the 1116 patients using antipsychotics, 1475 antipsychotic prescriptions were made. Out of the 829 patients (74%) using an antipsychotic as a monotherapy, antipsychotics were the only therapy used for 185 (185/829, 22%) of them. The most common combination of antipsychotics with another psychotropic drug was with antidepressants (in 109 patients). Antipsychotics were used in polypharmacy regimen in 287 patients (26%). In 151 patients, the combinations were only used with other antipsychotics.

Table 4 shows the different antipsychotics prescribed, ATC/DDD classification and doses employed in our clinical practice. It is important to note that antipsychotics used in an excessive dosing were long-acting paliperidone and ziprasidone.
The proportion of polypharmacy for every antipsychotic and the dose used when antipsychotics were used alone or in combination are showed in Tables 5 and 6.

# Discussion

## Main findings

In this study, we described a method to perform naturalistic prospective data gathering regarding prescription habits via a web-based application available from a smartphone or any other Internet-connected wireless device. This observational study was the first step of the development of CDSS that may help care providers to better monitor their prescriptions. We found that antipsychotics were mostly used in schizophrenia and related disorders but also in other disorders, in both approved and off label indications. Antipsychotic polypharmacy was employed in 26% of prescriptions made. Second-generation antipsychotics were mainly chosen for prescriptions (quetiapine, aripiprazole and long-acting paliperidone). Excessive dosing was only found with long acting paliperidone and ziprasidone whereas the use of low doses was relatively common. In this study, we were able to identify polypharmacy high dose and off label use in an outpatient setting. These results provide information about drug management under real conditions and highlight discrepancies between guidelines and actual practice that could guide research in new uses for drugs.

## Limitations

The current study was performed in a naturalistic setting of patients treated as usual. Out of the 4975 outpatients that received psychiatric care during study period, 4345 agreed to

<table><caption>Table 4. Prescribed Daily Dose (PDD), and the PDD to defined daily dose ratio of antipsychotics (n = 1116).</caption><thead><tr><th>Number of prescriptions</th><th>Drug</th><th>ATC code</th><th>DD (mg)</th><th>Median PDD (mg)</th><th>Mean PDD (mg)</th><th>PDD (mg) IC 95%</th><th>PDD/DDD</th></tr></thead><tbody><tr><td>47</td><td>Amisulpride</td><td>N05AL05</td><td>400</td><td>400.00</td><td>520.21</td><td>401.63–638.79</td><td>1.30</td></tr><tr><td>262</td><td>Aripiprazole</td><td>N05AX12</td><td>15</td><td>10.00</td><td>12.76</td><td>11.68–13.84</td><td>0.85</td></tr><tr><td>88</td><td>Asenapine</td><td>N05AH05</td><td>20</td><td>7.50</td><td>9.29</td><td>8.07–10.51</td><td>0.46</td></tr><tr><td>3</td><td>Chlorpromazine</td><td>N05AA01</td><td>300</td><td>100.00</td><td>76.67</td><td>30.93–122.40</td><td>0.26</td></tr><tr><td>24</td><td>Clotiapine</td><td>N05AH06</td><td>80</td><td>40.00</td><td>37.20</td><td>31.71–42.69</td><td>0.47</td></tr><tr><td>65</td><td>Clozapine</td><td>N05AH02</td><td>300</td><td>280.00</td><td>287.92</td><td>254.42–321.43</td><td>0.96</td></tr><tr><td>16</td><td>Fluphenazine</td><td>N05AB02</td><td>1</td><td>0.89</td><td>0.89</td><td>0.72–1.05</td><td>0.89</td></tr><tr><td>25</td><td>Haloperidol</td><td>N05AD01</td><td>8</td><td>5.00</td><td>6.96</td><td>4.36–9.55</td><td>0.87</td></tr><tr><td>13</td><td>Levomepromazine</td><td>N05AA01</td><td>300</td><td>38.75</td><td>63.61</td><td>41.46–85.76</td><td>0.21</td></tr><tr><td>1</td><td>Levosulpiride</td><td>N05AL07</td><td>400</td><td>25.00</td><td>25.00</td><td></td><td>0.06</td></tr><tr><td>150</td><td>Olanzapine</td><td>N05AH03</td><td>10</td><td>10.00</td><td>9.82</td><td>8.66–10.98</td><td>0.98</td></tr><tr><td>104</td><td>Paliperidone</td><td>N05AX13</td><td>6</td><td>6.00</td><td>7.56</td><td>6.61–8.50</td><td>1.26</td></tr><tr><td>214</td><td>Long-acting paliperidone</td><td>N05AX13</td><td>2,5</td><td>3.57</td><td>4.41</td><td>4.17–4.65</td><td>1.76</td></tr><tr><td>1</td><td>Perphenazine</td><td>N05AB03</td><td>30</td><td>8.00</td><td>8.00</td><td></td><td>0.27</td></tr><tr><td>3</td><td>Pimozide</td><td>N05AG02</td><td>4</td><td>4.00</td><td>3.67</td><td>0.82–6.51</td><td>0.92</td></tr><tr><td>279</td><td>Quetiapine</td><td>N05AH04</td><td>400</td><td>100.00</td><td>194.35</td><td>170.76–217.95</td><td>0.49</td></tr><tr><td>110</td><td>Risperidone</td><td>N05AX08</td><td>5</td><td>3.00</td><td>4.15</td><td>3.51–4.79</td><td>0.83</td></tr><tr><td>5</td><td>Long-acting risperidone</td><td>N05AX08</td><td>2,7</td><td>3.57</td><td>3.57</td><td>1.65–5.49</td><td>1.32</td></tr><tr><td>1</td><td>Sertindole</td><td>N05AE03</td><td>16</td><td>4.00</td><td>4.00</td><td></td><td>0.25</td></tr><tr><td>2</td><td>Sulpiride</td><td>N05AL01</td><td>800</td><td>100.00</td><td>100.00</td><td></td><td>0.13</td></tr><tr><td>19</td><td>Tiapride</td><td>N05AL03</td><td>400</td><td>100.00</td><td>144.74</td><td>107.34–182.13</td><td>0.36</td></tr><tr><td>14</td><td>Ziprasidone</td><td>N05AE04</td><td>80</td><td>90.00</td><td>130.00</td><td>72.36–187.64</td><td>1.63</td></tr><tr><td>1</td><td>Zuclopenthixol</td><td>N05AF05</td><td>30</td><td>25.00</td><td>25.00</td><td></td><td>0.83</td></tr><tr><td>28</td><td>Zuclopenthixol depot</td><td>N05AF05</td><td>15</td><td>9.52</td><td>11.39</td><td>10.01–12.78</td><td>0.76</td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t004
<table><caption>Table 5. Proportion of antipsychotic polypharmacy compared with monotherapy (n = 1116).</caption><thead><tr><td>Drug</td><td>ATC code</td><td>Prescriptions N (%)</td><td>Monotherapy N (%)</td><td>Polypharmacy N (%)</td></tr></thead><tbody><tr><td>Amisulpride</td><td>N05AL05</td><td>47 (3.2%)</td><td>19 (40%)</td><td>28 (60%)</td></tr><tr><td>Aripiprazole</td><td>N05AX12</td><td>262 (17.6%)</td><td>181 (69%)</td><td>81 (31%)</td></tr><tr><td>Asenapine</td><td>N05AH05</td><td>88 (5.9%)</td><td>59 (67%)</td><td>29 (33%)</td></tr><tr><td>Chlorpromazine</td><td>N05AA01</td><td>3 (0.2%)</td><td>1 (33%)</td><td>2 (67%)</td></tr><tr><td>Clotiapine</td><td>N05AH06</td><td>24 (1.6%)</td><td>5 (21%)</td><td>19 (79%)</td></tr><tr><td>Clozapine</td><td>N05AH02</td><td>65 (4.4%)</td><td>22 (34%)</td><td>43 (66%)</td></tr><tr><td>Fluphenazine</td><td>N05AB02</td><td>16 (1.1%)</td><td>5 (31%)</td><td>11 (69%)</td></tr><tr><td>Haloperidol</td><td>N05AD01</td><td>25 (1.7%)</td><td>11 (44%)</td><td>14 (56%)</td></tr><tr><td>Levomepromazine</td><td>N05AA01</td><td>13 (0.9%)</td><td>10 (77%)</td><td>3 (23%)</td></tr><tr><td>Levosulpiride</td><td>N05AL07</td><td>1 (0.1%)</td><td>0</td><td>1 (100%)</td></tr><tr><td>Olanzapine</td><td>N05AH03</td><td>150 (10.0%)</td><td>102 (68%)</td><td>48 (32%)</td></tr><tr><td>Paliperidone</td><td>N05AX13</td><td>104 (7%)</td><td>63 (61%)</td><td>41 (39%)</td></tr><tr><td>Long-acting paliperidone</td><td>N05AX13</td><td>214 (14.4%)</td><td>118 (55%)</td><td>96 (45%)</td></tr><tr><td>Perphenazine</td><td>N05AB03</td><td>1 (0.1%)</td><td>1 (100%)</td><td>0</td></tr><tr><td>Pimozide</td><td>N05AG02</td><td>3 (0.2%)</td><td>2 (67%)</td><td>1 (33%)</td></tr><tr><td>Quetiapine</td><td>N05AH04</td><td>279 (18.8%)</td><td>176 (63%)</td><td>103 (37%)</td></tr><tr><td>Risperidone</td><td>N05AX08</td><td>110 (7.5%)</td><td>61 (55%)</td><td>49 (45%)</td></tr><tr><td>Long-acting risperidone</td><td>N05AX08</td><td>5 (0.3%)</td><td>4 (80%)</td><td>1 (20%)</td></tr><tr><td>Sertindole</td><td>N05AE03</td><td>1 (0.1%)</td><td>0</td><td>1 (100%)</td></tr><tr><td>Sulpiride</td><td>N05AL01</td><td>2 (0.1%)</td><td>2 (100%)</td><td>0</td></tr><tr><td>Tiapride</td><td>N05AL03</td><td>19 (1.3%)</td><td>15 (79%)</td><td>4 (21%)</td></tr><tr><td>Ziprasidone</td><td>N05AE04</td><td>14 (0.9%)</td><td>4 (29%)</td><td>10 (71%)</td></tr><tr><td>Zuclopenthixol</td><td>N05AF05</td><td>1 (0.1%)</td><td>0</td><td>1 (100%)</td></tr><tr><td>Zuclopenthixol depot</td><td>N05AF05</td><td>28 (1.9%)</td><td>5 (18%)</td><td>23 (82%)</td></tr><tr><td>TOTAL</td><td></td><td>1475</td><td>866 (58.7%)</td><td>609 (41%)</td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t005

participate to the study. It is likely that some patients were not asked to participate due to the supplementary burden of entering data into the MEmind web application. Furthermore, some patients did not meet the inclusion criteria or refused to participate. During the preliminary process of the study, clinicians pointed out that the monitoring of patient acceptability, including refusal and reason for refusal or agreement, would add an additional task to fulfill during the consultation. This could have altered the naturalistic setting required for the study. Another concern of clinicians was also that this monitoring would have provided information about individual performance toward recruitment process. For these reasons, patients not meeting the inclusion criteria, patients who were not asked to participate, and patients refusing to participate were considered to be “missing data”. Overall, 4345 were finally included in the final analysis. Thus, data were partially or totally missing for 630 patients (12%) that were not included in the final analysis.

## Type of antipsychotics used

In our practice, second-generation antipsychotics were more commonly used than classic antipsychotics, with quetiapine, aripiprazole and long-acting paliperidone representing the most prescribed antipsychotics. This prescription habit reflects how second-generation antipsychotics have become the first-line of treatment for schizophrenia because of their fewer extrapyramidal side effects [28–30].

The prevalent use of quetiapine reflects our outpatient setting with anxiety and mood disorders being the more frequent disorders. This also suggests greater approval and off label use of
<table><caption>Table 6. Antipsychotic doses when use in combination (n = 287).</caption><thead><tr><th rowspan="2">Drug</th><th rowspan="2">ATC code</th><th colspan="2">One antipsychotic</th><th colspan="2">Two antipsychotics</th><th colspan="2">Three antipsychotics</th><th colspan="2">Four antipsychotics</th></tr><tr><th>N (%)</th><th>Mean PDD (mg)</th><th>N (%)</th><th>Mean PDD (mg)</th><th>N (%)</th><th>Mean PDD (mg)</th><th>N (%)</th><th>Mean PDD (mg)</th></tr></thead><tbody><tr><td>Amisulpride</td><td>N05AL05</td><td>19 (2.2%)</td><td>315.79</td><td>22 (4.5%)</td><td>665.91</td><td>5 (4.7%)</td><td>720.00</td><td>1 (10%)</td><td>200.00</td></tr><tr><td>Aripiprazole</td><td>N05AX12</td><td>181 (21%)</td><td>11.01</td><td>71 (14.4%)</td><td>16.48</td><td>9 (8.4%)</td><td>17.22</td><td>1 (10%)</td><td>25.00</td></tr><tr><td>Asenapine</td><td>N05AH05</td><td>59 (6.8%)</td><td>8.01</td><td>23 (4.7%)</td><td>12.61</td><td>6 (5.6%)</td><td>9.17</td><td>0 (0%)</td><td></td></tr><tr><td>Chlorpromazine</td><td>N05AA01</td><td>1 (0.1%)</td><td>30.00</td><td>0 (0%)</td><td></td><td>2 (1.9%)</td><td>100.00</td><td>0 (0%)</td><td></td></tr><tr><td>Clotiapine</td><td>N05AH06</td><td>5 (0.6%)</td><td>34.00</td><td>13 (2.6%)</td><td>35.38</td><td>5 (4.7%)</td><td>48.00</td><td>1 (10%)</td><td>20.00</td></tr><tr><td>Clozapine</td><td>N05AH02</td><td>22 (2.5%)</td><td>248.64</td><td>40 (8.13%)</td><td>307.13</td><td>3 (2.8%)</td><td>320.00</td><td>0 (0%)</td><td></td></tr><tr><td>Fluphenazine</td><td>N05AB02</td><td>5 (0.6%)</td><td>0.63</td><td>8 (1.62%)</td><td>1.05</td><td>3 (2.8%)</td><td>0.89</td><td>0 (0%)</td><td></td></tr><tr><td>Haloperidol</td><td>N05AD01</td><td>11 (1.3%)</td><td>3.75</td><td>11 (2.2%)</td><td>9.34</td><td>2 (1.9%)</td><td>12.50</td><td>1 (10%)</td><td>5.00</td></tr><tr><td>Levomepromazine</td><td>N05AA01</td><td>10 (1.2%)</td><td>76.00</td><td>2 (0.4%)</td><td>100.00</td><td>1 (0.9%)</td><td>100.00</td><td>0 (0%)</td><td></td></tr><tr><td>Levosulpiride</td><td>N05AL07</td><td>0 (0%)</td><td></td><td>1 (0.2%)</td><td>25.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Olanzapine</td><td>N05AH03</td><td>102 (11.8%)</td><td>8.97</td><td>37 (7.5%)</td><td>11.96</td><td>10 (9.3%)</td><td>11.00</td><td>1 (10%)</td><td>5.00</td></tr><tr><td>Paliperidone</td><td>N05AX13</td><td>63 (7.3%)</td><td>6.57</td><td>31 (6.3%)</td><td>8.81</td><td>9 (8.4%)</td><td>10.67</td><td>1 (10%)</td><td>3.00</td></tr><tr><td>Long-acting paliperidone</td><td>N05AX13</td><td>118 (13.6%)</td><td>4.00</td><td>81 (16.5%)</td><td>4.81</td><td>15 (14%)</td><td>5.48</td><td>0 (0%)</td><td></td></tr><tr><td>Perphenazine</td><td>N05AB03</td><td>1 (0.1%)</td><td>8.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Pimozide</td><td>N05AG02</td><td>2 (0.23%)</td><td>2.50</td><td>1 (0.2%)</td><td>6.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Quetiapine</td><td>N05AH04</td><td>176 (20.3%)</td><td>158.45</td><td>79 (16.1%)</td><td>244.78</td><td>21 (19.6%)</td><td>309.52</td><td>3 (30%)</td><td>166.66</td></tr><tr><td>Risperidone</td><td>N05AX08</td><td>61 (7.0%)</td><td>3.12</td><td>41 (8.3%)*</td><td>5.30</td><td>7 (6.5%)</td><td>6.50</td><td>1 (10%)</td><td>3.00</td></tr><tr><td>Long-acting risperidone</td><td>N05AX08</td><td>4 (0.5%)</td><td>3.57</td><td>1 (0.2%)</td><td>3.57</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Sertindole</td><td>N05AE03</td><td>0 (0%)</td><td></td><td>1 (0.2%)</td><td>4.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Sulpiride</td><td>N05AL01</td><td>2 (0.2%)</td><td>100.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Tiapride</td><td>N05AL03</td><td>15 (1.7%)</td><td>140.00</td><td>3 (0.6%)</td><td>150.00</td><td>1 (0.9%)</td><td>200.00</td><td>0 (0%)</td><td></td></tr><tr><td>Ziprasidone</td><td>N05AE04</td><td>4 (0.5%)</td><td>65.00</td><td>7 (1.4%)</td><td>165.71</td><td>3 (2.8%)</td><td>133.33</td><td>0 (0%)</td><td></td></tr><tr><td>Zuclopenthixol</td><td>N05AF05</td><td>0 (0%)</td><td></td><td>1 (0.2%)</td><td>25.00</td><td>0 (0%)</td><td></td><td>0 (0%)</td><td></td></tr><tr><td>Zuclopenthixol depot</td><td>N05AF05</td><td>5 (0.6%)</td><td>9.52</td><td>18 (3.7%)</td><td>11.90</td><td>5 (4.7%)</td><td>11.43</td><td>0 (0%)</td><td></td></tr><tr><td>TOTAL</td><td></td><td>866</td><td></td><td>492</td><td></td><td>107</td><td></td><td>10</td><td></td></tr></tbody></table>

doi:10.1371/journal.pone.0163796.t006

quetiapine in recent years [30]. In this way, quetiapine could be used for generalized anxiety disorder [31], depression [32,33], insomnia [34] or dementia-related psychiatric symptoms [30,35].

## Range of diagnoses where antipsychotics were used and off label use

Consistent with findings in Spain [36], in our sample, around half of antipsychotic prescriptions were made in schizophrenia and related disorders while the rest were in other diagnoses. We also found that antipsychotics were prevalently utilized for mood disorders, personality disorders and, anxiety and related disorders (F40-F49 IDC codes) with more than 50% of prescriptions used in these three categories. As mood disorders include bipolar disorder, antipsychotic use is logical and expected. It is also important to remember approved and evidence based use of second generation antipsychotics in treatment-resistant depression (29,30). For anxiety and personality disorders, mainly represented by borderline personality disorder, antipsychotic use is not approved but widespread, with evidence based results on the topic [37,38]. A minority use of antipsychotics in our sample was made by participants with substance use disorders, mental retardation or ICD codes between F0 and F09 which includes dementia. These are uses consistent with those previously reported [39,40]. Patients with schizophrenia that did not have antipsychotic medication were patients in a change in treatment process (wash out period).

Considering the prevalent use of antipsychotics, it is interesting to reflect on how within complex situations, or even just daily clinical practice, solutions may be required that sometimes do
not fit guidelines. Additionally, it is common in psychiatric practice to treat symptoms against
diseases using the pharmacodynamic properties of drugs in order to guide treatment [41].

Antipsychotic polipharmacy

The 26% rate of antipsychotic polypharmacy found in our sample is consistent with rates in outpatient settings worldwide [9,11,12] and in Spain [42,43]. Guidelines accepted antipsychotic polypharmacy in cases of cross-titration, control of acute disturbances and clozapine augmentation [44,45]. As our study is a transversal observation of our sample, we cannot measure cases of cross-titration. Acute disturbances are more likely treated in an inpatient setting, so that is not a plausible explanation for our rates of polypharmacy. Concerning clozapine augmentation, we used this antipsychotic in polypharmacy in 66% of cases, but this still does not explain all the polypharmacy employed.

Interestingly, classic long acting antipsychotics were mostly used in polypharmacy, 82% of prescriptions of zuclopenthixol depot and 69% of fluphenazine, which may reflect a frequent and non-evidence based clinical practice in patients with chronic schizophrenia course [46].

Clotiapine is another classic antipsychotic more frequently used in combination (79% of prescriptions). This high rate of polypharmacy and the low dosage generally used of this drug (PDD/DDD = 0.47) probably highlights its use for its hypnotic properties rather than as an antipsychotic. Clotiapine is an antipsychotic with a rapid onset of action and a strong sedative effect, which explains its use in insomnia in psychotic and non-psychotic patients [47].

Finally, amisulpride is also used in combination (68%) more frequently than in monotherapy. It is commonly said that for amisulpride, polypharmacy is the rule rather than the exception [48]. Moreover, amisulpride may be particularly suitable for clozapine augmentation [49]. This is a probable use in our sample according to our data.

Antipsychotics dosing

According to our results, only two antipsychotics were employed at excessive dosing: long-acting paliperidone (PDD/DDD = 1.76) and ziprasidone (PDD/DDD = 1.63). This finding is consistent with previous knowledge; high doses are prevalent in hospitalized patients with schizophrenia [50,51] and less frequent in outpatient settings [52].

On the other hand, many antipsychotics were also used at low doses. This dosage use could be explained by the outpatient setting, where patients usually are in an established moment of the illness. Furthermore, antipsychotics are used in conditions other than psychosis, like insomnia in the case of clotiapine, chlorpromazine or levomepromazine, or mood and anxiety disorders or behaviour disorders in dementia, in the case of quetiapine. Special mention is needed for asenapine, an antipsychotic approved in Spain only for manic episodes in bipolar disorder. This narrow indication probably reflects its low dose usage.

Information for this study was obtained with a novel web tool, the mental state tracker MEmind. This device also has an interesting potential use in clinical research. Data collected by the provider are instantaneously transmitted to the database and made available for data mining. The system is also able to deliver alarms. In this pilot study we only made both raw data and graphic information about medical prescription available for the provider. We are currently assessing the possibility of incorporating, in the analysis, data proceeding directly from the patient that uses the EMA function of the program.

Future development and implementation

In this study, treatment related information was collected via the web-application but pro-
cessed secondarily by statistical software. As a result, it would have been possible to give
instantaneous feedback to the care provider. Programs also exist that are able to alarm care
providers about treatment interaction [53]. However, for the first step of the development of
our web application, we decided to only monitor prescription habits and disable momentary
feedback about treatment and alarm function of our web application. Alarms and feedback are
part of the decision making support process [54]. By enabling this function in our web applica-
tion, we probably would have faced the professional reluctance to welcome our web application
in a routine clinical setting. Many studies have encountered difficulties incorporating EHRs
into routine practices, especially when associated with CDSS. We are currently assessing pro-
fessional acceptability of the device in order to propose a CDSS to clinicians that could be easily
incorporated in their practice. Evaluating changes in routine practice caused by the use of the
Memind application would also be an objective.

The objective of this study was to describe the prescription habits of antipsychotics via the
Memind web-application. The Memind web application has Patient interface but this feature
was not enabled for the present study. As a result patient acceptability of the application was
not assessed, and neither was treatment adherence or symptom tracking using the EMA func-
tion. EMA involves repeated sampling of subjects' behaviors and experiences in real time, in
their natural environment. EMA has been successfully used for real-time self-reporting of
symptoms and behaviours. This feature will soon allow us to integrate data proceeding from
patient self-monitoring into CDSS.

Although many EHR CDSS have yet to be developed, their performance varies largely.
Approaches that foster the impact of CDSS often rely on improved alerting concerning evi-
dence-based recommendation or drug-drug interaction. We also believe that alerting could be
taken into account by implementing or refining a severity grading. For this very first step of
development, we only focused on the capacity of the web application to monitor prescription
[55]. However, smartphone technology gives us the opportunity to combine pharmacological
insight into analysis with idiosyncratic clinical data proceeding either from medical assessment
or patient. A promising challenge would be to further incorporate an alert algorithm into a
clinical dimension, for example integrating it into EMA data [56].

**Acknowledgments**

Authors would like to acknowledge Ivan de la Calle (Cabaro S.L.), for his implication in the
development of the MEmind program.

MEMind Study Group

Romain Billot, Mercedes Perez Rodriguez, David Delgado Gomez

**Fellows and PhD students:** Covadonga Bonal-Giménez, Rosa Ana Bello-Sousa, Ruth Polo-del Rio, Pedro Gutiérrez-Recacha, Iratxe Tapia-Jara, Marta Migoya-Borja, Elsa Arrua, Antonio Vian-Lains, Elena Hernando-Merino, Nora Palomar-Ciria, Leticia Serrano-Marugán, Alba Sedano-Capdevila, Marisa Herraiz, María Constanza Vera-Varela, Silvia Vallejo-Oñate

**QUINTANA-PONTO NES-FJD Hospital, Madrid:** Irene Caro-Cañizares, Mónica Jiménez-Giménez, Juncal Sevilla-Vicente, Olga Bautista, Sara María Bañón-González, María Luz Palacios, María Natalia Silva, Jaime Chamorro-Delmo, Marta González-Granado, Sergio Sánchez-Alonso, Ernesto José Verdura-Vizcaíno, Miren Iza, Lucía Villoria-Borrego, Sonia Carollo-Vivian, Rocío Navarro-Jiménez, Laura Mata-Iturralde, Javier Fernández-Aurrecoechea, Santiago Ovejero, Laura Muñoz-Lorenzo, Alba Rodriguez-Jover, Jorge Hernán Hoyos Marín, Carolina Vigil-López, Ana Rico-Romano, Rodrigo Carmona, Susana Amodeo-Escribano, Ana López-Gómez, Margarita Pérez-Fominaya
**VILLALBA Hospital, Madrid:** Ana Alcón-Durán, Juan Manuel García-Vega, Yago Cebolla-Meliá, Ezequiel Di Stasio, Pedro Martín-Calvo, Ana José Ortega, Marta Segura-Valverde

**INFANTA ELENA Hospital, Madrid:** Rosana Codesal-Julián, Luis Sánchez-Pastor, Edurne Crespo-Llanos, Ainara Frade-Ciudad, Marisa Martin-Calvo

**MOSTOLES Hospital, Madrid:** Laura de Andrés-Pastor Pablo Puras-Rico Miriam Agudo-Urbanos, Diego Laguna-Ortega, Sara Clariana-Martín, Eduardo Reguera-Nieto, Teresa Legido-Gil, María Guadalupe García-Jiménez, Pablo Portillo-de Antonio, Eva María Romero-Gómez, Sara González-Granado

## Author Contributions

**Conceptualization:** PL PC EBG.

**Data curation:** SB MLB SAB SOG RAG JJC PL PC EBG MEmind Study Group.

**Formal analysis:** SB MLB EBG.

**Funding acquisition:** SB EBG.

**Investigation:** SB EBG.

**Methodology:** SAB JJC PL PC EBG.

**Project administration:** EBG.

**Resources:** SB EBG.

**Software:** SB EBG.

**Supervision:** MLB EBG.

**Validation:** SB EBG.

**Visualization:** SB EBG.

**Writing – original draft:** SB MLB.

**Writing – review & editing:** SB MLB SAB SOG RAG JJC PL PC EBG MEmind Study Group.

## References

1. Leucht S, Cipriani A, Spineli L, Mavridis D, Örey D, Richter F, et al. Comparative efficacy and tolerability of 15 antipsychotic drugs in schizophrenia: a multiple-treatments meta-analysis. The Lancet. 2013; 382: 951–962. doi: 10.1016/S0140-6736(13)60733-3

2. Lauriello J, Ithman M, Gopalakrishna G. Does indication drive use, or does use drive indication? J Clin Psychiatry. 2015; 76: e366–367. doi: 10.4088/JCP.14com09755 PMID: 25830459

3. Effectiveness of Antipsychotic Drugs in Patients with Chronic Schizophrenia—NEJM [Internet]. [cited 21 Dec 2015]. Available: http://www.nejm.org/doi/full/10.1056/NEJMoa051688

4. Christian R, Saavedra L, Gaynes B, Sheitman B, Wines R, Jonas D, et al. Future Research Needs for First—and Second- Generation Antipsychotics for Children and Young Adults. Future Research Needs Paper No. 13. (Prepared by the RTI -UNC Evidence-based Practice Center under Contract No. 290 2007 10056 I.) [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; Fe; 2012. Available: http://www.effectivehealthcare.ahrq.gov/reports/final.cfm

5. Ballard C, Waite J. The effectiveness of atypical antipsychotics for the treatment of aggression and psychosis in Alzheimer's disease. Cochrane Database Syst Rev. 2006; CD003476. doi: 10.1002/14651858.CD003476.pub2 PMID: 16437455

6. Alexander GC, Gallagher SA, Mascola A, Moloney RM, Stafford RS. Increasing off-label use of anti-psychotic medications in the United States, 1995–2008. Pharmacoepidemiol Drug Saf. 2011; 20: 177–184. doi: 10.1002/pds.2082 PMID: 21254289
7. Hartung DM, Middleton L, McFarland BH, Haxby DG, McDonagh MS, McConnell KJ. Use of administrative data to identify off-label use of second-generation antipsychotics in a Medicaid population. Psychiatr Serv Wash DC. 2013; 64: 1236-1242. doi: 10.1176/appi.ps.005482012 PMID: 23999754

8. Faries D, Ascher-Svanum H, Zhu B, Correll C, Kane J. Antipsychotic monotherapy and polypharmacy in the naturalistic treatment of schizophrenia with atypical antipsychotics. BMC Psychiatry. 2005; 5: 26. doi: 10.1186/1471-244X-5-26 PMID: 15921508

9. Novick D, Ascher-Svanum H, Brugnoli R, Bertsch J, Hong J, Haro JM. Antipsychotic Monotherapy and Polypharmacy in the Treatment of Outpatients With Schizophrenia in the European Schizophrenia Outpatient Health Outcomes Study: J Nerv Ment Dis. 2012; 200: 637-643. doi: 10.1097/NMD. 0b013e31825bfd95 PMID: 22759944

10. Correll CU, Gallego JA. Antipsychotic Polypharmacy. Psychiatr Clin North Am. 2012; 35: 661-681. doi: 10.1016/j.psc.2012.06.007 PMID: 22929872

11. Sun F, Stock EM, Copeland LA, Zeber JE, Ahmedani BK, Morissette SB. Polypharmacy with antipsychotic drugs in patients with schizophrenia: trends in multiple health care systems. Am J Health-Syst Pharm AJHP Off J Am Soc Health-Syst Pharm. 2014; 71: 728-738. doi: 10.2146/ajhp130471 PMID: 24733136

12. Procyshyn RM, Honer WG, Wu TKY, Ko RWY, McIsaac SA, Young AH, et al. Persistent Antipsychotic Polypharmacy and Excessive Dosing in the Community Psychiatric Treatment Setting: A Review of Medication Profiles in 435 Canadian Outpatients. J Clin Psychiatry. 2010; 71: 566-573. doi: 10.4088/JCP.08m04912gre PMID: 20361903

13. Carton L, Cottencin O, Lapeyre-Mestre M, Geoffroy PA, Favre J, Simon N, et al. Off-Label Prescribing of Antipsychotics in Adults, Children and Elderly Individuals: A Systematic Review of Recent Prescription Trends. Curr Pharm Des. 2015; 21: 3280-3297. PMID: 26088115

14. Centorrino F, Masters GA, Talamo A, Baldessarini RJ, Öngür D. Metabolic syndrome in psychiatrically hospitalized patients treated with antipsychotics and other psychotropics. Hum Psychopharmacol. 2012; 27: 521-526. doi: 10.1002/hup.2257 PMID: 22996619

15. Baandrup L, Sørensen J, Lublin H, Nordentoft M, Glenthoj B. Association of antipsychotic polypharmacy with health service cost: a register-based cost analysis. Eur J Health Econ HEPAC Health Econ Prev Care. 2012; 13: 355-363. doi: 10.1007/s10198-011-0308-0 PMID: 21452062

16. Windfuhr K, Turnbull P, While D, Swinson N, Mehta H, Hadfield K, et al. The incidence and associated risk factors for sudden unexplained death in psychiatric in-patients in England and Wales. J Psycho-pharmacol Oxf Engl. 2011; 25: 1533-1542. doi: 10.1177/0269881110379288 PMID: 20952453

17. DesRoches CM, Campbell EG, Rao SR, Donelan K, Ferris TG, Jha A, et al. Electronic health records in ambulatory care—a national survey of physicians. N Engl J Med. 2008; 359: 50-60. doi: 10.1056/NEJMsa0802005 PMID: 18565855

18. Wang SJ, Middleton B, Prosser LA, Bardon CG, Spurr CD, Carchidi PJ, et al. A cost-benefit analysis of electronic medical records in primary care. Am J Med. 2003; 114: 397-403. PMID: 12714130

19. Schiff GD, Bates DW. Can electronic clinical documentation help prevent diagnostic errors? N Engl J Med. 2010; 362: 1066-1069. doi: 10.1056/NEJMp0911734 PMID: 20335582

20. Koppel R, Kreda DA. Healthcare IT usability and suitability for clinical needs: challenges of design, workflow, and contractual relations. Stud Health Technol Inform. 2010; 157: 7-14. PMID: 20543360

21. Siegel C, Alexander MJ, Dlugacz YD, Fischer S. Evaluation of a computerized drug review system: impact, attitudes, and interactions. Comput Biomed Res Int J. 1984; 17: 419-435.

22. Gaviria AM, Franco JG, Aguado V, Rico G, Labad J, de Pablo J, et al. A Non-Interventional Naturalistic Study of the Prescription Patterns of Antipsychotics in Patients with Schizophrenia from the Spanish Province of Tarragona. PLoS ONE. 2015; 10. doi: 10.1371/journal.pone.0139403 PMID: 26427051

23. Weiner MG, Embi PJ. Toward reuse of clinical data for research and quality improvement: the end of the beginning? Ann Intern Med. 2009; 151: 359-360. PMID: 19638404

24. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc JAMIA. 2013; 20: 144-151. doi: 10.1136/jamiajl-2011-000681 PMID: 22733976

25. Hersh WR, Weiner MG, Embi PJ, Logan JR, Payne PRO, Bernstam EV, et al. Caveats for the use of operational electronic health record data in comparative effectiveness research. Med Care. 2013; 51: S30-37. doi: 10.1097/MLR.0b013e31829b1dbd PMID: 23774517

26. World Health Organization. Tenth revision of the International Classification of Diseases and related health problems (ICD-10). Geneva, Switzerland: WHO; 1992.

27. WHOCC—Structure and principles [Internet]. [cited 4 Dec 2014]. Available: http://www.whocc.no/atc/structure_and_principles/
28. Leucht S, Pitschel-Walz G, Abraham D, Kissling W. Efficacy and extrapyramidal side-effects of the new antipsychotics olanzapine, quetiapine, risperidone, and sertindole compared to conventional anti-psychotics and placebo. A meta-analysis of randomized controlled trials. Schizophr Res. 1999; 35: 51–68. PMID: 9988841

29. Davis JM, Chen N, Glick ID. A meta-analysis of the efficacy of second-generation antipsychotics. Arch Gen Psychiatry. 2003; 60: 553–564. doi: 10.1001/archpsyc.60.6.553 PMID: 12796218

30. Carney AC. Efficacy of quetiapine off-label uses: data synthesis. J Psychosoc Nurs Ment Health Serv. 2013; 51: 11–18. doi: 10.3928/02793695-20130709-01 PMID: 23848159

31. Kreys T-JM, Phan SV. A Literature Review of Quetiapine for Generalized Anxiety Disorder. Pharmacother J Hum Pharmacol Drug Ther. 2015; 35: 175–188. doi: 10.1002/phar.1529 PMID: 25689246

32. Wright BM, Eiland EH, Lorenz R. Augmentation with Atypical Antipsychotics for Depression: A Review of Evidence-Based Support from the Medical Literature. Pharmacother J Hum Pharmacol Drug Ther. 2013; 33: 344–359. doi: 10.1002/phar.1204 PMID: 23456734

33. McElroy SL, Guerdjikova A, Mori N, Keck PE Jr. Therapeutic potential of new second generation anti-psychotics for major depressive disorder. Expert Opin Investig Drugs. 2010; 19: 1527–1544. doi: 10.1517/13543784.2010.538048 PMID: 21105856

34. Anderson SL, Vande Griend JP. Quetiapine for insomnia: A review of the literature. Am J Health-Syst Pharm AJHP Off J Am Soc Health-Syst Pharm. 2014; 71: 394–402. doi: 10.2146/ajhp130221 PMID: 24534594

35. Maher AR, Theodore G. Summary of the comparative effectiveness review on off-label use of atypical antipsychotics. J Manag Care Pharm JMCP. 2012; 18: S1–20.

36. Montejo AL, Majadas S, Mayoral F, Sanjuán J, Ros S, Olivares JM, et al. [Analysis of prescription patterns of antipsychotic agents in psychiatry]. Actas Esp Psiquiatr. 2006; 34: 323–329. PMID: 16991021

37. Gao K, Muzina D, Gajwani P, Calabrese JR. Efficacy of typical and atypical antipsychotics for primary and comorbid anxiety symptoms or disorders: a review. J Clin Psychiatry. 2006; 67: 1327–1340. PMID: 17017818

38. Stoffers JM, Lieb K. Pharmacotherapy for borderline personality disorder—current evidence and recent trends. Curr Psychiatry Rep. 2015; 17: 534. doi: 10.1007/s11920-014-0534-0 PMID: 25413640

39. Gentile S. Second-generation antipsychotics in dementia: beyond safety concerns. A clinical, systematic review of efficacy data from randomised controlled trials. Psychopharmacology (Berl). 2010; 212: 119–129. doi: 10.1007/s00213-010-1939-z PMID: 20661553

40. Zhornitsky S, Rizkallah É, Pampoulova T, Chiasson J-P, Stip E, Rompré P-P, et al. Antipsychotic Agents for the Treatment of Substance Use Disorders in Patients With and Without Comorbid Psychosis: J Clin Psychopharmacol. 2010; 30: 417–424. doi: 10.1097/JCP.0b013e3181e7810a PMID: 20631559

41. Schwartz T, Bodynerman K. Utilizing pharmacodynamic properties of second-generation antipsychotics to guide treatment. Drugs Today Barc Spain 1998. 2012; 48: 283–292. doi: 10.1358/dot.2012.48.17.45225 PMID: 22536570

42. Florez Menéndez G, Blanco Ramos M, Gómez-Reino Rodríguez I, Gayoso Diz P, Bobes García J. [Polipharmacy in the antipsychotic prescribing in practices psychiatric out-patient clinic]. Actas Esp Psiquiatr. 2004; 32: 333–339. PMID: 15529221

43. Bernardo M, Coma A, Ibáñez C, Zara C, Bari J, Serrano-Blanco A. Antipsychotic polypharmacy in a regional health service: a population-based study. BMC Psychiatry. 2012; 12: 42. doi: 10.1186/1471-244X-12-42 PMID: 22587453

44. Grupo de Trabajo de la Guía de Práctica Clínica sobre la Esquizofrenia y el Trastorno Psicótico Incipiente., Espanya., Ministerio de Sanidad y Consumo., Plan de Calidad para el Sistema Nacional de Salud (Espanya), Catalunya., Departament de Salut., et al. Guía de práctica clínica sobre la esquizofrenia y el trastorno psicótico incipiente. Barcelona: Gobierno de España, Ministerio de Sanidad y Consumo: Plan de Calidad para el Sistema Nacional de Salud: Generalitat de Catalunya, Departament de Salut; 2009.

45. Taylor D, Paton C, Kapur S. The Maudsley Prescribing Guidelines in Psychiatry. John Wiley & Sons; 2012.

46. Connolly A, Taylor D. Factors associated with non evidence-based prescribing of antipsychotics. Ther Adv Psychopharmacol. 2014; 4: 247–256. doi: 10.1177/2045125314540298 PMID: 25489476

47. Berk M, Rathbone J, Mandriota-Carpenter SL. Clotiapine for acute psychotic illnesses. Cochrane Database of Systematic Reviews. John Wiley & Sons, Ltd; 1996. Available: http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD002304.pub2/abstract
48. Linden M, Scheel T, Xaver Eich F. Dosage finding and outcome in the treatment of schizophrenic inpatients with amisulpride. Results of a drug utilization observation study. Hum Psychopharmacol Clin Exp. 2004; 19: 111–119. doi: 10.1002/hup.574 PMID: 14994321

49. Pani PL, Villagrán JM, Kontaxakis VP, Alptekin K. Practical Issues with Amisulpride in the Management of Patients with Schizophrenia. Clin Drug Investig. 2008; 28: 465–477. doi: 10.2165/00044011-200828080-00001 PMID: 18598092

50. Sim K, Su A, Leong JY, Yip K, Chong MY, Fujii S, et al. High dose antipsychotic use in schizophrenia: findings of the REAP (research on east Asia psychotropic prescriptions) study. Pharmacopsychiatry. 2004; 37: 175–179. doi: 10.1055/s-2004-827174 PMID: 15467975

51. Roh D, Chang J-G, Kim C-H, Cho H-S, An SK, Jung Y-C. Antipsychotic polypharmacy and high-dose prescription in schizophrenia: a 5-year comparison. Aust N Z J Psychiatry. 2014; 48: 52–60. doi: 10.1177/0004867413488221 PMID: 23671214

52. Ranceva N, Ashraf W, Odelola D. Antipsychotic Polypharmacy in Outpatients at Birch Hill Hospital: Incidence and Adherence to Guidelines. J Clin Pharmacol. 2010; 50: 699–704. doi: 10.1177/0091270009350625 PMID: 20056801

53. Horsky J, Schiff GD, Johnston D, Mercincavage L, Bell D, Middleton B. Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions. J Biomed Inform. 2012; 45: 1202–1216. doi: 10.1016/j.jbi.2012.09.002 PMID: 22995208

54. Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality. J Am Med Inform Assoc JAMIA. 2003; 10: 523–530. doi: 10.1197/jamia.M1370 PMID: 12925543

55. Classen DC, Phansalkar S, Bates DW. Critical drug-drug interactions for use in electronic health records systems with computerized physician order entry: review of leading approaches. J Patient Saf. 2011; 7: 61–65. doi: 10.1097/PTS.0b013e31821d6f6e PMID: 21577077

56. Runyan JD, Steenbergh TA, Bainbridge C, Daugherty DA, Oke L, Fry BN. A Smartphone Ecological Momentary Assessment/Intervention “App” for Collecting Real-Time Data and Promoting Self-Awareness. PloS One. 2013; 8: e71325. doi: 10.1371/journal.pone.0071325 PMID: 23977016