# Patient and physician perspectives of a smartphone application for depression: a qualitative study

Marie-Camille Patoz, Diego Hidalgo-Mazzei, Olivier Blanc, Norma Verdolini, Isabella Pacchiarotti, Andrea Murru, Laurent Zukerwar, Eduard Vieta, Pierre-Michel Llorca, Ludovic Samalin

<figure><img src="image_1.png" /></figure>

To cite this version:

Marie-Camille Patoz, Diego Hidalgo-Mazzei, Olivier Blanc, Norma Verdolini, Isabella Pacchiarotti, et al.. Patient and physician perspectives of a smartphone application for depression: a qualitative study. BMC Psychiatry, 2021, 21 (1), pp.65. 10.1186/s12888-021-03064-x. http://dx.doi.org/10.1186/s12888-021-03064-x

HAL Id: hal-04905461

https://uca.hal.science/hal-04905461v1

Submitted on 22 Jan 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH ARTICLE

Open Access

# Patient and physician perspectives of a smartphone application for depression: a qualitative study

<figure><img src="image_3.png" /></figure>

Check for
updates

Marie-Camille Patoz¹, Diego Hidalgo-Mazzei², Olivier Blanc¹,³, Norma Verdolini², Isabella Pacchiarotti², Andrea Murru², Laurent Zukerwar⁴, Eduard Vieta², Pierre-Michel Llorca¹,³ and Ludovic Samalin¹,³*

**Abstract**

**Background:** Despite an increasing number of smartphone apps, such therapeutic tools have not yet consistently demonstrated their efficacy and many suffer from low retention rates. To ensure the development of efficient apps associated with high adherence, we aimed to identify, through a user-centred design approach, patient and physician expectations of a hypothetical app dedicated to depression.

**Methods:** We conducted semi-structured interviews with physicians (psychiatrists and general practitioners) and patients who had experienced a major depressive episode during the last 12 months using the focus group method. The interviews were audio recorded, transcribed and analysed using qualitative content analysis to define codes, categories and emergent themes.

**Results:** A total of 26 physicians and 24 patients were included in the study. The focus groups showed balanced sex and age distributions. Most participants owned a smartphone (83.3% of patients, 96.1% of physicians) and were app users (79.2% of patients and 96.1% of physicians).

The qualitative content analysis revealed 3 main themes: content, operating characteristics and barriers to the use of the app. Expected content included the data collected by the app, aiming to provide information about the patient, data provided by the app, gathering psychoeducation elements, therapeutic tools and functionalities to help with the management of daily life and features expected for this tool. The "operating characteristics" theme gathered aims considered for the app, its potential target users, considered modalities of use and considerations around its accessibility and security of use. Finally, barriers to the use of the app included concerns about potential app users, its accessibility, safety, side-effects, utility and functioning. All themes and categories were the same for patients and physicians.

**Conclusions:** Physician and patient expectations of a hypothetical smartphone app dedicated to depression are high and confirmed the important role it could play in depression care. The key points expected by the users for such a tool are an easy and intuitive use and a personalised content. They are also waiting for an app that gives information about depression, offers a self-monitoring functionality and helps them in case of emergency.

**Keywords:** Smartphone, Mobile health, Application, Depression, Major depressive episode

<footnote>* Correspondence: Isamalin@chu-clermontferrand.fr
¹Department of Psychiatry, CHU Clermont-Ferrand, University of Clermont Auvergne, EA 7280 Clermont-Ferrand, France
²Fondation FondaMental, Hôpital Albert Chenevier, Pôle de Psychiatrie, Créteil, France
Full list of author information is available at the end of the article</footnote>
## Background

Depression is a common psychiatric disorder with a prevalence reaching more than 300 million people around the world [1]. Its impact on patients' psychosocial functioning and quality of life makes it a leading cause of disability worldwide [2, 3]. Despite the existence of effective treatments, such as antidepressants and cognitive-behavioural therapy, almost half of patients with depression stay untreated [4]. The appearance of computers and internet development in the '90s brought about the idea that technological devices could be used as therapeutic tools [5–8] so as to improve treatment rates [9].

In recent decades, the development of new technologies and their worldwide spread have led the way to new therapeutic and screening tools in mental health [10]. This field, called “mobile health” or “m-health” [11, 12], has seen exponential growth with more than 10,000 downloadable mental health smartphone applications (apps) associated with the extensive use of wearables such as smartbands or smartwatches [13]. Although m-health is a promising field for increasing access to mental health programmes, their current use in clinical practice is limited and most of the available apps have not yet consistently demonstrated their effectiveness in the management of depression [14]. Several causes may be considered regarding these two issues. First, most of the apps for depression fail to incorporate evidence-based practices or clinical expertise into their design [15–18]. Conversely, most of the scientifically validated apps are not available in apps stores [16, 19, 20]. Finally, m-health suffers from a low retention rate and engagement by users [21, 22] and is rarely integrated into clinical practice, relegating apps to a “self-medication tools” status [23, 24].

To overcome these issues, it could be of interest to implement a user-centred design approach to develop m-health tools to remain as close as possible to patient and physician expectations; this would facilitate both improved retention rates and app implementation in professional healthcare practice [21, 23].

Qualitative analysis is commonly used to assess patients' expectations in various domains. It has mostly been used to evaluate patients' use of pre-existing apps for depression [25, 26] or to explore the expectations of an app for depression in young people [27, 28]. To the best of our knowledge, no qualitative study has investigated both patient and physician expectations of a smartphone app dedicated to depression including patients with previous major depressive episodes (MDE), general practitioners and psychiatrists.

## Methods

### Study design

The perceptions and expectations of patients, general practitioners and psychiatrists concerning a hypothetical

smartphone app dedicated to depression were investigated by using a qualitative design with a focus group methodology. The focus group method has been chosen because it is a reliable way to assess the participants' expectations by facilitating the sharing of ideas and experiences among them.

The focus groups were conducted between November 2018 and May 2019 in France. Patients and physicians were allocated to separate groups. Psychiatrists and general practitioners were distributed randomly in the physicians groups.

## Sample and recruitment

Patients included were adults with a diagnosis of MDE in the last 12 months according to the Diagnostic and Statistical Manual of Mental Disorders - 4th edition, Text Revision (DSM-IV-TR) criteria [29]. They were required to understand and be fluent in French.

Physicians were psychiatrists or general practitioners working in the private and/or public sectors and dealing with patients with MDE in their clinical practice.

Eligible participants (patients and physicians) were screened by the investigator centres hosted by academic Departments of Psychiatry (Clermont-Ferrand, Lyon, Grenoble).

Physicians were solicited by email or by phone to participate.

Patients were recruited among in- and outpatient services of investigator centres. Those who gave consent to be contacted were followed up to arrange participation. The focus groups were held in the centre where the participants were recruited.

The study was carried out in accordance with ethical principles for medical research involving humans (WMA, Declaration of Helsinki). The assessment protocol was approved by the relevant ethical review board (CPP EST I, 2018-A01469-46). All subjects provided written informed consent to participate.

## Data collection

After a literature search on m-health and smartphone apps for depression, mirrored semi-structured interview guides have been established for patients and physicians (Additional file 1).

Before starting the session, patients completed a survey with their sociodemographic information, including age, gender and living place (urban or rural). They also indicated their smartphone and app use habits. Finally, the severity of their depressive symptoms was measured using the Inventory of Depressive Symptomatology (IDS-SR) questionnaire. The IDS-SR is a 30-item self-rated questionnaire assessing all the criterion symptom domains designated by the DSM-IV-TR [30].
Physicians' age, gender, type of practice (public or private), number of visits per week, number of patients with depression seen each week and smartphone and app use habits were assessed through a questionnaire.

Each focus group included 6 to 8 participants and lasted from 60 to 90 min. There was an interviewer and an observer present for each group (LS, MCP or OB), all familiar with and well trained in the focus group methodology. All focus groups were audio recorded and transcribed verbatim.

## Analysis

Data collection and analysis were conducted at the same time in accordance with established qualitative methodologies [31]. After a focus group was transcribed verbatim, it was fully read then independently and manually coded by two researchers (LS and MCP). To gain familiarity with the content, the transcripts were read several times. Each unit of text was then coded, a code being defined as a meaningful unit describing a section of text (for example, the code “Helping patient’s self-evaluation” described the following text section: “With a self-administered survey on the app, the patient could do self-assessments”). Codes were organised into categories (for example: “data provided by the app”, including codes such as “exercises” or “therapeutic tools”) and themes (for example, “content of the app”, including categories such as “features” or “data collected by the app”). The codes, categories and themes were compared and agreed upon among the research team. In the case of discrepancies between researchers, agreements were reached by individually clarifying the meaning of a code and discussing its interpretation until mutual consent was achieved. If necessary, the codes, categories and themes were updated. Team meetings were held to discuss and monitor coding consistency and to address the analytic validity of the identified themes. Moreover, the research team met to ensure that the findings were internally consistent and supported by the data from the participants’ interviews. After four patient focus groups and four physician focus groups, no new codes or categories were emerging, indicating the reaching of data saturation.

Patients and physicians respective focus groups have been analysed separately to identify the discrepancies between them. The two codebooks were then merged into a single codebook.

Sociodemographic data of the sample are presented as the mean (Standard Deviation, SD) for continuous variables and frequency distribution for categorical variables.

## Results

### Participant characteristics

The sample’s general characteristics are summarised in Table 1. A total of 24 patients and 26 physicians were included in the study.

For patients, the focus groups showed balanced sex (male/female ratio = 13/11) and age distributions (from 20 to 73 years). The mean ± SD age was 51.5 (± 15.5). Most of the patients had a smartphone (83.3%) and were app users (79.2%).

For physicians, the focus groups also showed balanced sex (male/female ratio = 13/13), age (from 31 to 67 years) and type of practice distributions (private/public ratio = 13/13). The mean ± SD age was 45.5 (± 12.2). Most of the physicians had a smartphone (96.1%) and were app users (96.1%).

## Identification of themes

All data were collected during the focus groups. Within-group consensus was rare, as the point of qualitative research is to highlight all the opinions and not to find a consensual one.

A content analysis of the verbatim data resulted in primary codes, which, after an inductive interpretation and

<table><caption>**Table 1** Sample characteristics (n = 50)</caption><thead><tr><th></th><th></th></tr></thead><tbody><tr><td><strong>Patient characteristics (N = 24)</strong></td><td><strong>Mean ± SD or n (%)</strong></td></tr><tr><td>Male</td><td>13 (54.1)</td></tr><tr><td>Age</td><td>51.5 ± 15.5</td></tr><tr><td>Urban living</td><td>11 (45.8)</td></tr><tr><td>IDS-SR score</td><td>36.9 ± 12.2</td></tr><tr><td>Phone owners</td><td>24 (100.0)</td></tr><tr><td>Smartphone owners</td><td>20 (83.3)</td></tr><tr><td>Android /IOS</td><td>18 (75) / 2 (8.3)</td></tr><tr><td>App users</td><td>19 (79.2)</td></tr><tr><td>App number</td><td>16.2 ± 19.0</td></tr><tr><td>Health App number</td><td>0.3 ± 0.6</td></tr><tr><td><strong>Physician characteristics (N = 26)</strong></td><td><strong>Mean ± SD or n (%)</strong></td></tr><tr><td>Male</td><td>13 (50.0)</td></tr><tr><td>Age</td><td>45.5 ± 12.2</td></tr><tr><td>Urban practice</td><td>24 (92.3)</td></tr><tr><td>General Practitioners</td><td>10 (38.5)</td></tr><tr><td>Private practice</td><td>13 (50.0)</td></tr><tr><td>Years of practice</td><td>15.8 ± 11.6</td></tr><tr><td>Visits per week</td><td>66.8 ± 50.0</td></tr><tr><td>Patients with depression seen per week</td><td>14.0 ± 11.0</td></tr><tr><td>Phone owners</td><td>26 (100.0)</td></tr><tr><td>Smartphone owners</td><td>25 (96.1)</td></tr><tr><td>Android/IOS</td><td>14 (53.9) / 11 (42.3)</td></tr><tr><td>App users</td><td>25 (96.1)</td></tr><tr><td>App number</td><td>28.9 ± 29.0</td></tr><tr><td>Health App number</td><td>2.8 ± 3.1</td></tr></tbody></table>

SD standard deviation, IDS-SR inventory of depressive symptomatology, IOS
iphone operating system
categorisation process, were structured within three themes (Table 2):

1. Content of the app

2. Operating characteristics

3. Barriers to the use of the app

## Theme 1: content of the app

### Data collected by the app

Patients and physicians felt that an ideal app should collect data about its users to ensure the delivery of a suitable content. They mentioned the creation of a profile for the patient using the app, with medical history and general information, including their interests and leisure activities.

Patients and physicians agreed on the need to assess symptoms. Opinions diverged on the way to do it, some considering the use of validated questionnaires and scales and others showing a preference for free texts or logbooks. Mood charts were described by patients and physicians as useful items. It was considered a good method to collect symptom descriptions, including their intensity, chronology, rhythm, evolution and their impact on patients' quality of life. In addition to the collection of symptoms, both patients and physicians mentioned the benefits of checking medication uptake, allowing a close monitoring of medication compliance.

> "With a self-administered survey on the app, the patient could do self-assessments. He could follow his clinical status and this could help him to realise 'I feel better than last week.'" Physician 1, group 3.

Among participants, physicians only discussed the interest of using passive phone data (data collected without the active action of the patient; i.e. the number of steps a day...), considered as a desirable feature in order to collect reliable information on patients' state without active participation. They were of the opinion that this

<table><caption>**Table 2** Analysis codebook</caption><thead><tr><td>Theme</td><td>Categories</td></tr></thead><tbody><tr><td rowspan="3">Content of the app</td><td>Data collected by the app</td></tr><tr><td>Data provided by the app</td></tr><tr><td>Features</td></tr><tr><td rowspan="5">Operating characteristics</td><td>Relevant population</td></tr><tr><td>Aims of the app</td></tr><tr><td>Modalities and frequency of use</td></tr><tr><td>Accessibility and visibility</td></tr><tr><td>Security</td></tr><tr><td rowspan="3">Barriers to the use of the app</td><td>Users and accessibility</td></tr><tr><td>Safety and side effects</td></tr><tr><td>Utility and functioning</td></tr></tbody></table>

approach would overcome patients' subjective assessments in order to obtain reliable and accurate data. Some physicians, however, were sceptical of this intrusive process and raised its possible non-acceptance by patients.

> "Collection of passive data. It is the most obvious interest point. [...] If we can get data from SMS and other messaging apps, we will have, in the end, really precise clinical indicators. The only comparable thing would be to discuss with a caregiver living with the patient 24/7." Physician 4, group 1.

### Data provided by the app

Patients and physicians suggested several tools that help them in daily life that should be integrated within the app. They included a diary to keep appointments and a phonebook to facilitate communication with healthcare professionals and associations.

Information about depression was also considered, organised in different sections: a clinical section with symptom descriptions, a medication section with therapeutic strategies, drug interaction and potential side effects, and a social section to help them with administrative tasks. The lack of knowledge about the disease has been pointed out to explain this need for information about depression. Furthermore, patients and physicians showed a real expectation of professional advice in various domains such as therapeutic adaptation in crisis or alternative medicines.

> "I would like to know, considering our usual medication, if we can take other drugs. Me for example, I take lithium, and with lithium, you cannot take, for example, non-steroidal anti-inflammatory drugs. So, maybe there are other drugs we cannot take?" Patient 1, group 3.

Patients and physicians also cited several exercises and therapeutic tools they would like to find in this app such as games, relaxation sessions or cognitive-behavioural therapy exercises. They explained that this kind of tool could be an easy way to extend the work initiated with the therapist in face-to-face visits. They also agreed on the necessity of specific content for physicians, including patient profiles, clinical and therapeutic recommendations based on clinical practice guidelines and a messaging service. This content could support physicians to optimise patient care and sustain interactions between patients and therapists, thus providing feedback regarding patients' mental states through the use of the app.

> "From the psychiatrist side, if I had to have such an app, I'd like to have therapeutic help finding the
next line of treatment. The app could use the previ-
ous treatment of the patient and even his medical
history to determine the best medication to use next."
Physician 4, group 3.

Among participants, only patients asked for other pa-
tients' testimonies, explaining they could feel comforted
by reading stories from other people struggling with de-
pression. They also expressed a need for a medical chat
room to receive reliable and adapted advice.

Features

Patients and physicians stated that the app should be tai-
lorable. Personalisation was seen as the best way to ob-
tain an app suitable for the greatest number of people
that is able to adapt to patients' clinical states and their
changes.

Various technical features were suggested, such as
automatic replies by notifications or SMS or through a
virtual interlocutor (i.e. chat bot). Patients and physi-
cians considered that the app could also use and collect
data provided by other connected tools (e.g. wearables)
to improve its capacity to assess patients' symptoms in
momentary ecological conditions.

Charts were described as being useful to display symp-
toms collected by the app. The use of different colours
and smileys was also cited as a smart method of
highlighting important information and giving the app a
friendly aspect.

"A diagram or a histogram, well visible, easy to read. We need something more ludic, intuitive and easy."
Physician 1, group 2.

Dealing with emergencies was a feature judged to be
essential to an app dedicated to depression by both pa-
tients and physicians. Different features were considered
for this purpose, from written advice provided by the
app to a call to their physician or family. Patients and
physicians agreed on the utility of a partnership with
emergency services to ensure a quick and reliable reac-
tion to a suicidal crisis.

"The app could send automatic replies in [the] case of symptoms worsening. It could be advice or suggestions. In [the] case of suicidal thoughts or immediate risk, the app could directly call the patient's physician."
Physician 6, group 1.

However, physicians expressed some concerns about
emergency management by the app, as developed in the
"security section". These concerns were not found in the
patients' groups.

Theme 2: operating characteristics of the app

Relevant population

Participants were invited to discuss an app dedicated to patients with depression; nonetheless, they emphasised the need for a tool dedicated to non-diagnosed patients. To facilitate and increase mental healthcare access, they suggested an app to screen, among the general population, people with a feeling of unease.

"...Do I feel good?' I think it could be interesting to help people to ask themselves this question before seeing a professional. Actually, patients know nothing about depression. They think: 'I'm just tired, I'm gonna rest and everything will be alright,' and [a] depression diagnosis is made really late. [...] Today people struggle with depression until they are exhausted. They don't have the opportunity to assess themselves. They don't find an app to know if they suffer from depression." Physician 3, group 2.

Patients and physicians also agreed on the necessity of an app, or a section of the app, dedicated to patients' caregivers, seen as an essential actor in depression care. They pointed out caregivers' usual lack of knowledge about depression and suggested that an app with information about depression and an indication of what they should do in the case of relapses could be useful.

Regarding the target users of an app dedicated to de-
pression, patients and physicians pointed out the risk of
difficulties in its implementation and use with patients
suffering from severe depression. They considered that it
should be preferable for patients suffering from mild to
moderate depression.

Finally, patients and physicians cited psychiatrists and
general practitioners among healthcare professionals who
could be connected and linked to patients' accounts.

Aims of the app

Patients and physicians suggested the app could have
different aims. These aims vary according to the targeted
users and their clinical state.

The four main objectives were screening, orientation,
information and monitoring. Screening and orientation
were associated with apps dedicated to the general
population, which could diagnose depression and refer
patients to a mental healthcare professional. Information
was considered in two ways: first, to sensitise the general
population to depression and to destigmatise it; sec-
ondly, within a psychoeducational perspective, for pa-
tients suffering from depression. Monitoring was
considered to overcome the memory bias encountered
in monthly follow-ups, with patients often remembering
how they felt for the few days preceding the visit or
focusing on the worst state they have encountered in that month, regardless of how long it had lasted.

> "Sometimes in visits you're asked, 'How are you doing? What happened since the last time?' And you have forgot! A useful thing could be a questionnaire to check your mental state and feelings everyday so you can show it to your physician on the next visit."
> 
> Patient 5, group 3.

The app was also considered by patients and physicians to be a reassurance tool, providing a presence during weekends and physicians' vacation time.

Physicians suggested other objectives not mentioned by patients. They considered the app to be of additional value in depression care, being an intermediate between them and their patients, allowing access to complementary information and facilitating the discussion of personal topics in visits, such as sexuality. It was also described as possibly promoting care adherence and reducing anxiolytic use through therapeutic education.

On the other hand, they only insisted on the creation of a social network allowed by the app, proposing a forum and chat feature for patients to share their experiences with their peers.

## Modalities and frequency of use

Opinions on the modalities and frequency of app use were numerous and strongly diverged among participants.

The optimal frequency of use ranged from daily to bi-weekly or only on the patient's request. Where some patients or physicians considered unlimited use of the app, others preferred to restrict its use to depressive episodes only.

> "I think this app should have [an] unlimited lifetime; it shouldn't stop. Even if it means we have to deactivate some features with time..."
> 
> Physician 2, group 4.

Only physicians discussed the possibility of naming a trusted person among the patient's entourage whose contact information (phone or email) would be registered in the app. The trusted person could be contacted (i.e. an alert by mail or SMS) by the app in case of an emergency or a reminder with their phone number could be displayed to make it easier for the patient to call them when they are feeling unwell. They also suggested the reception of patient data should occur during working hours only. Some even suggested data should only be shared during patient visits and that physicians should only be contacted through the app in the case of an emergency. To facilitate the use of the app and help them to gain time, data transfers to physicians' medical software were also considered.

> "When I see the patient in visit[s], I could log on the patient's app. I could even transfer what has been measured by the app on my medical software."
> 
> Physician 5, group 1.

Conversely, patients insisted on the need to be able to reach their physicians, or at least a mental healthcare professional each time they needed to, regardless of the time or day.

## Accessibility and communication around the app

Both patients and physicians felt that access to the app should be easy. They suggested it could benefit from good visibility on the web and be presented to patients through educational material available in physicians' waiting rooms.

> "So, when you write 'Am I depressive?' on an internet search engine, the first result should be this app, and you just have to click on it to download it."
> 
> Physician 1, group 2.

Access to the app was a dividing point, with participants in favour of unrestricted access in app stores and others suggesting an app available after medical prescription only.

Patients and physicians emphasised the need for a free app to ensure access for all patients with depression, regardless of their incomes.

## Security

The app's data security and privacy policies were discussed as being a fundamental requirement in both patient and physician groups. They agreed on access protected by a password or code. Data storage was a point of concern; participants considered that such a device requires dedicated secured servers to store and protect collected data.

> "It's problematic, we need storage [on a] secured server."
> 
> Physician 2, group 4.

As mentioned in the "features" section, physicians but not patients considered an app that would work on patients' phones only, with no professional dashboard, assuring strict confidentiality and limited access to data.

Physicians also insisted on medico-legal issues raised by mental health information transmission and emergency management. They emphasised the need for well-defined conditions of data transmission to physicians, keeping in mind that they would not check the app during nights or weekends and so there may be delays in emergency situations.
"The app could raise some medicolegal issues. If the patient tries to contact us, it's the same with e-mail, patients could believe or think we have received and processed his message. If we don't receive it, or [we receive it] too late, we could [be] held medically responsible." Physician 4, group 4.

## Theme 3: barriers to the use of the app

### Users and accessibility

Patients and physicians showed themselves to be sceptical about the ability of a patient to use the app during a depressive episode, regardless of severity. They insisted on the potential impact of depressive symptoms on the use of the app, such as cognitive dysfunction and anhedonia.

Costs and material access were pointed out as limitations of the democratisation of the app, making it a tool restricted to a privileged population. Patients and physicians also suggested that this kind of device could not be applied to all age groups, with the risk that older patients may struggle with the use of new technologies.

Only physicians described the risk of time consumption associated with the use of the app as a strong limitation. They worried about not being able to deal with the app in addition to their other professional duties. They also expressed doubts about their ability to integrate these tools into their daily practice.

"Let's take email: I read it once every two days. I cannot check it more often. I come back home really late, 11.30 pm sometimes. Checking mail and SMS and answering it takes a lot of time. Honestly, I don't think I could answer patients contacting me through an app." Physician 2, group 3.

### Safety and side-effects

Patients and physicians worried about potential side effects related to the use of the app. Anxiety was seen as a symptom that could be worsened or created by the app. Overuse of the app and social withdrawal were also suggested to be potential side effects. Participants assumed that the daily use of an app would keep users away from their relatives and so increase withdrawal symptoms already seen in depressive disorders.

The risk of a decrease in visit frequency with healthcare professionals was suggested, as well as a progressive replacement of the physicians by the app, both in evaluation and therapeutic aspects. Patients and physicians argued that the app could provide the therapist with a feeling of security and encourage them to space appointments out. They were particularly concerned about the risk of reducing the number of face-to-face visits, meaning for them a loss of human contact, considered as essential in depression care.

"Then I think we should be careful with these medical apps because in the end it will promote telemedicine: if all indicators are positive, the patient takes its treatments, he displays happy smileys, why [should we see] him in visits?" Physician 1, group 4.

### Utility and functioning

Among participants, some patients and physicians showed themselves to be sceptical about the utility of such an app. They expressed that they could not see any utility in it, thinking that the use of a connected device for psychotherapy is nonsense. They also emphasised the already wide range of apps available for depression and explained a new app would not improve care for patients with MDE.

Some physicians suggested that psychosocial interventions such as psychoeducation could not be done without healthcare professionals and expressed doubts about patients' comprehension of information delivered by the app.

"The issue is [the] interpretation of messages received by the patient. You don't have an instantaneous feedback for it and if he had a wrong interpretation it will not help him." Physician 3, group 2.

"I think that psychiatry is based on discussion, trust, empathy, everything that makes medicine an art, and I think all this cannot pass through an app." Physician 2, group 2.

Only patients expressed doubts about the potential marketing use of the app, and stated that advertisements would be unwelcome while using the app and would make them uncomfortable.

### Discussion

This qualitative study is the first to assess both physician and patient expectations of an app dedicated to depression. The use of the focus group method provided a range of experiences and opinions among the participants and a relationship of trust among the group. The discussions it allows increased the role of the participants who collectively built the results of the research.

All themes and categories were the same for patients and physicians, highlighting a shared interest and mutual needs regarding this tool. However, some code differences pointed out the potential conflict between patients' needs and physicians' constraints. Direct access to a professional through the app, which was a strong wish expressed in the patient group, was not mentioned in the physician group and echoed the worry about physicians' availability to use an app. Nevertheless, these conflicts remained scarce and this study revealed strong similarities between patient and physician expectations,
revealing that an app suitable for both patients and physicians could easily be developed. Patients and physicians expressed expectations regarding its content, its operating characteristics and discussed potential barriers to its implementation in real-world clinical practice. Content considered by participants included data provided to and delivered by the app, as well as features thought to be useful for that kind of tool. Data collection methods must gather information about the patient using the app to evaluate their mental state and to inform physicians of the evolution of depressive symptoms. Data delivered by the app should provide psychoeducation elements, therapeutic tools and various functionalities to aid the management of daily life. Features considered for the app were meant to facilitate its use by physicians and ensure patient care in the case of an emergency. The "operating characteristics" theme showed strong heterogeneity between participants' expectations regarding target users, frequency of use and aims of the app. This heterogeneity emphasised the interest of a tailorable tool to meet all the needs and desires of patients and physicians. Finally, this study highlighted doubts and limitations that both patients and physicians may have regarding an app dedicated to depression. These barriers included concerns about users of the app, its accessibility, safety, side effects, utility and functioning.

Most of our results are consistent with previous qualitative studies on health apps, whether they focus on apps for depression or not. Regarding content, information on the disorder and day-to-day life-supporting activities like music, breathing exercises and videos are often cited as expected items [27, 32, 33]. Self-tracking is a highly rated activity of health apps [27, 32] and is described by patients as a reason to return to the app [34]. Similarly to our findings, among possible app features, personalisation is the most requested and liked, both by patients and professionals [26, 27, 32–35]. The expected aims of such apps found in the literature included psychoeducation [35], monitoring [27, 32, 35], providing a presence between face-to-face visits [27] and social connectivity [26, 32]. Consistently with our result, other studies highlighted two main barriers to the use of apps cited by physicians: lack of time and medicolegal responsibility [27, 28]. Financial aspects and deficiency in technological competencies are common barriers to the use of apps for patients [26, 33, 35].

An important issue considered by the participants in our study was the type of population that could benefit from an app dedicated to depression. First, in line with other studies, patients and physicians agreed to focus on an app for people suffering from mild-to-moderate depression [24]. This statement tended to be confirmed by a recent meta-analysis focusing on the efficacy of app interventions for depressive symptoms, the post hoc

subgroup analysis showing that significant benefits from smartphone apps were only found for patients with self-reported mild-to-moderate depression [36]. Those results should be considered carefully, with the variations in subgroup sample sizes leaving the analyses for major depression underpowered to detect significant effects. Moreover, a more recent study identified that more severe depression led to enhanced information seeking, counteracting the theory that severe depression keeps patients from using apps [37].

An app to screen potential depression in the general population was also discussed. Participants emphasised the significant role that this app could provide in facilitating access to mental health for depressed people. They assumed that the large-scale use of such an app could decrease the mean duration of untreated depression and hence the recurrences and the duration of MDEs [38, 39]. In line with our results, several studies pointed out the possible interest of apps for depression screening in the general population, showing that a large number of people from different countries were searching for, and willing to use, that kind of tool [40]. Additionally, several apps using text analysis have shown their ability to improve the immediate detection of depressive symptoms [41, 42]. Finally, several studies highlighted the fact that depression screening apps could motivate some users to discuss the obtained results of the tests with healthcare professionals for further diagnosis and management [43, 44].

Our findings also emphasised the interest in an app that would not be time-consuming for physicians and could help treatment decision-making in patients with depression based on the most updated and high-quality evidence. To the best of our knowledge, there are very few apps currently available providing evidence-based guidance for treatment decision-making to physicians.

One study highlighted that an app could be an effective tool for both increasing confidence in depression treatment and educating physicians [45], pointing out the interest to develop more connected tools for healthcare professionals.

Finally, participants mentioned the usefulness of an app for informal caregivers, to inform them, help them in supporting their ill relative and to destigmatise mental health. This demand is supported by the results of a recent systematic review focusing on apps dedicated to caregivers, showing most of the included studies proved their effectiveness in the overall well-being of the caregivers [46]. Apps dedicated to caregivers, who are often suffering themselves from depression or anxiety, could significantly improve mental healthcare regarding their essential role for patients suffering from depression [47].

These findings highlight that a single app is not enough: multiple versions of the app are needed to
encompass the support and care objectives of patients, mental health professionals and informal caregivers.

One crucial feature expected by participants was self-monitoring. The main interest of it is to improve mental health and wellbeing by increasing emotional self-awareness [48, 49]. The use of apps for self-monitoring allows precise, easy and quick ecological momentary assessment with the possibility of providing real time feedback for patients and alerts for clinicians in case of emergencies. It would also allow clinicians to monitor the efficacy of treatment over time, predict short-term mood changes and detect the worsening of symptoms early on [50]. There are many apps for depression integrating a self-monitoring feature and several studies have examined their usability, acceptability, adherence and effectiveness. Self-monitoring of depressive symptoms on patients' phones has been shown to be easy and reliable [51, 52] and several studies highlighted its effectiveness to improve depressive symptoms [36, 53, 54]. A study on untreated patients with symptoms of depression and anxiety also showed that access to daily self-monitoring helped them to translate their intention to seek treatment into actual treatment-seeking behaviour [55]. Even if this effect was small, it defines self-monitoring as a promising tool to decrease the number of untreated patients suffering from depression. However, the main bottleneck of self-monitoring is the low retention rate of apps offering this feature. For this particular point, studies showed inconsistent results, where some highlighted a quick drop out rate of self-monitoring apps [56, 57], while others noted, conversely, a fairly high retention rate for these tools [52, 54, 58].

In addition to self-monitoring and patients' active input of data, passive data collection has been suggested by physicians in our study. This is consistent with the new research allowed by advanced technologies such as digital phenotyping [59], aiming to determine clinical phenotypes by measuring patient behaviours from smartphone sensors [60]. Requiring no active participation from the patient, the collection of passive data has been increasingly studied in recent years and seems to be a promising field for the future of m-health. This method could indeed allow ecological momentary assessment of several parameters and could be a strong tool to improve depression care. An interesting application domain for this method is the use of an algorithm to facilitate the detection of new MDEs that could be of significant help for clinicians in the follow up of patients with mood disorders [61–64]. A study focusing on therapists' ability to detect negative changes in their patients showed that clinical judgement allowed the detection of only 21% of symptom worsenings [65]. Early detection of an episode with passive data collection could then facilitate the quick reaction of physicians and improve

patients' outcomes [66]. Despite being promising, passive data collection is, as shown in our study, not yet accepted by everyone, whether patients or physicians, and remains a strong barrier to the use of apps.

The analysis of the barriers identified the potential replacement of the physician by the app as a major concern in psychiatry, where state-of-the-art methods require human interaction. This barrier is raised in several studies who mentioned the lack of therapist contact as a negative point of apps [24, 34, 67]. This issue could be overcome with the use of mixed methods or adjunctive apps, integrating the app in face-to-face therapy. This kind of approach has shown better efficacy than self-guidance therapy only through web intervention or smartphone apps [68–71], thus demonstrating the essential role of the therapist in patient care. All these elements emphasised an essential point: complementarity between therapists and m-health tools. In Western countries, the main aim of these devices is to support existing care by providing, for example, better information regarding the patient's daily state through momentary ecological assessment. The use of new technologies should not be seen as a replacement tool for physicians but as an opportunity to increase the quality of care provided. The inclusion of apps in therapy could then be compared to the development of imagery devices in radiology, improving diagnosis without removing the need for clinical examination and physicians' knowledge and expertise.

## Perspectives

The key findings of this study allow us to build a list of suggestions for app developers in the field of depression to fill both patients' and physicians' expectations:

- The use of the app should be easy and intuitive.

- The app should be personalised. The content and functioning of the app should be tailored to each patient and should adapt to the patient's condition over time.

- A self-monitoring function should be included to both increase the patient's self-awareness and sharpen the evaluation of the physician. This function should focus on key symptoms and offer the patient and the physician the possibility of choosing other symptoms to monitor.

- The app should be able to deal with emergency situations. At the least, it should include a tailorable crisis procedure and, at best, include a partnership with the local emergency service.

- The app should provide the patient with information about depression and/or psychoeducational messages.
Furthermore, our results highlighted several key points that should remove the potential barriers to the use of the app:

- Relevant users should be precisely targeted to ensure their capacities to use the app, with particular attention given to the intensity of depression.

- To reduce the potential difficulties bound to the use of the app, physicians should plan a dedicated educational time with the patient to explain the functioning of the app. A user guide should also be included and delivered to the patient.

- Mixed approaches should be preferred. The app should be fully integrated with the usual therapy and be an adjunctive tool rather than an independent one. The use of the app should not lead to any reduction of the frequency of visits to the therapist.

- The use of the app should be free of charge.

- Access should be protected by a password and data stored in a secured server.

## Strengths and limitations

This study has a number of limitations. Selection bias may have occurred: patients' recruitment was limited to France for practical reasons. Furthermore, most of the physicians practiced in urban areas. Therefore, the findings may not be transferable to practitioners in rural areas. This study was also limited to some degree in the use of *focus groups* as a methodology: group dynamics might have, in some way, shaped the expectations expressed by participants and the interviewers' personal skills and attributes could also have influenced the nature and quality of the gathered data. However, the use of focus group is also one of the strengths of this study as it allows for interaction among participants and facilitates discussion and sharing of ideas.

## Conclusion

Physician and patient expectations of a smartphone app dedicated to depression are significant, suggesting a real place for such a device in the management of depression. The key points expected by the users for such a tool are an easy and intuitive use and a personalised content. They are also waiting for an app that gives information about depression, offers a self-monitoring functionality and help them in case of emergency. To ensure good implementation and retention rates, these expectations must be of major concern while developing these tools. Finally, apps should be considered as medical devices and be tested in clinical trials. Consequently, their development requires further studies to ensure their efficacy and safety.

# Supplementary Information

The online version contains supplementary material available at https://doi.org/10.1186/s12888-021-03064-x.

**Additional file 1.** Interview guide. Details of the interview guide used to facilitate discussion within the focus groups.

## Abbreviations

MDE: Major depressive episode; FG: Focus group; DSM-IV-TR: Diagnostic and statistical manual of mental disorders - 4th edition, text revision; IDS-SR: Inventory of depressive symptomatology; SD: Standard deviation; CBT: Cognitive-behavioural therapy

## Acknowledgements

We thank all the physicians and patients who participated in the study. We would also like to acknowledge Maryline Chalmeton for providing support on the study.

## Authors' contributions

MCP, OB, PML and LS were involved in the study conceptualisation and design. Analyses and interpretation of the data were carried out by all the authors (MCP, DHM, OB, NV, IP, AM, LZ, EV, PML and LS). The first draft of the manuscript was written by MCP and LS. All authors (MCP, DHM, OB, NV, IP, AM, LZ, EV, PML and LS) contributed to and approved the final manuscript.

## Funding

This work was supported with funding from the Auvergne-Rhône-Alpes Regional Health Agency and the Clermont-Ferrand University Hospital Center in France.

## Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

## Ethics approval and consent to participate

The study was carried out in accordance with ethical principles for medical research involving humans (WMA, Declaration of Helsinki). The assessment protocol was approved by the relevant ethical review board (CPP EST I, 2018-A01469-46). All subjects provided written informed consent to participate.

## Consent for publication

Not applicable.

## Competing interests

Dr. Pacchiarotti has received CME-related honoraria, or consulting fees from ADAMED, Janssen-Cilag and Lundbeck.

Dr. Murru has served as a consultant, adviser or speaker for Adamed, AstraZeneca, Bristol-Myers Squibb, Janssen-Cilag, Lundbeck, Otsuka and Sanofi-Aventis and has received a grant (PI19/00672) from the Instituto de Salud Carlos IIISubdirección General de Evaluación y Fomento de la investigación, Plan Nacional 2019-2022.

Prof. Vieta has received grants and served as a consultant, advisor or CME speaker for the following entities: AB-Biotics, Abbott, Allergan, Angelini, AstraZeneca, Bristol-Myers Squibb, Dainippon Sumitomo Pharma, Farmindustria, Ferrer, Forest Research Institute, Gedeon Richter, Glaxo-Smith-Kline, Janssen, Lundbeck, Otsuka, Pfizer, Roche, SAGE, Sanofi-Aventis, Servier, Shire, Sunovion, Takeda, the Brain and Behaviour Foundation, the Spanish Ministry of Science and Innovation (CIBERSAM), the EU Horizon 2020 and the Stanley Medical Research Institute.

Prof. Llorca has received grants, honoraria or consulting fees from ESAI, Gedeon Richeter, Janssen, Lundbeck, Otsuka and Sanofi.

Dr. Samalin has received grants, honoraria or consulting fees from AstraZeneca, Bristol-Myers Squibb, Janssen-Cilag, Lundbeck, Otsuka, Sanofi-Aventis, and Takeda.

The other authors declare that they have no conflicts of interest.

## Author details

<footnote n="1">¹Department of Psychiatry, CHU Clermont-Ferrand, University of Clermont Auvergne, EA 7280 Clermont-Ferrand, France. ²Bipolar and Depressive</footnote>
Disorders Unit, Hospital Clinic, University of Barcelona, Institute of Neuroscience, IDIBAPS, CIBERSAM, 170 Villarroel st, 12-0, 08036 Barcelona, Catalonia, Spain. ³Fondation FondaMental, Hôpital Albert Chenevier, Pôle de Psychiatrie, Créteil, France. ⁴Clinique Mon Repos, Ecully, France.

Received: 20 October 2020 Accepted: 14 January 2021

Published online: 29 January 2021

## References

1. World Health Organization. Mental health atlas 2017. Geneva: WHO; 2018. ISBN: 978-92-4-151401-9

2. The ESEMED/MHEEDA 2000 investigators*, Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, Girolamo G, Graaf R, Demyttenaere K, Gasquet I, Haro JM, Katz SJ, Kessler RC, Kovess V, Lepine JP, Ormel J, Polidori G, Russo LJ, Vilagut G, Almansa J, Arbabzadeh-Bouchez S, Autonell J, Bernal M, Buist-Bouwman MA, Codony M, Domingo-Salvany A, Ferrer M, Joo SS, Martinez-Alonso M, Matschinger H, Mazzi F, Morgan Z, Morosini P, Palacin C, Romera B, Taub N, Vollebergh WAM. Disability and quality of life impact of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMED) project. Acta Psychiatr Scand Suppl. 2004; doi:https://doi.org/10.1111/j.1600-0047.2004.00329.x.

3. Steensma C, Loukine L, Orpana H, Vachon J, Mo F, Boileau-Falardeau M, Reid C, Choi BC. Describing the population health burden of depression: health-adjusted life expectancy by depression status in Canada. Health Promot Chronic Dis Prev Can. 2016. https://doi.org/10.24095/hpcdp.36.10.01.

4. Kohn R, Saxena S, Levav I, Saracen B. The treatment gap in mental health care. Bull World Health Organ. 2004;82(11):858-66.

5. Davies EB, Morriss R, Glazebrook C. Computer-delivered and web-based interventions to improve depression, anxiety, and psychological well-being of university students: a systematic review and meta-analysis. J Med Internet Res. 2014. https://doi.org/10.2196/jmir.3142.

6. Wahle F, Bollhalder L, Kowatsch T, Fleisch E. Toward the Design of Evidence-Based Mental Health Information Systems for people with depression: a systematic literature review and meta-analysis. J Med Internet Res. 2017. https://doi.org/10.2196/jmir.7381.

7. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009. https://doi.org/10.1080/16506070903318960.

8. Mohr DC, Tomasino KN, Lattie EG, Palac HL, Kwasny MJ, Weingardt K, Karr CJ, Kaiser SM, Rossom RC, Bardsley LR, Caccamo L, Stiles-Shields C, Schueller SM. IntelliCare: an eclectic, skills-based app suite for the treatment of depression and anxiety. J Med Internet Res. 2017. https://doi.org/10.2196/jmir.6645.

9. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, Acceptable and Practical Health Care: A Meta-Analysis. Baune BT, editor. Plos One. 2010; doi:https://doi.org/10.1371/journal.pone.0013196.

10. Möller R, Barboutov K, Furuskär A, Inam R, Lindberg P, Öhman K, Sachs J, Sveningsson R, Torsner J, Wallstedt K, Gully V. Ericsson Mobility Report. 2017. https://www.ericsson.com/en/mobility-report/reports. Accessed 23 Feb 2020.

11. Cameron JD, Ramaprasad A, Syn T. An ontology of and roadmap for mHealth research. Int J Med Inform. 2017. https://doi.org/10.1016/j.ijmedinf. 2017.01.007.

12. Ben-Zeev D, Schueller SM, Begale M, Duffecy J, Kane JM, Mohr DC. Strategies for mHealth research: lessons from 3 Mobile intervention studies. Admin Pol Ment Health. 2015. https://doi.org/10.1007/s10488-014-0556-2.

13. Torous J, Roberts LW. Needed innovation in digital health and smartphone applications for mental health: transparency and trust. JAMA Psychiatry. 2017. https://doi.org/10.1001/jamapsychiatry.2017.0262.

14. Weisel KK, Fuhrmann LM, Berking M, Baumeister H, Cuijpers P, Ebert DD. Standalone smartphone apps for mental health—a systematic review and meta-analysis. NPJ Digit Med. 2019. https://doi.org/10.1038/s41746-019- 0188-8.

15. Patel S, Saunders KE. Apps and wearables in the monitoring of mental health disorders. Br J Hosp Med (Lond). 2018; doi:https://doi.org/10.12968/ hmed.2018.79.12.672.

16. Van Ameringen M, Turna J, Khalesi Z, Pullia K, Patterson B. There is an app for that! The current state of mobile applications (apps) for DSM-5 obsessive-compulsive disorder, posttraumatic stress disorder, anxiety and mood disorders. Depress Anxiety. 2017. https://doi.org/10.1002/da.22657.

17. Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit Med. 2018. https://doi.org/10.1038/s41746-018-0021-9.

18. Marshall JM, Dunstan DA, Bartik W. The digital psychiatrist: In search of evidence-based apps for anxiety and depression. Front Psychiatry. 2019. https://doi.org/10.3389/fpsyt.2019.00831.

19. Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for smarter delivery of mental health programs: a systematic review. J Med Internet Res. 2013. https://doi.org/10.2196/jmir.2791.

20. Hidalgo-Mazzei D, Llach C, Vieta E. mHealth in affective disorders: hype or hope? A focused narrative review. Int Clin Psychopharmacol. 2020. https:// doi.org/10.1097/YIC.00000000000000302.

21. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Mental Health. 2018. https://doi.org/10.1136/eb-2018-102891.

22. Krebs P, Duncan DT. Health app use among US Mobile phone owners: a National Survey. JMIR mHealth uHealth. 2015. https://doi.org/10.2196/ mhealth.4924.

23. Chan S, Godwin H, Gonzalez A, Yellowlees PM, Hilty DM. Review of use and integration of Mobile apps into psychiatric treatments. Curr Psychiatry Rep. 2017. https://doi.org/10.1007/s11920-017-0848-9.

24. Kerst A, Zielasek J, Gaebel W. Smartphone applications for depression: a systematic literature review and a survey of health care professionals' attitudes towards their use in clinical practice. Eur Arch Psychiatry Clin Neurosci. 2019. https://doi.org/10.1007/s00406-018-0974-3.

25. Nicholas J, Fogarty AS, Boydell K, Christensen H. The reviews are in: a qualitative content analysis of consumer perspectives on apps for bipolar disorder. J Med Internet Res. 2017. https://doi.org/10.2196/jmir.7273.

26. Pung A, Fletcher SL, Gunn JM. Mobile app use by primary care patients to manage their depressive symptoms: qualitative study. J Med Internet Res. 2018. https://doi.org/10.2196/10035.

27. Hetrick SE, Robinson J, Burge E, Blandon R, Mobilio B, Rice SM, Simmons MB, Alvarez-Jimenez M, Goodrich S, Davey CG. Youth Codesign of a Mobile phone app to facilitate self-monitoring and Management of Mood Symptoms in young people with major depression, suicidal ideation, and self-harm. JMIR Ment Health. 2018. https://doi.org/10.2196/mental.9041.

28. Meng J, Hussain SA, Mohr DC, Czerwinski M, Zhang M. Exploring user needs for a Mobile behavioral-sensing Technology for Depression Management: qualitative study. J Med Internet Res. 2018. https://doi.org/10.2196/10139.

29. American Psychiatric Association. Diagnostic and statistical manual of mental disorders Dsm-iv-tr (text Revision). Washington, DC: American Psychiatric Association; 2000. ISBN: 0890420246.

30. Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH. The inventory of depressive symptomatology (IDS): psychometric properties. Psychol Med. 1996. https://doi.org/10.1017/S0033291700035558.

31. Maxwell J. Designing a qualitative study. In: the SAGE handbook of applied social research methods. Thousand Oaks: SAGE Publications, Inc.; 2009. https://doi.org/10.4135/9781483348858.n7.

32. Teo CH, Ng CJ, White A. What Do Men Want from a Health Screening Mobile App? A Qualitative Study. Choo K-KR, editor. Plos One; 2017;12(1); doi:https://doi.org/10.1371/journal.pone.0169435.

33. Peng W, Kanthawala S, Yuan S, Hussain SA. A qualitative study of user perceptions of mobile health apps. BMC Public Health. 2016. https://doi.org/ 10.1186/s12889-016-3808-0.

34. Fuller-Tyszkiewicz M, Richardson B, Klein B, Skouteris H, Christensen H, Austin D, Castle D, Mihalopoulos C, O'Donnell R, Arulkadacham L, Shatte A, Ware A. A Mobile app-based intervention for depression: end-user and expert usability testing study. JMIR Ment Health. 2018. https://doi.org/10. 2196/mental.9445.

35. Mayer G, Gronewold N, Alvarez S, Bruns B, Hilbel T, Schultz J-H. Acceptance and expectations of medical experts, students, and patients toward electronic mental health apps: cross-sectional quantitative and qualitative survey study. JMIR Ment Health. 2019. https://doi.org/10.2196/14018.

36. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, Sarris J. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. 2017. https://doi.org/10.1002/wps.20472.

37. Scherr S, Goering M. Is a self-monitoring app for depression a good place for additional mental health information? Ecological momentary assessment of mental help information seeking among smartphone users. Health Commun. 2019. https://doi.org/10.1080/10410236.2019.1606135.
38. Altamura AC, Dell'Osso B, Vismara S, Mundo E. May duration of untreated illness influence the long-term course of major depressive disorder? Eur Psychiatry. 2008. https://doi.org/10.1016/j.eurpsy.2007.11.004.

39. Bukh JD, Bock C, Vinberg M, Kessing LV. The effect of prolonged duration of untreated depression on antidepressant treatment outcome. J Affect Disord. 2013. https://doi.org/10.1016/j.jad.2012.07.008.

40. BinDhim NF, Shaman AM, Trevena L, Basyouni MH, Pont LG, Alhawassi TM. Depression screening via a smartphone app: cross-country user characteristics and feasibility. J Am Med Inform Assoc. 2014. https://doi.org/10.1136/amiajnl-2014-002840.

41. Ramos RM, Cheng PGF, Jonas SM. Validation of an mHealth app for depression screening and monitoring (psychologist in a pocket): correlational study and concurrence analysis. JMIR Mhealth Uhealth. 2019. https://doi.org/10.2196/12051.

42. Cheng PGF, Ramos RM, Bitsch JÁ, Jonas SM, Ix T, See PLQ, Wehrle K. Psychologist in a pocket: lexicon development and content validation of a Mobile-based app for depression screening. JMIR Mhealth Uhealth. 2016. https://doi.org/10.2196/mhealth.5284.

43. BinDhim NF, Alanazi EM, Aljadhey H, Basyouni MH, Kowalski SR, Pont LG, Shaman AM, Trevena L, Alhawassi TM. Does a Mobile phone depression-screening app motivate Mobile phone users with high depressive symptoms to seek a health care Professional's help? J Med Internet Res. 2016. https://doi.org/10.2196/jmir.5726.

44. Chung K, Jeon M-J, Park J, Lee S, Kim CO, Park JY. Development and evaluation of a mobile-optimized daily self-rating depression screening app: A preliminary study. Guloksuz S, editor. Plos One. 2018; doi:https://doi.org/10.1371/journal.pone.019118.

45. Man C, Nguyen C, Lin S. Effectiveness of a smartphone app for guiding antidepressant drug selection. Fam Med. 2014;46(8):626-30.

46. Lorca-Cabrera J, Grau C, Martí-Argues R, Raigal-Aran L, Falcó-Pegueroles A, Albacar-Riobóo N. Effectiveness of health web-based and mobile app-based interventions designed to improve informal caregiver's well-being and quality of life: a systematic review. Int J Med Inform. 2020. https://doi.org/10.1016/j.jmedinf.2019.104003.

47. Cabral L, Duarte J, Ferreira M, dos Santos C. Anxiety, stress and depression in family caregivers of the mentally ill. Aten Primaria. 2014. https://doi.org/10.1016/S0212-6567(14)70087-3.

48. Beitman BD, Soth AM. Activation of self-observation: a core process among the psychotherapies. J Psychother Integr. 2006. https://doi.org/10.1037/1053-0479.16.4.383.

49. Morris ME, Kathawala Q, Leen TK, Gorenstein EE, Guilak F, Labhard M, Deleeuw W. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. J Med Internet Res. 2010. https://doi.org/10.2196/jmir.1371.

50. Nuij C, van Ballegooijen W, Ruwaard J, de Beurs D, Mokkenstorm J, van Duijn E, de Winter RFP, O'Connor RC, Smit JH, Riper H, Kerkhof A. Smartphone-based safety planning and self-monitoring for suicidal patients: rationale and study protocol of the CASPAR (continuous assessment for suicide prevention and research) study. Internet Interv. 2018. https://doi.org/10.1016/j.invent.2018.04.005.

51. Torous J, Staples P, Shanahan M, Lin C, Peck P, Keshavan M, Onnela J-P. Utilizing a personal smartphone custom app to assess the patient health Questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Ment Health. 2015. https://doi.org/10.2196/mental.3889.

52. Lauritsen L, Andersen L, Olsson E, Søndergaard SR, Nørregaard LB, Løventoft PK, Svendsen SD, Frøkjaer E, Jensen HM, Hageman I, Kessing LV, Martiny K. Usability, acceptability, and adherence to an electronic self-monitoring system in patients with major depression discharged from inpatient wards. J Med Internet Res. 2017. https://doi.org/10.2196/jmir.6673.

53. Zhang R, Nicholas J, Knapp AA, Graham AK, Gray E, Kwasny MJ, Reddy M, Mohr DC. Clinically meaningful use of mental health apps and its effects on depression: mixed methods study. J Med Internet Res. 2019. https://doi.org/10.2196/15644.

54. Colombo D, Fernández-Álvarez J, Patané A, Semonella M, Kwiatkowska M, García-Palacios A, Cipresso P, Riva G, Botella C. Current state and future directions of technology-based ecological momentary assessment and intervention for major depressive disorder: a systematic review. J Clin Med. 2019. https://doi.org/10.3390/jcm8040465.

55. Shafran R, Gyani A, Rostron J, Allen S, Myles-Hooton P, Allcott-Watson H, Rose S. Translating the intention to seek treatment into action: does symptom monitoring make a difference? Results from a randomized controlled trial. Behav Cogn Psychother. 2019. https://doi.org/10.1017/S1352465818000498.

56. Burns MN, Begale M, Duffecy J, Gergle D, Karr CI, Giangrande E, Mohr DC. Harnessing context sensing to develop a Mobile intervention for depression. J Med Internet Res. 2011. https://doi.org/10.2196/jmir.1838.

57. Anguera JA, Jordan JT, Castaneda D, Gazzaley A, Areán PA. Conducting a fully mobile and randomised clinical trial for depression: access, engagement and expense. BMJ Innov. 2016. https://doi.org/10.1136/bmjinnov-2015-000098.

58. Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone-based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic Review J Med Internet Res. 2017. https://doi.org/10.2196/jmir.7006.

59. Jain SH, Powers BW, Hawkins JB, Brownstein JS. The digital phenotype. Nat Biotechnol. 2015. https://doi.org/10.1038/nbt.3223.

60. Insel TR. Digital Phenotyping: Technology for a new Science of behavior. JAMA. 2017. https://doi.org/10.1001/jama.2017.11295.

61. Bourla A, Ferreri F, Ogorzelec L, Guinchard C, Mouchabac S. Evaluation des troubles thymiques par l'étude des données passives: le concept de phénomène digital à l'épreuve de la culture de métier de psychiatre. Encephale. 2018. https://doi.org/10.1016/j.encep.2017.07.007.

62. Cormack F, McCue M, Taptiklis N, Skirrow C, Glazer E, Panagopoulos E, van Schaik TA, Fehnert B, King J. Barnett JHF Wearable Technology for High-Frequency Cognitive and Mood Assessment in Major Depressive Disorder: Longitudinal Observational Study JMIR Ment Health. 2019. https://doi.org/10.2196/12814.

63. Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR mHealth and uHealth. 2016. https://doi.org/10.2196/mhealth.5960.

64. Cho C-H, Lee T, Kim M-G, In HP, Kim L, Lee H-J. Mood prediction of patients with mood disorders by machine learning using passive digital phenotypes based on the circadian rhythm: prospective observational cohort study. J Med Internet Res. 2019. https://doi.org/10.2196/11029.

65. Hatfield D, McCullough L, Frantz SHB, Krieger K. Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clin Psychol Psychother. 2009. https://doi.org/10.1002/cpp.656.

66. Lambert M. Presidential address: what we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychother Res. 2007. https://doi.org/10.1080/10503300601032506.

67. Stiles-Shields C, Montague E, Lattie EG, Kwasny MJ, Mohr DC. What might get in the way: barriers to the use of apps for depression. Digit Health. 2017. https://doi.org/10.1177/2055207617713827.

68. Torous J, Lipschitz J, Ng M, Firth J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: a systematic review and meta-analysis. J Affect Disord. 2020. https://doi.org/10.1016/j.jad.2019.11.167.

69. Titzler I, Saruhanjan K, Berking M, Riper H, Ebert DD. Barriers and facilitators for the implementation of blended psychotherapy for depression: a qualitative pilot study of therapists' perspective. Internet Interv. 2018. https://doi.org/10.1016/j.invent.2018.01.002.

70. Cuijpers P, Kleiboer A, Karyotaki E, Riper H. Internet and mobile interventions for depression: opportunities and challenges. Depress Anxiety. 2017. https://doi.org/10.1002/da.22641.

71. Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry. 2019. https://doi.org/10.1002/wps.20673.

**Publisher's Note**

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.