# A Short Media Training Session Is Effective in Reinforcing Psychiatrists' Communication Skills About Suicide.

K. Walter, M. Wathelet, S. Valdenaire, Pierre Grandgenevre, N. Pauwels, Guillaume Vaiva, C. E. Notredame

► To cite this version:

K. Walter, M. Wathelet, S. Valdenaire, Pierre Grandgenevre, N. Pauwels, et al., A Short Media Training Session Is Effective in Reinforcing Psychiatrists' Communication Skills About Suicide. Frontiers in Psychology, 2021, Frontiers in Psychology, 12, pp.733691. 10.3389/fpsyg.2021.733691. hal-04700881

HAL Id: hal-04700881

https://lilloa.hal.science/hal-04700881v1

Submitted on 18 Sep 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

Check for
updates

# A Short Media Training Session Is Effective in Reinforcing Psychiatrists' Communication Skills About Suicide

Karl Walter<fnref n="1" />,²*, Marielle Wathelet<fnref n="1" />,³,⁴,⁵, Sacha Valdenaire², Pierre Grandgenèvre<fnref n="1" />,², Nathalie Pauwels²,³, Guillaume Vaiva<fnref n="1" />,⁴,⁵ and Charles-Edouard Notredame<fnref n="1" />,²,⁵

Because it has been associated with significant increases [through the Werther Effect (WE)] or decreases [through the Papageno Effect (PE)] of suicide rates, media coverage of suicide-related events is recognized as a prevention leverage. Unfortunately, the recommendations that the World Health Organization (WHO) has published to help journalists reporting on suicide remain poorly applied. The Mini Media Training (MMT) is a short media training session designed to increase psychiatrists' ability to communicate about suicide during interviews. We aimed at assessing the effect of the MMT on psychiatrists' ability to help journalists complying with the WHO recommendations. From June 2017 to December 2019, 173 physicians and residents in psychiatry were recruited during French national congresses. At baseline (T0) and 1 and 3 months later (T1), participants received the MMT, which consisted in a simulated interview where they we asked to answer a journalist about a mock suicide. Communication skills were measured with a score summing the number of delivered pieces of advice in relation to the WHO recommendations, with a maximum score of 33. A weighted score was also derived based on the degree of directivity needed for the participant to provide these items, again with a possible maximum of 33. A total of 132 psychiatrists participated in the study at T0 and T1. Both the weighted and unweighted score significantly increased from T0 to T1 (d = +2.08, *p* < 0.001, and d = +1.24, *p* < 0.001, respectively). Having a history of contacts with journalists, a short professional experience (<3 years) and prior knowledge of the WE, PE, and WHO recommendations were significantly associated with greater unweighted and weighted scores at baseline. The latter two variables also predicted greater T0-T1 improvement of the weighted score. These results suggest that the MMT could be effective for improving the ability of psychiatrists to guide journalists toward more responsible media coverage of suicide. As a short, easy to implement educational activity, the MMT could therefore be considered in association with other measures to help media professionals mitigating the WE and promoting the PE.

**Keywords:** suicide, media, Werther effect, Papageno effect, psychiatrist, training

**Abbreviations:** MMT, Mini Media Training; PE, Papageno Effect; WE, Werther Effect; WHO, World Health Organization.

**OPEN ACCESS**

**Edited by:**
Thomas Niederkrotenthaler,
Medical University of Vienna, Austria

**Reviewed by:**
Sebastian Scherr,
Texas A&M University, United States
Stefanie Kirchner,
Medical University of Vienna, Austria

*Correspondence:
Karl Walter
karl.walter@chru-lille.fr

**Specialty section:**
This article was submitted to
*Health Psychology,*
a section of the journal
*Frontiers in Psychology*

**Received:** 30 June 2021
**Accepted:** 19 August 2021
**Published:** 16 September 2021

**Citation:**
Walter K, Wathelet M, Valdenaire S, Grandgenèvre P, Pauwels N, Vaiva G and Notredame C-E (2021) A Short Media Training Session Is Effective in Reinforcing Psychiatrists' Communication Skills About Suicide. *Front. Psychol.* 12:733691.
doi: 10.3389/fpsyg.2021.733691

<footnote n="1">¹ Psychiatry Department, CHU Lille, Lille, France, ² Papageno Program, Lille, France, ³ Fédération Régionale de Recherche en Psychiatrie et Santé Mentale Hauts-de-France (F2RSM Psy), Saint-André, France, ⁴ Centre National de Ressources et Résilience pour les Psychotraumatismes (Cn2r), Lille, France, ⁵ PSY Lab, Lille Neuroscience & Cognition Centre, INSERM U1172, University of Lille, Lille, France</footnote>
# INTRODUCTION

Despite sustained prevention efforts, suicide still accounts for 1.4% of premature deaths worldwide (Bachmann, 2018). In most Asian, American and European regions, it remains one of the top ten causes of age standardized years of life loss (Naghavi, 2019). In France, suicide has caused about 9,280 evitable deaths in 2016 (Observatoire National du Suicide, 2019).

In response to this alarming observation, the World Health Organization (WHO) has set, in its Global Mental Health Action Plan, the objective of a 10% decrease of suicides over the period 2013–2020 (WHO, 2019). Among prevention actions recommended as efficient, the WHO promotes the empowerment of media professionals in reporting on suicide-related events. For more than half a century, the literature has indeed provided robust evidence that incautious media coverage of suicide is associated with a substantial increase of suicide rates, especially in young populations (Phillips, 1974; Leon et al., 2014) and/or when a celebrity in involved (Niederkrotenthaler et al., 2020). Detrimental consequences of suicide-related reports have been tagged “Werther Effect” (WE) in reference to the European suicide epidemy that followed the publication of Goethes’ *Sorrow of the Young Werther* (Von Goethe, 1774). Conversely, more limited but growing evidence exist that specific media productions, such as testimonies of individuals who successfully coped with a suicidal crisis, could reduce suicidal ideations, increase life satisfaction, provide knowledge about suicide-related matters and promote help-seeking behaviors in readers or viewers (Niederkrotenthaler et al., 2019). Niederkrotenthaler et al. (2010) coined Papageno Effect (PE) the possible protective effects of such portray in reference to the resilient character of Mozart’s opera *The Magic Flute*.

Importantly, both the WE and PE have been related to specific characteristics of media productions. From a quantitative point of view, the risk of WE increases with the number and length of articles and broadcasts according to a dose-effect relationship (Etzersdorfer et al., 2004; Pirkis et al., 2006). From a qualitative point of view, using a sensational tone, describing with precision the mean and place of the suicidal event or displaying the term “suicide” in the headline have been related to stronger WE, presumably due to greater salience and emotional impact (Etzersdorfer et al., 2004; Pirkis et al., 2006; Niederkrotenthaler and Sonneck, 2007; Niederkrotenthaler et al., 2010; Notredame et al., 2015). Conversely, the literature suggests that suicide-related reports that contribute to debunk stereotypes around suicide and highlight help resources promote the PE (Niederkrotenthaler et al., 2014; Notredame et al., 2016).

To improve media coverage of suicide, the WHO published in 2008 eleven recommendations for media professionals (World Health Organization (WHO), and International Association for Suicide Prevention (IASP), 2008). Basically, the document encourages journalists to raise awareness about suicide without spreading misconceptions, to carefully consider the relevance of covering a suicide-related event that has already been reported, to avoid sensationalizing or normalizing style and wording, to remain vague when describing the mean and place of the suicide and to pay special attention when dealing with a celebrity suicide.

In 2017, the WHO added a twelfth recommendation dedicated to the promotion of the PE by encouraging journalists to provide precisions about how to deal with stressors or suicidal thoughts and how to get help (World Health Organization (WHO), and International Association for Suicide Prevention (IASP), 2017).

Regrettably, release of national adaptations of the WHO recommendations has led to mixed results (Tatum et al., 2010; Chandra et al., 2014). Michel et al. (2000) for instance, observed that the publication of the Swiss guidelines resulted in an overall improvement of the quality of the reporting, but also in a significant increase of the number of articles dealing with suicide. This observation violates one of the most critical recommendation about avoiding redundancy in suicide-related information (Michel et al., 2000). Fu and Yip (2009) failed to find any significant difference in the compliance of media productions to the WHO recommendations before and after their national release. Likewise, Tatum et al. (2010) observed that the newspapers articles about suicide published in the 2 years after the release of the United States media guidelines did not consistently reflect their influence.

One possible account for the poor compliance of media productions with guidelines (Collings and Kemp, 2010) is that journalists are rarely aware of their responsibility about suicide and remain mostly uninformed of the existence of any recommendations (Jamieson et al., 2003). Therefore, rather than a simple publication and distribution process, a global interdisciplinary approach involving consultation and collaboration with media professionals may be needed for the WHO guidelines to be applied (Notredame et al., 2016).

In France, the Papageno Program works since 2015 at preventing suicide contagion and promoting access to care by leveraging different communication channels.<fnref n="1" /> One of its core goal consists in reaching better compliance with the WHO recommendations in media productions. Inspired by similar national initiatives (Skehan et al., 2009; Scherr et al., 2019; Duncan and Luce, 2020), the Papageno program carries out a multimodal strategy associating the spread of a French translation of the WHO guidelines with the publication of resources and the organization of training sessions for media actors, professionals and students. More recently, the program also considered strengthening the role of psychiatrists in the prevention of the WE and promotion of the PE.

Because they are frequently interviewed as experts about suicidal behaviors, psychiatrists are key resources to raise media stakeholders’ awareness about the possible consequences of suicide coverage and to help them addressing themes in relations with suicidal behaviors. However, psychiatrists and psychotherapists were shown to endorse very heterogenous theories and understandings about media effects on mental health (Arendt and Scherr, 2017). Most French medical curricula don’t include any course or training about public communication. Thereby, psychiatrists tend to feel uncomfortable about responding to journalists and media contributors or even mistrust them. As a consequence, they often decline their interview request.

<footnote n="1">¹www.papageno-suicide.com</footnote>
To create new opportunities for improving media coverage of suicide, the Papageno Program developed a Mini Media Training (MMT) session specifically designed for mental health professionals. The MMT aims at raising psychiatrists' awareness about the importance of communicating about suicide, at delivering accurate information about the WE and PE, at strengthening their capacity to respond to journalists in compliance with the WHO recommendations and at promoting reliable resources. The training session consists in a 10-min roleplay where psychiatrists are asked to answer the questions of a fiction journalist about a celebrity suicide. After this mock interview, the psychiatrists are offered a feedback based on their responses. As a positive reinforcer, answers in line with the WHO recommendations are pinpointed and likely positive consequences highlighted. The instructor then informs the participants about not-cited recommendations and provides advice about how to introduce them to journalists. Finally, psychiatrists receive a booklet containing the French version of the WHO recommendations.

The primary objective of the present study is to assess the effect of the MMT on psychiatrists' ability to communicate about suicide in a way that helps journalists apply the WHO recommendations. We also studied the predictors of this ability and of its progression after the MMT.

# MATERIALS AND METHODS

## Participants

Participants were French-speaking voluntary psychiatrists and residents in psychiatry recruited during eight French national psychiatry congresses that took place between June 2017 and December 2019. All participants provided their oral consent.

## Procedure

The participants were approached randomly during the psychiatry congresses (T0). They were informed orally and in writing about the study as part as the recruitment procedure. They were told that they were going to participate in a research aiming at evaluating the ability of psychiatrists to respond journalists about suicidal events. Then, participants were briefly introduced to the Papageno Program and were given an overview of the study process. They were then administered self-questionnaires about their sociodemographic characteristics, before receiving a face-to-face MMT. The instructor that led the mock interviews was also the main investigator of the study (KW). The MMT started with a short, standardized introduction providing some elements of context about the fictious suicide that motivated the interview. The instructor pretended he was a journalist working for a local newspaper. He explained that the body a famous French actor had just been discovered. He added that the actor had left a suicide note to his wife.

To test the extent to which the participant was able to spontaneously avoid talking about the specific case of the actor but rather provide general advice to guide the journalist, the questions were formulated to create three levels of directivity:

1. "What can you tell me about this suicide" (no directivity).

2. "What can you tell me about suicide in general" (low directivity).

3. "Do you have any advice for us to write our article" (strong directivity).

Between 1 and 3 months later (T1), the participants were called to carry on a second MMT by phone. They were informed of this recall at the time of their recruitment, at T0. They were explained that they would receive a text message or e-mail to schedule the appointment. The structure of the interview was exactly the same as in the first MMT. The scenario was analogous as respect to the type of event but changed in content. The instructor told the participant that a young singer who participated to a TV show was found dead in one location and surrounded by objects suggesting a death by suicide. The death was told to have occurred 3 days after the leak of a sextape involving the singer. The questions that the mock journalist asked were the same as at T0.

Both T0 and T1 were audio recorded.

## Outcomes

To assess the effect of the MMT, we developed a 33-items score of compliance with WHO recommendations (the WHO score). Twenty-seven items of this grid consisted in direct operationalization of the WHO recommendations. The last six items assessed whether the participant informed the journalist about the WE and PE, avoided taking about the specific suicide case, and promoted reliable resources such as the consultation of the WHO recommendations (Table 1). The audio-records of the interviews were screened based on the 33 items of the WHO score. One point was attributed for each cited item, and the total score was calculated by summing the points (unweighted WHO score). To measure the ability of the psychiatrist to spontaneously deliver the pieces of advice, we also calculated a weighted WHO score attributing three points when the items were spontaneously cited, two points when they were cited after a lowly directive question and one point when they were cited after a highly directive question. The total weighted WHO score was calculated by summing the points, then dividing by three to bring the total score to 33, like the unweighted WHO score. These scores also made it possible to take into account the degree of adherence of psychiatrists to WHO recommendations. The higher these scores, the more the psychiatrists adhered to the recommendations.

Ratings were carried out by two researchers (KW and SV, who practiced rating based on recordings collected during a pilot study at current work Kappa coefficients were calculated for each of the items (see Supplementary Table 1). The items for which the Kappa was less than 0.6 (N = 11) were reviewed by the 2 assessors for harmonization of the rating (Landis and Koch, 1977).

## Co-variables

We collected several variables to describe the sample: (1) socio-demographic characteristics: age (in years), gender (male, female), (2) professional information: status (psychiatrist,
<table><caption>**TABLE 1** | Items of the WHO score and the codebook defining each of them.</caption><thead><tr><th></th><th></th></tr></thead><tbody><tr><td><strong>Generalities</strong></td><td></td></tr><tr><td>1. Make yourself available to journalists: Score only when the participant makes himself available to the journalist for after the interview.</td><td></td></tr><tr><td>2. Encourage the consultation of the WHO recommendations: Score only when the participant specifically or explicitly mentions WHO recommendations.</td><td></td></tr><tr><td>3. Consult reliable scientific resources.</td><td></td></tr><tr><td>4. Inform about the Werther effect.</td><td></td></tr><tr><td>5. Inform about the Papageno effect.</td><td></td></tr><tr><td>6. Refuse to comment on the specific case: Rate when the participant does not give his opinion on the suicide mentioned, or does not take a position on it. Do not rate responses that make assumptions related to the suicide mentioned, or that describe the facts related to it.</td><td></td></tr><tr><td><strong>WHO recommendation 1: take the opportunity to educate the public about suicide</strong></td><td></td></tr><tr><td>7. Advise against presenting suicide as a consequence of a single cause: Score when the participant explicitly refers to the multifactorial nature of suicide, or when he describes in detail the process of the suicidal crisis by highlighting the chain of the different factors involved.</td><td></td></tr><tr><td>8. Encourage people to remember that suicide is often associated with psychiatric illness or substance use: Rate only those responses that clearly emphasize that psychiatric illness or substance use is frequently associated with suicide.</td><td></td></tr><tr><td>9. Encourage talking about suicide/dispel myths: Rate responses that prompt the journalist to talk about suicide in general, as well as responses that encourage journalists to de-stigmatize suicide.</td><td></td></tr><tr><td>10. Encourage the inclusion of elements suggesting that suicide is as a major public health problem: Rate responses that use arguments indicating that suicide is a public health issue. Do not rate responses that simply mention the frequent nature of suicide.</td><td></td></tr><tr><td>11. Encourage giving information about suicide risk factors or warning signs: Rate the responses that suggest the existence of risk factors for suicide by explicitly using the expression, or by mentioning risk factors by presenting them as such. Rate the responses that suggest the existence of warning signs at the onset of suicide, either explicitly using the expression or an equivalent, or by describing the dynamic process of the suicidal crisis.</td><td></td></tr><tr><td>12. Encourage mentioning the suicidal thoughts that preceded the act: Score only those responses that link the presence of suicidal ideation to a suicide act. Do not rate responses that only evoke suicidal ideation without associating them with a suicidal gesture.</td><td></td></tr><tr><td><strong>WHO recommendation 2: avoid any language that sensationalizes or normalizes suicide, or presents it as a solution</strong></td><td></td></tr><tr><td>13. Discourage language elements that tend to sensationalize, normalize, trivialize, or criminalize the act of suicide: Rate the responses that make the journalist aware of the importance of the elements of language used in talking about a suicide, or that encourage the journalist to avoid any emotional content in the mention of a suicidal fact.</td><td></td></tr><tr><td>14. Encourage not to use expressions such as "successful suicide" or "failed attempt".</td><td></td></tr><tr><td>15. Discourage language elements that contribute to presenting suicide as a solution: Rate only those responses that explicitly encourage the journalist not to present suicide as a solution.</td><td></td></tr><tr><td><strong>WHO recommendation 3: avoid prominent placement and undue repetition of stories about suicide</strong></td><td></td></tr><tr><td>16. Avoid repeating the coverage a suicide story/questioning the relevance of a new article: Rate the responses which insist on the harmful effect of the repeated media coverage of a suicidal event, or which explicitly question the relevance of writing an article on this subject. Do not rate responses that question the content of the article, without questioning the very existence of the article.</td><td></td></tr><tr><td>17. Recommend not placing the article on the first page or at the top of the page: Rate only those responses that clearly indicate that the article dealing with the suicide incident should not be featured in the newspaper.</td><td></td></tr><tr><td>18. In general, advise against highlighting and over-mediating suicidal events: Rate the responses that clearly emphasize the necessary differentiation that must be made, by the media, between the specific suicidal act, and suicide in general, and which clearly indicates that the emphasis should be on the second and not on the first.</td><td></td></tr><tr><td><strong>WHO recommendation 4: avoid explicit descriptions of the method used in a completed or attempted suicide</strong></td><td></td></tr><tr><td>19. Recommend not detailing the means used during a suicide or attempted suicide: Rate only those responses that clearly indicate that suicidal means should not be used in the article or story.</td><td></td></tr><tr><td><strong>WHO recommendation 5: avoid providing detailed information about the site of a completed or attempted suicide</strong></td><td></td></tr><tr><td>20. Advise against any detailed information concerning the place where the suicide or attempted suicide took place, as well as the history of this place in matters of suicide: Rate only those responses that clearly indicate that the location of the suicide took place in the article or story.</td><td></td></tr><tr><td>21. Advise against any details concerning the suicidal act: Rate only those responses that clearly advise reporters against giving details of the suicide incident itself. Do not rate responses that advise against dealing with suicide in particular without emphasizing not going into the details of the suicide in question.</td><td></td></tr><tr><td><strong>WHO recommendation 6: word headlines carefully</strong></td><td></td></tr><tr><td>22. Discourage the use of the word "suicide" in headlines, or the location or method of suicide.</td><td></td></tr><tr><td><strong>WHO recommendation 7: exercise caution in using photographs or video footage</strong></td><td></td></tr><tr><td>23. Discourage using inappropriate image(s) about the suicide.</td><td></td></tr><tr><td>24. Invite not to publish the content of the farewell letter: Score only those responses that clearly indicate that publication of the found farewell letter should be avoided.</td><td></td></tr></tbody></table>

(Continued)
<table><caption>**TABLE 1 | Continued**</caption><thead><tr><th></th><th></th></tr></thead><tbody><tr><td>WHO recommendation 8: take particular care when reporting celebrity suicides</td><td>25. Encourage the treatment of a celebrity suicide or attempted suicide with caution, without valuing the gesture and/or by recontextualizing: Rate only the responses that link the specificity of a celebrity's suicide, with at least one of the following three points concerning the media coverage of this suicide: caution, lack of valuation of the gesture, and recontextualization (or an equivalent at least one of the three). Do not rate responses that simply evoke the celebrity of the person without making the connection to one of the three dimensions mentioned above.<br>26. Encourage to focus on the consequences that the suicidal behavior will have: Rate the answers that clearly mention one type of possible consequence of the act. Do not rate responses that simply state that there will be consequences, without specifying which ones.<br>27. Discourage speculation about the possibility of a suicidal cause for the unexplained death of a celebrity: Rate only those responses that stress the need to be certain that the fact mentioned is indeed suicide. Do not rate responses that imply that the suicide in question is certain.</td></tr><tr><td>WHO recommendation 9: show due consideration for people bereaved by suicide</td><td>28. Encourage respect for the privacy of the family and friends of the person affected by the suicide.<br>29. Recommend avoiding the interviews of families and friends persons who died by suicide.</td></tr><tr><td>WHO recommendation 10: provide information about where to seek help</td><td>30. Encourage giving information about resources/where to find help: Rate only those responses that clearly cite a specific worker or structure from which a person with suicidal thoughts can find help.<br>31. Encourage people to talk about the possibility of action, of care: Rate the responses that evoke the possibility of aid, prevention, care, and the fight against suicide. Do not rate the answers that start from the example of the deceased person to evoke the possibility of taking charge of a suicidal crisis.<br>32. Encourage giving examples of interventions that have contributed to prevent suicidal behaviors: Rate responses that suggest that the journalist include an insert in the article that includes the testimony of a person who has successfully overcome a suicidal crisis.</td></tr><tr><td>WHO recommendation 11: recognize that media professionals themselves may be affected by stories about suicide</td><td>33. Mention the potential impact and/or resonance that a suicidal behavior can induce in journalists: Rate only the answers clearly mentioning the resonances that the suicidal act can have on the journalist.</td></tr></tbody></table>

resident in psychiatry), professional experience (in years), hospital activity (yes, no), (3) level of knowledge (high if the participant reported to know the WE, the PE and the WHO recommendations, medium if the respondent declared to know one of the three notions, and low if none of the notions were known), and (4) media relations: previous experience with journalists (no experience, have already been solicited but without having answered, having already been interviewed).

## Analysis

The baseline characteristics were described and compared between respondents and non-respondents at T1 using Chi-square tests for proportions and Student's tests for means.

To assess the effect of the MMT, analyses were only performed in participants who responded to both T0 and T1. Effect-sizes of change in mean WHOOr scores were calculated using Cohen's d for a paired samples by dividing the mean difference by the standard deviation of the difference. Within-subjects *t*-test was performed to compare WHOOr scores at T0 and T1.

To identify factors likely to influence the WHOOr score and its improvement after the MMT, we computed multivariate linear regression models with the WHOOr scores at T0 and T1 being the outcome variable.

We adjusted the models for gender (male, female), professional experience (in years, categorized into four quartiles), hospital activity (yes, no), level of knowledge (high, medium, and low) and history regarding relations with media (no experience, solicited, and interviewed). Age and status were not included due to redundancy with the information provided by

the variable “professional experience.” The models explaining the WHOOr scores at T1 were additionally adjusted for the score at baseline. Associations between factors and WHOOr scores were presented as differences and 95% confidence intervals (CI 95%).

The tests were two-tailed, and the level of significance was 0.05. Analyses were performed using R 3.6.1.

## RESULTS

### Sample Characteristics

The characteristics of the respondents are described in Table 2. Among the psychiatrists and residents in psychiatry attending the French national psychiatry congresses, 173 volunteered to participate in the study at T0, and 132 also participated at T1 (response rate = 76%). No differences at baseline were found between respondents and non-respondents at T1.

### Impact of the Mini Media Training

Both the unweighted and the weighted WHOOr scores increased at T1 (Figure 1). The average unweighted WHOOr score was 4.72 (±2.78) at T0 and 6.80 (±3.41) at T1 (difference = 2.08, *p* < 0.001). The average weighted WHOOr score was 3.02 (±2.00) at T0 and 4.26 (±2.31) at T1 (difference = 1.24, *p* < 0.001). Depending on whether we relied on the unweighted or weighted WHOOr score, this corresponded to a Cohen's *d* equal to 0.76 or 0.65, respectively.
<table><caption>**TABLE 2** | Baseline characteristics of the respondents and non-respondents at T1.</caption><thead><tr><th></th><th>Overall sample</th><th>Non-respondents at T1</th><th>Respondents at T1</th><th>p</th></tr></thead><tbody><tr><td>Age, m (sd)</td><td>N = 173<br>41.7 (15.7)</td><td>N = 41<br>45.5 (15.2)</td><td>N = 132<br>40.5 (15.7)</td><td>0.074</td></tr><tr><td>Genre, n (%)</td><td></td><td></td><td></td><td>0.913</td></tr><tr><td>Male</td><td>81 (46.8)</td><td>20 (48.8)</td><td>61 (46.2)</td><td></td></tr><tr><td>Female</td><td>92 (53.2)</td><td>21 (51.2)</td><td>71 (53.8)</td><td></td></tr><tr><td>Status, n (%)</td><td></td><td></td><td></td><td>0.127</td></tr><tr><td>Psychiatrist</td><td>116 (67.1)</td><td>32 (78.0)</td><td>84 (63.6)</td><td></td></tr><tr><td>Resident</td><td>57 (32.9)</td><td>9 (22.0)</td><td>48 (36.4)</td><td></td></tr><tr><td>Professional experience, m (sd)</td><td>14.6 (14.1)</td><td>17.4 (14.1)</td><td>13.8 (14.1)</td><td>0.153</td></tr><tr><td>Hospital activity, n (%)</td><td></td><td></td><td></td><td>0.112</td></tr><tr><td>Yes</td><td>132 (76.3)</td><td>27 (65.9)</td><td>105 (79.5)</td><td></td></tr><tr><td>No</td><td>41 (23.7)</td><td>14 (34.1)</td><td>27 (20.5)</td><td></td></tr><tr><td>Previous experience with journalists, n (%)</td><td></td><td></td><td></td><td>0.224</td></tr><tr><td>No previous experience</td><td>77 (44.5)</td><td>20 (48.8)</td><td>57 (43.2)</td><td></td></tr><tr><td>Solicited</td><td>16 (9.2)</td><td>1 (2.4)</td><td>15 (11.4)</td><td></td></tr><tr><td>Interviewed</td><td>80 (46.2)</td><td>20 (48.8)</td><td>60 (45.5)</td><td></td></tr><tr><td>Previous knowledge, n (%)</td><td></td><td></td><td></td><td>0.590</td></tr><tr><td>Low</td><td>20 (11.6)</td><td>19 (46.3)</td><td>54 (40.9)</td><td></td></tr><tr><td>Medium</td><td>80 (46.2)</td><td>19 (46.3)</td><td>61 (46.2)</td><td></td></tr><tr><td>High</td><td>73 (42.2)</td><td>3 (7.3)</td><td>17 (12.9)</td><td></td></tr><tr><td>Unweighted WHO score, m (sd)</td><td>4.64 (2.65)</td><td>4.39 (2.20)</td><td>4.72 (2.78)</td><td>0.489</td></tr><tr><td>Weighted WHO score, m (sd)</td><td>2.97 (1.88)</td><td>2.81 (1.43)</td><td>3.02 (2.00)</td><td>0.535</td></tr></tbody></table>

<figure><img src="image_3.png" /><figcaption>**FIGURE 1** | Unweighted (A) and weighted (B) WHO score before (T0) and after (T1) the Mini Media Training. The mean score is symbolized by a blue dot on the boxplot.</figcaption></figure>
The detailed responses to T0 and T1, item by item and depending on the level of directivity, are provided in **Supplementary Table 2**.

## Factors Associated With the WHOOr Score

Results of the models explaining the WHOOr scores at T0 are presented in **Figure 2**. Compared to psychiatrists with short professional experience (<3 years), those reporting a long professional experience (>28 years) had a significantly lower WHOOr score at T0 (estimate [CI 95%] = -2.17 [-3.36, -0.97], *p* < 0.001 for the unweighted WHOOr score, and -1.17 [-2.02, -0.32], *p* = 0.007 for the weighted score. Conversely, a high level of knowledge was associated with a better WHOOr score at T0 compared to a low level of knowledge (estimate [CI 95%] = 2.16 [0.87, 3.44], *p* = 0.001 for the unweighted WHOOr score, and 1.67 [0.76, 2.58], *p* < 0.001 for the weighted WHOOr score). In the model explaining the weighted WHOOr score, having an experience of media interview was also associated with a score was also associated with a higher score (estimate [CI 95%] = 0.64 [0.01, 1.28], *p* = 0.049).

Results of the models explaining the WHOOr scores at T1 are presented in **Figure 3**. After adjusting for the score at baseline (the higher the T0 score, the higher the T1 score), professional experience was still associated with a lower WHOOr score at T1. Compared to psychiatrists reporting an experience under 3 years, those with a more than 28 years of experience had a lower WHOOr score at T1 (estimate [CI 95%] = -2.74 [-4.19, -1.30], *p* < 0.001 for the unweighted WHOOr score, and -1.55 [-2.53,

-0.57], *p* = 0.002 for the weighted WHOOr score). In the model explaining the unweighted WHOOr score, this difference was also significant for those reporting 7-28 years of experience (estimate [CI 95%] = -1.47 [-2.83, -0.11], *p* < 0.034). A high level of knowledge was only associated with the weighted WHOOr score (estimate [CI 95%] = 1.26 [0.22, 2.31], *p* = 0.018).

# DISCUSSION

## Main Results

Among the 132 psychiatry physicians that completed both T0 and T1 assessments, the MMT resulted in significant improvements of both weighted and unweighted WHOOr scores, suggesting better abilities in advising journalists about media coverage of suicide. Having a shorter professional experience, a history of contact with journalists and stronger general knowledge about the WE, PE, and the WHO recommendations were associated with greater communication skills at baseline. All these characteristics, along with prior experience in communicating with media, also predicted a better weighted WHOOr score at T1.

## Interpretation

These results support the relevance of the MMT for improving psychiatrists' ability to guide journalists toward more responsible media coverage of suicide. After the MMT, physicians where more prone to deliver relevant pieces of advice in relation with the WHO recommendations, as suggested by the significant T0-T1 increase of the WHOOr weighted score. The T0-T1 progression of the weighted score also indicate a stronger tendency to

<table><caption>**FIGURE 2** | Factors associated with the unweighted and the weighted WHOOr scores at T0—Results of the multivariate linear regression models.</caption><thead><tr><th>Variable</th><th>N</th><th>Estimate</th><th>p</th><th>Estimate</th><th>p</th></tr></thead><tbody><tr><td>Professional experience</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;&lt; 3 years</td><td>51</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;4-7 years</td><td>41</td><td>0.27 (-0.77, 1.31)</td><td>0.606</td><td>0.49 (-0.25, 1.23)</td><td>0.196</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;7-28 years</td><td>39</td><td>-0.99 (-2.13, 0.15)</td><td>0.087</td><td>-0.38 (-1.19, 0.43)</td><td>0.356</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;&gt; 28 years</td><td>42</td><td>-2.17 (-3.36, -0.97)</td><td>&lt;0.001</td><td>-1.17 (-2.02, -0.32)</td><td>0.007</td></tr><tr><td>Gender</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Male</td><td>81</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Female</td><td>92</td><td>-0.07 (-0.84, 0.71)</td><td>0.869</td><td>-0.05 (-0.61, 0.50)</td><td>0.847</td></tr><tr><td>Hospital activity</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;No</td><td>41</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Yes</td><td>132</td><td>0.23 (-0.70, 1.16)</td><td>0.633</td><td>0.21 (-0.45, 0.87)</td><td>0.526</td></tr><tr><td>Media experience</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;No experience</td><td>77</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Solicited</td><td>16</td><td>0.05 (-1.33, 1.43)</td><td>0.947</td><td>0.08 (-0.90, 1.06)</td><td>0.871</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Interviewed</td><td>80</td><td>0.70 (-0.20, 1.60)</td><td>0.125</td><td>0.64 (0.00, 1.28)</td><td>0.049</td></tr><tr><td>Knowledge</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Low</td><td>73</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Medium</td><td>80</td><td>0.49 (-0.34, 1.32)</td><td>0.249</td><td>0.23 (-0.36, 0.82)</td><td>0.443</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;High</td><td>20</td><td>2.16 (0.87, 3.44)</td><td>0.001</td><td>1.67 (0.76, 2.58)</td><td>&lt;0.001</td></tr></tbody></table>
<table><caption>**FIGURE 3** | Factors associated with the unweighted and the weighted WHO scores at T1—Results of the multivariate linear regression models.</caption><thead><tr><th>Variable</th><th>N</th><th>Estimate</th><th>p</th><th>Estimate</th><th>p</th></tr></thead><tbody><tr><td>Baseline score</td><td>132</td><td>0.61 (0.44, 0.78)</td><td>&lt;0.001</td><td>0.58 (0.41, 0.74)</td><td>&lt;0.001</td></tr><tr><td>Professional experience</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;&lt; 3 years</td><td>41</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;4-7 years</td><td>37</td><td>-0.09 (-1.22, 1.04)</td><td>0.877</td><td>0.24 (-0.54, 1.03)</td><td>0.542</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;7-28 years</td><td>23</td><td>-1.47 (-2.83, -0.11)</td><td>0.034</td><td>-0.78 (-1.71, 0.15)</td><td>0.099</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;&gt; 28 years</td><td>31</td><td>-2.74 (-4.19, -1.30)</td><td>&lt;0.001</td><td>-1.55 (-2.53, -0.57)</td><td>0.002</td></tr><tr><td>Gender</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Male</td><td>61</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Female</td><td>71</td><td>0.34 (-0.55, 1.23)</td><td>0.449</td><td>0.38 (-0.24, 0.99)</td><td>0.229</td></tr><tr><td>Hospital activity</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;No</td><td>27</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Yes</td><td>105</td><td>0.19 (-0.93, 1.30)</td><td>0.741</td><td>0.07 (-0.70, 0.84)</td><td>0.860</td></tr><tr><td>Media experience</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;No experience</td><td>57</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Solicited</td><td>15</td><td>-1.20 (-2.69, 0.28)</td><td>0.111</td><td>-0.24 (-1.27, 0.79)</td><td>0.649</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Interviewed</td><td>60</td><td>0.03 (-1.05, 1.10)</td><td>0.962</td><td>0.03 (-0.71, 0.78)</td><td>0.930</td></tr><tr><td>Knowledge</td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Low</td><td>54</td><td>Reference</td><td></td><td>Reference</td><td></td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;Medium</td><td>61</td><td>0.32 (-0.63, 1.26)</td><td>0.510</td><td>0.16 (-0.50, 0.81)</td><td>0.634</td></tr><tr><td>&nbsp;&nbsp;&nbsp;&nbsp;High</td><td>17</td><td>1.13 (-0.35, 2.61)</td><td>0.135</td><td>1.26 (0.22, 2.31)</td><td>0.018</td></tr></tbody></table>

deliver these recommendations spontaneously. It is noteworthy—and maybe counterintuitive—that younger professionals have been found to be more comfortable communicating with journalists than their older counterparts. This may reflect a generational gap according to which younger populations are more aware of contemporaneous communication challenges because they grew in a highly mediatistic environment (Horst, 2012). The consequences of communication about suicide, in particular, has gained a considerable interest in the past 10 years (Niederkrotenthaler and Till, 2019), with possible translations into the curriculum of young doctors. Also, minimal professional experience may be associated with greater plasticity of professional identity, and possibly greater availability to the acquisition of new professional skills. This may explain that the MMT appeared more beneficial to early career than to confirmed psychiatrists.

The participants had better performances during the interviews when they had greater prior knowledge of the WE, PE, and WHO recommendations. This result was expected since literacy is usually considered as a prerequisite for, or potentiator of, professional skills, especially as regards to suicide prevention (Inman et al., 1984). Although they did not necessarily know each of the recommendations, it is likely that psychiatrists relied on their general awareness of the WE and PE to infer the relevant pieces of advice to provide to the journalists. The level of prior knowledge about the effect of media coverage of suicide at baseline predicted a greater progression of the WHO weighted score between T0 and T1, but not of the unweighted score. Rather than informing about the new pieces of advice to deliver, the MMT may have helped psychiatrists who already

had knowledge about suicide-related communication to take a stronger lead during the interview and guide more proactively the journalists.

Finally, it was also expected that participants who already had contacts with journalists would have greater weighted scores at baseline than the rest of the sample. Indeed, already having dealt with journalists is likely to be associated with greater confidence during interviews, and therefore with greater ease in spontaneously giving advice to media professionals.

## Perspective

The journalistic work is driven by strong missions and constrains that might sometimes contradict prevention perspectives, especially when it comes to suicidal behaviors. For instance, the duty to provide information in a context of increasing economic pressure and of competition with social media incite media professionals to rapidly release high impact productions (Collings and Kemp, 2010). This may lead to structural contradictions with the principles of the WHO recommendations by urging journalists to use catchy headlines, explicit pictures or a sensational tone. Some journalists may also perceive externally applied recommendations as restrictions for their freedom of information (Notredame et al., 2016; Yaqub et al., 2020). Despite these possible sticking points, most media professionals show a strong interest in mental health issues. In a survey that inquired 20 journalists by a self-questionnaire sent over the Internet, 90% of the sample agreed that the press could be used as a vehicle for spreading information about mental health (Barasino et al., 2016; Legrand, 2016). However, the respondents also expressed some frustration
because many psychiatrists refused, ignored, or responded after a long delay to their interview request. As a short, easy to implement pedagogical format, the MMT may offer a solution to mitigate this interprofessional gap. It encourages and give psychiatrists the tools to actively present themselves as resources for journalists. While breaking with a prescriptive or moralizing attitude, it helps them endorsing the role of prevention ambassadors, overcoming the possible points of tension between media demands and health principles, and, in turn, raise awareness in journalists. Beyond simply delivering technical advice, this effort to make media and mental health perspectives converge may be the condition for both mental health professionals and journalists to really grasp the challenges of the WHO recommendations and thus apply them (Notredame et al., 2016).

According to our results, students and young psychiatrists could be a primary target for such educative programs. Assuming that residency and early carrier is the privileged period for physicians to build their professional identity, delivering media-oriented training sessions such as the MMT during this time of the curriculum could help raising a culture of collaboration between journalists and mental health professionals at the benefit of suicide prevention (Notredame et al., 2016).

## Limits

To our knowledge, the present study is the first evaluated initiative taken to improve the communication skills of psychiatrists about suicide. However, several methodological limitations need to be taken in account. (1) The experimental setting was not exactly the same at T0 and T1. For ecological reasons, we organized a face-to-face simulation exercise at T0, while the interview was carried out by telephone at T1. This may alter the possibility to impute the observed score variations to the MMT because of reduced comparability between the assessment points. However, it is very unlikely that phone contacts had, by themselves, improved the performance of the psychiatrists. In addition, this protocol helped considerably minimizing the attrition bias which was less than 25%. (2) Due to agenda constrains of the participants, the time lag between T0 and T1 varied from 1 and 3 months, which may have introduced variability in the performances due to a memory retention bias. If our results allow to be pretty confident about the effect of the MMT at 1 month, other studies could be led to confirm the remanence of this effect on longer periods. (3) During the training interviews, the journalist adopted a neutral position without bouncing on the psychiatrist's responses or pushing him to his limits. Such conditions may lack realism, and it is possible that the trained psychiatrists would show poorer performances in an ecological context. An interesting development path for MMT could be to divide the participants into two groups, one with a journalist adopting a neutral tone, the other with a journalist with a more aggressive style. Such work would make it possible to better understand the potential influence of journalistic style on the quality of the psychiatrist's responses. (4) Investigators had to deal with rating ambiguities between some items of the WHO scale. For example, the items "Avoid repeating the coverage of a suicidal behavior/questioning the

relevance of a new article" and "In general, advise against highlighting and over-mediating suicidal events" were sometimes overlapping (5) As the MMT evaluates the effectiveness of the entire intervention, i.e., the debriefing associated with the brochure given to the participant at the end of T0, it was unfortunately not possible to attribute the observed effect to any of the components of MMT. (6) Although still very influent in France and worldwide (Newman et al., 2021), journalism isn't the only source of suicide-related media productions. For instance, suicidal contents are frequent on websites (Baker and Fortune, 2008) and social media (Ruder et al., 2011), with a large panel of stakeholders involved such as citizens, webmasters, or blog moderators. Also, the notion of "suicidal contents" cannot be summed up to reports of suicidal behaviors. Testimonies, general information, posts or fictions may also be concerned by the risk of WE and opportunity of PE. To that respect the MMT has a rather narrow scope and specific variations should be considered.

## CONCLUSION

The MMT appears as an interesting tool to improve psychiatrists' ability to guide journalists toward a more responsible media coverage of suicide. In a relatively short time, it raises awareness about the effects of suicide-related communication and trains the participants to concretely help journalists better applying the WHO recommendations. Because actioning indirect levers, its sole implementation would certainly not be sufficient to reduce the WE and promote the PE. However, the MMT aims at involving psychiatrists as active stakeholders in the collective effort for safer media productions about suicide. As such, it may be synergistic with other actions organized in France by the Papageno program, such as the publication of national adaptation of the recommendations (Legrand, 2016), more complete media trainings (Legrand, 2016) or collaborations between mental health trainees and students in journalism (Notredame et al., 2016).

## DATA AVAILABILITY STATEMENT

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

## ETHICS STATEMENT

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements. Written informed consent was not obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
## AUTHOR CONTRIBUTIONS

C-EN and NP were responsible for the original idea of the Mini-Media Training. C-EN conceived the protocol. KW carried out the Mini-Media Training sessions and collected the data. KW and SV rated the interviews and managed the data. MW performed the analysis. KW, C-EN, and MW wrote the manuscript with support from NP, SV, PG, and GV. GV supervised the whole project. All authors contributed to the article and approved the submitted version.

## FUNDING

The authors declare that the Papageno Program, that developed and implemented the Mini Media Training, received funding from the French Ministry of Health. The funder was not involved in the study design, collection, analysis, interpretation

## REFERENCES

Arendt, F., and Scherr, S. (2017). A qualitative study on health practitioners' subjective theories regarding the media effects on depression-related outcomes. *Suicidol. Online* 8, 78–88.

Bachmann, S. (2018). Epidemiology of Suicide and the Psychiatric Perspective. *Int. J. Environ. Res. Public Health* 15:1425. doi: 10.3390/ijerph15071425

Baker, D., and Fortune, S. (2008). Understanding self-harm and suicide websites: a qualitative interview study of young adult website users. *Crisis* 29, 118–122. doi: 10.1027/0227-5910.29.3.118

Barasino, O., Laurent, A., and Charrel, C.-L. (2016). *Journalistes, Psychiatres : les voix de la Communication*. Available Online at: https://www.f2rsmpsy.fr/100-journalistes-psychiatres-voix-communication.html [accessed Jun 12, 2021].

Chandra, P. S., Doraiswamy, P., Padmanabh, A., and Philip, M. (2014). Do newspaper reports of suicides comply with standard suicide reporting guidelines? A study from Bangalore, India. *Int. J. Soc. Psychiatry* 60, 687–694. doi: 10.1177/0020764013513438

Collings, S. C., and Kemp, C. G. (2010). Death knocks, professional practice, and the public good: the media experience of suicide reporting in New Zealand. *Soc. Sci. Med.* 71, 244–248. doi: 10.1016/j.socscimed.2010.03.017

Duncan, S., and Luce, A. (2020). Teaching responsible suicide reporting (RSR): using storytelling as a pedagogy to advance media reporting of suicide. *Journal. Educ.* 9, 18–31.

Etzersdorfer, E., Voracek, M., and Sonneck, G. (2004). A dose-response relationship between imitational suicides and newspaper distribution. *Arch. Suicide Res.* 8, 137–145. doi: 10.1080/13811110490270985

Fu, K.-W., and Yip, P. S. F. (2009). Estimating the risk for suicide following the suicide deaths of 3 Asian entertainment celebrities: a meta-analytic approach. *J. Clin. Psychiatry* 70, 869–878. doi: 10.4088/jcp.08m04240

Horst, H. A. (2012). "New Media Technologies in Everyday Life," in *Digital Anthropology*, eds, H. A. Horst, and D. Miller. (Oxfordshire: Routledge), 19.

Inman, D. J., Bascue, L. O., Kahn, W. J., and Shaw, P. A. (1984). The relationship between suicide knowledge and suicide interviewing skill. *Death Educ.* 8, 179–184. doi: 10.1080/07481188408252456

Jamieson, P., Jamieson, K. H., and Romer, D. (2003). The responsible reporting of suicide in print journalism. *Am. Behav. Sci.* 46, 1643–1660. doi: 10.1177/0002764203254620

Landis, J. R., and Koch, G. G. (1977). The measurement of observer agreement for categorical data. *Biometrics* 33, 159–174. doi: 10.2307/2529310

Legrand, C. (2016). *Accompagner les journalistes vers un traitement médiatique plus responsable du suicide. Le rôle des psychiatres*. Available Online at: https://papageno-suicide.com/publications-scientifiques/ [accessed Jun 12, 2021].

of data, the writing of this article, or the decision to submit it for publication.

## ACKNOWLEDGMENTS

We thank Claire Legrand for having conducted the first media training sessions and helped improving the intervention.

## SUPPLEMENTARY MATERIAL

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.733691/full#supplementary-material

**Supplementary Table 1** | Initial kappa coefficients for each item (in red, items whose initial kappa coefficients were less than 0.6).

**Supplementary Table 2** | Responses to each of the items of the WHOr score according to the level of directivity at T0 and T1 (paired sample, N = 132).

Leon, S. L., Cloutier, P., Bélair, M.-A., and Cappelli, M. (2014). Media coverage of youth suicides and its impact on paediatric mental health emergency department presentations. *Healthc. Policy* 10, 97–107.

Michel, K., Frey, C., Wyss, K., and Valach, L. (2000). An exercise in improving suicide reporting in print media. *Crisis* 21, 71–79. doi: 10.1027//0227-5910.21.2.71

Naghavi, M. (2019). Global Burden of Disease Self-Harm Collaborators. Global, regional, and national burden of suicide mortality 1990 to 2016: systematic analysis for the Global Burden of Disease Study 2016. *BMJ* 364:l94. doi: 10.1136/bmj.l94

Newman, N., Fletcher, R., Schulz, A., Andi, S., Robertson, C. T., and Nielsen, R. K. (2021). *Reuters Institute Digital News Report 2021*. Oxford: Reuters Institute for the Study of Journalism.

Niederkrotenthaler, T., Braun, M., Pirkis, J., Till, B., Stack, S., Sinyor, M., et al. (2020). Association between suicide reporting in the media and suicide: systematic review and meta-analysis. *BMJ* 368:m575. doi: 10.1136/bmj.m575

Niederkrotenthaler, T., Reidenberg, D. J., Till, B., and Gould, M. S. (2014). Increasing help-seeking and referrals for individuals at risk for suicide by decreasing stigma: the role of mass media. *Am. J. Prev. Med.* 47, S235–S243.

Niederkrotenthaler, T., and Sonneck, G. (2007). Assessing the impact of media guidelines for reporting on suicides in Austria: interrupted time series analysis. *Aust. N. Z. J. Psychiatry* 41, 419–428. doi: 10.1080/00048670701266680

Niederkrotenthaler, T., Stack, S., Till, B., Sinyor, M., Pirkis, J., Garcia, D., et al. (2019). Association of Increased Youth Suicides in the United States With the Release of 13 Reasons Why. *JAMA Psychiatry* 76, 933–940. doi: 10.1001/jamapsychiatry.2019.0922

Niederkrotenthaler, T., and Till, B. (2019). Suicide and the Media: from Werther to Papageno Effects – A Selective Literature Review. *Suicidologi* 24:7398. doi: 10.5617/suicidologi.7398

Niederkrotenthaler, T., Voracek, M., Herberth, A., Till, B., Strauss, M., Etzersdorfer, E., et al. (2010). Role of media reports in completed and prevented suicide: Werther v. Papageno effects. *Br. J. Psychiatry* 197, 234–243. doi: 10.1192/bjp.bp.109.074633

Notredame, C.-E., Pauwels, N., Vaiva, G., Danel, T., and Walter, M. (2016). [Can we consider the journalist an actor in suicide prevention?]. *Encephale* 42, 448–452.

Notredame, C.-E., Pauwels, N., Walter, M., Danel, T., and Vaiva, G. (2015). [Media coverage of suicide: from the epidemiological observations to prevention avenues]. *Presse Med.* 44, 1243–1250.

Observatoire National du Suicide. (2019). *Observatoire National du Suicide*. Paris: French Ministry of Health.
Phillips, D. P. (1974). The influence of suggestion on suicide: substantive and theoretical implications of the Werther effect. *Am. Sociol. Rev.* 39, 340–354.

Pirkis, J. E., Burgess, P. M., Francis, C., Blood, R. W., and Jolley, D. J. (2006). The relationship between media reporting of suicide and actual suicide in Australia. *Soc. Sci. Med.* 62, 2874–2886. doi: 10.1016/j.socscimed.2005.11.033

Ruder, T. D., Hatch, G. M., Ampanozi, G., Thali, M. J., and Fischer, N. (2011). Suicide announcement on Facebook. *Crisis* 32, 280–282. doi: 10.1027/0227-5910/a000086

Scherr, S., Markiewitz, A., and Arendt, F. (2019). Effectiveness of a Workshop Intervention on Responsible Reporting on Suicide Among Swiss Media Professionals. *Crisis* 40, 446–450.

Skehan, J., Burns, L. S., and Hazell, T. (2009). The Response Ability Project: integrating the Reporting of Suicide and Mental Illness into Journalism Curricula. *Journal. Mass Commun. Educ.* 64, 191–204.

Tatum, P. T., Canetto, S. S., and Slater, M. D. (2010). Suicide coverage in U.S. newspapers following the publication of the media guidelines. *Suicide Life Threat Behav.* 40, 524–534. doi: 10.1521/suli.2010.40.5.524

Von Goethe, J. W. (1774). *Die leiden des jungen Werthers*. Leipzig: Weygand'sche Buchhandlung.

World Health Organization (WHO) (2019). Available Online at: https://www.who.int/mental_health/prevention/suicide/suicideprevent/fr (accessed 2021).

World Health Organization (WHO), and International Association for Suicide Prevention (IASP). (2008). *Preventing suicide: A resource for media professionals*. Switzerland: WHO.

World Health Organization (WHO), and International Association for Suicide Prevention (IASP). (2017). *Preventing suicide: A resource for media professionals, Update 2017*. Switzerland: WHO.

Yaqub, M. M., Beam, R. A., and John, S. L. (2020). 'We report the world as it is, not as we want it to be': Journalists' negotiation of professional practices and responsibilities when reporting on suicide. *Journalism* 21, 1283–1299. doi: 10.1177/1464884917731957

**Conflict of Interest:** The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

**Publisher's Note:** All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Copyright © 2021 Walter, Wathelet, Valdenaire, Grandgenèvre, Pauwels, Vaiva and Notredame. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.