# Variations in postpartum hemorrhage management among midwives: A national vignette-based study

Anne Rousseau, Patrick Rozenberg, Élodie Perrodeau, Catherine Deneux-Tharaux, Philippe H. Ravaud

► To cite this version:

Anne Rousseau, Patrick Rozenberg, Élodie Perrodeau, Catherine Deneux-Tharaux, Philippe H. Ravaud. Variations in postpartum hemorrhage management among midwives: A national vignette-based study. PLoS ONE, 2016, 11 (4), 10.1371/journal.pone.0152863. hal-02559117

HAL Id: hal-02559117

https://hal.science/hal-02559117

Submitted on 7 Jun 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

RESEARCH ARTICLE

# Variations in Postpartum Hemorrhage Management among Midwives: A National Vignette-Based Study

A. Rousseau<sup>1,2,*</sup>, P. Rozenberg<sup>1,3,*</sup>, E. Perrodeau<sup>2,4</sup>, C. Deneux-Tharaux<sup>5</sup>, P. Ravaud<sup>2,4,●</sup>

1 Department of Obstetrics and Gynecology, Poissy-Saint Germain Hospital, Poissy, France, 2 INSERM U1153, METHODS (Méthodes en évaluation thérapeutique des maladies chroniques) Research Unit, Paris Descartes-Sorbonne Paris Cité University, Paris, France, 3 Research unit EA 7285, Versailles-St Quentin University, Saint Quentin en Yvelines, France, 4 Assistance Publique-Hôpitaux de Paris, Centre d'Epidémiologie Clinique, Hôpital Hôtel-Dieu, Paris, France, 5 INSERM U1153, EPOPé (Epidémiologie Obstétricale, Périnatale et Pédiatrique) Research Unit, Paris Descartes-Sorbonne Paris Cité University, Paris, France

● These authors contributed equally to this work.

* anne.rousseau@uvsq.fr

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Rousseau A, Rozenberg P, Perrodeau E, Deneux-Tharaux C, Ravaud P (2016) Variations in Postpartum Hemorrhage Management among Midwives: A National Vignette-Based Study. PLoS ONE 11(4): e0152863. doi:10.1371/journal.pone.0152863

**Editor:** Shannon M. Hawkins, Indiana University School of Medicine, UNITED STATES

**Received:** June 5, 2015

**Accepted:** March 21, 2016

**Published:** April 4, 2016

**Copyright:** © 2016 Rousseau et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** All relevant data are within the paper and its Supporting Information files.

**Funding:** This trial was supported by a research grant from the Département à la Recherche Clinique Ile-de-France, Assistance Publique-Hôpitaux de Paris, which also sponsored the study (PHRC-AOR13212). The study sponsor did not participate in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. Authors had full access to all the data and had final responsibility for the decision to submit for publication.

## Abstract

### Objective

To assess variations in adherence to guidelines for management of postpartum hemorrhage (PPH) among midwives.

### Methods

A multicentre vignette-based study was e-mailed to a random sample of midwives from 145 maternity units in France. They were asked to describe how they would manage the PPH described in 2 case-vignettes. These previously validated case-vignettes described 2 different scenarios for severe PPH. Vignette 1 described a typical immediate, severe PPH and vignette 2 a less typical case of severe but gradual PPH. They were constructed in 3 successive steps and included multiple-choice questions proposing several types of clinical practice options at each step. An expert consensus defined 14 criteria for assessing adherence to guidelines issued by the French College of Obstetricians and Gynecologists in 2004 in the midwives' responses. We analyzed the number of errors among the 14 criteria to quantify the level of adherence.

## Results

We obtained 450 complete responses from midwives from 87 maternity units. The rate of complete adherence (no error for any of the 14 criteria) was low: 25.1% in vignette 1 and 4.2% in vignette 2. The error rate was higher for pharmacological management, especially oxytocin use, than for non-pharmacological management and communication-monitoring-investigation. Adherence to guidelines varied substantially between and within maternity units, as well as between the vignettes for the same midwives.
**Competing Interests:** The authors have declared that no competing interests exist.

## Conclusion

Reponses to case-vignettes demonstrated substantial variations in PPH management and especially individual variations in adherence to guidelines. Midwives should participate in continuous and individualized training.

## Introduction

Severe postpartum hemorrhage (PPH) is a leading cause of maternal mortality and morbidity worldwide [1-3] and occurs in around 1% to 2% of deliveries in high-income countries [3,4]. The incidence of PPH is increasing worldwide [5-8]: in the United States, the rate has increased from 2.3% to 2.9% (i.e., +26%) over the past 10 years [2,9]. Hemorrhage accounts for 12% of pregnancy-related deaths in the United States and 18% in France [10-13]. Moreover reports from confidential enquiries show that 67% of the US and 85% of the French deaths were avoidable [13-15], as they resulted from delay in treatment or inadequate management.

Furthermore, variations in clinical practice related to PPH occur between and within countries, even though national clinical practice guidelines for PPH are similar in France, other western European countries, the United States, and Canada [16-23]. Winter et al [16], using questionnaires to document policies of maternity units for the immediate management of postpartum hemorrhage in 12 countries, found considerable differences in the choice of pharmaceutical agents. Two French studies have showed that management of severe PPH is not optimal and that the guidelines are not fully applied [24,25]. The existence of variations in the conformity of clinical practice to guidelines between professionals in the same maternity units and between different PPH situations for the same professional has not yet been investigated, however, although it would be useful for developing effective strategies to improve clinical practices.

Clinical vignettes have been widely used to compare quality of clinical care and to assess practice variations across countries, health care systems, specialties, and clinicians [26-29]. The case-vignette method can be used to identify variations in practice and to understand discrepancies between guidelines and practices in PPH management. In a previous study, dynamic vignettes with several steps proved to be a valid tool that can accurately reflect real practices in such complex emergency situations as severe PPH [30]. The objective of our study was to assess variations in adherence to the guidelines issued by the French College of Obstetricians and Gynecologists [20,21] for management of postpartum hemorrhage (PPH) among midwives, who diagnose and provide initial management of PPH at the same time as they call for the obstetrician in some countries, including France and the United Kingdom. In France midwives have a specific medical education certified by a state diploma considered equivalent to a Masters degree, and midwifery is included in the Public Health Code as a medical professions along with doctors and dentists. Midwives work closely with the obstetricians and anesthesiologists on duty to manage life-threatening situations, notably severe PPH. They may prescribe some medications as well as oxytocin. Understanding the discrepancies between the guidelines and midwives' actions during PPH should highlight the areas where improvement is needed.

## Material and Methods

This multicentre cross-sectional study was conducted from January to April 2014.
Midwives were requested to respond to an online survey, in which they answered multiple-choice questions about how they would manage 2 case-vignettes of PPH.

## Survey instrument: case-vignettes

Our previous validation study concerned 66 dynamic case vignettes that we developed to describe real incidents of severe PPH in several steps [30]. Briefly, vignettes were developed by abstracting from patient files women's medical history and information about the pregnancy, labor, delivery, and PPH. All information that might identify the specific situation was intentionally changed. Cases were selected from Ile-de-France maternity unit birth registers according to the requirements of the validation study and included two cases each from each of 33 senior obstetricians.

Six obstetrics professionals (3 midwives and 3 obstetricians) jointly selected 2 case-vignettes among these 66 for this study. They opted for 2 very different situations: vignette 1 describes a typical immediate and severe PPH and vignette 2 a less typical case of severe but gradual PPH with constant trickle of blood (see S1 and S2 Files).

These 2 selected vignettes of PPH included multiple-choice questions that proposed different options for clinical care. We designed the vignettes to include 3 successive steps that re-created the course of each PPH. The first step included a partogram describing the medical history, labor, delivery and PPH. The next 2 steps of the vignette presented the postpartum course over the next 15 minutes (response to treatment) visually: bleeding was illustrated by photographs of simulated soaked pads and containers [31], and maternal condition by photographs of a simulated monitor display (pulse, blood pressure, and SpO₂). At each step, midwives were asked how they would manage the emergency situation.

For each step, we used the same closed-ended questions—"What measures would you perform within the next 15 minutes"- for each of the three different types of management, for the midwife to choose none, one or more actions from the list of choices for each type of management (see S1 Text):

* pharmacological management: antibiotic, oxytocin, misoprostol (prostaglandin E1 analogue), methylergometrine, sulprostone (prostaglandin E2 analogue), tranexamic acid;

* non-pharmacological management: abdominal ultrasound, uterine massage, bimanual uterine compression, torsion of the cervix, bladder catheterization, manual examination of the uterine cavity, cervical examination with speculum, perineal repair, intrauterine tamponade, selective arterial embolization, surgical treatment;

* communication, monitoring and investigation: alert other members of the team, venipuncture for blood sampling, resuscitation and monitoring

When the midwife selected some interventions, the result in terms of patient response was mentioned in the next step in order to guide the next management decision. After responding to the questions at each step, participants could not return to the previous step to change their answers.

## Survey administration

In France, all maternity units, both public and private, belong to a regional perinatal network that groups together level 1 (no facilities for nonroutine neonatal care) and level 2 (with a neonatal care unit) units around one or more level 3 units (reference centres with an onsite neonatal intensive care unit). We selected 15 perinatal networks, about half the total number of networks in France. All 215 maternity units of 15 perinatal networks were eligible. Two
networks (i.e., 37 maternity units) decided not to participate. Among the 13 participating networks, 33 units decided not to participate or were closed before our study started. Accordingly, our sample included 145 maternity units representing 27% of French maternity units.

We sent an email to the supervising midwife in each unit, explaining the aim of the survey and asking each to transmit the link to the survey website by email to all midwives who did work during a arbitrarily selected period (from January 13 to 19 (Monday to Sunday), 2014) in the unit's delivery room. If the midwives did not respond to the survey, their supervisors received two gentle email reminders 2 weeks apart [32].

## Main outcome

Criteria for assessing responses were determined in a two-step procedure involving two separate expert committees. The first comprised 3 midwives and 3 obstetricians previously involved in developing French guidelines for PPH or conducting studies on this topic. They were asked to respond to the 2 vignettes according to guidelines published by the French College of Obstetricians and Gynecologists in 2004 and updated in 2014[20–21], which are similar to those of both the American College of Obstetricians and Gynecologists [19] and the Royal College of Obstetricians and Gynaecologists [22]. A second committee of one obstetrician, one midwife, and one epidemiologist reviewed their answers and selected as criteria only those responses selected by all members of the first committee. Finally, 14 criteria were used to define adherence to guidelines for each vignette: 3 for pharmacological management, 8 for non-pharmacological management, and 3 criteria for other management (communication, monitoring and investigation) (Table 1): some were answers that had to be chosen, while others were answers that were always wrong in that circumstance. The remaining responses were considered neither correct nor incorrect and did not count in the assessment.

Management was considered appropriate when all 14 criteria were met. Finally, to quantify adherence to guidelines, we assessed the number of errors, defined as the number of the 14 selected criteria performed incorrectly, that is, the actions that should not have been taken and the failure to take necessary actions. Thus 0 to 14 errors were possible for each vignette. Adherence was assessed separately for each vignette (expected responses were, however, identical).

<table><caption>**Table 1. Criteria for evaluation of adherence to guidelines.**</caption><tr><td><strong>Pharmacological management:</strong></td></tr><tr><td>First line uterotonic: oxytocin in step 1</td></tr><tr><td>Second line uterotonic: sulprostone (prostaglandin E2 analogue) in step 2</td></tr><tr><td>No misoprostol (prostaglandin E1 analogue) in each step</td></tr><tr><td><strong>Non-pharmacological management:</strong></td></tr><tr><td>Manual placental delivery, manual examination of the uterine cavity in step 1</td></tr><tr><td>No intrauterine tamponade in step 1</td></tr><tr><td>No torsion of the cervix in step 1</td></tr><tr><td>Uterine massage in steps 1 or 2</td></tr><tr><td>Cervical examination with speculum in steps 1 or 2</td></tr><tr><td>No surgical treatment in steps 1 or 2</td></tr><tr><td>No selective arterial embolization in steps 1 or 2</td></tr><tr><td>Surgical treatment, selective arterial embolization and/or intrauterine tamponade in step 3</td></tr><tr><td><strong>Communication, monitoring and investigation:</strong></td></tr><tr><td>Alert other members of the team in steps 1 or 2</td></tr><tr><td>Venipuncture with blood count, hemostasis in steps 1 or 2</td></tr><tr><td>Resuscitation measure in steps 1 or 2</td></tr></table>

doi:10.1371/journal.pone.0152863.t001
## Ethics statement

Our institutional review board (Comité de Protection des Personnes Ile de France Paris- XI) approved this study on September 13, 2012, as number 12066.

Participants were all midwives who completed a questionnaire about how they would respond to 2 clinical vignettes. By clicking on the survey link and completing the questionnaire, they provided informed consent to participate. Participants were informed about the purpose of the study at the beginning of the study (through the email that led them to contact the study site and by the introduction to the study).

## Statistical analysis

Data are available in S1 Table.

Characteristics of midwives and maternity units and adherence to guidelines were described with means and standard deviation (SD) for quantitative variables and frequencies and percentages for qualitative variables.

To compare adherence to guidelines between vignette 1 and vignette 2, numbers of errors for the 3 types of management were compared with Wilcoxon signed rank tests.

To evaluate the correlation of adherence to guidelines between midwives in the same maternity units, we calculated intraclass correlation coefficients (ICC) for error counts for pharmacological management, non-pharmacological management and other management, separately for each type of management.

Finally, we assessed the correlation between error counts in vignette 1 and vignette 2 with Pearson's correlation coefficient.

All statistical tests were two-sided, and *P* < .05 was considered statistically significant. Statistical analysis was conducted with R statistical software, version 3.0.1.

## Results

We obtained complete responses from 450 midwives from 87 maternity units (Fig 1).

The mean (+/-SD) age of midwives was 34.72 years (+/-8.44) and 94.4% were women. Table 2 summarizes the characteristics of the maternity units.

All midwives reported that their institution has a specific protocol for PPH management, and 81.1% that they know the guidelines issued by the French College of Obstetricians and Gynecologists.

## Description of adherence to guidelines

For vignette 1, 113 (25.1%) midwives chose appropriate management that complied completely with guidelines (no errors for any of the 14 criteria), 230 (51.1%) at least 13 correct answers (only 1 error), and 315 (70.0%) at least 12. For vignette 2, 19 (4.2%) midwives respected all 14 criteria (0 errors), 84 (18.6%) proposed at least 13 correct answers, and 170 (37.7%) at least 12 (Table 3). Among midwives who had only one error, the most common one was the failure to administer oxytocin: 41.9% in vignette 1 and 30.8% in vignette 2.

For vignette 1, pharmacological management was appropriate and completely consistent with guidelines in 237 responses (53.7%), non-pharmacological management in 235 (52.25%), and communication-monitoring-investigation in 319 (70.9%); for vignette 2, however, these figures were significantly poorer for each type of management (*P*<0.001 for each) substantially lower: 86 (19.1%), 126 (28%), and 168 (37.3%), respectively (Fig 2).
<figure><img src="image_4.png" /><figcaption>**Fig 1. Flowchart.** This figure corresponds to the flowchart of the study.</figcaption></figure>

doi:10.1371/journal.pone.0152863.g001

As the results above indicate, adherence to guidelines was better for vignette 1 than for vignette 2. Adherence to each criterion in vignette responses 1 and 2 is detailed in Table 4. The use of oxytocin was the correct action least frequently selected.

## Variations in adherence to guidelines

Fig 3 reports the variations in adherence to guidelines between maternity units, between midwives within each maternity unit, and between the 2 case-vignettes. Again, adherence was lower for vignette 2 than for vignette 1 and was lowest for oxytocin use.

<table><caption>**Table 2. Characteristics of maternity-units and midwives.**</caption><tbody><tr><th scope="row">Maternity units</th><td></td><td>n = 87</td></tr><tr><th scope="row">Public, n (%)</th><td></td><td>65 (74.7)</td></tr><tr><th scope="row">University, n (%)</th><td></td><td>14 (16.1)</td></tr><tr><th scope="row">Level of care, n (%)</th><td>level 1</td><td>35 (40.2)</td></tr><tr><th scope="row"></th><td>level 2</td><td>36 (41.4)</td></tr><tr><th scope="row"></th><td>level 3</td><td>16 (18.4)</td></tr><tr><th scope="row">Volume of births per year</th><td>mean (SD)</td><td>1623.2 (997.46)</td></tr><tr><th scope="row"></th><td>median [25th, 75th centile]</td><td>1362.5 [803; 2257.83]</td></tr><tr><th scope="row">Midwives</th><td></td><td>n = 450</td></tr><tr><th scope="row">Gender: Female, n (%)</th><td></td><td>425 (94.4)</td></tr><tr><th scope="row">Age, year, mean (SD)</th><td></td><td>34.72 (8.44)</td></tr><tr><th scope="row">Experience*, year, mean (SD)</th><td></td><td>11.38 (8.71)</td></tr></tbody></table>

doi:10.1371/journal.pone.0152863.t002

<footnote>* Experience corresponds to number of years of professional experience after completion of midwifery school.</footnote>
<table><caption>Table 3. Adherence to guidelines and number of correct answers.</caption><thead><tr><th></th><th>Vignette 1, n (%)</th><th>Vignette 2, n (%)</th></tr></thead><tbody><tr><td>14 criteria met (0 error)</td><td>113 (25.1)</td><td>19 (4.2)</td></tr><tr><td>13 criteria met (1 errors)</td><td>117 (26.0)</td><td>65 (14.4)</td></tr><tr><td>12 criteria met (2 errors)</td><td>85 (18.9)</td><td>86 (19.1)</td></tr><tr><td>11 criteria met (3 errors)</td><td>70 (15.6)</td><td>70 (15.6)</td></tr><tr><td>10 criteria met (4 errors)</td><td>45 (10.0)</td><td>73 (16.2)</td></tr><tr><td>9 or fewer criteria met (5 errors and more)</td><td>20 (4.4)</td><td>137 (30.5)</td></tr></tbody></table>

doi:10.1371/journal.pone.0152863.t003

We observed a centre effect, especially for vignette 1: the ICC for error counts for pharmacological management was 0.19 [95% CI: 0.10; 0.29], which indicates that 19% of the overall variance in error counts may be explained by factors at the level of the maternity units (centre effect) and 81% to midwife-level or unknown factors. The ICC for error counts for non-pharmacological management was 0.08 [0.01; 0.17], and for communication-monitoring-investigation 0.07 [0; 0.16]. For vignette 2, the ICC for error counts for pharmacological management was 0.07 [0; 0.16], for non-pharmacological management 0.06 [0; 0.14], and for communication-monitoring-investigation 0.10 [0.03; 0.20].

The correlation between the error counts in vignette 1 and vignette 2 was low but still significant: Rho: 0.31 [0.22–0.39] and indicates that midwives tended to make fewer errors for vignette 2 when they made fewer errors for vignette 1.

# Discussion

## Principal findings of the study

The global rate of complete adherence to guidelines was low: 25.1% in vignette 1 and 4.2% in vignette 2. It was lower for pharmacological management, especially oxytocin use, than for either non-pharmacological management or communication-monitoring-investigation. Midwives recognized the severity of the PPH by calling the team but many did not provide pharmacological management sufficiently promptly. Our study showed variations in adherence to guidelines between and within maternity units and between the two different PPH situations.

## Clinical meaning of the study

We noted that management was poorer for vignette 2 than for vignette 1. There are two main explanations for this difference. First, the PPH situation in vignette 2 is probably less common; secondly, and perhaps relatedly, the guidelines are probably less appropriate or less useful for gradual, slow hemorrhages with a constant trickle of blood, so that midwives are uncertain about its optimal management.

Even though most midwives (81.1%) reported that they knew the French guidelines, our study showed poor adherence with them. It has already been demonstrated that physicians frequently fail to follow clinical practice guidelines [33]. Lack of awareness, familiarity or agreement have been suggested as possible barriers to guideline adherence. Professionals appear to know that there are guidelines but either do not know the contents or prefer more conservative measures than those recommended by guidelines [33]. The French guidelines are published by the French College of Obstetricians and Gynecologists and intended to be disseminated to every maternity unit and integrated into their protocol. We do not know either if all units actually include these guidelines in their protocols or if they in fact follow either the guidelines or the protocols. Moreover we do not know if pharmacological management is specified in the
<figure><img src="image_5.png" /></figure>

<figure><img src="image_6.png" /></figure>

<figure><img src="image_7.png" /><figcaption>**Fig 2.** Difference in adherence to guidelines between vignette 1 and vignette 2 for the 3 types of management. This figure indicates the adherence to guidelines for vignette 1 and vignette 2 regarding pharmacological management, non-pharmacological management and communication-monitoring-investigation.</figcaption></figure>

doi:10.1371/journal.pone.0152863.g002

protocols. If midwives made errors in adherence to guidelines, we could not know if 1) they applied their protocol and it was not consistent with the national guidelines, or 2) they did not apply their protocol, which was consistent with national guidelines.

When we assessed each criterion separately (Table 4, Fig 3), the highest error rate concerned oxytocin. The other criteria with high error rates were surgery, selective arterial embolization and/or intrauterine tamponade, blood tests, and resuscitation measures, possibly because these decisions are beyond midwives’ expertise.

Winter et al [16] found similar results in a study by postal questionnaires of policies for immediate PPH management sent to maternity units in 12 European countries: European
<table><caption>Table 4. Adherence to 14 criteria in vignette response.</caption><thead><tr><th></th><th>Vignette 1, n (%)</th><th>Vignette 2, n (%)</th></tr></thead><tbody><tr><td><strong>Pharmacological management:</strong></td><td></td><td></td></tr><tr><td>First line uterotonic: oxytocin in step 1</td><td>291 (64.7)</td><td>201 (44.7)</td></tr><tr><td>Second line uterotonic: sulprostone (prostaglandin E2 analogue) in step 2</td><td>348 (77.3)</td><td>181 (40.2)</td></tr><tr><td>No misoprostol (prostaglandin E1 analogue) in each step</td><td>440 (97.8)</td><td>436 (96.9)</td></tr><tr><td><strong>Non-pharmacological management:</strong></td><td></td><td></td></tr><tr><td>Manual placental delivery, manual examination of the uterine cavity in step 1</td><td>444 (98.7)</td><td>326 (72.4)</td></tr><tr><td>No torsion of the cervix in step 1</td><td>450 (100)</td><td>448 (99.6)</td></tr><tr><td>No intrauterine tamponade in step 1</td><td>440 (97.8)</td><td>445 (98.9)</td></tr><tr><td>Uterine massage in steps 1 or 2</td><td>436 (96.9)</td><td>296 (65.8)</td></tr><tr><td>Cervical examination with speculum in steps 1 or 2</td><td>403 (89.6)</td><td>402 (89.3)</td></tr><tr><td>No surgical treatment in steps 1 or 2</td><td>418 (92.9)</td><td>443 (98.4)</td></tr><tr><td>No selective arterial embolization in steps 1 or 2</td><td>366 (81.3)</td><td>410 (91.1)</td></tr><tr><td>Surgical treatment, selective arterial embolization and/or intrauterine tamponade in step 3</td><td>286 (63.6)</td><td>260 (57.8)</td></tr><tr><td><strong>Communication, monitoring and investigation:</strong></td><td></td><td></td></tr><tr><td>Alert other members of the team in steps 1 or 2</td><td>445 (98.9)</td><td>411 (91.3)</td></tr><tr><td>Venipuncture with blood count, hemostasis in steps 1 or 2</td><td>353 (78.4)</td><td>249 (55.3)</td></tr><tr><td>Resuscitation measure in steps 1 or 2</td><td>393 (87.3)</td><td>247 (54.9)</td></tr></tbody></table>

doi:10.1371/journal.pone.0152863.t004

countries varied in pharmacological management and oxytocin use, but little in uterine massage rates.

Driessen et al [25] also studied initial care in a cohort of 4550 women with PPH due to uterine atony in 106 French maternity units. They found oxytocin administration inappropriate (because delayed by more than 10 minutes or not done at all) in 24.5% of cases. We approached these time-dependent actions by defining the criteria according to the steps, with oxytocin use expected, for example, within 15 minutes in step 1.

The delay or failure to use oxytocin that we observed may explain the high rate of invasive treatments reported by Kayem et al [34]. They found a rate of invasive second-line therapies for PPH significantly higher (by a factor of 6 to 8) in France than in the United Kingdom or the Netherlands.

Inappropriate oxytocin use, that is, failure to use it in a timely manner or at all, may result in less effective management of early stages of PPH, before it has become severe, and thus in a relatively higher proportion of cases that are not controlled at those stages. This delay may explain the high rate of maternal deaths from hemorrhage in France.

## Strengths and limitations of the study

Our study has a number of strengths. The characteristics of participating units were similar to those of French maternity units overall [35,36].

The case-vignette is a simple tool but no less valid than more complicated methods for evaluating adequacy of care and adherence to guidelines, as shown by the similarity of our results to those of previous studies using other methods [16,20,21]. Case-vignettes have been widely used to analyze practices such as screening, diagnosis, care, assessment of prognosis, and ethics in decision making. This tool allowed us to describe important variations in adherence to guidelines at the individual level, both between midwives and between 2 different situations of
<figure><img src="image_8.png" /></figure>

Rate of correct answers
per unit per criterion
**Fig 3. Adherence to guidelines between and within maternity units, between the 2 vignettes.** This figure indicates the rates of correct answers for the 9 most important criteria and for maternity units with more than 4 participating midwives. Each line represents a maternity unit, and they ranked in descending order of global adherence.

doi:10.1371/journal.pone.0152863.g003

PPH managed by the same midwife. Few if any previous studies have shown variations in PPH management at the individual level.

This study also has limitations. Case-vignette is a theoretical approach, based on plans and intentions and not actual practice. A vignette cannot instill the sense of urgency and stress generated by PPH. Nor can it adequately transcribe the multidisciplinary approach that is necessary to improve care and that probably decreases both omissions and errors. Theoretical approaches testing reflection rather than action are also likely to be subject to a social desirability bias that may result in overestimating appropriate management and adherence to guidelines. Evaluating clinical practice with a clinical vignette and a multiple-choice rather than an open-ended format also tends to overestimate participant performance [37]. Finally, the midwives who participated in our sample were probably those the most interested in the topic and in quality of care or continuing education and were therefore more likely to be able to respond correctly. Nonetheless, given the low level of complete adherence, we may wonder if this limitation played any role in our findings.

Appropriate management was defined by complete adherence to all criteria—selecting every required answer and not selecting any wrong answers. Expecting strict adherence to all 14 criteria is probably unrealistic; and management may well finally prove to be appropriate without complete and strict adherence to all 14 of the guideline-based criteria. Therefore we also assessed the number of errors separately for each vignette and each criterion separately. Finally each criterion had the same weight in our study. Undoubtedly some criteria are more essential to adherence to guidelines than others. Several studies have shown the efficacy of oxytocin [38], which is recommended in all guidelines [23], while the importance or value of uterine massage has never been demonstrated [39]. That is part of the reason that we assessed the number of errors overall and individually by criterion.

Finally, this study only involved midwives. The results cannot be generalised to obstetricians or general (or family) practitioners. Moreover, even for midwives, generalization may be possible only in countries where midwives provide initial management of PPH.

## Conclusion

Case vignettes were effective for demonstrating variations in adherence to guidelines for PPH management, especially at the individual level. Midwives appropriately alert other team members. However, their knowledge about the indications, route and dosage of oxytocin, which is the firstline uterotonic treatment requires improvement. The center effect found in our study shows the need to continue efforts in each center to improve department protocols, training, and morbidity and mortality review, especially among midwives. Clinical vignettes are a useful tool for measuring quality. They can be used in each institution to identify individual discrepancies with good practices and to identify the training necessary for improvement, e.g. simulation. Different factors may be considered to explain discrepancies with guidelines: those related to individual characteristics of parturients, those related to medical care and both personal and professional factors related to health care providers. These factors should be explored.

## Supporting Information

S1 File. Vignette 1.
(PDF)
S2 File. Vignette 2.

(PDF)

S1 Table. Database of midwives’ responses.

(XLS)

S1 Text. Exhaustive list of available choices for multiple-choice questions.

(PDF)

Author Contributions

Conceived and designed the experiments: AR P. Rozenberg EP CD P. Ravaud. Performed the experiments: AR P. Rozenberg EP CD P. Ravaud. Analyzed the data: EP. Contributed reagents/ materials/analysis tools: AR P. Rozenberg EP CD P. Ravaud. Wrote the paper: AP P. Rozenberg EP CD P. Ravaud.

References

1. Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, et al. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014 Jun; 2: e323–33. doi: 10.1016/S2214-109X(14) 70227-X PMID: 25103301

2. Callaghan WM, Kuklina EV, Berg CJ. Trends in postpartum hemorrhage: United States, 1994–2006. Am J Obstet Gynecol. 2010 Apr; 202: 353.e1–6. doi: 10.1016/j.ajog.2010.01.011

3. Zhang W-H, Alexander S, Bouvier-Colle M-H, Macfarlane A, MOMS-B Group. Incidence of severe pre-eclampsia, postpartum haemorrhage and sepsis as a surrogate marker for severe maternal morbidity in a European population-based study: the MOMS-B survey. BJOG Int J Obstet Gynaecol. 2005 Jan; 112: 89–96.

4. Al-Zirqi I, Vangen S, Forsen L, Stray-Pedersen B. Prevalence and risk factors of severe obstetric haemorrhage. BJOG Int J Obstet Gynaecol. 2008 Sep; 115: 1265–72. doi: 10.1111/j.1471-0528.2008. 01859.x

5. Mehrabadi A, Hutcheon JA, Lee L, Kramer MS, Liston RM, Joseph KS. Epidemiological investigation of a temporal increase in atonic postpartum haemorrhage: a population-based retrospective cohort study. BJOG Int J Obstet Gynaecol. 2013 Jun; 120: 853–62. doi: 10.1111/1471-0528.12149

6. Knight M, Callaghan WM, Berg C, Alexander S, Bouvier-Colle M-H, Ford JB, et al. Trends in postpartum hemorrhage in high resource countries: a review and recommendations from the International Postpartum Hemorrhage Collaborative Group. BMC Pregnancy Childbirth. 2009; 9: 55. doi: 10.1186/1471- 2393-9-55 PMID: 19943928

7. Lutomski JE, Byrne BM, Devane D, Greene RA. Increasing trends in atonic postpartum haemorrhage in Ireland: an 11-year population-based cohort study. BJOG Int J Obstet Gynaecol. 2012 Feb; 119: 306–14. doi: 10.1111/j.1471-0528.2011.03198.x

8. Kramer MS, Berg C, Abenhaim H, Dahhou M, Rouleau J, Mehrabadi A, et al. Incidence, risk factors, and temporal trends in severe postpartum hemorrhage. Am J Obstet Gynecol. 2013 Nov; 209: 449.e1–7. doi: 10.1016/j.ajog.2013.07.007

9. Berg CJ, Mackay AP, Qin C, Callaghan WM. Overview of maternal morbidity during hospitalization for labor and delivery in the United States: 1993–1997 and 2001–2005. Obstet Gynecol. 2009 May; 113: 1075–81. doi: 10.1097/AOG.0b013e3181a09fc0 PMID: 19384123

10. Clark SL, Belfort MA, Dildy GA, Herbst MA, Meyers JA, Hankins GD. Maternal death in the 21st century: causes, prevention, and relationship to cesarean delivery. Am J Obstet Gynecol. 2008 Jul; 199: 36.e1–5; discussion 91–2. e7–11. doi: 10.1016/j.ajog.2008.03.007

11. Creanga AA, Berg CJ, Syverson C, Seed K, Bruce FC, Callaghan WM. Pregnancy-related mortality in the United States, 2006–2010. Obstet Gynecol. 2015 Jan; 125: 5–12. doi: 10.1097/AOG. 000000000000564 PMID: 25560097

12. Deneux-Tharaux C, Berg C, Bouvier-Colle M-H, Gissler M, Harper M, Nannini A, et al. Underreporting of pregnancy-related mortality in the United States and Europe. Obstet Gynecol. 2005 Oct; 106: 684–92. PMID: 16199622

13. Saucedo M, Deneux-Tharaux C, Bouvier-Colle M-H, French National Experts Committee on Maternal Mortality. Ten years of confidential inquiries into maternal deaths in France, 1998–2007. Obstet Gynecol. 2013 Oct; 122: 752–60. doi: 10.1097/AOG.0b013e31829fc38c PMID: 24084531
14. Geller SE, Koch AR, Martin NJ, Rosenberg D, Bigger HR, Illinois Department of Public Health Maternal Mortality Review Committee Working Group. Assessing preventability of maternal mortality in Illinois: 2002–2012. Am J Obstet Gynecol. 2014 Dec; 211: 698.e1–11. doi: 10.1016/j.ajog.2014.06.046

15. Saucedo M, Deneux-Tharaux C, Bouvier-Colle M-H, Le Comité national d'experts sur la mortalité maternelle. [Maternal mortality in France, 2007–2009]. J Gynécologie Obstétrique Biol Reprod. 2013 Nov; 42: 613–27. doi: 10.1016/j.jgyn.2013.06.011

16. Winter C, Macfarlane A, Deneux-Tharaux C, Zhang W- H, Alexander S, Brocklehurst P, et al. Variations in policies for management of the third stage of labour and the immediate management of postpartum haemorrhage in Europe. BJOG Int J Obstet Gynaecol. 2007 Jul; 114: 845–54.

17. Audureau E, Deneux-Tharaux C, Lefèvre P, Brucato S, Morello R, Dreyfus M, et al. Practices for prevention, diagnosis and management of postpartum haemorrhage: impact of a regional multifaceted intervention. BJOG Int J Obstet Gynaecol. 2009 Sep; 116: 1325–33. doi: 10.1111/j.1471-0528.2009.02238.x

18. Deneux-Tharaux C, Dreyfus M, Goffinet F, Lansac J, Lemery D, Parant O, et al. [Prevention and early management of immediate postpartum haemorrhage: policies in six perinatal networks in France]. J Gynécologie Obstétrique Biol Reprod. 2008 May; 37: 237–45. doi: 10.1016/j.jgyn.2008.01.007

19. American College of Obstetricians and Gynecologists. ACOG Practice Bulletin: Clinical Management Guidelines for Obstetrician-Gynecologists Number 76, October 2006: postpartum hemorrhage. Obstet Gynecol. 2006 Oct; 108: 1039–47. PMID: 17012482

20. Collège National des Gynécologues et Obstétriciens Français, Agence Nationale d'Accréditation et d'Evaluation en Santé. [Guidelines for postpartum hemorrhage]. J Gynécologie Obstétrique Biol Reprod. 2004 Dec; 33: 4S130–4S136. Available in English from the CNGOF website: http://www.cngof.asso.fr/D_TELE/postpartum_haemorrhage_guidelines.pdf

21. Sentilhes L, Vayssière C, Mercier F, Aya AG, Bayoumeu F, Bonnet M-P, et al. [Postpartum hemorrhage: Guidelines for clinical practice—Text of the Guidelines (short text)].]. J Gynecol Obstet Biol Reprod (Paris). 2014 Nov 11; 43: 1170–9. doi: 10.1016/j.jgyn.2014.10.009

22. Royal College of Obstetricians and Gynaecologists. Prévention and management of postpartum haemorrhage. Green-Top Guideline n°52 [Internet]. 2009. Available: https://www.rcog.org.uk/globalassets/documents/guidelines/gt52postpartumhaemorrhage0411.pdf

23. Dahlke JD, Mendez-Figueroa H, Maggio L, Hauspurg AK, Sperling J, Chauhan SP, et al. Prevention and management of postpartum hemorrhage: a comparison of 4 national guidelines. Am J Obstet Gynecol. 2015 Feb 28. doi: 10.1016/j.ajog.2015.02.023

24. Bouvier-Colle MH, Ould El Joud D, Varnoux N, Goffinet F, Alexander S, Bayoumeu F, et al. Evaluation of the quality of care for severe obstetrical haemorrhage in three French regions. BJOG Int J Obstet Gynaecol. 2001 Sep; 108: 898–903.

25. Driessen M, Bouvier-Colle M-H, Dupont C, Khoshnood B, Rudigoz R-C, Deneux-Tharaux C, et al. Postpartum hemorrhage resulting from uterine atony after vaginal delivery: factors associated with severity. Obstet Gynecol. 2011 Jan; 117: 21–31. doi: 10.1097/AOG.0b013e318202c845 PMID: 21173641

26. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA J Am Med Assoc. 2000 Apr 5; 283: 1715–22.

27. Peabody JW, Luck J, Glassman P, Jain S, Hansen J, Spell M, et al. Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Ann Intern Med. 2004 Nov 16; 141: 771–80. PMID: 15545677

28. Bachmann LM, Mühleisen A, Bock A, ter Riet G, Held U, Kessels AGH. Vignette studies of medical choice and judgement to study caregivers’ medical decision behaviour: systematic review. BMC Med Res Methodol. 2008; 8: 50. doi: 10.1186/1471-2288-8-50 PMID: 18664302

29. Landon BE, Reschovsky J, Reed M, Blumenthal D. Personal, organizational, and market level influences on physicians’ practice patterns: results of a national survey of primary care physicians. Med Care. 2001 Aug; 39: 889–905. PMID: 11468507

30. Rousseau A, Rozenberg P, Ravaud P. Assessing Complex Emergency Management with Clinical Case-Vignettes: a Validation Study. PLoS One. 2015; 10: e0138663. doi: 10.1371/journal.pone.0138663 PMID: 26383261

31. Bose P, Regan F, Paterson-Brown S. Improving the accuracy of estimated blood loss at obstetric haemorrhage using clinical reconstructions. BJOG Int J Obstet Gynaecol. 2006 Aug; 113: 919–24.

32. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;(3: ):MR000008. doi: 10.1002/14651858.MR000008.pub4
33. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999 Oct 20; 282:1458–65. PMID: 10535437

34. Kayem G, Dupont C, Bouvier-Colle MH, Rudigoz RC, Deneux-Tharaux C. Invasive therapies for primary postpartum haemorrhage: a population-based study in France. BJOG Int J Obstet Gynaecol. 2015 Jun 26. doi: 10.1111/1471-0528.13477

35. Blondel B, Lelong N, Kermarrec M, Goffinet F, National Coordination Group of the National Perinatal Surveys. Trends in perinatal health in France from 1995 to 2010. Results from the French National Perinatal Surveys. J Gynécologie Obstétrique Biol Reprod. 2012 Jun; 41: e1–15. doi: 10.1016/j.jgyn.2012.04.014

36. DRESS. Statistique annuelle des établissements de santé 2013. Available: https://www.sae-diffusion.sante.gouv.fr/sae-diffusion/accueil.htm

37. Pham T, Roy C, Mariette X, Lioté F, Durieux P, Ravaud P. Effect of response format for clinical vignettes on reporting quality of physician practice. BMC Health Serv Res. 2009; 9: 128. doi: 10.1186/1472-6963-9-128 PMID: 19638231

38. Mousa HA, Blum J, Abou El Senoun G, Shakur H, Alfirevic Z. Treatment for primary postpartum haemorrhage. Cochrane Database Syst Rev. 2014 Feb 13; 2:CD003249. doi: 10.1002/14651858. CD003249.pub3 PMID: 24523225

39. Hofmeyr GJ, Abdel-Aleem H, Abdel-Aleem MA. Uterine massage for preventing postpartum haemorrhage. Cochrane Database Syst Rev. 2013; 7:CD006431. doi: 10.1002/14651858.CD006431.pub3 PMID: 23818022