# Quality Indicators during Delivery and the Immediate Postpartum Period: A Modified Delphi Study

Candy Guiguet-Auclair, Olivier Rivière, Laurent Gerbaud, Françoise Vendittelli

► To cite this version:

Candy Guiguet-Auclair, Olivier Rivière, Laurent Gerbaud, Françoise Vendittelli. Quality Indicators during Delivery and the Immediate Postpartum Period: A Modified Delphi Study. Healthcare, 2023, 11 (6), pp.848. 10.3390/healthcare11060848. [https://uca.hal.science/hal-04031630](https://uca.hal.science/hal-04031630)

HAL Id: hal-04031630

https://uca.hal.science/hal-04031630

Submitted on 16 Mar 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Article

# Quality Indicators during Delivery and the Immediate Postpartum Period: A Modified Delphi Study

Candy Guiguet-Auclair<sup>1,2 ID</sup>, Olivier Rivière<sup>3</sup>, Laurent Gerbaud<sup>1,2</sup> and Françoise Vendittelli<sup>1,4,* ID</sup>

<figure><img src="image_2.png" /></figure>

check for
updates

**Citation:** Guiguet-Auclair, C.; Rivière, O.; Gerbaud, L.; Vendittelli, F. Quality Indicators during Delivery and the Immediate Postpartum Period: A Modified Delphi Study. *Healthcare* **2023**, *11*, 848. https://doi.org/10.3390/healthcare11060848

Academic Editor: Abdel-Latif Mohamed

Received: 9 February 2023

Revised: 3 March 2023

Accepted: 10 March 2023

Published: 13 March 2023

<figure><img src="image_3.png" /></figure>

**Copyright:** © 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

**Abstract:** Background: Our research hypothesis was that most French indicators of quality of care have been validated by experts who are not clinicians and might not always be meaningful for clinicians. Our objective was to define a core set of measurable indicators of care quality during delivery and the immediate postpartum period relevant to clinical practice. Methods: A steering committee comprising nine specialists in obstetrics and/or public health conducted a literature review to develop potential indicators. A panel of obstetrician-gynecologists and midwives working in a delivery unit rated each indicator for appropriateness in a two-round Rand-modified Delphi procedure and a physical meeting. The consensus among the panelists was assessed. Results: In the first round, 145 panelists (110 obstetrician-gynecologists and 35 midwives) assessed 77 indicators and 3 definitions: 6 related to labor onset, 20 to delivery, 3 to pain management, 23 to neonatal morbidity/mortality, and 28 to maternal morbidity. In the second round, 132 panelists (98 obstetrician-gynecologists and 34 midwives) assessed 42 indicators and 1 definition. The final set comprised 50 indicators and 2 definitions. Conclusions: This Delphi procedure selected 50 indicators that reflect the quality of perinatal care. These indicators should be recorded in each French maternity ward's birth register for each delivery.

**Keywords:** consensus; Delphi study; maternity care; perinatal health; quality indicators

## 1. Introduction

Reducing maternal and perinatal severe morbidity and mortality around the world remains a major public health concern [1]. Accordingly, different indicators assessing the quality of perinatal care have been proposed [2–12], although their promulgation and distribution have not resulted in a notable reduction in perinatal and neonatal outcomes around the world [13–16], or even only in France [17–20]. These findings, especially given that many are regularly reported to perinatal professionals [19–22], suggest that these indicators remain less than optimal in France. There are always, of course, variations between countries, between maternity departments within a country, and even between professionals within the same maternity unit [22,23]. One explanation may be that most current maternity indicators derived from routinely collected hospital data are not always easy to understand. This is due mainly to the lack of clinical information contained in these medical-administrative databases and the absence of evidence for the best practice in specific obstetric situations [18,24]. Moreover, indicators derived from routine hospital data can lack validity. For example, “good” maternity wards are considered to be those with a global cesarean rate near the mean for the country. However, what is a good cesarean rate? We do not know; maternity units with low cesarean rates may have high neonatal morbidity

<footnote n="1">1 CHU Clermont-Ferrand, CNRS, Institut Pascal, Université Clermont Auvergne, F-63000 Clermont-Ferrand, France; cauclair@chu-clermontferrand.fr (C.G.-A.); lgerbaud@chu-clermontferrand.fr (L.G.)</footnote>

<footnote n="2">2 Service de Santé Publique, CHU Clermont-Ferrand, F-63000 Clermont-Ferrand, France</footnote>

<footnote n="3">3 Audipog, Université Claude Bernard Lyon 1-Laennec, 7 Rue Guillaume Paradin, CEDEX 08, F-69372 Lyon, France; olivier.riviere@audipog.net</footnote>

<footnote n="4">4 Réseau de Santé Périnatale d'Auvergne, CHU Clermont-Ferrand, F-63000 Clermont-Ferrand, France</footnote>

<footnote>* Correspondence: fvendittelli@chu-clermontferrand.fr</footnote>
and/or mortality, perhaps because their cesarean rates are too low [25]. Several French obstetric guidelines do not provide indicators to assess their impact on the practice or appropriate outcome indicators [26]. Worse, some French national guidelines do not clearly identify the indicators they are intended to affect. For example, the French guidelines about planned cesarean deliveries at term do not define a planned cesarean [27].

Our research hypothesis was that as most of the indicators currently used were developed by working groups of experts in quality, public health, or epidemiology, they might not always make sense to clinicians working in delivery rooms. However, it is important to have quality indicators that are well accepted by professionals working in maternity units and are easy to collect so that they can be recorded continuously and enable valid comparisons over time. The National College of French Gynecologists and Obstetricians (CNGOF) and the National College of Midwives (CNSF) have therefore decided to study the opinions of French clinicians practicing in the birth sector about the relevance of quality indicators in maternity units.

Our objective was to use a modified Delphi study to define a core set of quality indicators, measurable and relevant to clinical practice, during delivery and the immediate postpartum period. This technique is widely used to select quality indicators in health care [28].

## 2. Materials and Methods

### 2.1. *Design and Setting*

A modified RAND/University of California at Los Angeles (UCLA) appropriateness method Delphi study took place in four stages (Figure 1) to develop a set of indicators of the quality of care during delivery and the immediate postpartum period for deliveries or births ≥22 weeks (or birth weight ≥ 500 g when the date of conception was unknown) [29]. The first stage was the constitution of a French multidisciplinary steering committee, and the second was the extensive review of the literature it was assigned to perform to identify quality indicators in obstetrics. The third phase consisted of two Delphi consensus rounds in which potential indicators were rated by a panel of informed persons. Delphi is a formalized technique for determining consensus from the collective wisdom of the panelists about, in this context, appropriate indicators. The benefits of this approach are anonymity, iteration (allowing participants to change their opinions), not requiring the physical presence of the panelist, controlled feedback in which panelists can have the panel's previous responses, and the derivation of summary measures of agreement [30]. In the fourth and last phase, the steering committee and an external board approved the final set of quality indicators.

We modified the RAND/UCLA appropriateness method by beginning the process with a set of selected quality indicators. The French panelists did not meet physically, and indicators could be discarded between the two rounds.

### 2.2. *Literature Review*

The French steering committee established comprised nine specialists in obstetrics and/or public health, recognized for their expertise in quality indicators and/or the Delphi method. This committee reviewed the literature from January 2003 through December 2013. A PubMed search was conducted for the keywords "quality indicators" and "obstetrics". All reports on perinatal quality indicators issued by learned societies in France or abroad were also collected. A database of 318 references was identified.

During face-to-face and telephone meetings, completed by email exchanges, the steering committee used the literature search results to establish an exhaustive list of potential quality indicators. The indicators to be chosen were to be collected and calculated from data in patient files, collected immediately intrapartum, during delivery, and early postpartum (in the delivery or operating unit, according to the type of delivery).
The Delphi questionnaire was then drafted, with special attention paid to the clarity of each indicator. The web-based questionnaire and instructions were tested before each round for face validity.

<figure><img src="image_4.png" /><figcaption>**Figure 1.** The modified Delphi process for the selection of indicators of quality of care during delivery and the immediate postpartum period.</figcaption></figure>
## 2.3. Modified Delphi Process

### 2.3.1. Participants

The list of quality of care indicators was presented for rating in a two-round Delphi study. Obstetrician-gynecologists who were members of CNGOF and midwives belonging to the CNSF—all practicing in French delivery rooms—were invited via each organization's email list to compose the panel of the Delphi study. They received a cover letter by email explaining the study and inviting them to participate by completing the electronic questionnaire accessible with the URL in the email. No financial incentive was proposed. The panelists gave their consent to participate in the Delphi survey when they replied to the first round. Under French law, this study was exempt from approval by an ethics committee.

### 2.3.2. Data Collection

Round 1 data were collected from 11 December 2014 to 28 January 2015, and round 2 data from 25 March to 17 May 2015. The participants were asked to answer within four weeks for each round. No reminder was sent out during the first round, whereas two reminder emails were sent during the second. Only participants who completed the first-round electronic questionnaire received the URL to participate in the second round.

During both rounds, the panelists were invited to rate individually and independently each quality indicator for its clinical relevance on a 9-point Likert scale from 1 (totally inappropriate/irrelevant) to 9 (totally appropriate/relevant), with 5 for no preference, indecision, etc. They were also invited to comment on each indicator.

For the second round, the panelists received descriptive statistics of the distribution of the panel's scores for each indicator rated in the first round. Each panelist was invited to re-score on the same 9-point Likert scale the indicators that had not been accepted in the first round, taking into account the previous answers of the panel.

### 2.3.3. Data Analysis

After each of the two rounds, the distribution of scores was described by the number and frequencies of each score of the rating scale, the number and frequencies in the lowest tertile (between 1 and 3), the number and frequencies in the upper tertile (between 7 and 9), and the median score.

Judgment of the indicators and consensus followed the RAND/UCLA method [29]. A median score was used to judge an indicator by measuring the central tendency of the distribution for each indicator's rating. An indicator was judged *appropriate* if the panelists' median score ranged from 7 through 9. An indicator with a median score of 1–3 was judged *inappropriate*. To evaluate the consensus between the panelists (that is, the panelists' agreement with one another), a continuous statistical measure of dispersion among the individual scores was used: the Disagreement Index. We adapted the Rand Working Group definition and defined the Disagreement Index as the 10–90% interpercentile range (IPR) divided by the interpercentile range adjusted for symmetry (IPRAS) [29], which applies to any size panel. In the RAND method, a Disagreement Index lower than 1 indicates consensus or agreement between panelists (low dispersion of scores, with the IPRAS larger than the IPR), and a Disagreement Index higher than 1 indicates a lack of consensus or disagreement (high score dispersion with the IPRAS smaller than the IPR).

If an indicator was judged *appropriate* with agreement among the panelists, then it was considered *accepted*. Indicators consensually judged *inappropriate* were *rejected*. An indicator with a median score ranging between 3.5 and 6.5 or scored with disagreement between panelists was considered *uncertain*. Based on the findings of round 1, *uncertain* indicators were resubmitted for further evaluation and discussion in the second rating round.

Statistical analyses were performed with SAS software (version 9.3, SAS Institute, Cary, NC, 2002–2012).
## 2.4. External Validity

The steering committee received the detailed results after each round and discussed them. In November 2015, after the second round, the Delphi results were sent for validation to the CNGOF and CNSF board members. The final set of quality indicators was established.

# 3. Results

## 3.1. Modified Delphi Survey Questionnaire

The steering committee proposed a total of 77 indicators and 3 definitions for evaluation in the two Delphi rounds, categorized as follows: “onset of labor” (5 indicators and 1 definition), “delivery” (19 indicators and 1 definition), “pain management” (3 indicators), “neonatal morbidity and mortality” (23 indicators), and “maternal morbidity” (27 indicators and 1 definition) (Figure 1). Indicator results were expressed as percentages. Numerators (number of the exposed population by the relevant event) and denominators (target population) were detailed for each quality indicator.

## 3.2. Description of the Modified Delphi Survey Panel

The first round was completed by 145 panelists, 110 obstetrician-gynecologists (75.9%) practicing for 20.5 ± 10.1 years, and 35 midwives (24.1%), practicing for 21.7 ± 11.6 years (Table 1). Men accounted for 54.5%, and the mean age of the entire panel was 49.7 ± 10.6 years. Overall, 34.5% practiced in academic hospitals, 41.4% in general public hospitals, and 24.1% in private hospitals; 20.7% worked in level I maternity units, 40.7% in level II facilities, and 38.6% in level III hospitals, with 50.3% practicing in a maternity unit with an average of more than 2500 deliveries annually.

Participating in the second round were 132 panelists who had responded to the first round—98 obstetrician-gynecologists and 34 midwives (89.1% and 97.1%, respectively) (Table 1). They had been in practice for a mean of 21.5 ± 10.6 years, and 53.0% practiced in a maternity unit with a mean of more than 2500 annual deliveries.

<table><caption>**Table 1.** Panelists’ characteristics.</caption><thead><tr><th>Rounds of Modified<br>Delphi Survey</th><th>Variables</th><th>Obstetrician-Gynecologists</th><th>Midwives</th><th>Total</th></tr></thead><tbody><tr><td rowspan="13">First Round</td><td>N of participants</td><td>110</td><td>35</td><td>145</td></tr><tr><td>Age (years), mean ± SD</td><td>51.5 ± 9.6</td><td>45.4 ± 11.6</td><td>49.7 ± 10.6</td></tr><tr><td>Sex, n (%)</td><td></td><td></td><td></td></tr><tr><td>Female</td><td>32 (29.1)</td><td>34 (97.1)</td><td>66 (45.5)</td></tr><tr><td>Male</td><td>78 (70.9)</td><td>1 (2.9)</td><td>79 (54.5)</td></tr><tr><td>Professional experience (years), n<br>(%)</td><td></td><td></td><td></td></tr><tr><td>&lt;10</td><td>19 (17.3)</td><td>8 (22.9)</td><td>27 (18.6)</td></tr><tr><td>≥10-&lt;20</td><td>30 (27.3)</td><td>4 (11.4)</td><td>34 (23.4)</td></tr><tr><td>≥20-&lt;30</td><td>37 (33.6)</td><td>12 (34.3)</td><td>49 (33.8)</td></tr><tr><td>≥30</td><td>24 (21.8)</td><td>11 (31.4)</td><td>35 (24.1)</td></tr><tr><td>Current place of work <sup>1</sup>, n (%)</td><td></td><td></td><td></td></tr><tr><td>Academic hospital</td><td>37 (33.6)</td><td>13 (37.1)</td><td>50 (34.5)</td></tr><tr><td>General public hospital</td><td>43 (39.1)</td><td>17 (48.6)</td><td>60 (41.4)</td></tr><tr><td>Private hospital</td><td>30 (27.3)</td><td>5 (14.3)</td><td>35 (24.1))</td></tr><tr><td>Maternity unit level <sup>2</sup>, n (%)</td><td></td><td></td><td></td></tr><tr><td>Level I</td><td>27 (24.5)</td><td>3 (8.6)</td><td>30 (20.7)</td></tr><tr><td>Level II</td><td>41 (37.3)</td><td>18 (51.4)</td><td>59 (40.7)</td></tr><tr><td>Level III</td><td>42 (38.2)</td><td>14 (40.0)</td><td>56 (38.6)</td></tr><tr><td>Mean number of annual deliveries,<br>n (%)</td><td></td><td></td><td></td></tr><tr><td>&lt;500</td><td>3 (2.7)</td><td>0</td><td>3 (2.1)</td></tr><tr><td>≥500-&lt;1500</td><td>29 (26.4)</td><td>10 (28.6)</td><td>39 (26.9)</td></tr><tr><td>≥1500</td><td>78 (70.9)</td><td>25 (71.4)</td><td>103 (71.0)</td></tr></tbody></table>
<table><caption>**Table 1.** *Cont.*</caption><thead><tr><th>Rounds of Modified<br>Delphi Survey</th><th>Variables</th><th>Obstetrician-Gynecologists</th><th>Midwives</th><th>Total</th></tr></thead><tbody><tr><td rowspan="14">Second Round</td><td>N of participants</td><td>98</td><td>34</td><td>132</td></tr><tr><td>Age (years), mean ± SD</td><td>51.5 ± 9.6</td><td>46.3 ± 11.7</td><td>50.2 ± 10.4</td></tr><tr><td>Sex, n (%)</td><td></td><td></td><td></td></tr><tr><td>Female</td><td>29 (29.6)</td><td>1 (2.9)</td><td>62 (47.0)</td></tr><tr><td>Male</td><td>69 (70.4)</td><td>33 (97.1)</td><td>70 (53.0)</td></tr><tr><td>Professional experience (years), n (%)</td><td></td><td></td><td></td></tr><tr><td>&lt;10</td><td>17 (17.3)</td><td>7 (20.6)</td><td>24 (18.2)</td></tr><tr><td>≥10-&lt;20</td><td>27 (27.6)</td><td>5 (14.7)</td><td>32 (24.2)</td></tr><tr><td>≥20-&lt;20</td><td>31 (31.6)</td><td>10 (29.4)</td><td>41 (31.1)</td></tr><tr><td>≥30</td><td>23 (23.5)</td><td>12 (35.3)</td><td>35 (26.5)</td></tr><tr><td>Current place of work <sup>1</sup>, n (%)</td><td></td><td></td><td></td></tr><tr><td>Academic hospital</td><td>35 (35.7)</td><td>13 (38.2)</td><td>48 (36.4)</td></tr><tr><td>General public hospital</td><td>37 (37.8)</td><td>16 (47.1)</td><td>53 (40.2)</td></tr><tr><td>Private hospital</td><td>26 (26.5)</td><td>5 (14.7)</td><td>31 (23.5)</td></tr><tr><td>Maternity unit level <sup>2</sup>, n (%)</td><td></td><td></td><td></td></tr><tr><td>Level I</td><td>21 (21.4)</td><td>3 (8.8)</td><td>24 (18.2)</td></tr><tr><td>Level II</td><td>37 (37.8)</td><td>17 (50.0)</td><td>54 (40.9)</td></tr><tr><td>Level III</td><td>40 (40.8)</td><td>14 (41.2)</td><td>54 (40.9)</td></tr><tr><td>Mean number of annual deliveries, n (%)</td><td></td><td></td><td></td></tr><tr><td>&lt;500</td><td>1 (1.0)</td><td>0</td><td>1 (0.8)</td></tr><tr><td>≥500-&lt;1500</td><td>25 (25.5)</td><td>10 (29.4)</td><td>35 (26.5)</td></tr><tr><td>≥1500</td><td>72 (73.5)</td><td>24 (70.6)</td><td>96 (72.7)</td></tr></tbody></table>

### 3.3. Modified Delphi Survey Analysis

Figure 1 presents the modified Delphi process used to select the quality indicators.

After the first round, 35 indicators and 2 definitions were accepted: 3 indicators in the domain "onset of labor", 11 indicators and 1 definition in "delivery", all the indicators in "pain management" (i.e., 3), 8 indicators in "neonatal morbidity and mortality", and 10 indicators and 1 definition in "maternal morbidity". No indicator was rejected. Forty-two indicators and 1 definition were considered uncertain and proposed for further evaluation in the second round (Table 2).

After the second round, 14 indicators were accepted: 1 indicator in the "onset of labor" domain, 2 in "delivery", 5 in "neonatal morbidity and mortality", and 6 in "maternal morbidity". No indicator was rejected, while 28 indicators and 1 definition remained uncertain (Table 2). The indicators (including their definitions) that remained uncertain after the two rounds are listed in Supplementary Table S1.

### 3.4. External Validity

A synthesis of the two rounds of the Delphi process was presented and discussed in a face-to-face meeting of the CNGOF board members. Among the indicators that had not been accepted, one was judged highly important based on the international literature review and was included in the final set of quality indicators: the Robson classification [31], advocated by the International Federation of Gynecology and Obstetrics (FIGO) [32].

Finally, a set of 50 quality indicators and 2 definitions was established: 4 indicators in the domain of "onset of labor", 15 indicators and 1 definition in "delivery", 3 indicators in "pain management", 13 indicators in "neonatal morbidity and mortality", and 16 indicators and 1 definition in "maternal morbidity". Table 3 presents the detailed definition (numerator and denominator) for each final quality indicator.

<footnote n="1">¹ Academic hospital: regional public hospital connected with a university in France; general public hospital: not connected with a university; private hospital: in the private sector, whether for profit or not for profit. ² Level I: without a neonatology department; Level II: with a neonatology department; Level III: with a neonatology department and a neonatal intensive care unit.</footnote>
<table><caption>Table 2. Rating scores of the proposed quality indicators and definitions during the two-round Delphi survey.</caption><thead><tr><th rowspan="2">Category</th><th rowspan="2">Quality Indicators <sup>1</sup> or Definition</th><th colspan="3">First Round (n = 145)</th><th colspan="3">Second Round <sup>2</sup> (n = 132)</th></tr><tr><th>Median Score <sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain <sup>4</sup></th><th>Median Score <sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain <sup>4</sup></th></tr></thead><tbody><tr><td rowspan="7">Onset of labor</td><td>Spontaneous labor</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Inductions of labor</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Planned cesarean deliveries</td><td>9</td><td>0.5</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Planned cesareans ≥ 39 wk</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Definition of a planned cesarean delivery</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Cesarean deliveries before labor</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr><tr><td>Vaginal deliveries</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td rowspan="10">Delivery</td><td>Spontaneous vaginal deliveries (non-operative)</td><td>9</td><td>0.5</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Instrumental vaginal deliveries</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Global cesarean deliveries</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Global cesarean deliveries ≥ 37 wk with a singleton pregnancy and a breech presentation</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Cesarean deliveries in nulliparas</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Cesareans in primiparas with one previous cesarean <sup>5</sup></td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>2.3</td><td>Uncertain</td></tr><tr><td>Cesarean deliveries during labor</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Adjusted proportion of cesarean deliveries</td><td>7</td><td>1.1</td><td>Uncertain</td><td>7</td><td>1.1</td><td>Uncertain</td></tr><tr><td>Cesareans ≥ 37 wk in nulliparas women with a singleton pregnancy and a cephalic presentation</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.7</td><td>Accepted</td></tr><tr><td rowspan="10">Pain management</td><td>Cesarean deliveries after one previous cesarean</td><td>9</td><td>0.5</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Cesarean deliveries in twin pregnancy</td><td>9</td><td>0.5</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Planned cesarean deliveries ≥ 39 wk</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Cesarean deliveries < 32 wk</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Unplanned cesareans after failure of labor induction</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Unplanned cesareans after spontaneous onset of labor</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Definition of low risk at the end of pregnancy</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Cesarean deliveries in women at low risk</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr><tr><td>Maternity Unit Performance Index</td><td>5</td><td>4.4</td><td>Uncertain</td><td>5</td><td>4.4</td><td>Uncertain</td></tr><tr><td>Cesarean deliveries according to Robson classification</td><td>6</td><td>1.6</td><td>Uncertain</td><td>7</td><td>1.6</td><td>Uncertain</td></tr><tr><td rowspan="10">Neonatal morbidity and mortality</td><td>General anesthesia for cesarean delivery</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Epidural analgesia for vaginal delivery</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Spinal analgesia for cesarean delivery</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Apgar score < 7 at 5 min</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr><tr><td>Apgar score < 5 at 5 min</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Births ≥ 37 wk with Apgar score < 7 at 5 min</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Live-born preterm infants < 37 wk</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Live-born infants, preterm birth < 34 wk</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Live-born infants, preterm birth < 33 wk</td><td>7</td><td>3.4</td><td>Uncertain</td><td>7</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Live-born infants, preterm birth < 32 wk</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr><tr><td>Live-born infants, preterm birth < 28 wk</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td rowspan="10">Neonatal morbidity and mortality</td><td>Arterial pH < 7.10</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr><tr><td>Arterial pH < 7.0</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>0.5</td><td>Accepted</td></tr><tr><td>Birth weight < 5th percentile for gestational age</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Birth weight < 3rd percentile for gestational age</td><td>8</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Birth weight < 2750 g with birth ≥ 40 wk</td><td>6</td><td>3.4</td><td>Uncertain</td><td>6</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Birth weight < 2500 g</td><td>7</td><td>3.4</td><td>Uncertain</td><td>7</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Infant discharged from delivery unit with mother and birth ≥ 37 wk</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr></tbody></table>
<table><caption>Table 2. *Cont.*</caption><thead><tr><th rowspan="2">Category</th><th rowspan="2">Quality Indicators <sup>1</sup> or Definition</th><th colspan="3">First Round (n = 145)</th><th colspan="3">Second Round <sup>2</sup> (n = 132)</th></tr><tr><th>Median Score <sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain <sup>4</sup></th><th>Median Score <sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain <sup>4</sup></th></tr></thead><tbody><tr><td rowspan="10">Neonatal morbidity and mortality</td><td>Neonatal transfers in resuscitation or intensive care or neonatology unit</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Neonatal transfers in intensive care unit</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.7</td><td>Accepted</td></tr><tr><td>Neonatal transfers in intensive care unit with birth weight > 2500 g</td><td>7</td><td>1.6</td><td>Uncertain</td><td>7</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Neonatal transfers to any neonatal units for inborn infants with birth ≥ 37 wk</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Neonatal transfers to any neonatal units for inborn infants with birth ≥ 22 wk</td><td>7</td><td>2.3</td><td>Uncertain</td><td>7</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Uncomplicated births with a healthy infant</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Stillbirths</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Stillbirths ≥ 28 wk</td><td>8</td><td>1.1</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Postpartum hemorrhages > 500 mL (regardless of mode of delivery)</td><td>9</td><td>1.6</td><td>Uncertain</td><td>9</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Postpartum hemorrhages > 500 mL for vaginal delivery</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td rowspan="10">Maternal morbidity</td><td>Postpartum hemorrhages > 1000 mL (regardless of mode of delivery)</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.7</td><td>Accepted</td></tr><tr><td>Postpartum hemorrhages > 1000 mL for vaginal delivery</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.7</td><td>Accepted</td></tr><tr><td>Postpartum hemorrhages > 1000 mL for cesarean delivery</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Postpartum hemorrhages > 1500 mL (regardless of mode of delivery)</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>2.3</td><td>Uncertain</td></tr><tr><td>Postpartum hemorrhages > 1500 mL for cesareans</td><td>7</td><td>2.3</td><td>Uncertain</td><td>8</td><td>2.3</td><td>Uncertain</td></tr><tr><td>Blood transfusions in delivery or operating rooms</td><td>9</td><td>0.5</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Hemostatic hysterectomy</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Hemostatic surgery (other than hysterectomy)</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Uterine rupture</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.7</td><td>Accepted</td></tr><tr><td>Discharge from delivery unit by transfer to intensive care unit</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Intact perineum (without perineal suture)</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Intact perineum in spontaneous delivery</td><td>8</td><td>3.4</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Intact perineum in primiparas</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>2.3</td><td>Uncertain</td></tr><tr><td>Episiotomies</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Episiotomies in primiparas</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>0.5</td><td>Accepted</td></tr><tr><td>Perineal lacerations (perineal tears and/or episiotomy)</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Perineal lacerations without episiotomy</td><td>8</td><td>1.6</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>First-degree perineal tears <sup>6</sup></td><td>7</td><td>3.4</td><td>Uncertain</td><td>7</td><td>3.4</td><td>Uncertain</td></tr><tr><td>Second-degree perineal tears <sup>7</sup></td><td>7</td><td>2.3</td><td>Uncertain</td><td>8</td><td>2.3</td><td>Uncertain</td></tr><tr><td>Severe perineal tears (3rd- or 4th-degree) <sup>8</sup></td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Severe perineal tears in instrumental vaginal delivery</td><td>9</td><td>0.7</td><td>Accepted</td><td></td><td></td><td></td></tr><tr><td>Severe perineal tears in non-instrumental vaginal delivery</td><td>9</td><td>1.1</td><td>Uncertain</td><td>9</td><td>0.3</td><td>Accepted</td></tr><tr><td>Severe perineal tears in forceps delivery</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>0.7</td><td>Accepted</td></tr></tbody></table>
<table><caption>**Table 2.** *Cont.*</caption><thead><tr><th rowspan="2">Category</th><th rowspan="2">Quality Indicators<sup>1</sup> or Definition</th><th colspan="3">First Round (n = 145)</th><th colspan="3">Second Round<sup>2</sup> (n = 132)</th></tr><tr><th>Median Score<sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain<sup>4</sup></th><th>Median Score<sup>3</sup></th><th>Disagreement Index</th><th>Accepted, Rejected, or Uncertain<sup>4</sup></th></tr></thead><tbody><tr><td rowspan="3">Maternal morbidity</td><td>Severe perineal tears in vacuum delivery</td><td>8</td><td>2.3</td><td>Uncertain</td><td>8</td><td>1.6</td><td>Uncertain</td></tr><tr><td>Adjusted proportion of severe perineal lacerations</td><td>8</td><td>3.4</td><td>Uncertain</td><td>8</td><td>3.4</td><td>Uncertain</td></tr><tr><td>International definition of perineal tears<sup>6,7,8</sup><br>(first, second, third, and fourth degree)</td><td>9</td><td>0.3</td><td>Accepted</td><td></td><td></td><td></td></tr></tbody></table>

Wk: weeks of amenorrhea. ¹ Quality indicators are expressed as percentages. ² Quality indicators or definitions *uncertain* in the first round were resubmitted. Quality indicators and definitions *accepted* in the first round were not included in the second round. ³ Each quality indicator or definition was rated on a 9-point Likert scale where 1 = totally inappropriate/irrelevant and 9 = totally appropriate/relevant. ⁴ A quality indicator or definition consensually judged appropriate (median score of 7–9 and Disagreement Index < 1) was *accepted*. A quality indicator or definition consensually judged inappropriate (median score of 1–3 and Disagreement Index < 1) was *rejected*. A quality indicator or definition with a median score of 3.5–6.5 or scored nonconsensually (Disagreement Index > 1) was considered *uncertain* and reconsidered in the second round. ⁵ Women with a history of only one child born by cesarean and who have a secondary cesarean for their second delivery. ⁶ First-degree tear involves damage to vaginal and perineal skin. ⁷ Second-degree tear involves the posterior vaginal wall and the underlying elevator and perineal muscles. ⁸ Severe perineal tears include 3rd and 4th degree perineal tears. Third-degree tears involve the anal sphincter, with either total or partial damage to the sphincter, and fourth-degree tears involve the anal sphincter and tears into the rectal mucosa.

<table><caption>**Table 3.** Final set of quality indicators and definitions.</caption><thead><tr><th>Category</th><th>Quality Indicators<sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td rowspan="4">Onset of labor</td><td>Inductions of labor</td><td>Number of inductions of labor<sup>2</sup></td><td>Total number of deliveries<sup>2</sup></td></tr><tr><td>Planned cesarean deliveries</td><td>Number of planned cesarean deliveries performed on or before the scheduled due date (surgical indication recorded ≥ 48 h before performance)<sup>2</sup></td><td>Total number of cesarean deliveries<sup>2</sup></td></tr><tr><td>Planned cesareans ≥ 39 wk</td><td>Number of planned cesarean deliveries ≥ 39 wk performed on or before the scheduled due date (surgical indication recorded ≥ 48 h before performance)<sup>2</sup></td><td>Total number of planned cesarean deliveries<sup>2</sup></td></tr><tr><td>Cesareans before labor</td><td>Number of cesarean deliveries before labor<sup>2</sup></td><td>Total number of cesarean deliveries<sup>2</sup></td></tr></tbody></table>
<table><caption>Table 3. Cont.</caption><thead><tr><th>Category</th><th>Quality Indicators<sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td rowspan="12">Delivery</td><td>Vaginal deliveries</td><td>Number of vaginal deliveries<sup>2</sup></td><td>Total number of deliveries<sup>2</sup></td></tr><tr><td>Spontaneous vaginal deliveries (non-instrumental)</td><td>Number of non-instrumental spontaneous vaginal deliveries<sup>2</sup></td><td>Total number of vaginal deliveries<sup>2</sup></td></tr><tr><td>Instrumental vaginal deliveries</td><td>Number of instrumental vaginal deliveries<sup>2,3</sup></td><td>Total number of vaginal deliveries<sup>2</sup></td></tr><tr><td>Global cesarean deliveries</td><td>Number of cesareans<sup>2</sup></td><td>Total number of deliveries<sup>2</sup></td></tr><tr><td>Global cesareans ≥ 37 wk with a singleton pregnancy in breech presentation</td><td>Number of cesareans ≥ 37 wk with a singleton pregnancy in breech presentation<sup>2</sup></td><td>Total number of deliveries ≥ 37 wk with a singleton pregnancy in breech presentation<sup>2</sup></td></tr><tr><td>Cesareans among nulliparas</td><td>Number of cesareans among nulliparas<sup>2</sup></td><td>Total number of deliveries for nulliparas<sup>2</sup></td></tr><tr><td>Cesareans during labor</td><td>Number of cesareans during labor (among planned cesareans or planned vaginal deliveries)<sup>2</sup></td><td>Total number of cesarean deliveries<sup>2</sup></td></tr><tr><td>Cesareans ≥ 37 wk for nulliparas with a singleton pregnancy in cephalic presentation</td><td>Number of cesareans ≥ 37 wk for nulliparas with a singleton pregnancy in cephalic presentation<sup>2</sup></td><td>Total number of deliveries ≥ 37 wk for nulliparas with a singleton pregnancy in cephalic presentation<sup>2</sup></td></tr><tr><td>Cesareans after one previous cesarean</td><td>Number of cesareans after only one previous cesarean delivery<sup>2</sup></td><td>Total number of deliveries with only one previous cesarean delivery<sup>2</sup></td></tr><tr><td>Cesareans in non-singleton pregnancy</td><td>Number of cesareans in non-singleton pregnancy<sup>2</sup></td><td>Total number of non-singleton deliveries<sup>2</sup></td></tr><tr><td>Planned cesareans ≥ 39 wk</td><td>Number of planned cesareans ≥ 39 wk<sup>2</sup></td><td>Total number of cesarean deliveries<sup>2</sup></td></tr><tr><td>Unplanned cesareans after failure of induction</td><td>Number of unplanned cesareans after induction of labor<sup>2</sup></td><td>Total number of inductions of labor<sup>2</sup></td></tr><tr><td>Definition of low risk at the end of pregnancy</td><td colspan="3">Low-risk women at the end of pregnancy defined as initially at low risk at the beginning of pregnancy (1), and at low risk during pregnancy (2), without placenta previa or other obstacle for a vaginal delivery, with a fetus in cephalic presentation.<br>(1) Initially (at first consultation) at low risk:<ul><li>Age: ≥18 years and &lt;35 years</li><li>No medical history negatively affecting the pregnancy</li><li>No history of preterm birth, stillbirth, neonatal death</li><li>Singleton pregnancy</li><li>No previous cesarean or other uterine scar</li></ul>(2) Low-risk women during pregnancy:<ul><li>Initially at low risk and no disorders of pregnancy</li><li>No threatened premature delivery</li><li>No hypertension</li><li>No diabetes</li><li>No amniotic fluid abnormality</li><li>No uterine growth abnormality</li></ul></td></tr></tbody></table>
<table><caption>Table 3. Cont.</caption><thead><tr><th>Category</th><th>Quality Indicators <sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td></td><td>Cesareans in women at low risk</td><td>Number of cesareans in women at low risk <sup>2,4</sup></td><td>Total number of deliveries in women at low risk <sup>2</sup></td></tr><tr><td rowspan="10">Delivery</td><td rowspan="10">Cesarean sections according to Robson 10-group classification</td><td>Number of cesareans <sup>2</sup> in:</td><td></td></tr><tr><td>1. Nulliparas, singleton cephalic fetus, ≥37 wk, in spontaneous labor</td><td></td></tr><tr><td>2. Nulliparas, singleton cephalic fetus ≥37 wk, induction or cesarean before labor</td><td></td></tr><tr><td>3. Multiparas (excluding previous cesarean), singleton cephalic fetus, ≥37 wk, in spontaneous labor</td><td></td></tr><tr><td>4. Multiparas (excluding previous cesarean), singleton cephalic fetus, ≥37 wk, induction or cesarean before labor</td><td rowspan="6">Total number of deliveries <sup>2</sup> according to the description of each group (for example, for group 1: total number of deliveries in nulliparas, with a singleton cephalic fetus, ≥37 wk, in spontaneous labor)</td></tr><tr><td>5. Previous cesarean, singleton cephalic fetus, ≥37 wk</td></tr><tr><td>6. All nulliparas with fetus in breech presentation</td></tr><tr><td>7. All multiparas with fetus in breech presentation (including previous cesarean)</td></tr><tr><td>8. All multiple pregnancies (including previous cesarean)</td></tr><tr><td>9. All abnormal lies (including previous cesarean)</td></tr><tr><td>10. All singleton cephalic fetuses, ≤36 wk (including previous cesarean)</td></tr><tr><td rowspan="3">Pain management</td><td>General anesthesia for cesarean delivery</td><td>Number of women receiving general anesthesia for cesareans <sup>2</sup></td><td>Total number of cesarean deliveries <sup>2</sup></td></tr><tr><td>Epidural analgesia for vaginal delivery</td><td>Number of women receiving epidural analgesia for vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries <sup>2</sup></td></tr><tr><td>Spinal analgesia for cesareans</td><td>Number of women receiving spinal analgesia for cesareans <sup>2</sup></td><td>Total number of cesarean deliveries <sup>2</sup></td></tr></tbody></table>
<table><caption>Table 3. *Cont.*</caption><thead><tr><th>Category</th><th>Quality Indicators<sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td rowspan="10">Neonatal morbidity and mortality</td><td>Apgar score &lt; 7 at 5 min</td><td>Number of live-born infants with Apgar score &lt; 7 at 5 min<sup>2</sup></td><td>Total number of live-born infants (stillborn infants excluded)<sup>2</sup></td></tr><tr><td>Births ≥ 37 wk with Apgar score &lt; 7 at 5 min</td><td>Number of live-born infants with a birth ≥ 37 wk and an Apgar score &lt; 7 at 5 min<sup>2</sup></td><td>Total number of live-born infants ≥ 37 wk (stillborn infants excluded)<sup>2</sup></td></tr><tr><td>Live-born preterm neonate</td><td>Number of live-born infants before &lt; 37 wk gestation<sup>2</sup></td><td>Total number of live-born infants<sup>2</sup></td></tr><tr><td>Live-born infants before &lt; 34 wk gestation</td><td>Number of live-born infants before &lt; 34 wk gestation<sup>2</sup></td><td>Total number of live-born infants<sup>2</sup></td></tr><tr><td>Live-born infants before &lt; 32 wk gestation</td><td>Number of live-born infants before &lt; 32 wk gestation<sup>2</sup></td><td>Total number of live-born infants<sup>2</sup></td></tr><tr><td>Live-born infants before &lt; 28 wk gestation</td><td>Number of live-born infants before &lt; 28 wk gestation<sup>2</sup></td><td>Total number of live-born infants<sup>2</sup></td></tr><tr><td>Arterial pH &lt; 7.10</td><td>Number of live-born infants with umbilical artery pH &lt; 7.10<sup>2</sup></td><td>Total number of live-born infants with umbilical artery pH measured<sup>2</sup></td></tr><tr><td>Arterial pH &lt; 7.0</td><td>Number of live-born infants with umbilical artery pH &lt; 7.0<sup>2</sup></td><td>Total number of live-born infants with umbilical artery pH measured<sup>2</sup></td></tr><tr><td>Birth weights &lt; 3rd percentile for gestational age</td><td>Number of infants with a birth weight &lt; 3rd percentile for gestational age<sup>2</sup></td><td>Total number of newborns<sup>2</sup></td></tr><tr><td>Neonatal transfers to intensive care or neonatology unit</td><td>Number of live-born infants transferred to an intensive care or neonatology unit<sup>2</sup></td><td>Total number of live-born infants (admissions for congenital malformations and transfer to kangaroo care unit excluded)<sup>2</sup></td></tr><tr><td>Neonatal transfers to intensive care unit</td><td>Number of live-born infants transferred to intensive care unit<sup>2</sup></td><td>Total number of live-born infants (admissions for congenital malformations excluded)<sup>2</sup></td></tr><tr><td>Immediate transfers to any neonatal unit for infants born ≥ 37 wk</td><td>Number of infants born ≥ 37 wk transferred to any neonatal unit<sup>2</sup></td><td>Total number of live-born infants ≥ 37 wk (admissions for congenital malformations excluded)<sup>2</sup></td></tr><tr><td>Stillbirths</td><td>Number of fetal or immediate neonatal deaths (including fetal deaths in utero, medical terminations of pregnancy, and intrapartum deaths)<sup>2</sup></td><td>Total number of births (live-born or stillborn infants)<sup>2</sup></td></tr></tbody></table>
<table><caption>Table 3. *Cont.*</caption><thead><tr><th>Category</th><th>Quality Indicators <sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td rowspan="10">Maternal morbidity</td><td>Postpartum hemorrhages >500 mL for vaginal delivery</td><td>Number of postpartum hemorrhages > 500 mL for vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries <sup>2</sup></td></tr><tr><td>Postpartum hemorrhages > 1000 mL (regardless of mode of delivery)</td><td>Number of postpartum hemorrhages > 1000 mL for delivery <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Postpartum hemorrhage > 1000 mL for vaginal delivery</td><td>Number of postpartum hemorrhages > 1000 mL for vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries <sup>2</sup></td></tr><tr><td>Postpartum hemorrhages > 1000 mL for cesarean deliveries</td><td>Number of postpartum hemorrhages > 1000 mL for cesareans <sup>2</sup></td><td>Total number of cesarean deliveries <sup>2</sup></td></tr><tr><td>Blood transfusions in delivery or operating room</td><td>Number of blood transfusions in the delivery or operating room <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Hemostatic hysterectomies</td><td>Number of hemostatic hysterectomies <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Hemostatic surgery (other than hysterectomy)</td><td>Number of hemostatic surgeries other than hysterectomies <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Uterine ruptures</td><td>Number of complete or subperitoneal uterine ruptures (dehiscences excluded) <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Discharge from delivery unit by transfer to adult intensive care unit</td><td>Number of women discharged from the delivery unit by a transfer to an intensive care unit <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Intact perineum</td><td>Number of women with an intact perineum (without suture) <sup>2</sup></td><td>Total number of deliveries <sup>2</sup></td></tr><tr><td>Episiotomies</td><td>Number of women with an episiotomy for vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries <sup>2</sup></td></tr><tr><td>Episiotomies in primiparas</td><td>Number of primiparas with an episiotomy in vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries in primiparas <sup>2</sup></td></tr><tr><td>Severe perineal tears</td><td>Number of women with 3rd- and 4th-degree perineal tears <sup>5</sup> in vaginal delivery <sup>2</sup></td><td>Total number of vaginal deliveries <sup>2</sup></td></tr><tr><td>Severe perineal tears for instrumental vaginal delivery</td><td>Number of women with 3rd- and 4th-degree perineal tears <sup>5</sup> for instrumental vaginal delivery <sup>2</sup></td><td>Total number of instrumental vaginal deliveries (forceps, vacuum, spatula) <sup>2</sup></td></tr><tr><td>Severe perineal tears for non-instrumental vaginal delivery</td><td>Number of women with 3rd- and 4th-degree perineal tears <sup>5</sup> in non-instrumental vaginal delivery <sup>2</sup></td><td>Total number of non-instrumental vaginal deliveries <sup>2</sup></td></tr></tbody></table>
<table><caption>Table 3. *Cont.*</caption><thead><tr><th>Category</th><th>Quality Indicators <sup>1</sup> or Definitions</th><th>Numerator</th><th>Denominator</th></tr></thead><tbody><tr><td rowspan="2">Maternal morbidity</td><td>Severe perineal tears for forceps delivery</td><td>Number of women with 3rd- and 4th-degree perineal tears <sup>5</sup> in instrumental vaginal delivery using forceps <sup>2</sup></td><td>Total number of instrumental vaginal deliveries using forceps <sup>2</sup></td></tr><tr><td>International definition of perineal tears (first, second, third, and fourth degrees)</td><td>1st degree: tears affecting the skin or the vaginal mucosa<br>2nd degree: tears affecting the muscle of the perineum but not the sphincter<br>3rd degree: tears affecting the anal sphincter<br>4th degree: tears involving the anal sphincter and tears into the rectal mucosa</td><td></td></tr></tbody></table>

Wk: weeks of amenorrhea. <sup>1</sup> Quality indicators are expressed as percentages. <sup>2</sup> For births ≥ 22 wk or birth weight ≥ 500 g in the absence of a known pregnancy onset. <sup>3</sup> Forceps, spatula, or vacuum extractor. <sup>4</sup> According to the previously proposed definition during the Delphi process. <sup>5</sup> Third-degree tears involve the anal sphincter, with either total or partial damage to the sphincter and fourth-degree tears involving the anal sphincter and tears into the rectal mucosa.
## 4. Discussion

Using a modified RAND-UCLA Delphi method, we developed a clinically relevant set of 50 quality indicators and 2 definitions in obstetrics that covered care during delivery and in the immediate postpartum period. They were based simultaneously on medical literature and on the judgments of a large panel. One indicator—the Robson classification for cesareans—was selected after the Delphi process by the CNGOF in view of international guidelines and to promote international comparability by the FIGO [32].

The number of panelists in the two-round Delphi survey is one of the strengths of our study. To the best of our knowledge, there are currently no clear guidelines for the sample size of a Delphi panel [33]. It has been suggested that a minimum number of panelists should range from 7 to 15 [29,34]. The large panel of obstetrician-gynecologists and midwives who participated in this Delphi survey should certainly have increased the stability of our results and the reliability of the final set of quality indicators [35,36]. Second, only a few panelists did not respond to the second round of Delphi, and the follow-up response rate exceeded the 70% suggested by Sumsion [37]. Another strength of our study was the assessment of external validity. Indeed, the final set of quality indicators was submitted for an external independent review for approval by two French professional societies specialized in childbirth: CNGOF and CNSF—whose members are the obstetricians and midwives who complete the delivery register in the maternity units for each delivery. Similarly, the only eligible panelists were obstetricians and midwives working in a delivery unit. Our final objective was to select indicators that can be routinely filled in and monitored via the computerization of the delivery registers available in all French maternity units to guide the development of quality improvement programs at the local and national levels.

This study has some limitations. The indicators were developed in a French setting, so the results may not be generalizable to other countries as practices vary internationally. Nonetheless, the recommendations were based on references extracted from an international literature review, which should provide good external validity. The self-selection of the panelists may have influenced the results. Those who participated in the Delphi rounds may not have had the same characteristics and/or may not have rated the indicators the same as those who did not participate. To facilitate a high level of continued participation, the number of rounds for the Delphi procedure was limited to 2. This left some indicators or definitions neither accepted nor rejected. This is the case for the definition of a planned cesarean, which remains a problem in France. We have guidelines about planned cesareans and a national indicator (rate of cesareans [%]) but still no clear definition of a planned cesarean [27,38].

Globally, the panelists did not select any of the risk-adjusted indicators or adverse outcome index models suggested by various authors [12,39–41]. However, they did select the main’s cesarean indicator “nulliparous term singleton vertex cesarean birth” (NTSV CB) [42]. This underlines the incomprehensibility of risk-adjusted indicators for clinicians without substantial training and experience in statistics.

During the first Delphi round, the panelists accepted the international definitions about perineal lacerations, which will enable comparisons of French studies with non-French studies and quality indicators on this topic. To our surprise, the definition of low risk at the end of pregnancy was accepted during the first Delphi round, although there was no formal consensus in France on this subject at that time.

We expected a lower number of quality indicators to be selected after the second round because mandatory care quality and safety indicators in French hospitals are poorly accepted by caregivers [43]. The results of these indicators contribute to the pay-for-performance mechanism of French health establishments [44]. However, the bulk of hospital revenues is still allocated according to medical activities. This medical resistance to guideline implementation, assessment by indicators, and audits point to the physicians’
feeling of loss of autonomy through the demands of standardization of medical prac-
tices [45–47]. We were therefore surprised by the high number of perinatal care providers
participating in the Delphi procedure.

For many indicators, we do not know what the right rate is [48]. For example, the planned cesarean rate is a good indicator of the quality of care in a maternity ward. Nonetheless, it is difficult to tell physicians what the correct rate of this intervention is. The mean rate is usually recommended, on the assumption that the highest and lowest rates are inappropriate, but this is not necessarily true. In a study, we assessed the incidence of postpartum hemorrhage (PPH) and second-line procedures in maternity units according to the quality of their PPH protocol [49]. We find that maternity units with higher scores identified PPH better and used fewer curative second-line procedures. So the ideal rate is that associated with the lowest level of maternal and/or neonatal morbidity or mortality, but it is difficult to ascertain in practice.

The number of indicators selected at the end of our study is reduced compared to some
reviews of the literature [50,51]. This can be explained by the fact that we have focused on
indicators that can be recorded in the daily routine in the birth unit and so we do not have
structure or health-determinant quality indicators [50].

**5. Conclusions**

In conclusion, our study has identified a list of 50 quality indicators and 2 definitions suitable for routine monitoring in maternity units. However, the feasibility of these quality indicators will need to be assessed by research studies conducted under the conditions of everyday practices. To improve the calculation and monitoring of these indicators, birth registers, still widely kept on paper in French maternity wards, should be required to be computerized. Further research should study the impact of monitoring these indicators on improving maternal and neonatal morbidity and mortality at a national level.

**Supplementary Materials:** The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare11060848/s1, Supplementary Table S1: Quality indicators (numerator and denominator) and definitions that were not accepted after both rounds of the Delphi survey.

**Author Contributions:** Conceptualization, F.V.; methodology, C.G.-A. and L.G.; validation, C.G.-A., L.G. and F.V.; formal analysis, C.G.-A.; investigation, F.V.; data curation, C.G.-A. and O.R.; writing—original draft preparation, C.G.-A. and F.V.; writing—review and editing, C.G.-A., L.G. and F.V.; visualization, C.G.-A. and F.V.; supervision, O.R. and F.V.; project administration, F.V. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Institutional Review Board Statement:** This study did not require ethics review and approval given that no personal medical data regarding panelists were collected. Under French legislation, ethics approval is not required for this type of study. All information and data collected were treated anonymously.

**Informed Consent Statement:** All panelists gave their informed consent to participate in the study.

**Data Availability Statement:** The data that support the findings of this study are available from the corresponding author upon reasonable request.

**Acknowledgments:** The authors would like to thank all obstetrician-gynecologists and midwives who participated in the Delphi process for their contribution to the study and their time in responding to the questionnaires. We acknowledge the CNSF and the CNGOF for their support and the Audipog association for its free logistic support. We acknowledge Catherine Crenn-Hébert (Audipog, APHP, Hôpital Louis-Mourier), Jeanne Fresson (CHU de Nancy), Pascal Thibon (CHU de Caen), Sandra David-Tchouda (CHU de Grenoble), Marie-José D'Alché-Gautier (CHU de Caen), and Rym Boulkedid (APHP, Hôpital Robert Debré) for their participation in the steering committee of the study.

**Conflicts of Interest:** The authors declare no conflict of interest.
## References

1. World Health Organization—Millennium Development Goals (MDGs). Available online: https://www.who.int/news-room/fact-sheets/detail/millennium-development-goals-(mdgs) (accessed on 9 February 2023).

2. Talungchit, P.; Liabsuetrakul, T.; Lindmarck, G. Development and assessment of indicators for quality of care in severe preeclampsia/eclampsia and postpartum hemorrhage. *J. Healthc. Qual.* **2013**, *35*, 22–34. [CrossRef] [PubMed]

3. Kristensen, S.; Mainz, J.; Bartels, P. Selection of indicators for continuous monitoring of patient safety: Recommendations of the project 'safety improvement for patients in Europe'. *Int. J. Qual. Health Care* **2009**, *21*, 169–175. [CrossRef] [PubMed]

4. Bonfill, X.; Roqué, M.; Aller, M.B.; Osorio, D.; Foradada, C.; Vives, A.; Rigau, D. Development of quality of care indicators from systematic reviews: The case of hospital delivery. *Implement. Sci.* **2013**, *8*, 42. [CrossRef] [PubMed]

5. Kesmodel, U.S.; Jolving, L.R. Measuring and improving quality in obstetrics—The implementation of national indicators in Denmark. *Acta Obstet. Gynecol. Scand.* **2011**, *90*, 295–304. [CrossRef] [PubMed]

6. Korst, L.M.; Gregory, K.D.; Lu, M.C.; Reyes, C.; Hobel, C.J.; Chavez, G.F. A framework for the development of maternal quality of care indicators. *Matern. Child Health J.* **2005**, *9*, 317–341. [CrossRef]

7. Sibanda, T.; Fox, R.; Draycott, T.J.; Mahmood, T.; Richmond, D.; Simms, R.A. Intrapartum care quality indicators: A systematic approach for achieving consensus. *Eur. J. Obstet. Gynecol. Reprod. Biol.* **2013**, *166*, 23–29. [CrossRef] [PubMed]

8. Macfarlane, A.; Gissler, M.; Bolumar, F.; Rasmussen, S. The availability of perinatal health indicators in Europe. *Eur. J. Obstet. Gynecol. Reprod. Biol.* **2003**, *111*, S15–S32. [CrossRef]

9. Wildman, K.; Blondel, B.; Nijhuis, J.; Defoort, P.; Bakoula, C. European indicators of health care during pregnancy, delivery and the postpartum period. *Eur. J. Obstet. Gynecol. Reprod. Biol.* **2003**, *111*, S53–S65. [CrossRef]

10. Melman, S.; Schoorel, E.C.N.; de Boer, K.; Burggraaf, H.; Derks, J.B.; van Dijk, D.; van Dillen, J.; Dirksen, C.D.; Duvekot, J.J.; Franx, A.; et al. Development and measurement of guidelines-based quality indicators of caesarean section care in the Netherlands: A Rand-modified Delphi procedure and retrospective chart review. *PLoS ONE* **2016**, *11*, e0145771. [CrossRef]

11. Zeitlin, J.; Wildman, K.; Bréart, G.; Alexander, S.; Barros, H.; Blondel, B.; Buitendijk, S.; Gissler, M.; Macfarlane, A. Selecting an indicator set for monitoring and evaluating perinatal health in Europe: Criteria, methods and results from the PERISTAT project. *Eur. J. Obstet. Gynecol. Reprod. Biol.* **2003**, *111*, S5–S14. [CrossRef]

12. Bailit, J.L. Measuring the quality of inpatient care. *Obstet. Gynecol. Surv.* **2007**, *62*, 207–213. [CrossRef]

13. Alkema, L.; Chou, D.; Hogan, D.; Zhang, S.; Moller, A.B.; Gemmill, A.; Fat, D.M.; Boerma, T.; Temmerman, M.; Mathers, C.; et al. Global, regional, and national levels and trends in maternal mortality between 1990 and 2015, with scenario-based projections to 2030: A systematic analysis by the UN Maternal Mortality Estimation Inter-Agency Group. *Lancet* **2016**, *38*, 462–474. [CrossRef] [PubMed]

14. Say, L.; Chou, D.; Gemmill, A.; Tunçalp, Ö.; Moller, A.B.; Daniels, J.; Gülmezoglu, A.M.; Temmerman, M.; Alkema, L. Global causes of maternal death: A WHO systematic analysis. *Lancet Glob. Health* **2014**, *2*, e323–e333. [CrossRef] [PubMed]

15. Haller, G.; Camparini-Righini, N.; Kern, C.; Pfister, R.E.; Morales, M.; Berner, M.; Clergue, F.; Irion, O. Patient safety indicators for obstetrics: A Delphi based study. *J. Gynecol. Obstet. Biol. Reprod.* **2010**, *39*, 371–378. [CrossRef]

16. Bunch, K.J.; Allin, B.; Jolly, M.; Hardie, T.; Knight, M. Developing a set of consensus indicators to support maternity service quality improvement: Using Core Outcome Set methodology including a Delphi process. *BJOG* **2018**, *125*, 1612–1618. [CrossRef] [PubMed]

17. Boulkedid, R.; Sibony, O.; Goffinet, F.; Fauconnier, A.; Branger, B.; Alberti, C. Quality indicators for continuous monitoring to improve maternal and infant health in maternity departments: A modified Delphi survey of an international multidisciplinary panel. *PLoS ONE* **2013**, *8*, e60663. [CrossRef] [PubMed]

18. Sauvegrain, P.; Chantry, A.A.; Chiesa-Dubruille, C.; Keita, H.; Goffinet, F.; Deneux-Tharaux, C. Monitoring quality of obstetric care from hospital discharge databases: A Delphi survey to propose a new set of indicators based on maternal health outcomes. *PLoS ONE* **2019**, *14*, e0211955. [CrossRef]

19. Deneux-Tharaux, C.; Morau, E.; Dreyfus, M. Maternal mortality in France 2013–2015: An evolving profile. *Gynecol. Obstet. Fertil. Senol.* **2021**, *49*, 1–2. [CrossRef] [PubMed]

20. Zeitlin, J.; Alexander, S.; Barros, H.; Blondel, B.; Delnord, M.; Durox, M.; Gissler, M.; Hindori-Mohangoo, A.D.; Hocquette, A.; Szamotulska, K.; et al. Perinatal health monitoring through a European lens: Eight lessons from the Euro-Peristat report on 2015 births. *BJOG* **2019**, *126*, 1518–1522. [CrossRef] [PubMed]

21. Blondel, B.; Durox, M.; Zeitlin, J. How perinatal health in France compared with other European countries in 2015: Some progress but also some concerns about newborn health. *Arch. Pediatr.* **2019**, *26*, 249–251. [CrossRef]

22. European Perinatal Health Report—Core Indicators of the Health and Care of Pregnant Women and Babies in Europe from 2015 to 2019. Available online: https://www.europeristat.com/images/Euro-Peristat_Fact_sheets_2022_for_upload.pdf (accessed on 9 February 2023).

23. Corallo, A.N.; Croxford, R.; Goodman, D.C.; Bryan, E.L.; Srivastava, D.; Stukel, T.A. A systematic review of medical practice variation in OECD countries. *Health Policy* **2014**, *114*, 5–14. [CrossRef]

24. The Royal College of Obstetricians and Gynaecologists. *Patterns of Maternity Care in English NHS Hospitals, 2011–2012*; RCOG Press: London, UK, 2013.

25. Vendittelli, F.; Tassié, M.C.; Gerbaud, L.; Lémery, D. Appropriateness of elective casarean deliveries in a perinatal network: A cross-sectional study. *BMC Pregnancy Childbirth* **2014**, *14*, 135. [CrossRef] [PubMed]
26. Vendittelli, F.; Rivière, O.; Crenn-Hébert, C.; Giraud-Roufast, A.; Audipog Sentinel Network. Do perinatal guidelines have an impact on obstetric practices? *Rev. Epidemiol. Sante Publique* **2012**, *60*, 355-362. [CrossRef] [PubMed]

27. Haute Autorité de Santé—Indications de la Césarienne Programmée à Terme. Méthode Recommandations pour la Pratique Clinique. Available online: https://www.has-sante.fr/upload/docs/application/pdf/2012-03/indications_cesarienne_programme_-_argumentaire.pdf (accessed on 9 February 2023).

28. Boulkedid, R.; Abdoul, H.; Loustau, M.; Sibony, O.; Alberti, C. Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review. *PLoS ONE* **2011**, *6*, e20476. [CrossRef] [PubMed]

29. Fitch, K.; Bernstein, S.J.; Aguilar, M.D.; Burnand, B.; LaCalle, J.R.; Lazaro, P.; van het Loo, M.; McDonnell, J.; Vader, J.; Kahan, J.P. *The RAND/UCLA Appropriateness Method User's Manual*; RAND Corporation: Santa Monica, CA, USA, 2001.

30. Jones, J.; Hunter, D. Consensus methods for medical and health services research. *BMJ* **1995**, *311*, 376-380. [CrossRef] [PubMed]

31. Robson, M.S. Can we reduce the cesarean section rate? *Best Pract. Res. Clin. Obstet. Gynaecol.* **2001**, *15*, 179-194. [CrossRef] [PubMed]

32. FIGO Working Group on Challenges in Care of Mothers and Infants during Labour and Delivery. Best practice advice on the 10-Group Classification System for cesarean deliveries. *Int. J. Gynecol. Obstet.* **2016**, *135*, 232-233. [CrossRef]

33. Jorm, A.F. Using the Delphi expert consensus method in mental health research. *Aust. N.Z.J. Psychiatry* **2015**, *49*, 887-897. [CrossRef] [PubMed]

34. Okoli, C.; Pawlowski, S.D. The Delphi method as a research tool: An example, design considerations and applications. *Inf. Manag.* **2004**, *42*, 15-29. [CrossRef]

35. Dalkey, N.C. *The Delphi Method: An Experimental Study of Group Opinion*; RAND Corporation: Santa Monica, CA, USA, 1969.

36. Murphy, M.K.; Black, N.A.; Lamping, D.L.; McKee, C.M.; Sanderson, C.F.; Askham, J.; Marteau, T. Consensus development methods, and their use in clinical guideline development. *Health Technol. Assess.* **1998**, *2*, 1-88. [CrossRef] [PubMed]

37. Sumsion, T. The Delphi technique: An adaptive research tool. *Br. J. Occup. Ther.* **1998**, *61*, 153-156. [CrossRef]

38. République Française, Santé Publique France, Inserm—Enquête Nationale Périnatale. Rapport 2021. Les naissances, le suivi à deux mois et les établissements. Situation et évolution depuis 2016. Available online: https://www.santepubliquefrance.fr/maladies-et-traumatismes/maladies-de-la-mere-et-de-l-enfant/surdite-permanente-neonatale/documents/enquetes-etudes/enquete-nationale-perinatale.-rapport-2021.-les-naissances-le-suivi-a-deux-mois-et-les-etablissements (accessed on 9 February 2023).

39. David, S.; Mamelle, N.; Riviere, O. Estimation of an expected caesarean section rate, taking into account the case mix of a maternity hospital. Analysis from the AUDIPOG Sentinelle Network (France). Obstetricians of AUDIPOG. Association of Users of Computerised Files in Perinatalogy, Obstetrics and Gynaecology. *BJOG* **2001**, *108*, 919-926. [CrossRef] [PubMed]

40. Mann, S.; Pratt, S.; Gluck, P.; Nielsen, P.; Risser, D.; Greenberg, P.; Marcus, R.; Goldman, M.; Shapiro, D.; Pearlman, M.; et al. Assessing quality obstetrical care: Development of standardized measures. *Jt. Comm. J. Qual. Patient Saf.* **2006**, *32*, 497-505. [CrossRef]

41. Foglia, L.M.; Nielsen, P.E.; Hemann, E.A.; Walker, S.; Pates, J.A.; Napolitano, P.G.; Deering, S. Accuracy of the Adverse Outcome Index: An Obstetrical Quality Measure. *Jt. Comm. J. Qual. Patient Saf.* **2015**, *41*, 370-377. [CrossRef] [PubMed]

42. Main, E.K.; Moore, D.; Farrell, B.; Schimmel, L.D.; Altman, R.J.; Abrahams, C.; Campbell Bliss, M.; Polivy, L.; Sterling, J. Is there a useful cesarean birth measure? Assessment of the nulliparous term singleton vertex cesarean birth rate as a tool for obstetric quality improvement. *Am. J. Obstet. Gynecol.* **2006**, *194*, 1644-1651. [CrossRef] [PubMed]

43. Bertillot, H. How quality indicators take hold in French hospital: Mechanisms of a soft institutionalization. *Sociologies* **2020**, *1–15*. (In French) [CrossRef]

44. Ministère des Solidarités et de la Santé—Décret n° 2021-1613 du 9 décembre 2021 portant modification De dispositions réglementaires du code de la sécurité sociale relatives à l'amélioration de la qualité et de la sécurité des soins. Available online: https://www.legifrance.gouv.fr/download/file/k9J4QampA_S_KWuxcrXD3mPztg_RyZO4BL7nbsvBufc=/JOE_TEXTE (accessed on 9 February 2023).

45. Abelhauser, A.; Gori, R.; Sauret, M.J. *La Folie Évaluation. Les Nouvelles Fabriques De La Servitude*; Edition Fayard/Mille et Une Nuits: Paris, France, 2011.

46. Todd, R. *The End of Average: How We Succeed in A World That Values Sameness*; HarperCollins: Toronto, ON, Canada, 2016.

47. Dumesnil, J. *Art Médical Et Normalisation Du Soin*; Presse Universitaire de France: Paris, France, 2011.

48. Wennberg, J. Which rate is right? *N. Engl. J. Med.* **1986**, *314*, 310-311. [CrossRef]

49. Vendittelli, F.; Barasinski, C.; Rivière, O.; Da Costa Correia, C.; Crenn-Hébert, C.; Dreyfus, M.; Legrand, A.; Gerbaud, L. Does the Quality of Postpartum Hemorrhage Local Protocols Improve the Identification and Management of Blood Loss after Vaginal Deliveries? A Multicenter Cohort Study. *Healthcare* **2022**, *10*, 992. [CrossRef] [PubMed]
50. Saturno-Hernández, P.J.; Martínez-Nicolás, I.; Moreno-Zegbe, E.; Fernández-Elorriaga, M.; Poblano-Verástegui, O. Indicators for monitoring maternal and neonatal quality care: A systematic review. *BMC Pregnancy Childbirth* **2019**, *19*, 25. [CrossRef]

51. Lazzaretto, E.; Nespoli, A.; Fumagalli, S.; Colciago, E.; Perego, S.; Locatelli, A. Intrapartum care quality indicators: A literature review. *Minerva Ginecol.* **2018**, *70*, 346–356. [CrossRef] [PubMed]

**Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.