# Optimal combination of non-invasive tools for the early detection of potentially life-threatening emergencies in gynecology

Catalina Varas, Marion Ravit, Camille Mimoun, Pierre Panel, Cyrille Huchon, Arnaud Fauconnier

► To cite this version:

Catalina Varas, Marion Ravit, Camille Mimoun, Pierre Panel, Cyrille Huchon, et al.. Optimal combination of non-invasive tools for the early detection of potentially life-threatening emergencies in gynecology. PLoS ONE, 2016, 11 (9), e02559097

HAL Id: hal-02559097

https://hal.science/hal-02559097

Submitted on 7 Jun 2023

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

RESEARCH ARTICLE

# Optimal Combination of Non-Invasive Tools for the Early Detection of Potentially Life-Threatening Emergencies in Gynecology

Catalina Varas¹,², Marion Ravit¹, Camille Mimoun¹,², Pierre Panel³, Cyrille Huchon¹,², Arnaud Fauconnier¹,²*

1 EA 7285 Research Unit "Risk and Safety in Clinical Medicine for Women and Perinatal Health", Versailles-Saint-Quentin University (UVSQ), Montigny-le-Bretonneux, France, 2 Department of Gynecology and Obstetrics, Intercommunal Hospital Centre of Poissy-Saint-Germain-en-Laye, Poissy, France, 3 Department of Gynecology and Obstetrics, Mignot Hospital, Le Chesnay, France

* afauconnier@chi-poissy-st-germain.fr

## Abstract

### Objectives

Potentially life-threatening gynecological emergencies (G-PLEs) are acute pelvic conditions that may spontaneously evolve into a life-threatening situation, or those for which there is a risk of sequelae or death in the absence of prompt diagnosis and treatment. The objective of this study was to identify the best combination of non-invasive diagnostic tools to ensure an accurate diagnosis and timely response when faced with G-PLEs for patients arriving with acute pelvic pain at the Gynecological Emergency Department (ED).

### Methods

The data on non-invasive diagnostic tools were sourced from the records of patients presenting at the ED of two hospitals in the Parisian suburbs (France) with acute pelvic pain between September 2006 and April 2008. The medical history of the patients was obtained through a standardized questionnaire completed for a prospective observational study, and missing information was completed with data sourced from the medical forms. Diagnostic tool categories were predefined as a collection of signs or symptoms. We analyzed the association of each sign/symptom with G-PLEs using Pearson's Chi-Square or Fischer's exact tests. Symptoms and signs associated with G-PLEs (p-value < 0.20) were subjected to logistic regression to evaluate the diagnostic value of each of the predefined diagnostic tools and in various combinations.

### Results

The data of 365 patients with acute pelvic pain were analyzed, of whom 103 were confirmed to have a PLE. We analyzed five diagnostic tools by logistic regression: Triage Process, History-Taking, Physical Examination, Ultrasonography, and Biological Exams. The

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Varas C, Ravit M, Mimoun C, Panel P, Huchon C, Fauconnier A (2016) Optimal Combination of Non-Invasive Tools for the Early Detection of Potentially Life-Threatening Emergencies in Gynecology. PLoS ONE 11(9): e0162301. doi:10.1371/journal.pone.0162301

**Editor:** Shengtao Zhou, West China Second Hospital, Sichuan University, CHINA

**Received:** May 13, 2016

**Accepted:** August 20, 2016

**Published:** September 1, 2016

**Copyright:** © 2016 Varas et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** All relevant data are within the Supporting Information files of the paper (S1 File).

**Funding:** CV received a research grant from the Woman's Health Research Institute (France). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing Interests:** The authors have declared that no competing interests exist.
combination of History-Taking and Ultrasonography had a C-index of 0.83, the highest for a model combining two tools.

## Conclusions

The use of a standardized self-assessment questionnaire for history-taking and focal ultrasound examination were found to be the most successful tool combination for the diagnosis of gynecological emergencies in a Gynecological ED. Additional tools, such as physical examination, do not add substantial diagnostic value.

## Introduction

Acute pelvic pain accounts for up to 40% of the visits to gynecological emergency departments (G-EDs) [1] and may indicate a serious condition. Potentially life-threatening gynecological emergencies (G-PLEs) are acute pelvic conditions that may spontaneously evolve into a life-threatening situation. They may also carry a risk of sequelae (organ failure or organ removal) or death in the absence of prompt diagnosis and treatment [2–5].

The most common G-PLEs encountered in G-EDs [3, 6–8] are ruptured ectopic pregnancy [9], adnexal torsion [10], and complicated pelvic inflammatory disease (tubo-ovarian and pyosalpinx) [3, 6–8, 11]. Missing these high-risk conditions may delay treatment that could lead to potentially negative patient outcomes [1, 6]. The early identification of patients with PLEs who require prompt surgical treatment is thus crucial.

In this context, history-taking taking [12, 13], physical examination [12, 13], ultrasonography [14, 15], and laboratory tests [16] are the most appropriate tools. They are currently available in routine practice in most Gynecological EDs. Their diagnostic performance for the identification of patients with G-PLEs has been widely described in the literature [4]. However, the use of these tools in developed countries is highly variable. They can also be used in combination as a diagnostic strategy. For example, obstetrics/gynecology physicians in France routinely perform the initial evaluation of patients seen in G-EDs, including bedside transvaginal ultrasonography, whereas emergency ultrasound is performed in most other developed countries at the request of ED physicians by radiologists or board-certified obstetricians/gynecologists [17]. Most developing countries do not even have an ultrasound in the G-ED [18].

The purpose of the present study was to select the best package of non-invasive diagnostic tools to diagnose PLEs in patients presenting with acute pelvic pain at the G-ED.

## Materials and Methods

### Study design

The study was approved by the French Department of Higher Education and Research (N° 06.336) and the French National Committee for Information Technology and Individual Liberties (N°906253). The participants did not directly provide written consent to participate in this study, but accepted to complete a Self-Assessment Questionnaire for Gynecological Emergency (SAQ-GE) accompanied by instructions. This consent procedure was approved by the ethics committees.

Part of the data were collected from a prospective observational multicenter study designed to evaluate the usefulness of a standardized questionnaire for the systematic assessment of the medical history of patients referred for acute pelvic pain to the G-ED [9]. An important
limitation of this previous study was that it was based on history-taking only and did not compare this approach with classical diagnostic tools (i.e. clinical and ultrasound examination). For the purpose of the present study, we completed the data using a standardized data collection form for medical records of the patients included in the two main centers to. We collected information on the diagnostic tools used including the triage process, physical examination, ultrasound examination, and biological examination. No new patients were included.

## Study Setting and population

The study included all patients > 18 years of age presenting with acute pelvic pain at G-EDs of the Poissy-St Germain Hospital and Mignot Hospital, Versailles, between September 2006 and April 2008, and hospitalized for any therapeutic intervention or observation. These two hospitals serve a large population in the Parisian suburbs, and have a resident and a senior gynecologist on duty 24 hours a day with day and night access to ultrasound, CT scan, and operating rooms. They also have appropriate written pain management guidelines. In France, obstetrics and gynecology (Ob/Gyn) residents perform the initial evaluation of patients seen in gynecologic EDs, including routine bedside transvaginal sonography. The residents are required to follow a written protocol previously developed for bedside emergency ultrasonography and available online. These guidelines involve the routine recording of four standardized images: i) view of Morison's pouch with the transabdominal probe; ii) longitudinal view of the uterus to look for the midline stripe indicating an empty uterus; and iii) view of each ovary with the transvaginal probe. One to three additional views may be obtained as dictated by abnormal ultrasound findings (e.g., view of an ectopic gestational sac). The images are stored in the patient's medical chart, even when no abnormalities are detected [19]. The exclusion criteria were: i) women who had a history of chronic pelvic pain; ii) women presenting with acute pain of an origin other than abdominal and/or pelvic (i.e. acute breast or vulva conditions); iii) women with an intrauterine pregnancy of greater than 13 weeks gestation.

## Study protocol

A nurse performed a triage process on all patients including: taking a brief history, measuring vital signs (heart rate and arterial pressure [20], and measuring the pain intensity on a self-reported 11-point numerical rating scale (NRS).

All patients had to complete a Self-Assessment Questionnaire for Gynecological Emergency (SAQ-GE) based on history taking. The SAQ-GE was developed for the assessment of acute pelvic pain with a qualitative description, the location and intensity of the pain, and other signs such as vomiting, vaginal discharge, or syncope.

The physical examinations, including palpation of the abdomen and vaginal examination, were performed by the gynecology resident on duty.

Transvaginal ultrasonography (TVUS) was performed using a 3.5–5 MHz transabdominal probe and a 7 MHz transvaginal probe. The residents followed a standardized TVUS protocol including at least four images as described in the previous section. In cases of abnormalities, additional views were performed: a view of the uterine cavity content (i.e. gestational sac, other abnormality) and a view including any abnormal extra-uterine image (for example, extra-uterine gestational sac, ovarian cyst, etc.) [21].

Biological exams were performed if necessary, and included: a urinary hCG test, and if positive, a serum hCG assay. Blood counts were performed to determine whether the women had anemia based on serum hemoglobin levels [22], infection based on leucocyte counts [20], or inflammation based on C-reactive protein levels [23].
Additional investigations were performed (biological exams, complete ultrasonography by a certified obstetrician/gynecologist, CT scan) if needed. All women received appropriate pain management. This emergency protocol was supervised by a senior gynecologist who decided whether or not to perform emergency laparoscopy based on all of the available data. Patients who did not undergo surgery and received medical treatment were followed until their exams were negative and were classified as non-PLE. For example, women with miscarriage or uncomplicated ectopic pregnancy were followed until their hCG assay was negative.

## Key Outcome Measures

Signs and symptoms were classified as positive or negative using pre-determined information obtained through the analysis of the available literature (Appendix 1). For example, abdominal palpation was considered to be positive when there was guarding, rebound, or mass on abdominal palpation [10, 23]; TVUS was considered to be positive when pelvic fluid reached the uterine corpus or was found around the ovary [13, 22], or in cases of an ovarian cyst larger than 50 mm [24]. The entire description of signs and symptoms used in the study can be found in the appendix.

Signs and symptoms were grouped together into diagnostic tool categories according to the way they were collected (Appendix 1). For example: *Triage Process* was represented by Pulse, SBP, Shock index, and NRS; and *Physical Examination* by rebound tenderness, abdominal guarding, adnexal mass, and adnexal tenderness (Appendix 1).

## Gold standard

For the purpose of the study, G-PLEs were defined as (i) complicated ectopic pregnancy (tubal rupture or active bleeding); (ii) complicated pelvic inflammatory disease (tubo-ovarian abscess or pyosalpinx); (iii) adnexal torsion; (iv) hemoperitoneum exceeding 500 ml of any gynecological origin; (v) appendicitis; and (vi) intestinal obstruction. Non G-PLEs were defined as acute conditions expected to resolve spontaneously or with appropriate medical treatment such as uncomplicated ectopic pregnancy, uncomplicated pelvic inflammatory disease, uncomplicated cyst, myoma, or miscarriage. The reference standard was the visualization of G-PLEs at surgery (laparoscopy or laparotomy) with or without histological confirmation. For the non-G-PLE patients, the diagnosis was performed using either a non-surgical algorithm for early pregnancy complications [25], a non-surgical diagnosis of PID by the non-invasive prediction rule of the Centers for Disease Control and Prevention (CDC) [26], by reference imaging (including reference ultrasound examination or computed tomography), or by direct visualization at surgery. Both centers used similar diagnostic procedures.

## Data Analysis

We first analyzed the diagnostic accuracy of signs/symptoms to discriminate between the two groups (G-PLEs and non-G-PLEs) using Pearson's Chi-Square or Fischer's exact test. The diagnostic value of each sign/symptom found to be associated with G-PLEs at a threshold of $p < 0.20$ was then estimated by calculating the sensitivity (Se), specificity (Sp), positive likelihood ratio (LR+), and negative likelihood ratio (LR-) with a 95% CI.

We constructed different logistic models to evaluate the overall diagnostic value of each of the predefined diagnostic tool categories. First, we included all signs/symptoms which were significantly associated with G-PLEs in the univariate analysis in a logistic regression. Each predefined diagnostic tool category (for example, physical examination) (see appendix 1) was represented by its signs/symptoms (for example, rebound tenderness and guarding) significantly associated with G-PLEs.
Then, we constructed several logistic regressions, including distinct sets of tools, to evaluate the diagnostic value of the tools in combination. For example, we constructed a logistic regression to analyze *Triage Process* alone and another to analyze the diagnostic value of *Triage Process* combined with *Physical Examination*.

In the logistic models, the overall predictive information provided by each tool, and their possible combinations in the model, were expressed by the c-index. The c-index is defined as the proportion of all usable patient pairs in which the predictions and outcomes are concordant, which for a binary logistic regression is equivalent to the area under the receiver operating characteristic curve for a diagnostic tool [27]. Missing data were incorporated as dummy variables [28].

We constructed a forest plot to easily compare the diagnostic value of tools and their possible combinations. This plot presents the c-index and confidence interval for each tool and in combinations of two, three, four, or all, in a graphic manner.

Analyses were carried out using Stata® version 13.0 software (Stata Corp., College Station, Texas, USA.).

## Results

Out of the 460 patients available between September 2006 and April 2008, 46 had one or more exclusion criteria. Among the 414 eligible patients, 49 had missing or incomplete medical records, leaving 365 patients with complete data sets for the statistical analysis; from which 103 had confirmed G-PLEs (28.2%) and 262 other diagnoses (71.8%).

The distribution of each sign/symptom was verified before classification into two classes. No outlier or influential data point was detected.

The diagnostic performance characteristics of the variables (symptoms and signs) associated with G-PLEs is shown in Table 1. All of these variables accounted for more than 5% of events, except for the Systolic Blood Pressure $\le 90$ mmHg, which accounted for less than 3% of patients (8/307). This is an important sign, despite the fact that it is rare, and its specificity was excellent. None of the variables had a sensitivity greater than 90%. Seven variables had a specificity greater than 90%: systolic blood pressure $\le 90$ mmHg, shoulder pain, abdominal guarding, rebound tenderness, fluid in the Morison pouch, pelvic fluid reaching the uterus corpus, and an ovarian cyst larger than 50 mm (Table 1). Pulse, shock index, scapula pain, awakened by pain, pain resistant to drugs, pain when coughing, fainting, syncope, leucorrhea, abnormal vaginal discharge, digital vaginal examination, C-reactive protein, and hemoglobin concentration were not significantly associated with PLEs in the univariate analysis.

Five logistic regression models represent the diagnostic value of the different categories of diagnostic tools: (i) The *Triage Process* model included systolic blood pressure $< 90$ mmHg and NRS at the worst time $> 7$; (ii) The *History-taking* model included a history of ectopic pregnancy, shoulder pain, unbearable pain, pain during movement, pain on abdominal palpation, and vomiting during pain; (iii) The *Physical examination* model included abdominal guarding and rebound tenderness; (iv) The *Ultrasonography* model comprised fluid in the Morison pouch, pelvic fluid reaching the uterine corpus, abnormal adnexal mass, and ovarian cyst larger than 50 mm; (v) the *Biological Exams* model was composed of the urine hCG test or serum hCG assay among patients without a known pregnancy and a leucocyte count $> 10$ G/L. Table 2 presents the c-index for the five logistic regression models and those of the saturated model including the complete combination of all five tools. The saturated model leaving out one tool shows the loss of information after removal of a tool. The highest c-index was obtained for history-taking (0.76) and ultrasonography (0.77). The complete saturated model had a c-index of 0.86. Only the removal of ultrasonography from the saturated model was associated with a significant loss of information (Table 2).
<table><caption>Table 1. Diagnostic accuracy of selected signs in the univariate analysis with p < 0.20 for the diagnosis of potentially life-threatening gynecological emergencies (G-PLEs).</caption><thead><tr><th>Diagnostic tools</th><th>Patients with the characteristic (365)</th><th>Se (%)</th><th>Sp (%)</th><th>LR +</th><th>LR -</th><th>p-value*</th></tr></thead><tbody><tr><td><strong>Triage process</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Systolic Blood Pressure ≤ 90 mmHg*</td><td>8/307</td><td>6.9</td><td>99.1</td><td>7.59</td><td>0.94</td><td>0.003</td></tr><tr><td>Numerical Rating Scale (NRS) at the worst time >7°</td><td>245/358</td><td>82.2</td><td>37.0</td><td>1.30</td><td>0.48</td><td>0.000</td></tr><tr><td><strong>History-taking</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>History of ectopic pregnancy°</td><td>81/362</td><td>38.2</td><td>83.8</td><td>2.37</td><td>0.74</td><td>0.000</td></tr><tr><td>Shoulder pain°</td><td>27/347</td><td>14.0</td><td>94.7</td><td>2.66</td><td>0.91</td><td>0.006</td></tr><tr><td>Unbearable pain°</td><td>182/339</td><td>67.0</td><td>51.7</td><td>1.39</td><td>0.64</td><td>0.002</td></tr><tr><td>Pain during movement °</td><td>243/340</td><td>83.5</td><td>33.3</td><td>1.25</td><td>0.49</td><td>0.002</td></tr><tr><td>Pain on abdominal palpation°</td><td>226/335</td><td>81.9</td><td>38.2</td><td>1.32</td><td>0.47</td><td>&lt;0.001</td></tr><tr><td>Vomiting during pain°</td><td>84/356</td><td>37.0</td><td>81.6</td><td>2.02</td><td>0.77</td><td>0.000</td></tr><tr><td><strong>Physical examination</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Abdominal guarding*<fnref n="1" /></td><td>44/365</td><td>21.4</td><td>91.6</td><td>2.54</td><td>0.86</td><td>0.000</td></tr><tr><td>Rebound tenderness*<fnref n="1" /></td><td>45/365</td><td>18.4</td><td>90.1</td><td>1.86</td><td>0.91</td><td>0.069</td></tr><tr><td><strong>Ultrasound signs</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Fluid in Morrison pouch*<fnref n="1" /></td><td>24/365</td><td>16.5</td><td>97.3</td><td>6.18</td><td>0.86</td><td>0.000</td></tr><tr><td>Pelvic fluid reaching the uterine corpus*<fnref n="1" /></td><td>38/365</td><td>24.3</td><td>95.0</td><td>4.89</td><td>0.80</td><td>0.000</td></tr><tr><td>Abnormal adnexal mass*<fnref n="1" /></td><td>192/365</td><td>81.6</td><td>58.8</td><td>1.98</td><td>0.31</td><td>0.000</td></tr><tr><td>Mass larger than 50 mm*<fnref n="1" /></td><td>40/365</td><td>19.4</td><td>92.4</td><td>2.54</td><td>0.87</td><td>0.000</td></tr><tr><td><strong>Biological exams</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Urine hCG test or serum hCG* among patients without known pregnancy</td><td>159/250</td><td>69.5</td><td>39.3</td><td>1.14</td><td>0.76</td><td>0.175</td></tr><tr><td>Leucocyte count > 10 G/L*</td><td>154/353</td><td>56.4</td><td>61.5</td><td>1.47</td><td>0.71</td><td>0.002</td></tr></tbody></table>

doi:10.1371/journal.pone.0162301.t001

A forest plot presents the c-index and confidence interval for all possible tool combinations (Fig 1). Among all logistic models, the combination of history-taking and ultrasound signs had a c-index of 0.83. This is the two-tool model with the highest c-index. The best model with three diagnostic tools was obtained by incorporating triage, history-taking, and ultrasonography and had a c-index of 0.84. The best logistic model with four diagnostic tools was obtained by including biological exams with the last three and had a c-index of 0.86.

<table><caption>Table 2. C-index of non-invasive tools for the diagnosis of potentially life-threatening gynecological emergencies (G-PLEs) using multiple logistic regression.</caption><thead><tr><th></th><th>C-index of each tool alone [CI 95%]</th><th>C-index of the saturated model without the tool [CI 95%]</th></tr></thead><tbody><tr><td>Triage process</td><td>0.61 [0.56; 0.67]</td><td>0.84 [0.80; 0.89]</td></tr><tr><td>History-taking</td><td>0.76 [0.71; 0.82]</td><td>0.82 [0.77; 0.86]</td></tr><tr><td>Physical examination</td><td>0.59 [0.54; 0.64]</td><td>0.86 [0.82; 0.90]</td></tr><tr><td>Ultrasongraphy</td><td>0.77 [0.72; 0.82]</td><td>0.81 [0.76; 0.85]</td></tr><tr><td>Biological exams</td><td>0.64 [0.57; 0.70]</td><td>0.84 [0.80; 0.89]</td></tr><tr><td>C-index of saturated model</td><td></td><td>0.86 [0.82; 0.90]</td></tr></tbody></table>

The C-index indicates the amount of information of a given diagnostic tool. It also indicates the loss of information after removal of a variable from the saturated model.

doi:10.1371/journal.pone.0162301.t002

<footnote n="1">¹ Missing data were considered to be normal,</footnote>

<footnote>° Prospective Questionnaire evaluation,</footnote>

<footnote>* Retrospective Data from record.</footnote>
<figure><img src="image_4.png" /><figcaption>**Fig 1.** Diagnostic usefulness (represented by the c-index and its 95% confidence interval) of different available diagnostic tools in different combinations.</figcaption></figure>

doi:10.1371/journal.pone.0162301.g001

Discussion

History-taking, with the use of a standardized questionnaire, and ultrasonography, based on a standardized image acquisition procedure, provide sufficient diagnostic information for the detection of G-PLEs among women consulting for acute pelvic pain at the G-ED. The diagnostic value of adding other tools was not substantial. Moreover, our study does not support the traditional role of physical examination, including abdominal and vaginal digital examination, in the diagnostic procedure for acute gynecological emergency conditions.

The originality of this work has been to consider the most representative high-risk conditions encountered in a G-ED that need to be promptly managed to avoid complications with long-term impacts on the health and well-being of women, rather than a single gynecological condition. Such a global view of high-risk situations is essential for determining the best diagnostic approaches and identifying the facilities required by gynecological emergency services [4].

To test the diagnostic utility of a given diagnostic tool as a whole (i.e clinical examination or ultrasonography, for example), the different available tools were modeled by combining signs and/or symptoms which demonstrated diagnostic utility, instead of just studying sign by sign
[25]. This allowed us to study the clinical utility of different sets of diagnostic tools from the point of view of the organization of available care and resources [6, 29] and not from the traditional medical point of view.

Clinical examination, including abdominal examination and digital vaginal examination, is traditionally performed as a part of the diagnostic procedures for gynecologic emergencies in most care models in OECD countries. In one prospective study, clinical examination was found to be very useful for the diagnosis of ectopic pregnancy in an emergency care model with limited access to ultrasound [30]. In contrast, routine performance of digital vaginal examination was found to be completely useless for the diagnosis of ectopic pregnancy in a model of care based on unlimited use of ultrasound and serum hCG assays [25]. With the introduction of ultrasound scans in the 1990's, there has been little interest in studying clinical examination in the literature and recent well-designed studies evaluating the clinical examination in the context of gynecological emergencies are lacking [4]. This is likely explained by the limited additional diagnostic information provided by vaginal examination relative to that obtained by bedside emergency ultrasonography [31], as well as the potential hazards of this examination [16, 32] due to the lack of reproducibility and inter-observer variability.

Our results show that emergency bedside ultrasonography may be the cornerstone of the diagnosis of G-PLEs. This is in complete agreement with the results of a systematic review specifically designed to identify non-invasive tools for the diagnosis of G-PLE. Indeed, based on 20 studies, transvaginal ultrasound was the individual diagnostic tool with the best performance for the diagnosis of G-PLEs [4]. However, these studies lack any information about the qualifications and experience of the clinicians performing the ultrasound, contrary to the present study. Furthermore, these studies did not provide any comparison with other diagnostic tools that would place ultrasonography examination in the context of the entire diagnostic work-up process.

Medical history taking has been found to be useful in the context of acute pelvic or abdominal pain in women in some retrospective studies [12, 13, 33–35]. However, items collated by the physician may be misinterpreted as they are not based on standardized questions found in self-assessment questionnaires that are directly understandable by patients. We thus developed a standardized self-assessment questionnaire that does not require intervention from health-care professionals. This questionnaire has already proven useful for triaging most G-PLEs including ruptured ectopic pregnancy [24], adnexal torsion [10], and pelvic inflammatory disease [36]. The present study shows that the assessment of medical history by standardized questionnaire may not only be useful for triage purposes, but may also be a significant component of the entire diagnostic process as it brings independent and important information to the medical staff in charge of the diagnosis of gynecological emergencies.

Vital signs, including the measurement of heart rate, blood pressure, and pain intensity using a NRS, were found to be predictors of G-PLEs. However, the independent contribution to the diagnosis was low relative to those brought by ultrasonography or medical history taking. Nonetheless, vital signs, including the shock index calculation, have already proven to be an important aide in detecting instability which frequently occurs in G-PLEs [4]. The shock index is an easily obtained calculation based on physiological variables that are measured in every patient and has been shown to correlate well with early acute hypovolemia [37]. Due to the design of the present study, the rate of instability was low. We nonetheless recommend systematically performing vital sign measurements on arrival to the ED.

In most developed countries, emergency ultrasound is performed at the request of ED physicians by radiologists or board-certified obstetricians/gynecologists [17, 38]. Patients in most developing countries do not have access to ultrasound in the G-ED [18]. In contrast, in the French model of gynecological emergency care, women with acute pelvic pain can have direct
evaluation by ultrasound in G-EDs, to which all women have free access. Obstetrics/gynecology residents perform the initial evaluation of patients seen in G-EDs, including bedside transvaginal ultrasonography. Our study suggests that ultrasound facilities should be available around the clock for female patients presenting with acute pelvic pain for better detection of G-PLEs. Indeed, the availability of transvaginal ultrasound at the initial assessment of gynecological emergencies decreases the time to patient care and treatment, and reduces unnecessary admissions.

Another issue is potential variability in the training level of the resident that may slightly skew data. However, this variability is low because Ob/Gyn residents training in France systematically receive basic sonographic training. This training allows all residents to perform standardized sonography dedicated specifically for gynecologic emergencies [19].

The training and skills of the practitioner who perform the ultrasonography (US) is an important consideration. The examination is likely to be more accurate when performed by a physician with board certification in gynecological ultrasound examination, on a dedicated machine, than when performed bedside in an emergency context by a non-certified examiner. Most of the US examinations in the present study were performed by non-certified gynecological residents with the use of an appropriate teaching model [19]. A study performed in a general academic ED, with an active US training program for residents, found bedside US to be potentially useful for the diagnosis and management of ectopic pregnancy [39]. It will be important in the future to evaluate teaching models and standardized methods for the implementation of bedside US examinations to improve the competence of non-specialized practitioners in the performance of emergency ultrasound examinations. It may be suitable to implement this teaching process in non-gynecological care models.

Another element is the self-assessment questionnaire that we have developed. It can be immediately given to patients presenting with acute pelvic pain on admission to general EDs by non-clinicians. Implementation of this diagnostic method could be generalized by scaling up, useful in crowded EDs. The self-administered questionnaire can be filled out manually, but with the advent of new technologies, alternative methods of completing it can be considered, such as a host terminal or touch pads. Collection of the SAQ-GE, associated with the collection of other data, would then be instantly processed by a computer and its results would predict patients who belong to a risk group for specific diseases. Combining this information with that obtained by bedside ultrasound examination provided by a non-certified examiner would be a realistic way to improve access of G-PLEs to specialized centers in developing countries. Efficient educational training tools are available for learning how to perform standardized bedside sonographic examinations as a first-line investigation procedure for gynecologic emergency departments [19]. We suggest that implementation of this training process would make it possible for these scans to be performed by anyone involved in gynecologic emergency management (i.e. ED physicians, family medicine physicians, midwives, and advanced nurse practitioners).

## Limitations

One limitation of our study is related to our definition of G-PLEs. From the medical and pathological point of view, the different conditions that encompass G-PLEs are different entities, but from the point of view of quality of care, they can be viewed as near-miss cases in the G-ED. The main objective of gynecological emergency care departments is to identify high risk patients whose conditions may rapidly deteriorate and pose a potential threat to their life or fertility [4]. Healthcare services must have efficient screening processes for these patients. Any deficiency in this respect may have a major impact by delaying therapeutic intervention. Our
definition of G-PLEs is consistent with the clinical reality of patients with gynecological emergencies at risk of severe complications due to diagnostic delays. For example, it was recently suggested that the association between severe maternal morbidity in ectopic pregnancies may be related to the quality of care [6]. From the perspective of quality of care and safety, G-PLEs can be viewed as near-miss cases, and can thus be informative about obstacles that had to be overcome after the onset of an acute complication.

Another limitation is that we included all patients who consulted in G-EDs for acute pelvic pain and were hospitalized. This recruitment strategy is likely to have resulted in a referral bias [40] as it is likely that a large proportion of the hospitalized patients had an abnormal ultrasound image or clinical examination. Patients with acute pelvic pain who were not hospitalized may have had G-PLEs but were misdiagnosed (i.e. no abnormal criteria were revealed by any examination). However, we believe the risk of missing a surgical emergency among patients who leave the G-ED is very low. Patients with undiagnosed G-PLEs would experience severe complications and severe, persistent pain, and would have eventually returned to our G-EDs which serve a vast geographic area.

A final limitation is that we analyzed a small number of patients (365). However, our study allowed us to define hypotheses that we will test in a larger cohort, URGO, composed of all women who consulted in G-EDs for acute pelvic pain in 21 French hospital centers in the period from March 9 to April 13, 2015.

## Conclusions

The use of a standardized self-assessment questionnaire and focal ultrasonography, including TVUS by non-specialized examiners, was sufficient for the diagnosis of PLEs in G-EDs. Our study does not support the traditional role of physical examination, including abdominal and vaginal digital examination, in the diagnostic procedure for acute gynecological emergency conditions. The diagnostic methods and resources used in emergency departments require further exploration. Further studies are needed to test the performance of this care model in various situations, in particular in the context of low medical ressources.

## Supporting Information

**S1 Table. Diagnostic tools: definition of signs according to the available literature.**
(DOCX)

**S1 File. PLEs data anonym.**
(XLS)

## Author Contributions

**Conceptualization:** AF.

**Formal analysis:** AF CV MR.

**Funding acquisition:** CV.

**Investigation:** AF PP.

**Methodology:** AF CV MR.

**Supervision:** AF.

**Visualization:** AF MR CV.
**Writing – original draft:** AF CV MR.

**Writing – review & editing:** AF CV MR CH PP CM.

## References

1. Kontoravdis A, Chryssikopoulos A, Hassiakos D, Liapis A, Zourlas PA. The diagnostic value of laparoscopy in 2365 patients with acute and chronic pelvic pain. International Journal of Gynaecology & Obstetrics. 1996; 52:243-8.

2. Abbott J, Emmans LS, Lowenstein SR. Ectopic pregnancy: ten common pitfalls in diagnosis. Am J Emerg Med. 1990; 8(6):515-22. PMID: 2222596

3. Walker JW. Abdominal and pelvic pain. Emergency Medicine Clinics of North America. 1987; 5:425-8. PMID: 3653019

4. Polena V, Huchon C, Ramos CV, Rouzier R, Dumont A, Fauconnier A. Non-Invasive Tools for the Diagnosis of Potentially Life-Threatening Gynaecological Emergencies: A Systematic Review. PloS one. 2015; 10(2):e0114189. doi: 10.1371/journal.pone.0114189 PMID: 25723401

5. Huchon C, Dumont A, Chantry A, Falissard B, Fauconnier A. Triage using a self-assessment questionnaire to detect potentially life-threatening emergencies in gynecology. World J Emerg Surg. 2014; 9:46. doi: 10.1186/1749-7922-9-46 PMID: 25180047

6. van Mello NM, Zietse CS, Mol F, Zwart JJ, van Roosmalen J, Bloemenkamp KW, et al. Severe maternal morbidity in ectopic pregnancy is not associated with maternal factors but may be associated with quality of care. Fertility and sterility. 2012; 97(3):623-9. doi: 10.1016/j.fertnstert.2011.12.021 PMID: 22264999

7. McWilliams GD, Hill MJ, Dietrich CS. Gynecologic emergencies. Surgical Clinics of North America. 2008; 88(2):265-83. doi: 10.1016/j.suc.2007.12.007 PMID: 18381113

8. Barnhart KT. Ectopic pregnancy. New England Journal of Medicine. 2009; 361(4):379-87. doi: 10.1056/NEJMcp0810384 PMID: 19625718

9. Huchon C, Panel P, Kayem G, Bassot A, Nguyen T, Falissard B, et al. Is a Standardized Questionnaire Useful for Tubal Rupture Screening in Patients With Ectopic Pregnancy? Acad Emerg Med. 2012.

10. Huchon C, Panel P, Kayem G, Schmitz T, Nguyen T, Fauconnier A. Does this woman have adnexal torsion? Hum Reprod. 2012; 27(8):2359-64. doi: 10.1093/humrep/des186 PMID: 22674200

11. Kahn JG, Walker CK, Washington E, Landers DV, Sweet RL. Diagnosing pelvic inflammatory disease. A comprehensive analysis and considerations for developing a new model. JAMA. 1991; 226 (18):2594-604.

12. Buckley RG, King KJ, Disney JD, Gorman JD, Klausen JH. History and physical examination to estimate the risk of ectopic pregnancy: validation of a clinical prediction model [see comments]. Ann Emerg Med. 1999; 34(5):589-94. PMID: 10533005

13. Dart RG, Kaplan B, Varaklis K. Predictive value of history and physical examination in patients with suspected ectopic pregnancy. Ann Emerg Med. 1999; 33(3):283-90. PMID: 10036342

14. Condous G, Okaro E, Khalid A, Lu C, Van Huffel S, Timmerman D, et al. The accuracy of transvaginal ultrasonography for the diagnosis of ectopic pregnancy prior to surgery. Hum Reprod. 2005; 20 (5):1404-9. PMID: 15695311

15. Moore C, Todd WM, O'Brien E, Lin H. Free fluid in Morison's pouch on bedside ultrasound predicts need for operative intervention in suspected ectopic pregnancy. Acad Emerg Med. 2007; 14(8):755-8. PMID: 17554008

16. Ankum WM, Van der Veen F, Hamerlynck JV, Lammes FB. Transvaginal sonography and human chorionic gonadotrophin measurements in suspected ectopic pregnancy: a detailed analysis of a diagnostic approach. Hum Reprod. 1993; 8(8):1307-11. PMID: 8408533

17. Haider Z, Condous G, Khalid A, Kirk E, Mukri F, Van Calster B, et al. Impact of the availability of sonography in the acute gynecology unit. Ultrasound Obstet Gynecol. 2006; 28(2):207-13. PMID: 16807944

18. Mignini L. Interventions for tubal ectopic pregnancy. RHL commentary (last revised: 26 September 2007). The Who reproductive Health Library: Geneva: Word health Organisation; 2007.

19. Popowski T, Huchon C, Fathallah K, Falissard B, Dumont A, Fauconnier A. Impact of accreditation training for residents on sonographic quality in gynecologic emergencies. Journal of ultrasound in medicine: official journal of the American Institute of Ultrasound in Medicine. 2015; 34(5):829-35.

20. Birkhahn RH, Gaeta TJ, Bei R, Bove JJ. Shock index in the first trimester of pregnancy and its relationship to ruptured ectopic pregnancy. Acad Emerg Med. 2002; 9(2):115-9. PMID: 11825835
21. Popowski T, Huchon C, Toret-Labeeuw F, Chantry AA, Aegerter P, Fauconnier A. Hemoperitoneum assessment in ectopic pregnancy. International Journal of Gynecology & Obstetrics. 2012; 116(2):97-100.

22. Fauconnier A, Mabrouk A, Salomon LJ, Bernard JP, Ville Y. Ultrasound assessment of haemoperitoneum in ectopic pregnancy: derivation of a prediction model. World J Emerg Surg. 2007; 2:23. PMID: 17825105

23. Eschenbach DA, Wölner-Hanssen P, Hawes SE, Pavletic A, Paavonen J, Holmes KK. Acute pelvic inflammatory disease: associations of clinical and laboratory findings with laparoscopic findings. Obstetrics & Gynecology. 1997; 89(2):184-92.

24. Huchon C, Staraci S, Fauconnier A. Adnexal torsion: a predictive score for pre-operative diagnosis. Hum Reprod. 2010; 25(9):2276-80. doi: 10.1093/humrep/deq173 PMID: 20605899

25. Mol BW, Hajenius PJ, Engelsbel S, Ankum WM, van der Veen F, Hemrika DJ, et al. Can noninvasive diagnostic tools predict tubal rupture or active bleeding in patients with tubal pregnancy? Fertility and sterility. 1999; 71(1):167-73. PMID: 9935137

26. Workowski KA, Berman S. Sexually transmitted diseases treatment guidelines, 2010. 2010.

27. Harrell FE Jr., Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996; 15(4):361-8 PMID: 8668867

28. Cohen J, Cohen P, West S, Aiken L. Applied multiple regression/correlation analysis for the behavioral sciences. Lawrence Erlbaum. Mahwah, NJ. 2003.

29. Razzak JA, Kellermann AL. Emergency medical care in developing countries: is it worthwhile? Bulletin of the World Health Organization. 2002; 80(11):900-5. PMID: 12481213

30. Buckley RG, King KJ, Disney JD, Ambroz PK, Gorman JD, Klausen JH. Derivation of a clinical prediction model for the emergency department diagnosis of ectopic pregnancy. Acad Emerg Med. 1998; 5 (10):951-60. PMID: 9862584

31. Adhikari S, Marx J. Point-of-care ultrasound diagnosis of a ruptured live ectopic pregnancy with massive hemoperitoneum. J Emerg Med. 2013; 44(1):194-6. doi: 10.1016/j.jemermed.2012.05.008 PMID: 22818647

32. Sackett DL. A primer on the precision and accuracy of the clinical examination. Jama. 1992; 267 (19):2638-44. PMID: 1573753

33. Hirata AJ, Soper DE, Bump RC, Hurt WG. Ectopic pregnancy in an urban teaching hospital: can tubal rupture be predicted? South Med J. 1991; 84(12):1467-9. PMID: 1749980

34. Stovall TG, Kellerman AL, Ling FW, Buster JE. Emergency department diagnosis of ectopic pregnancy. Ann Emerg Med. 1990; 19(10):1098-103. PMID: 2221515

35. Eskelinen M, Ikonen J, Lipponen P. Usefulness of history-taking, physical examination and diagnostic scoring in acute renal colic. Eur Urol. 1998; 34(6):467-73. PMID: 9831787

36. Bouquier J, Huchon C, Panel P, Fauconnier A. A self-assessed questionnaire can help in the diagnosis of pelvic inflammatory disease. Sexually transmitted diseases. 2014; 41(9):525-31. doi: 10.1097/OLQ. 0000000000000169 PMID: 25118964

37. Birkhahn RH, Gaeta TJ, Terry D, Bove JJ, Tloczkowski J. Shock index in diagnosing early acute hypovolemia. The American journal of emergency medicine. 2005; 23(3):323-6. PMID: 15915406

38. Bignardi T, Burnet S, Alhamdan D, Lu C, Pardey J, Benzie R, et al. Management of women referred to an acute gynecology unit: impact of an ultrasound-based model of care. Ultrasound Obstet Gynecol. 2010; 35(3):344-8. doi: 10.1002/uog.7523 PMID: 20069669

39. Adhikari S, Blaivas M, Lyon M. Diagnosis and management of ectopic pregnancy using bedside transvaginal ultrasonography in the ED: a 2-year experience. Am J Emerg Med. 2007; 25(6):591-6. PMID: 17606080

40. Miller TD, Hodge DO, Christian TF, Milavetz JJ, Bailey KR, Gibbons RJ. Effects of adjustment for referral bias on the sensitivity and specificity of single photon emission computed tomography for the diagnosis of coronary artery disease. Am J Med. 2002; 112(4):290-7. PMID: 11893368