# Using a new diagnostic tool to predict lymph node metastasis in advanced epithelial ovarian cancer leads to simple lymphadenectomy decision rules: A multicentre study from the francogyn group

Camille Mimoun, Xavier Paoletti, Thomas Gaillard, Adrien Crestani, Jean Louis B. Benifla, Matthieu Mezzadri, Sofiane Bendifallah, Cyril Touboul, Alexandre Bricou, Yohann Dabi, et al.

► To cite this version:

Camille Mimoun, Xavier Paoletti, Thomas Gaillard, Adrien Crestani, Jean Louis B. Benifla, et al. Using a new diagnostic tool to predict lymph node metastasis in advanced epithelial ovarian cancer leads to simple lymphadenectomy decision rules: A multicentre study from the francogyn group. PLoS ONE, 2021, 16 (10), pp.e0258783. 10.1371/journal.pone.0258783. hal-03434960

HAL Id: hal-03434960

https://hal.science/hal-03434960

Submitted on 29 Nov 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
RESEARCH ARTICLE

# Using a new diagnostic tool to predict lymph node metastasis in advanced epithelial ovarian cancer leads to simple lymphadenectomy decision rules: A multicentre study from the FRANCOGYN group

Camille Mimoun<sup>1,2,3*</sup>, Xavier Paoletti<sup>4</sup>, Thomas Gaillard<sup>3</sup>, Adrien Crestani<sup>1</sup>, Jean-Louis Benifla<sup>1</sup>, Matthieu Mezzadri<sup>1</sup>, Sofiane Bendifallah<sup>5</sup>, Cyril Touboul<sup>5</sup>, Alexandre Bricou<sup>6</sup>, Yohann Dabi<sup>7</sup>, Geoffroy Canlorbe<sup>8</sup>, Yohan Kerbage<sup>9</sup>, Vincent Lavoué<sup>10</sup>, Lobna Ouldamer<sup>11</sup>, Lise Lecointre<sup>12</sup>, Charles Coutant<sup>13</sup>, Arnaud Fauconnier<sup>14</sup>, Roman Rouzier<sup>3,4</sup>, Cyrille Huchon<sup>1,2</sup>

1. Department of Gynecology and Obstetrics, Lariboisière University Hospital, AP-HP, Paris, France,

2. Research Unit EA 7285 "Risk and Safety in Clinical Medicine for Women and Perinatal Health", UVSQ,

Montigny-Le-Bretonneux, France, 3. Department of Surgical Oncology, Curie Institute, Saint-Cloud, France,

4. INSERM U900 STAMPM Team, Saint Cloud, France, 5. Department of Gynecology and Obstetrics, Tenon University Hospital, AP-HP, Paris, France, 6. Department of Obstetrics, Gynecology and Reproductive Medicine, CH Jean Verdier, AP-HP, Bondy, France, 7. Department of Gynecology and Obstetrics, CHIC, Créteil, France, 8. Department of Gynecological and Breast Surgery and Oncology, Pitié-Salpêtrière University Hospital, AP-HP, Paris, France, 9. Department of Gynecologic Surgery, Jeanne de Flandre Hospital, CHU of Lille, Loos, France, 10. Department of Gynecology, CHU de Rennes, Rennes, France,

11. Department of Obstetrics and Gynecology, Bretonneau Hospital, CHU of Tours, Tours, France,

12. Department of Obstetrics and Gynecology, University Hospital Center, Strasbourg, France,

13. Department of Surgical Oncology, Georges-François Leclerc Cancer Center, Dijon, France,

14. Department of Obstetrics and Gynecology, Poissy-St Germain Hospital, Poissy, France

* mimouncamille@gmail.com

<figure><img src="image_2.png" /></figure>

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Mimoun C, Paoletti X, Gaillard T, Crestani A, Benifla J-L, Mezzadri M, et al. (2021) Using a new diagnostic tool to predict lymph node metastasis in advanced epithelial ovarian cancer leads to simple lymphadenectomy decision rules: A multicentre study from the FRANCOGYN group. PLoS ONE 16(10): e0258783. https://doi.org/10.1371/journal.pone.0258783

**Editor:** Paolo Aurello, Università Sapienza di Roma, ITALY

**Received:** March 26, 2021

**Accepted:** October 5, 2021

**Published:** October 19, 2021

**Copyright:** © 2021 Mimoun et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** All relevant data are within the paper and its Supporting Information files.

**Funding:** The author(s) received no specific funding for this work.

**Competing interests:** The authors have declared that no competing interests exist.

## Abstract

### Objective

The aim of this study was to develop a new diagnostic tool to predict lymph node metastasis (LNM) in patients with advanced epithelial ovarian cancer undergoing primary cytoreductive surgery.

### Materials and method

The FRANCOGYN group's multicenter retrospective ovarian cancer cohort furnished the patient population on which we developed a logistic regression model. The prediction model equation enabled us to create LNM risk groups with simple lymphadenectomy decision rules associated with a user-friendly free interactive web application called shinyLNM.

### Results

277 patients from the FRANCOGYN cohort were included; 115 with no LNM and 162 with LNM. Three variables were independently and significantly (p<0.05) associated with LNM in multivariate analysis: pelvic and/or para-aortic LNM on CT and/or PET/CT (p<0.00), initial
PCI ≥ 10 and/or diaphragmatic carcinosis (p = 0.02), and initial CA125 ≥ 500 (p = 0.02).

The ROC-AUC of this prediction model after leave-one-out cross-validation was 0.72. There was no difference between the predicted and the observed probabilities of LNM (p = 0.09).

Specificity for the group at high risk of LNM was 83.5%, the LR+ was 2.73, and the observed probability of LNM was 79.3%; sensitivity for the group at low-risk of LNM was 92.0%, the LR- was 0.24, and the observed probability of LNM was 25.0%.

## Conclusion

This new tool may prove useful for improving surgical planning and provide useful information for patients.

## Introduction

Ovarian cancer is the second most common gynecological cancer in the United States with an expected estimated 21 750 new cases and 13 940 deaths in 2020 [1]. The backbone treatment for advanced epithelial ovarian cancer (AEOC) associates complete cytoreductive surgery with platinum- and taxane-based chemotherapy [2-4].

The conception of AEOC surgery has changed recently, in particular for the controversial question of pelvic and para-aortic lymphadenectomy [5-9]. The LION trial was the first prospective randomized trial to compare systematic lymphadenectomy with no lymphadenectomy during macroscopically complete primary resection of patients with “no suspect lymph node”. Lymphadenectomy was not associated with longer overall or progression-free survival than the no-lymphadenectomy, but it was associated with relatively high morbidity and mortality [6].

Today, therefore, the challenge is to triage patients appropriately, to distinguish those with “no suspect lymph node” who should not have a lymphadenectomy from those with “suspect lymph nodes” who should have lymphadenectomy. Two effective diagnostic tools currently exist: preoperative imagery and intraoperative clinical evaluation, which have respectively a specificity of 85% and 83.6% and a sensitivity of 79% and 62.5%, for the prediction of lymph node metastasis (LNM) in AEOC [10-12]. No other diagnostic tool exists nowadays to predict LNM in AEOC.

The aim of this study was to develop a new diagnostic tool to predict pelvic and/or para-aortic LNM and risk groups leading to simple lymphadenectomy decision rules in patients with AEOC undergoing primary cytoreductive surgery.

## Materials and method

### Study design and population

The study population was extracted from the ovarian cancer database of the FRANCOGYN study group, a retrospective multicentric cohort from 11 referral centers in France (Tenon, Jean Verdier, Créteil, Poissy, La Pitié Salpêtrière, Lariboisière, Lille, Rennes, Tours, Strasbourg and Dijon) including all patients managed for ovarian cancer from January 2000 through December 2017.

This study reviewed records of all consecutive patients who underwent surgery and had histologically confirmed AEOC of stages IIB to IV according to the FIGO classification, but included only those considered suitable for primary complete resection of their disease on
initial assessment and who underwent pelvic and/or paraaortic lymphadenectomy with the removal of 10 or more lymph nodes.

The Ethics Committee for Research in Obstetrics and Gynecology approved the research protocol (CEROG 2019-GYN-605). All the data were fully anonymized. As per French law, the requirement for informed consent was waived for this type of study that used only de-identified data gained from clinical practice.

## Gold standard

Histology was the gold standard used to diagnose pelvic and/or paraaortic LNM. The total number of lymph nodes removed, the number of positive lymph nodes and the number of negative lymph nodes was notified. Specialized pathologists reviewed all removed lymph nodes.

## Surgical procedure

No patients received chemotherapy before surgery. Surgery included at least hysterectomy, bilateral salpingo-oophorectomy, omentectomy, pelvic and/or para-aortic lymphadenectomy and removal of any other intraperitoneal metastasis. Surgical staging followed the FIGO staging system. Disease extent at the start of each surgical procedure was quantified with the peri-toneal cancer index (PCI), as described by Sugarbaker [13]. The surgery was classified as complete resection (CC0) when all visible tumor was removed (no macroscopic residual tumor) at the end of the intervention, CC1 when it was ≤ 2.5 mm and CC2 when it was more than 2.5 mm but less than 2.5 cm. Gynecologic oncology specialists performed all cytoreductive surgeries.

## Data collection

The following clinical and paraclinical items were collected: age at diagnosis, body mass index (BMI), personal or family history of gynecological cancers, presence or absence of identified genetic mutations, the American society of anesthesiologists (ASA) score [14], preoperative CA125, preoperative radiological characteristics (computed tomography (CT) and positron tomography emission/ computed tomography (PET/CT)). The tumor histology was detailed: histological type and tumor grade.

## Statistical analysis

We compared patients with no LNM to patients with LNM. We carried out univariate analysis using a quantitative (Student's t-test) or a qualitative (Chi² test) test as appropriate. Some quantitative variables were dichotomized to maximize the accuracy value. The accuracy of each variable for the prediction of LNM was assessed on the basis of sensitivity, specificity, positive likelihood ratio (LR+) and negative likelihood ratio (LR-) and diagnostic odds ratio (DOR). Variables associated with LNM in the univariate analysis at a threshold of p<0.20 were selected for the multivariate analysis.

The multiple logistic regression analysis, performed with a backward procedure, was used to estimate the most predictive combination of variables that was independently associated with LNM (p<0.05). Adjusted DORs (aDOR) were calculated. Missing data were treated as a distinct category.

The predictive accuracy of the model was assessed in terms of its discrimination and calibration. Discrimination is the ability to differentiate patients with no LNM from patients with LNM. It was studied using the receiver operating characteristic (ROC) curve and summarized
by the area under the curve (AUC) [15]. Calibration is the agreement between the observed outcome frequencies and the predicted probabilities. It was studied using graphical representation of the relationship between these two results (calibration curve). We also evaluated the average and maximal errors between the prediction and observation, obtained from the calibration curve.

Internal validation of the prediction model used leave-one-out cross-validation to correct for overoptimism in the predictive performance of the model [16]. This method consists of splitting the data set randomly into n partitions. For each of the n-th iterations, n - 1 partitions served as the training set and the left-out sample as the test set [17].

We created risk groups of pelvic and/or para-aortic LNM by choosing threshold values of the prediction model equation that maximised classification rates [18]. From this, we proposed simple lymphadenectomy decision rules associated with a user-friendly free interactive web app, called shinyLNM, that determines the risk group and their predicted probability of LNM for individual patients.

Differences were considered significant at a level of p<0.05. Statistical analyses were performed using STATA 13.0 (Stata Corp.; College Station, TX, USA). The shinyLNM app was programmed with the package Shiny from R Studio.

## Results

### Characteristics of study population

Fig 1 presents the flow chart of the study population: 277 patients from the FRANCOGYN cohort, 115 with no LNM and 162 with LNM. This population's characteristics are presented in Table 1. These two groups did not differ statistically except for FIGO stage (p<0.001), initial CA125 (p<0.001), initial PCI (p<0.001), bowel resection (p<0.001), and duration of surgery (p = 0.01).

### Prediction model and risk groups

The findings from the univariate analysis are presented in Table 2.

The multiple logistic regression analysis identified three variables independently and significantly (p<0.05) associated with pelvic and/or para-aortic LNM: pelvic and/or para-aortic LNM on CT and/or PET/CT (aDOR = 5.02 95%CI [2.42–10.44], p<0.001), initial PCI ≥ 10 and/or diaphragmatic carcinosis (aDOR = 2.34 95%CI [1.13–4.83], p = 0.02), and initial CA125 ≥ 500 (aDOR = 2.03 95%CI [1.14–3.61], p = 0.02) (Table 3).

The ROC-AUC of this prediction model after leave-one-out cross-validation was 0.72 (Fig 2). The predicted and the observed probabilities of LNM, shown in the calibration curve in Fig 3, did not differ significantly (p = 0.09).

We created risk groups of pelvic and/or para-aortic LNM based on the prediction model equation, using the following coding variables.

* LNM: pelvic and/or para-aortic LNM on CT and/or PET/CT, no = 0, yes = 1

* PCI: initial PCI ≥ 10 and/or diaphragmatic carcinosis, no = 0, yes = 1

* CA125: initial CA125 ≥ 500, no = 0, yes = 1

$$Pr = \frac{1}{1 + e^{(-0.51 - 1.61 \times \text{LNM} - 0.85 \times \text{PCI} - 0.71 \times \text{CA125})}}$$
<figure><img src="image_4.png" /><figcaption>**Fig 1. Flow chart.** PL: pelvic lymphadenectomy; PAL: para-aortic lymphadenectomy; LNM: lymph node metastasis.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0258783.g001

i. the low-risk group was defined for a probability < 0.377, its sensibility for the prediction of LNM was 92.0% and its LR- was 0.24; in the low-risk group, the observed probability of LNM was 25.0%;

ii. the high-risk group was defined for a probability ≥ 0.740, its specificity for the prediction of LNM was 83.5% and its LR+ was 2.73; in the high-risk group the observed probability of LNM was 79.3%.

## Clinical utility

Simple lymphadenectomy decision rules were proposed on the basis of these risk groups: patients in the low-risk group should not have lymphadenectomy whereas patients in the high-risk group should. Those rules are illustrated in a decision tree (Fig 4) and can also be easily used with our shinyLNM web app available at https://thomas-gaillard.shinyapps.io/Mimoun_node/. Fig 5 presents a sample screenshot.

## Discussion

We have constructed the first prediction model of pelvic and para-aortic LNM in patients with AEOC undergoing primary cytoreductive surgery. This study included 277 patients from the FRANCOGYN cohort: 115 with no LNM and 162 with LNM. The model was based on three
<table><caption>Table 1. Clinical, tumor, biological and surgical characteristics of the population.</caption><thead><tr><th>Variables</th><th>All Population<br>N = 277<br>mean +/- SD<br>or n (%)<sup>a</sup></th><th>LNM -<br>n = 115<br>mean +/- SD<br>or n (%)<sup>a</sup></th><th>LNM +<br>n = 162<br>mean +/- SD<br>or n (%)<sup>a</sup></th></tr></thead><tbody><tr><td colspan="4"><strong>CLINICAL CHARACTERISTICS</strong></td></tr><tr><td>Age (years)</td><td>57.4 +/- 11.3</td><td>58.04 +/- 10.9</td><td>56.9 +/- 11.6</td></tr><tr><td>BMI (kg/m<sup>-2</sup>)</td><td>24.5 +/- 5.8</td><td>23.8 +/- 4.3</td><td>25.0 +/- 5.8</td></tr><tr><td>Gravidity</td><td>1.9 +/- 1.4</td><td>2.1 +/- 1.5</td><td>1.8 +/- 1.4</td></tr><tr><td>Parity</td><td>1.7 +/- 1.4</td><td>1.8 +/- 1.4</td><td>1.7 +/- 1.4</td></tr><tr><td><strong>Menopause</strong></td><td></td><td></td><td></td></tr><tr><td>• No</td><td>64 (24.9)</td><td>29 (26.6)</td><td>35 (23.7)</td></tr><tr><td>• Yes</td><td>193 (75.1)</td><td>80 (73.4)</td><td>113 (76.3)</td></tr><tr><td><strong>Mutation</strong></td><td></td><td></td><td></td></tr><tr><td>• No mutation</td><td>39 (45.2)</td><td>20 (64.5)</td><td>19 (46.3)</td></tr><tr><td>• BRCA1</td><td>22 (30.6)</td><td>7 (22.6)</td><td>15 (36.6)</td></tr><tr><td>• BRCA2</td><td>9 (12.5)</td><td>4 (12.9)</td><td>5 (12.2)</td></tr><tr><td>• Others</td><td>2 (2.8)</td><td>0 (0.0)</td><td>2 (4.9)</td></tr><tr><td><strong>ASA score</strong></td><td></td><td></td><td></td></tr><tr><td>• 0</td><td>2 (1.0)</td><td>0 (0.0)</td><td>2 (1.8)</td></tr><tr><td>• 1</td><td>121 (63.0)</td><td>53 (66.3)</td><td>68 (60.7)</td></tr><tr><td>• 2</td><td>54 (28.1)</td><td>22 (27.5)</td><td>32 (28.6)</td></tr><tr><td>• 3</td><td>15 (7.8)</td><td>5 (6.3)</td><td>10 (3.9)</td></tr><tr><td><strong>Previous surgery</strong></td><td></td><td></td><td></td></tr><tr><td>• No</td><td>41 (35.3)</td><td>19 (40.4)</td><td>22 (31.9)</td></tr><tr><td>• Yes</td><td>75 (64.7)</td><td>28 (59.6)</td><td>47 (68.1)</td></tr><tr><td colspan="4"><strong>TUMOR CHARACTERISTICS</strong></td></tr><tr><td><strong>FIGO stage</strong></td><td></td><td></td><td></td></tr><tr><td>• 2B-2C</td><td>21 (7.6)</td><td>20 (17.4)</td><td>1 (0.6)</td></tr><tr><td>• 3A-3B-3C</td><td>228 (82.3)</td><td>81 (70.4)</td><td>147 (90.7)</td></tr><tr><td>• 4A-4B</td><td>28 (10.1)</td><td>14 (12.2)</td><td>14 (8.6)</td></tr><tr><td><strong>Tumor histological type</strong></td><td></td><td></td><td></td></tr><tr><td>• Serous</td><td>214 (77.3)</td><td>86 (74.8)</td><td>128 (79.0)</td></tr><tr><td>• Endometrioid</td><td>37 (13.4)</td><td>18 (15.7)</td><td>19 (11.7)</td></tr><tr><td>• Mucinous</td><td>7 (2.5)</td><td>4 (3.5)</td><td>3 (1.9)</td></tr><tr><td>• Clear-cell carcinoma</td><td>15 (5.4)</td><td>4 (3.5)</td><td>11 (6.8)</td></tr><tr><td>• Transitional-cell carcinoma</td><td>4 (1.4)</td><td>3 (2.6)</td><td>1 (0.6)</td></tr><tr><td colspan="4"><strong>BIOLOGICAL CHARACTERISTICS</strong></td></tr><tr><td>Initial CA125 level (IU/L)</td><td>957.6 +/- 1677.3</td><td>597.9 +/- 926.5</td><td>1178.5 +/- 1974.6</td></tr><tr><td colspan="4"><strong>SURGICAL CHARACTERISTICS</strong></td></tr><tr><td>Initial PCI score</td><td>7.9 +/- 9.4</td><td>4.1 +/- 5.2</td><td>10.6 +/- 10.7</td></tr><tr><td><strong>Residual disease after surgery</strong></td><td></td><td></td><td></td></tr><tr><td>• No visible tumor, complete cytoreduction</td><td>252 (92.3)</td><td>106 (93.8)</td><td>146 (91.8)</td></tr><tr><td>• Tumor nodules ≤ 2.5 cm</td><td>12 (4.4)</td><td>3 (2.7)</td><td>9 (5.7)</td></tr><tr><td>• Tumor nodules > 2.5 cm</td><td>8 (2.9)</td><td>4 (3.5)</td><td>4 (2.5)</td></tr><tr><td><strong>Bowel resection</strong></td><td></td><td></td><td></td></tr><tr><td>• No</td><td>159 (57.4)</td><td>83 (72.2)</td><td>76 (46.9)</td></tr><tr><td>• Yes, without ileostomy or colostomy</td><td>96 (34.7)</td><td>27 (23.5)</td><td>69 (42.6)</td></tr><tr><td>• Yes, with ileostomy or colostomy</td><td>22 (7.9)</td><td>5 (4.4)</td><td>17 (10.5)</td></tr></tbody></table>

(Continued)
<table><caption>**Table 1.** (Continued)</caption><thead><tr><th>Variables</th><th>All Population<br>N = 277<br>mean +/- SD<br>or n (%)<sup>a</sup></th><th>LNM -<br>n = 115<br>mean +/- SD<br>or n (%)<sup>a</sup></th><th>LNM +<br>n = 162<br>mean +/- SD<br>or n (%)<sup>a</sup></th></tr></thead><tbody><tr><td>Estimated blood loss (ml)</td><td>931.3 +/- 783.4</td><td>842.4 +/- 803.1</td><td>994.1 +/- 772.9</td></tr><tr><td><strong>Transfusion</strong></td><td></td><td></td><td></td></tr><tr><td>• No</td><td>37 (41.6)</td><td>20 (50.0)</td><td>17 (34.7)</td></tr><tr><td>• Yes</td><td>52 (58.4)</td><td>20 (50.0)</td><td>32 (65.3)</td></tr><tr><td>Duration of surgery (minutes)</td><td>381.5 +/- 145.2</td><td>331.6 +/- 102.6</td><td>414.5 +/- 160.1</td></tr></tbody></table>

pre-operative and intraoperative criteria: pelvic and/or para-aortic LNM on CT and/or PET/CT (aDOR = 5.02 95% CI [2.42–10.44], (p<0.00)), initial PCI ≥ 10 and/or diaphragmatic carcinosis (aDOR = 2.34 95% CI [1.13–4.83], p = 0.02), and initial CA125 ≥ 500 (aDOR = 2.03 95% CI [1.14–3.61], p = 0.02). There was no difference between the predicted and the observed probabilities of LNM (p = 0.09). Specificity for the group at high risk of LNM was 83.5%, the LR+ was 2.73, and the observed probability of LNM was 79.3%; sensitivity for the group at low-risk of LNM was 92.0%, the LR- was 0.24, and the observed probability of LNM was 25.0%.

Our study has several strengths. First, because the gold standard for the diagnosis of LNM was histology, misclassification bias was excluded. Moreover, we included only patients with at least 10 lymph nodes removed [9]. Specifically, we excluded patients with sampling of bulky nodes and selected only those with the lymphadenectomy dissection recommended for the cytoreductive surgery of every patient with AEOC before the publication of the LION trial in 2019. We then conducted an internal validation of the prediction model with the leave-one-out cross-validation procedure to correct for overoptimism [16]. Finally, two criteria of our prediction model have been described previously in the literature. In particular, an initial CA125 ≥ 500 has been associated with a higher rate of incomplete cytoreductive surgery [4] and an initial PCI < 10 corresponds to a complete cytoreductive surgery rate of 94% vs only 62% for an initial PCI ≥ 10 [19].

Two principal limitations of our study must be mentioned. The first is that we used a retrospective cohort to construct our prediction model, and collection bias may have occurred. Nonetheless, although this cohort is retrospective, it is also multicenter, with patients included from 11 French expert hospitals (FRANCOGYN group). This provided a large sample (277 patients) with good statistical power and tends to guarantee that our population is representative and that our results can be extrapolated. The second limitation is that there was no external validation with an independent sample but a second study with such a sample is planned for the very near future. Nonetheless, the internal validation may have enhanced the generalizability of the prediction model.

The publication of the LION trial in 2019 had a major impact on the surgical management of patients with AEOC who undergo primary cytoreductive surgery [6]. It is now clear that only patients with “suspect lymph nodes” at lymph node evaluation, preoperative imagery, or

<footnote>* Student's test.</footnote>

<footnote>** Chi2's test.</footnote>

<footnote>a: percentages are calculated on the total number of patients despite some missing values.</footnote>

<footnote>LNM: Lymph Node Metastasis; SD: Standard Derivation; BMI: Body Mass Index; BRCA: BR breast CAncer; ASA: American Society of Anaesthesiologists; FIGO: Fédération Internationale de Gynécologie-Obstétrique; CA: Carcinome Antigen; PCI: Peritoneal Carcinomatosis Index.</footnote>
<table><caption>Table 2. Univariate analysis for predicting lymph node metastasis.</caption><thead><tr><th>Variables</th><th>Total, n/N</th><th>LNM +, n/N</th><th>LNM -, n/N</th><th>Se (%)</th><th>Sp (%)</th><th>LR+</th><th>LR-</th><th>DOR 95% CI</th><th>p*</th></tr></thead><tbody><tr><td colspan="10" style="text-align: center; font-weight: bold;">CLINICAL CHARACTERISTICS</td></tr><tr><td>Age ≥ 50 years</td><td>211/277</td><td>120/277</td><td>91/277</td><td>74.1</td><td>20.9</td><td>0.94</td><td>1.24</td><td>0.75 0.42-1.34</td><td>0.33</td></tr><tr><td>Menopause</td><td>193/257</td><td>113/257</td><td>80/257</td><td>76.4</td><td>26.6</td><td>1.04</td><td>0.89</td><td>1.17 0.66-2.07</td><td>0.59</td></tr><tr><td>BRCA mutation</td><td>33/72</td><td>22/72</td><td>11/72</td><td>53.7</td><td>64.5</td><td>1.51</td><td>0.72</td><td>2.11 0.79-5.62</td><td><strong>0.13</strong></td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">TUMOR CHARACTERISTICS</td></tr><tr><td>Serous histological type</td><td>214/277</td><td>128/277</td><td>86/277</td><td>79.0</td><td>25.2</td><td>1.06</td><td>0.83</td><td>1.27 0.72-2.24</td><td>0.41</td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">RADIOLOGICAL CHARACTERISTICS: CT</td></tr><tr><td>Involvement of 1 ovary</td><td>120/186</td><td>68/186</td><td>52/186</td><td>61.3</td><td>30.7</td><td>0.88</td><td>1.26</td><td>0.70 0.37-1.31</td><td>0.26</td></tr><tr><td>Involvement of 2 ovaries</td><td>62/133</td><td>42/133</td><td>20/133</td><td>50.6</td><td>60.0</td><td>1.27</td><td>0.82</td><td>1.54 0.75-3.15</td><td>0.24</td></tr><tr><td>Involvement of 1 and/or 2 ovary(ies)</td><td>182/190</td><td>110/190</td><td>72/190</td><td>97.3</td><td>6.5</td><td>1.04</td><td>0.41</td><td>2.55 0.58-11.10</td><td><strong>0.20</strong></td></tr><tr><td>Diaphragmatic carcinosis</td><td>20/172</td><td>12/172</td><td>8/172</td><td>12.0</td><td>88.9</td><td>1.08</td><td>0.99</td><td>1.09 0.42-2.83</td><td>0.85</td></tr><tr><td>Omentum carcinosis</td><td>42/173</td><td>26/173</td><td>16/173</td><td>25.5</td><td>77.5</td><td>1.13</td><td>0.96</td><td>1.18 0.57-2.40</td><td>0.66</td></tr><tr><td>Small intestine involvement</td><td>4/142</td><td>4/142</td><td>0/142</td><td>4.7</td><td>100.0</td><td>-</td><td>0.95</td><td>-</td><td><strong>0.10</strong></td></tr><tr><td>Colon involvement</td><td>26/173</td><td>19/173</td><td>7/173</td><td>18.4</td><td>90.0</td><td>1.84</td><td>0.91</td><td>2.04 0.80-5.19</td><td><strong>0.13</strong></td></tr><tr><td>Bowel involvement</td><td>26/177</td><td>19/177</td><td>7/177</td><td>18.1</td><td>90.3</td><td>1.86</td><td>0.91</td><td>2.05 0.81-5.22</td><td><strong>0.12</strong></td></tr><tr><td>Liver metastasis</td><td>7/171</td><td>3/171</td><td>4/171</td><td>3.0</td><td>94.4</td><td>0.53</td><td>1.03</td><td>0.52 0.11-2.41</td><td>0.39</td></tr><tr><td>Ascites</td><td>85/158</td><td>51/158</td><td>34/158</td><td>52.6</td><td>44.3</td><td>0.94</td><td>1.07</td><td>0.88 0.46-1.68</td><td>0.70</td></tr><tr><td>Pelvic LNM</td><td>51/175</td><td>39/175</td><td>12/175</td><td>37.1</td><td>82.9</td><td>2.17</td><td>0.76</td><td>2.86 1.34-6.09</td><td><strong>0.01</strong></td></tr><tr><td>Para-aortic LNM</td><td>41/141</td><td>31/141</td><td>10/141</td><td>35.6</td><td>81.5</td><td>1.92</td><td>0.79</td><td>2.44 1.06-5.60</td><td><strong>0.03</strong></td></tr><tr><td>Pelvis and/or Para-aortic LNM</td><td>61/175</td><td>48/175</td><td>13/175</td><td>45.7</td><td>81.4</td><td>2.46</td><td>0.67</td><td>3.69 1.75-7.79</td><td><strong>0.00</strong></td></tr><tr><td>Supra-diaphragmatic LNM</td><td>11/126</td><td>8/126</td><td>3/126</td><td>9.9</td><td>93.3</td><td>1.48</td><td>0.97</td><td>1.53 0.38-6.15</td><td>0.54</td></tr><tr><td>Pleural effusion</td><td>14/178</td><td>9/178</td><td>5/178</td><td>8.4</td><td>93.0</td><td>1.19</td><td>0.99</td><td>1.21 0.39-3.79</td><td>0.74</td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">RADIOLOGICAL CHARACTERISTICS: PET/CT</td></tr><tr><td>Involvement of 1 ovary</td><td>21/30</td><td>12/30</td><td>9/30</td><td>66.7</td><td>25.0</td><td>0.89</td><td>1.33</td><td>0.67 0.13-3.53</td><td>0.63</td></tr><tr><td>Involvement of 2 ovary</td><td>9/30</td><td>7/30</td><td>2/30</td><td>38.9</td><td>83.3</td><td>2.33</td><td>0.73</td><td>3.18 0.49-20.72</td><td><strong>0.20</strong></td></tr><tr><td>Involvement of 1 and/or 2 ovary(ies)</td><td>26/30</td><td>16/30</td><td>10/30</td><td>88.9</td><td>16.7</td><td>1.07</td><td>0.67</td><td>1.60 0.19-13.82</td><td>0.67</td></tr><tr><td>Diaphragmatic carcinosis</td><td>4/31</td><td>3/31</td><td>1/31</td><td>15.8</td><td>91.7</td><td>1.89</td><td>0.92</td><td>2.06 0.18-23.75</td><td>0.55</td></tr><tr><td>Omentum carcinosis</td><td>4/32</td><td>4/32</td><td>0/32</td><td>20.0</td><td>100.0</td><td>-</td><td>0.80</td><td>-</td><td><strong>0.10</strong></td></tr><tr><td>Small intestine involvement</td><td>1/32</td><td>0/32</td><td>1/32</td><td>0.0</td><td>91.7</td><td>0.00</td><td>1.09</td><td>-</td><td><strong>0.20</strong></td></tr><tr><td>Colon involvement</td><td>5/32</td><td>3/32</td><td>2/32</td><td>15.0</td><td>83.3</td><td>0.90</td><td>1.02</td><td>0.88 0.12-6.42</td><td>0.90</td></tr><tr><td>Bowel involvement</td><td>6/32</td><td>3/32</td><td>3/32</td><td>15.0</td><td>75.0</td><td>0.60</td><td>1.13</td><td>0.53 0.08-3.32</td><td>0.49</td></tr><tr><td>Liver metastasis</td><td>1/32</td><td>1/32</td><td>0/32</td><td>5.0</td><td>100.0</td><td>-</td><td>0.95</td><td>-</td><td>0.44</td></tr><tr><td>Ascites</td><td>2/32</td><td>1/32</td><td>1/32</td><td>5.0</td><td>91.7</td><td>0.60</td><td>1.04</td><td>0.58 0.03-10.76</td><td>0.71</td></tr><tr><td>Pelvic LNM</td><td>8/32</td><td>8/32</td><td>0/32</td><td>40.0</td><td>100.0</td><td>-</td><td>0.60</td><td>-</td><td><strong>0.01</strong></td></tr><tr><td>Para-aortic LNM</td><td>10/33</td><td>8/33</td><td>2/33</td><td>38.1</td><td>83.3</td><td>2.29</td><td>0.74</td><td>3.08 0.49-19.16</td><td><strong>0.20</strong></td></tr><tr><td>Pelvis and/or Para-aortic LNM</td><td>14/33</td><td>12/33</td><td>2/33</td><td>57.1</td><td>83.3</td><td>3.43</td><td>0.51</td><td>6.67 0.97-45.94</td><td><strong>0.03</strong></td></tr><tr><td>Supra-diaphragmatic LNM</td><td>4/33</td><td>3/33</td><td>1/33</td><td>14.3</td><td>91.7</td><td>1.71</td><td>0.94</td><td>1.83 0.16-20.84</td><td>0.62</td></tr><tr><td>Pleural effusion</td><td>1/33</td><td>1/33</td><td>0/33</td><td>4.8</td><td>100.0</td><td>-</td><td>0.95</td><td>-</td><td>0.45</td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">RADIOLOGICAL CHARACTERISTICS: CT and/or PET/CT</td></tr><tr><td>Involvement of 1 ovary</td><td>126/192</td><td>72/192</td><td>54/192</td><td>62.6</td><td>29.9</td><td>0.89</td><td>1.25</td><td>0.71 0.38-1.33</td><td>0.28</td></tr><tr><td>Involvement of 2 ovaries</td><td>66/146</td><td>45/146</td><td>21/146</td><td>50.0</td><td>62.5</td><td>1.33</td><td>0.80</td><td>1.67 0.84-3.31</td><td><strong>0.14</strong></td></tr><tr><td>Involvement of 1 and/or 2 ovary(ies)</td><td>188/196</td><td>114/196</td><td>74/196</td><td>97.4</td><td>6.33</td><td>1.04</td><td>0.41</td><td>2.57 0.59-11.18</td><td><strong>0.19</strong></td></tr><tr><td>Diaphragmatic carcinosis</td><td>21/172</td><td>13/172</td><td>8/172</td><td>13.0</td><td>88.9</td><td>1.17</td><td>0.98</td><td>1.20 0.47-3.06</td><td>0.71</td></tr><tr><td>Omentum carcinosis</td><td>45/177</td><td>29/177</td><td>16/177</td><td>27.9</td><td>78.1</td><td>1.27</td><td>0.92</td><td>1.38 0.68-2.79</td><td>0.37</td></tr><tr><td>Small intestine involvement</td><td>5/155</td><td>4/155</td><td>1/155</td><td>4.3</td><td>98.4</td><td>2.67</td><td>0.97</td><td>2.74 0.30-26.46</td><td>0.36</td></tr><tr><td>Colon involvement</td><td>31/179</td><td>22/179</td><td>9/179</td><td>20.6</td><td>87.5</td><td>1.64</td><td>0.91</td><td>1.81 0.78-4.23</td><td><strong>0.16</strong></td></tr><tr><td>Bowel involvement</td><td>32/183</td><td>22/183</td><td>10/183</td><td>20.2</td><td>86.5</td><td>1.49</td><td>0.92</td><td>1.62 0.71-3.67</td><td>0.25</td></tr></tbody></table>

(Continued)
<table><caption>**Table 2.** (Continued)</caption><thead><tr><th>Variables</th><th>Total, n/N</th><th>LNM +, n/N</th><th>LNM -, n/N</th><th>Se (%)</th><th>Sp (%)</th><th>LR+</th><th>LR-</th><th>DOR 95% CI</th><th>p*</th></tr></thead><tbody><tr><td>Liver metastasis</td><td>8/177</td><td>4/177</td><td>4/177</td><td>3.9</td><td>94.5</td><td>0.70</td><td>1.02</td><td>0.69 0.17-2.87</td><td>0.61</td></tr><tr><td>Ascites</td><td>85/171</td><td>51/171</td><td>34/171</td><td>49.0</td><td>49.3</td><td>0.97</td><td>1.03</td><td>0.93 0.50-1.73</td><td>0.83</td></tr><tr><td>Pelvic LNM</td><td>56/182</td><td>44/182</td><td>12/182</td><td>40.4</td><td>83.6</td><td>2.46</td><td>0.71</td><td>3.44 1.62-7.32</td><td><strong>0.001</strong></td></tr><tr><td>Para-aortic LNM</td><td>50/155</td><td>38/155</td><td>12/155</td><td>40.4</td><td>80.3</td><td>2.05</td><td>0.74</td><td>2.77 1.28-6.01</td><td><strong>0.01</strong></td></tr><tr><td>Pelvis and/or Para-aortic LNM</td><td>70/182</td><td>56/182</td><td>14/182</td><td>51.4</td><td>80.8</td><td>2.68</td><td>0.60</td><td>4.45 2.14-9.29</td><td><strong>0.00</strong></td></tr><tr><td>Supra-diaphragmatic LNM</td><td>14/140</td><td>10/140</td><td>4/140</td><td>11.4</td><td>92.3</td><td>1.48</td><td>0.96</td><td>1.54 0.45-5.21</td><td>0.49</td></tr><tr><td>Pleural effusion</td><td>14/184</td><td>9/184</td><td>5/184</td><td>8.1</td><td>93.2</td><td>1.18</td><td>0.99</td><td>1.20 0.38-3.75</td><td>0.75</td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">BIOLOGICAL CHARACTERISTICS</td></tr><tr><td>Initial CA125 level ≥ 500</td><td>105/247</td><td>77/247</td><td>28/247</td><td>50.3</td><td>70.2</td><td>1.69</td><td>0.71</td><td>2.39 1.37-4.17</td><td><strong>0.00</strong></td></tr><tr><td colspan="10" style="text-align: center; font-weight: bold;">SURGICAL CHARACTERISTICS</td></tr><tr><td>Initial PCI score ≥ 10</td><td>24/77</td><td>20/77</td><td>4/77</td><td>44.4</td><td>87.5</td><td>3.56</td><td>0.64</td><td>5.60 1.55-20.26</td><td><strong>0.00</strong></td></tr><tr><td>Ascites</td><td>90/161</td><td>58/161</td><td>32/161</td><td>59.8</td><td>50.0</td><td>1.20</td><td>0.80</td><td>1.49 0.78-2.82</td><td>0.22</td></tr><tr><td>Omental cake</td><td>63/150</td><td>48/150</td><td>15/150</td><td>51.6</td><td>73.7</td><td>1.96</td><td>0.66</td><td>2.99 1.42-6.27</td><td><strong>0.00</strong></td></tr><tr><td>Peritoneal carcinosis</td><td>84/152</td><td>59/152</td><td>25/152</td><td>62.1</td><td>56.1</td><td>1.42</td><td>0.68</td><td>2.10 1.06-4.14</td><td><strong>0.03</strong></td></tr><tr><td>Diaphragmatic carcinosis</td><td>55/150</td><td>40/150</td><td>15/150</td><td>43.0</td><td>73.7</td><td>1.63</td><td>0.77</td><td>2.11 1.01-4.39</td><td><strong>0.04</strong></td></tr><tr><td>Stomach infiltration</td><td>6/146</td><td>4/146</td><td>2/146</td><td>4.4</td><td>96.4</td><td>1.24</td><td>0.99</td><td>1.26 0.22-7.14</td><td>0.80</td></tr><tr><td>Mesenteric retraction</td><td>11/146</td><td>6/146</td><td>5/146</td><td>6.6</td><td>90.9</td><td>0.73</td><td>1.03</td><td>0.71 0.20-2.45</td><td>0.58</td></tr><tr><td>Bowel infiltration</td><td>65/153</td><td>49/153</td><td>16/153</td><td>51.6</td><td>72.4</td><td>1.87</td><td>0.67</td><td>2.80 1.35-5.77</td><td><strong>0.00</strong></td></tr><tr><td>Liver metastasis</td><td>10/150</td><td>7/150</td><td>3/150</td><td>7.6</td><td>94.8</td><td>1.47</td><td>0.97</td><td>1.51 0.37-6.13</td><td>0.56</td></tr><tr><td>Initial PCI score ≥ 10 and/or Diaphragmatic carcinosis</td><td>66/166</td><td>49/166</td><td>17/166</td><td>48.0</td><td>73.4</td><td>1.81</td><td>0.71</td><td>2.56 1.28-5.12</td><td><strong>0.01</strong></td></tr></tbody></table>

LNM: Lymph Node Metastasis; CI: Confidence Interval; DOR: Diagnostic Odd Ratio; Se: Sensibility; Sp: Specificity; LR -: negative Likelihood Ratio; LR +: positive Likelihood Ratio; CT: Computed Tomography; PET/CT: Positron Emission Tomography/Computed Tomography; FIGO: Fédération Internationale de Gynécologie- Obstétrique; CA: Carcinome Antigen; PCI: Peritoneal Carcinomatosis Index.

https://doi.org/10.1371/journal.pone.0258783.t002

intraoperative clinical evaluation should have pelvic and/or paraaortic lymphadenectomy. Our study, consistent with those results, proposes a new more accurate tool for triaging patients according to simple lymphadenectomy decision rules:

<table><caption>**Table 3.** Prediction model.</caption><thead><tr><th>Variables</th><th>aDOR</th><th>95% CI</th><th>p</th></tr></thead><tbody><tr><td>Pelvic and/or Para-aortic LNM on CT and/or PET/CT</td><td></td><td></td><td></td></tr><tr><td>No</td><td>1</td><td></td><td rowspan="2">0.00</td></tr><tr><td>Yes</td><td>5.02</td><td>2.42-10.44</td></tr><tr><td>Initial PCI score ≥ 10 and/or diaphragmatic carcinosis</td><td></td><td></td><td></td></tr><tr><td>No</td><td>1</td><td></td><td rowspan="2">0.02</td></tr><tr><td>Yes</td><td>2.34</td><td>1.13-4.83</td></tr><tr><td>Initial PCI CA125 level ≥ 500</td><td></td><td></td><td rowspan="2">0.02</td></tr><tr><td>No</td><td>1</td><td></td></tr><tr><td>Yes</td><td>2.03</td><td>1.14-3.61</td><td></td></tr></tbody></table>

aDOR: adjusted Odd Ratio; CI: Confidence Interval; LNM: Lymph Node Metastasis; CT: Computed Tomography; PET/CT: Positron Emission Tomography/Computed Tomography; CA: Carcinome Antigen; PCI: Peritoneal Carcinomatosis Index.

https://doi.org/10.1371/journal.pone.0258783.t003

<footnote>* Chi2 test.</footnote>
<figure><img src="image_5.png" /><figcaption>Fig 2. ROC curve of the logistic regression model and performance after leave-one-out cross-validation. ROC: Receiving Operating Curve; AUC: Area Under the Curve.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0258783.g002

<figure><img src="image_6.png" /><figcaption>Fig 3. Internal calibration of the logistic regression model to predict lymph node positivity. The horizontal axis represents the predicted probability of LNM and the vertical axis its actual probability. Perfect prediction would correspond to the 45 degrees broken line. The solid blue line indicates the observed (apparent) logistic regression model performance. Circles correspond to the to the risk groups of predicted probability for LNM with their 95%CI. There was no difference between the predicted probabilities and the observed rates of LNM (p = 0.09). AUC: area under the curve; CITL: calibration in the large.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0258783.g003
<figure><img src="image_7.png" /><figcaption>Fig 4. A decision tree of the simple lymphadenectomy decision rules.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0258783.g004

<figure><img src="image_8.png" /><figcaption>Fig 5. ShinyLNM.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0258783.g005
i. a patient in the group at low-risk of LMN (no LNM on CT and/or PET CT, PCI<10, CA125<500) should not have lymphadenectomy and the systematic opening of the retroperitoneal space for the intraoperative clinical evaluation should be omitted to reduce operative time and morbidity. Thus in our cohort, the false-negative rate for LNM was 25.0%, compared with 55.3% in the LION trial. Moreover, these 25.0% accounted for a mean of only 0.9 +/- 2.5 LNM among the 29.0 +/- 18.4 lymph nodes removed, while it has been proven that disease prognosis worsens with the number of LNMs removed [5, 9].

ii. a patient in the group at high-risk for LNM should have lymphadenectomy. In our cohort, the true-positive rate for LNM was 79.3% and not comparable to the LION trial. Moreover, in these 79.3% patients, among 36.5 +/- 16.0 lymph nodes removed, the mean number with LNM was 7.5 +/- 8.4. We note that in addition to the patients with LNM at CT and/or PET CT, already known to need lymphadenectomy, the high-risk group included a previously unknown category patient requiring lymphadenectomy—those with no LNM at CT and/or PET CT, CA125 ≥ 500, and PCI≥ 10. In this subgroup of 15 patients, 66.7% had LNM.

iii. patients not classified by the prediction model; for these patients, intraoperative clinical evaluation should still be performed. Our previous meta-analysis of the diagnostic accuracy of intraoperative clinical evaluation for detecting pelvic and para-aortic LNM in gynecological cancers, which included 5 studies and 723 patients, found a pooled specificity of 0.79, 95% CI [0.67-0.87], and was significantly higher in the subgroup of patients with only ovarian cancer: 0.92, 95% CI [0.85-0.98], with a pooled LR+ of 5.11, 95% CI [2.30-11.36]. Pooled sensitivity was 0.85, 95% CI [0.67-0.94] and pooled LR- was 0.25, 95% CI [0.16-0.38] [12].

In daily practice, surgeons can easily use these simple lymphadenectomy decision rules with the shinyLNM interactive web app to plan surgery appropriately and provide useful information to patients.

**Supporting information**

**S1 Dataset.**

(XLSX)

**Author Contributions**

**Conceptualization:** Camille Mimoun, Jean-Louis Benifla, Matthieu Mezzadri, Sofiane Bendifallah, Cyril Touboul, Alexandre Bricou, Yohann Dabi, Geoffroy Canlorbe, Yohan Kerbage, Vincent Lavoué, Lobna Ouldamer, Lise Lecointre, Charles Coutant, Arnaud Fauconnier, Roman Rouzier, Cyrille Huchon.

**Data curation:** Camille Mimoun, Adrien Crestani.

**Formal analysis:** Camille Mimoun, Thomas Gaillard.

**Investigation:** Camille Mimoun.

**Methodology:** Camille Mimoun, Xavier Paoletti.

**Writing – original draft:** Camille Mimoun.

**References**

1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA: a cancer journal for clinicians. 2020; 70 (1):7-30.
2. du Bois A, Quinn M, Thigpen T, Vermorken J, Avall-Lundqvist E, Bookman M, et al. 2004 consensus statements on the management of ovarian cancer: final document of the 3rd International Gynecologic Cancer Intergroup Ovarian Cancer Consensus Conference (GCIG OCCC 2004). Ann Oncol. 2005;16 Suppl 8:viii7-12.

3. Colombo N, Sessa C, du Bois A, Ledermann J, McCluggage WG, McNeish I, et al. ESMO-ESGO consensus conference recommendations on ovarian cancer: pathology and molecular biology, early and advanced stages, borderline tumours and recurrent disease. Annals of Oncology. mai 2019; 30(5):672-705. https://doi.org/10.1093/annonc/mdz062 PMID: 31046081

4. Lavoue V, Huchon C, Akladios C, Alfonsi P, Bakrin N, Ballester M, et al. Management of epithelial cancer of the ovary, fallopian tube, and primary peritoneum. Short text of the French Clinical Practice Guidelines issued by FRANCOGYN, CNGOF, SFOG, and GINECO-ARCAGY, and endorsed by INCa. Eur J Obstet Gynecol Reprod Biol. mai 2019; 236:214-23. https://doi.org/10.1016/j.ejogrb.2019.03.010 PMID: 30905627

5. Panici PB, Maggioni A, Hacker N, Landoni F, Ackermann S, Campagnutta E, et al. Systematic aortic and pelvic lymphadenectomy versus resection of bulky nodes only in optimally debulked advanced ovarian cancer: a randomized clinical trial. J Natl Cancer Inst. 20 avr 2005; 97(8):560-6. https://doi.org/10.1093/jnci/dji102 PMID: 15840878

6. Harter P, Sehouli J, Lorusso D, Reuss A, Vergote I, Marth C, et al. A Randomized Trial of Lymphadenectomy in Patients with Advanced Ovarian Neoplasms. N Engl J Med. 28 2019; 380(9):822-32. https://doi.org/10.1056/NEJMoa1808424 PMID: 30811909

7. Pereira A, Magrina JF, Rey V, Cortes M, Magtibay PM. Pelvic and aortic lymph node metastasis in epithelial ovarian cancer. Gynecol Oncol. juin 2007; 105(3):604-8. https://doi.org/10.1016/j.ygyno.2007.01.028 PMID: 17321572

8. Fournier M, Stoeckle E, Guyon F, Brouste V, Thomas L, MacGrogan G, et al. Lymph node involvement in epithelial ovarian cancer: sites and risk factors in a series of 355 patients. Int J Gynecol Cancer. nov 2009; 19(8):1307-13. https://doi.org/10.1111/IGC.0b013e3181b8a07c PMID: 20009882

9. Chan JK, Urban R, Hu JM, Shin JY, Husain A, Teng NN, et al. The potential therapeutic role of lymph node resection in epithelial ovarian cancer: a study of 13918 patients. Br J Cancer. 18 juin 2007; 96 (12):1817-22. https://doi.org/10.1038/sj.bjc.6603803 PMID: 17519907

10. Choi HJ, Lim MC, Bae J, Cho K-S, Jung DC, Kang S, et al. Region-based diagnostic performance of multidetector CT for detecting peritoneal seeding in ovarian cancer patients. Arch Gynecol Obstet. févr 2011; 283(2):353-60. https://doi.org/10.1007/s00404-010-1442-0 PMID: 20376674

11. Hynninen J, Kemppainen J, Lavonius M, Virtanen J, Matomäki J, Oksa S, et al. A prospective comparison of integrated FDG-PET/contrast-enhanced CT and contrast-enhanced CT for pretreatment imaging of advanced epithelial ovarian cancer. Gynecol Oncol. nov 2013; 131(2):389-94. https://doi.org/10.1016/j.ygyno.2013.08.023 PMID: 23994535

12. Mimoun C, Benifla JL, Fauconnier A, Huchon C. Intraoperative Clinical Examination for Assessing Pelvic and Para-Aortic Lymph Node Involvement in Advanced Epithelial Ovarian Cancer: A Systematic Review and Meta-Analysis. J Clin Med. 29 août 2020; 9(9):E2793. https://doi.org/10.3390/jcm9092793 PMID: 32872558

13. Jacquet P, Sugarbaker PH. Clinical research methodologies in diagnosis and staging of patients with peritoneal carcinomatosis. Cancer Treatment and Research. 1996; 82:359-74. https://doi.org/10.1007/978-1-4613-1247-5_23 PMID: 8849962

14. ASA Physical Status Classification System [Internet]. [cité 7 oct 2020]. Disponible sur: https://www.asahq.org/standards-and-guidelines/asa-physical-status-classification-system

15. Demler OV, Pencina MJ, D'Agostino RB. Misuse of DeLong test to compare AUCs for nested models. Stat Med. 15 oct 2012; 31(23):2577-87. https://doi.org/10.1002/sim.5328 PMID: 22415937

16. Altman DG, Royston P. What do we mean by validating a prognostic model? Stat Med. 29 févr 2000; 19 (4):453-73. https://doi.org/10.1002/(sici)1097-0258(20000229)19:4<453::aid-sim350>3.0.co;2-5 PMID: 10694730

17. Molinaro AM, Simon R, Pfeiffer RM. Prediction error estimation: a comparison of resampling methods. Bioinformatics. 1 août 2005; 21(15):3301-7. https://doi.org/10.1093/bioinformatics/bti499 PMID: 15905277

18. Derivation of a Clinical Prediction Model for the Emergency Department Diagnosis of Ectopic Pregnancy—Buckley—1998—Academic Emergency Medicine—Wiley Online Library [Internet]. [cité 7 oct 2020]. Disponible sur: https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1553-2712.1998.tb02770.x?sid=nlm%3Apubmed

19. Llueca A, Escrig J, MUapos working group (Multidisciplinary Unit of Abdominal Pelvic Oncology Surgery). Prognostic value of peritoneal cancer index in primary advanced ovarian cancer. Eur J Surg Oncol. 2018; 44(1):163-9. https://doi.org/10.1016/j.ejso.2017.11.003 PMID: 29198495