# Development of an algorithm for phenotypic screening of carbapenemase-producing Enterobacteriaceae in the routine laboratory

Jérôme Robert, Alix Pantel, Audrey Merens, Elodie Meiller, Jean-Philippe

Lavigne, Marie-Hélène Nicolas-Chanoine

<figure><img src="image_1.png" /></figure>

## ► To cite this version:

Jérôme Robert, Alix Pantel, Audrey Merens, Elodie Meiller, Jean-Philippe Lavigne, et al.. Development of an algorithm for phenotypic screening of carbapenemase-producing Enterobacteriaceae in the routine laboratory. BMC Infectious Diseases, 2017, 17 (1), pp.78. 10.1186/s12879-016-2174-y. hal-01440745

HAL Id: hal-01440745

https://hal.sorbonne-universite.fr/hal-01440745

Submitted on 19 Jan 2017

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH ARTICLE

Open Access

<figure><img src="image_3.png" /></figure>

CrossMark

# Development of an algorithm for phenotypic screening of carbapenemase-producing Enterobacteriaceae in the routine laboratory

Jérôme Robert<fnref n="1" />,<fnref n="2" />*, Alix Pantel³,⁴, Audrey Merens⁵, Elodie Meiller⁶, Jean-Philippe Lavigne³,⁴, Marie-Hélène Nicolas-Chanoine⁶,⁷,⁸ and on behalf of ONERBA's carbapenem resistance study group

## Abstract

**Background:** Carbapenemase-producing Enterobacteriaceae (CPE) are difficult to identify among carbapenem non-susceptible Enterobacteriaceae (NSE). We designed phenotypic strategies giving priority to high sensitivity for screening putative CPE before further testing.

**Methods:** Presence of carbapenemase-encoding genes in ertapenem NSE (MIC > 0.5 mg/l) consecutively isolated in 80 French laboratories between November 2011 and April 2012 was determined by the Check-MDR-CT103 array method. Using the Mueller-Hinton (MH) disk diffusion method, clinical diameter breakpoints of carbapenems other than ertapenem, piperazicillin+tazobactam, ticarcillin+clavulanate and cefepime as well as diameter cut-offs for these antibiotics and temocillin were evaluated alone or combined to determine their performances (sensitivity, specificity, positive and negative likelihood ratios) for identifying putative CPE among these ertapenem-NSE isolates. To increase the screening specificity, these antibiotics were also tested on cloxacillin-containing MH when carbapenem NSE isolates belonged to species producing chromosomal cephalosporinase (AmpC) but *Escherichia coli*.

**Results:** Out of the 349 ertapenem NSE, 52 (14.9%) were CPE, including 39 producing OXA-48 group carbapenemase, eight KPC and five MBL. A screening strategy based on the following diameter cut offs, ticarcillin +clavulanate <15 mm, temocillin <15 mm, meropenem or imipenem <22 mm, and cefepime <26 mm, showed 100% sensitivity and 68.1% specificity with the better likelihood ratios combination. The specificity increased when a diameter cut-off <32 mm for imipenem (76.1%) or meropenem (78.8%) further tested on cloxacillin-containing MH was added to the previous strategy for AmpC-producing isolates.

**Conclusion:** The proposed strategies that allowed for increasing the likelihood of CPE among ertapenem-NSE isolates should be considered as a surrogate for carbapenemase production before further CPE confirmatory testing.

**Keywords:** Disk diffusion method, Algorithm, Screening, Carbapenemase, Enterobacteriaceae

<footnote>* Correspondence: jerome.robert0@upmc.fr</footnote>

<footnote n="1">¹Sorbonne Universités, UPMC Univ Paris 06, INSERM, U1135, Centre d'Immunologie et des Maladies Infectieuses (CIMI), Eq 13, F-75013 Paris, France</footnote>

<footnote n="2">²Bactériologie-Hygiène, Hôpitaux Universitaires Pitié Salpêtrière - Charles Foix, APHP, F-75013 Paris, France</footnote>

<footnote>Full list of author information is available at the end of the article</footnote>
## Background

Preventing the spread of carbapenemase-producing Enterobacteriaceae (CPE) is a priority because it may lead to therapeutic dead end [1]. The control strategies are based on better antibiotic use and decrease in cross-transmission. Thus, rapid detection of CPE in the laboratory is of paramount importance [2]. However, this detection is complex because carbapenemases display various hydrolytic activities with regard to β-lactams and mechanisms other than carbapenemase production, namely overproduction of AmpC β-lactamase and/or production of ESBL in isolates displaying reduced outer membrane permeability, are involved in resistance to carbapenems. In addition, appropriate studies have shown that the incidence of CPE is very low in some countries and that the other resistance mechanisms are the most frequent in carbapenem non-susceptible Enterobacteriaceae (NSE) [3–5]. Therefore, looking for CPE among all carbapenem NS isolates is difficult, and the routine clinical laboratory is in need of simple tools allowing for the rapid suspicion of CPE among carbapenem NSE isolates before further testing by more specific tests.

Recent tests designed to specifically detect carbapenemase production by real-time PCR assays [6] or carbapenem hydrolysis [7, 8] have been developed [9]. Nevertheless, these tests are not yet available in any microbiological laboratory or some may be costly if applied on all carbapenem NSE in a context of low CPE incidence. Thus, the objective is to decrease the number of carbapenem NSE submitted to such specific tests. For this purpose, a few teams sought to delineate laboratory screening strategies based on simple and widely available tests to identify isolates with high likelihood of being CPE among carbapenem NSE [10–15]. However, the effectiveness of these screening strategies has mostly been tested against biased samples, i.e. samples among which CPE were by far over-represented as compared to the current CPE prevalence [11, 12].

As we reported a low proportion (circa 10%) of CPE among non-selected carbapenem NSE in France in 2011–2012 [5], the French committee on antibiotic susceptibility testing (CA-SFM) affiliated to the European committee on antimicrobial susceptibility testing (EUCAST) raised interest in using this unbiased isolates collection to develop a screening strategy that could be applied in all laboratories to eliminate with certainty carbapenemase-negative isolates among carbapenem NSE. The aim of this article is to present the process used to establish a comprehensive screening algorithm, which was adopted by the French CA-SFM in 2015 (http://www.sfm-microbiologie.org/UserFiles/files/casfm/CASFM_EUCAST_V1_2015.pdf).

## Methods

### Bacteria

A total of 80 laboratories throughout the French territory participated on a voluntary basis in the study during a 6-month period in 2011–2012. As referral centre, we received 744 non-duplicate ertapenem NSE (ertapenem MIC >0.5 mg/L: broth microdilution method according to EUCAST recommendations) [16] consecutively collected, including 392 (52.7%) *Enterobacter cloacae*. Because of the very low prevalence of carbapenemase in *E. cloacae* at the period of the study [5], we randomly selected one fifth of the isolates belonging to this species for comprehensive analysis by using a roster ordered by laboratory and by isolation date. Therefore, 349 non-duplicate ertapenem NSE isolates, including 222 clinical isolates previously reported [5] and 127 consecutive isolates obtained from screening rectal swabs were studied. Isolates were characterised (species identification, antibiotic susceptibility and ESBL production) in each laboratory and further analysed by the referral centre, notably with regard to their *bla* gene content (Check-MDR CT103 array, Check-Points, Wageningen, The Netherlands) [5].

### Antibiotic susceptibility

The following antibiotic were tested by using the agar diffusion method following the 2011 CA-SFM recommendations on Mueller-Hinton agar medium (MH, BioRad, Marne La Coquette, France) and on MH containing 250 mg/L cloxacillin ($MH_{cloxa}$, bioMérieux, Marcy l'Etoile, France): ertapenem 10 µg, imipenem 10 µg, meropenem 10 µg, doripenem 10 µg, ticarcillin/clavulanate 75/10 µg, piperacillin/tazobactam 75/10 µg, cefotaxime 30 µg, ceftazidime 30 µg, cefepime 30 µg, and temocillin 30 µg [17].

Imipenem and meropenem MICs were determined by using the broth microdilution method in 96 wells-plaques containing lyophilized antibiotics (Sensititre MIC plates, Biocentric, Bandol, France).

### Additional phenotypic test designed for carbapenemase detection

Because previously described screening strategies [13, 15] included the use of the Rosco Diagnostica Neo-Sensitabs KPC and MBL confirm kit (Eurobio, Les Ullis France), each isolate of our collection was also submitted to this test according to manufacturer's instructions. It consists of four tablets: tablet A containing meropenem, tablet B containing meropenem and dipicolinic acid [metallo-β-lactamase (MBL) inhibitor], tablet C containing meropenem and cloxacillin (AmpC inhibitor), and tablet D containing meropenem and boronic acid (class A carbapenemase KPC inhibitor). The inhibition zone diameter around tablet A was compared to that of each
of meropenem-plus-inhibitor tablets (B, C, and D). If diameter around tablet B showed a difference >4 mm from that around tablet A, the isolate was recorded as demonstrating MBL activity. If diameter around tablet D showed a difference >4 mm from that of tablet A, the isolate was recorded as demonstrating KPC activity. If diameters around tablets C and D both showed a difference >4 mm from that of tablet A, the isolate was recorded as demonstrating AmpC activity coupled with outer membrane impermeability.

## Data analysis

The main objective of the analysis was to determine strategies based on the disk diffusion method allowing for retaining all carbapenemase-producing isolates (100% sensitivity, Se) and reducing the number of isolates submitted to CPE confirmatory tests, i.e. with the highest specificity. The performances, i.e. Se, specificity (Sp), positive (+) and negative (−) likelihood ratios (LR), were computed for single or combined screening tests with regard to their ability to separate carbapenemase-producing isolates from those non-producing carbapenemase.

These performances were successively evaluated with regard to clinical breakpoints delineating NS isolates from the susceptible (CA-SFM) ones, diameter cut-offs and specific carbapenemase detection test (Rosco test) previously published in strategies designed for screening of carbapenemase-positive isolates [13–15, 18], as well as diameter cut-offs determined in the present study by analysing the distributions of inhibition zone diameters displayed by our non-selected isolate collection (Additional file 1: Figure S1).

We used LR because they are independent of the pre-test probability of the event in the tested population (prevalence rate), in contrast with positive and negative predictive values. Moreover, by using the Fagan's nomogram, each laboratory can derive the positive and negative predictive values of any test by using the LR of the test and the prevalence rate of the event before the test [19]. The LR of a positive test (LR+) is the ratio of the true-positive rate to the false-positive rate, i.e. Se/(1-Sp). The LR of a negative test (LR-) is the ratio of the false-negative rate to the true-negative rate, i.e. (1-Se)/Sp. Hence, the values of the LR range from zero to infinity. The farther the LR value is away from 1 (reference where the test has no diagnostic value), the stronger the interest of the test.

LR graphs derived from standard receiver operating characteristics curves analysis were used to visually compare the interest of “screening tests” (II) to a reference test (I) [20, 21]. Non-susceptibility to imipenem as defined by CA-SFM clinical breakpoint (imipenem inhibition diameter size <24 mm) was chosen as reference

test because it is a widely used test in routine susceptibility testing. In LR graphs, the false-positive rate (1-Sp) of the reference (I) is plotted against its true-positive rate (Se). The slope of a solid line connecting this defined point to the point (0,0) represents the LR of a positive test, and the slope of a dashed line connecting this point to the point (1,1) represents the LR of a negative test (Fig. 2). Consequently, four regions are defined: region A, where the value of the screening test (II) yields overall superior characteristics than the reference (LR+ test II > LR+ test I and LR- test II < LR- test I); region B, where the value of the screening test (II) is superior to test I to eliminate the production of carbapenemase (LR+ test II < LR+ test I and LR- test II < LR- test I); region C, where the value of test II is superior for retaining isolates likely to produce of carbapenemase (LR+ test II > LR+ test I and LR- test II > LR- test I); region D, where the value of test II is inferior overall (LR+ test II < LR+ test I and LR- test II > LR- test I).

## Statistical analysis

The McNemar's test with exact significance probability was used to compare Se and Sp of selected tests and strategies.

## Results

The characteristics of the 349 ertapenem-NS isolates are shown in Table 1. A total of 52 (14.9%) isolates harboured carbapenemase genes, and 179 (51.3%) produced ESBL. Carbapenemase-encoding genes were the most frequent in *Klebsiella pneumoniae* (27.3%) and *E. coli* (23.8%), while none of the *Enterobacter* spp harboured

<table><caption>**Table 1** Number and proportion of ESBL-producing and carbapenemase-producing Enterobacteriaceae included in the study according to species</caption><thead><tr><th rowspan="3">Species</th><th colspan="6">Number (%) of isolates</th></tr><tr><th rowspan="2">Total</th><th rowspan="2">ESBL+</th><th colspan="4">Carbapenemase positive</th></tr><tr><th>Total</th><th>OXA-48</th><th>KPC</th><th>MBL</th></tr></thead><tbody><tr><td><i>Klebsiella pneumoniae</i></td><td>121</td><td>91 (75.2)</td><td>33 (27.3)</td><td>24</td><td>7</td><td>2</td></tr><tr><td><i>Enterobacter cloacae</i></td><td>89</td><td>32 (36.0)</td><td>0</td><td></td><td></td><td></td></tr><tr><td><i>Enterobacter aerogenes</i></td><td>46</td><td>20 (43.5)</td><td>0</td><td></td><td></td><td></td></tr><tr><td><i>Escherichia coli</i></td><td>42</td><td>24 (57.1)</td><td>10 (23.8)</td><td>9</td><td></td><td>1</td></tr><tr><td><i>Citrobacter freundii</i></td><td>18</td><td>7 (38.9)</td><td>2 (11.1)</td><td>1</td><td>1</td><td></td></tr><tr><td><i>Serratia marcescens</i></td><td>10</td><td>0</td><td>2 (20.0)</td><td>2</td><td></td><td></td></tr><tr><td><i>Klebsiella oxytoca</i></td><td>5</td><td>0</td><td>2 (40.0)</td><td>2</td><td></td><td></td></tr><tr><td><i>Proteus mirabilis</i></td><td>1</td><td>1 (100)</td><td>1 (100)</td><td></td><td></td><td>1</td></tr><tr><td><i>Salmonella spp</i></td><td>1</td><td>1 (100)</td><td>1 (100)</td><td></td><td></td><td>1</td></tr><tr><td>Others</td><td>16</td><td>3 (18.8)</td><td>1 (6.3)</td><td>1</td><td></td><td></td></tr><tr><td>Total</td><td>349</td><td>179 (51.3)</td><td>52 (14.9)</td><td>39</td><td>8</td><td>5</td></tr></tbody></table>

ESBL+ extended-spectrum β-lactamase production, OXA-48 OXA-48 group carbapenemase, MBL metallo-beta-lactamase
carbapenem-encoding genes. Among the 52 carbapenem-encoding genes, 39 (75.0%) encoded for the OXA-48 group carbapenemase, eight (15.4%) for KPC, and five (9.6%) for MBL. Imipenem MIC for the 52 CPE ranged from 1 mg/L to 64 mg/L, with 18 (34.6%) isolates displaying an imipenem MIC ≤ 2 mg/L. Meropenem MIC for CPE ranged from 0.25 mg/L to 64 mg/L, with 28 (53.8%) isolates displaying a meropenem MIC ≤ 2 mg/L. All CPE isolates with imipenem or

meropenem MIC ≤ 2 mg/L produced OXA-48 group carbapenemases.

### Screening with a single antibiotic disk

When using the inhibition zone diameter of a single antibiotic disk and CA-SFM clinical breakpoints, non-susceptibility to carbapenems other than ertapenem yielded Se ranging from 32.7 to 42.3% (Table 2) to screen CPE among ertapenem NS isolates. Higher Se

<table><caption>**Table 2** Sensitivity (Se, %), specificity (Sp, %), positive and negative likelihood ratios (LR+ and LR-, respectively) of screening strategies for carbapenemase-positive isolates among 349 isolates non-susceptible to ertapenem</caption><thead><tr><th rowspan="2">Antibiotic and diameter (&lt; in mm)</th><th colspan="2">Number (%) of isolates</th><th rowspan="2">Se<br>%</th><th rowspan="2">Sp<br>%</th><th rowspan="2">LR+</th><th rowspan="2">LR-</th></tr><tr><th>Carbase+<br>(n = 52)</th><th>Carbase-<br>(n = 297)</th></tr></thead><tbody><tr><td><strong>Clinical breakpoints</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>IMI 24</td><td>22 (42.3)</td><td>44 (14.8)</td><td>42.3</td><td>85.2</td><td>2.84</td><td>0.68</td></tr><tr><td>MER 22</td><td>22 (42.3)</td><td>40 (13.5)</td><td>42.3</td><td>86.5</td><td>3.12</td><td>0.67</td></tr><tr><td>DOR 24</td><td>17 (32.7)</td><td>22 (7.4)</td><td>32.7</td><td>92.6</td><td>4.37</td><td>0.72</td></tr><tr><td>TAZ 21</td><td>51 (98.1)</td><td>220 (74.1)</td><td>98.1</td><td>25.9</td><td>1.31</td><td>0.11</td></tr><tr><td>TCC 24</td><td>51 (98.1)</td><td>292 (98.3)</td><td>98.1</td><td>1.7</td><td>0.99</td><td>1.53</td></tr><tr><td>FEP 24</td><td>42 (80.8)</td><td>138 (46.5)</td><td>80.8</td><td>53.5</td><td>1.73</td><td>0.37</td></tr><tr><td><strong>Cut-offs</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>MER 27<sup>a</sup></td><td>40 (76.9)</td><td>80 (27.0)</td><td>76.9</td><td>73.0</td><td>2.83</td><td>0.32</td></tr><tr><td>TEM 8<sup>a</sup></td><td>35 (67.3)</td><td>12 (4.0)</td><td>67.3</td><td>96.0</td><td>15.97</td><td>0.34</td></tr><tr><td>TAZ 16<sup>b</sup></td><td>46 (88.5)</td><td>105 (35.4)</td><td>88.5</td><td>64.7</td><td>2.48</td><td>0.19</td></tr><tr><td>TEM 12<sup>b</sup></td><td>43 (82.7)</td><td>65 (21.9)</td><td>82.7</td><td>78.1</td><td>3.73</td><td>0.23</td></tr><tr><td>MER 25<sup>c</sup></td><td>32 (61.5)</td><td>59 (19.9)</td><td>61.5</td><td>80.1</td><td>3.07</td><td>0.48</td></tr><tr><td>TCC 15<sup>d</sup></td><td>51 (98.1)</td><td>227 (76.4)</td><td>98.1</td><td>23.6</td><td>1.27</td><td>0.12</td></tr><tr><td>TEM 15<sup>d</sup></td><td>50 (96.2)</td><td>126 (42.4)</td><td>96.2</td><td>57.6</td><td>2.24</td><td>0.08</td></tr><tr><td>FEP 26<sup>d</sup></td><td>43 (82.7)</td><td>162 (54.6)</td><td>82.7</td><td>45.4</td><td>1.51</td><td>0.39</td></tr><tr><td><strong>Combination of cut-offs</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>TAZ 16 &amp; TEM 12<sup>b*</sup></td><td>39 (75.0)</td><td>48 (16.2)</td><td>75.0</td><td>58.9</td><td>4.62</td><td>0.08</td></tr><tr><td>TCC 15 &amp; TEM 15<sup>d</sup></td><td>50 (96.2)</td><td>94 (31.7)</td><td>96.2</td><td>68.3</td><td>3.00</td><td>0.07</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; IMI 22<sup>d</sup></td><td>52 (100)</td><td>109 (36.7)</td><td>100</td><td>63.3</td><td>2.70</td><td>0.01</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; MER 22<sup>d</sup></td><td>52 (100)</td><td>110 (37.0)</td><td>100</td><td>63.0</td><td>2.67</td><td>0.01</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; IMI 22 &amp; FEP 26<sup>d</sup></td><td>52 (100)</td><td>92 (31.0)</td><td>100</td><td>69.0</td><td>3.19</td><td>0.01</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; MER 22 &amp; FEP 26<sup>d</sup></td><td>52 (100)</td><td>93 (31.3)</td><td>100</td><td>68.7</td><td>3.16</td><td>0.01</td></tr><tr><td><strong>Combination of cut-offs + additional tests</strong></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; IMI 22 &amp; IMI 32-Clo<sup>d,e</sup></td><td>51 (98.1)</td><td>81 (27.3)</td><td>98.1</td><td>72.7</td><td>3.55</td><td>0.04</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; MER 22 &amp; MER 32-Clo<sup>d,e</sup></td><td>52 (100)</td><td>68 (22.9)</td><td>100</td><td>77.1</td><td>4.31</td><td>0.01</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; IMI 22 &amp; FEP 26<sup>d</sup> &amp; IMI 32-Clo<sup>d,e</sup></td><td>51 (98.1)</td><td>71 (23.9)</td><td>98.1</td><td>76.1</td><td>4.05</td><td>0.04</td></tr><tr><td>TCC 15 &amp; TEM 15 &amp; MER 22 &amp; FEP 26<sup>d</sup> &amp; MER 32-Clo<sup>d,e</sup></td><td>52 (100)</td><td>63 (21.2)</td><td>100</td><td>78.8</td><td>4.65</td><td>0.01</td></tr><tr><td>MER 25 &amp; TEM 11 &amp; Rosco confirm kit<sup>c,f</sup></td><td>29 (55.8)</td><td>23 (9.4)</td><td>55.8</td><td>90.6</td><td>5.82</td><td>0.49</td></tr><tr><td>MER 27 &amp; TEM 8 &amp; Rosco confirm kit<sup>a,g</sup></td><td>36 (69.2)</td><td>14 (4.7)</td><td>69.2</td><td>95.3</td><td>14.15</td><td>0.33</td></tr></tbody></table>

IMI imipenem, MER meropenem, DOR doripenem, FEP cefepime, TAZ piperacillin/tazobactam, TCC ticarcillin/clavulanate, TEM temocillin, Carbase+ or Carbase-carbapenemase-positive or -negative isolate

<sup>a</sup>reference [13]; <sup>b</sup>85 (24.4%) isolates not classified according to reference [14] strategy; <sup>c</sup>this study

<sup>d</sup>cloxacillin test applied only to chromosomally encoding AmpC Enterobacteriaceae

<sup>e</sup>258 (73.9) of our isolates not tested according to reference [15] because of meropenem diameter ≥25 mm towards these isolates

<sup>f</sup>229 (65.6%) of our isolates not tested according to reference [13] because of meropenem diameter ≥27 mm towards these isolates
(98.1%) was obtained with piperacillin/tazobactam or ticarcillin/clavulanate clinical breakpoints but with very low Sp (25.9 and 1.7%, respectively) (Table 2). The use of cut-offs derived from a previous publication [14] for piperacillin/tazobactam (<16 mm) or from analysis of the inhibition zone diameter distribution in the present study (Additional file 1: Figure S1) for ticarcillin/clavulanate (<15 mm) allows increasing significantly Sp, although Sp values remained rather low (<65%). With regard to temocillin, a high Se, up to 96.2%, was reached when the previously proposed 12 mm inhibition zone diameter cut-off [14] or the 15 mm cut-off derived from our data analysis (Additional file 1: Figure S1) were applied (Table 2). The use of the previously proposed 8 mm temocillin cut-off [13] decreased the Se to 67.3% (Table 2).

## Screening with a combination of antibiotic disks

The previously published combination [14] of inhibition zone diameter of piperacillin/tazobactam <16 mm and temocillin <12 mm yielded a Se of 75.0% but 24.4% of our isolates were not classified because they did not fit in any of the categories defined by the authors (Table 2). Combining ticarcillin/clavulanate <15 mm with temocillin <15 mm as derived from the analysis of zone diameters for our isolates collection increased Se (96.2%) and Sp (68.3%). Se of 100% and Sp of 63% were reached when considering an inhibition zone diameter of imipenem or meropenem <22 mm for isolates not retained by

ticarcillin/clavulanate <15 mm and temocillin <15 mm (Table 2). Finally, the Sp of the latter strategy was significantly improved (69 vs 63%, *p* < 0.001; Table 3) by retaining only isolates with cefepime inhibition zone diameter <26 mm for the species producing chromosomal AmpC but *E. coli* (Table 2). All isolates were classified by using our strategies.

## Screening with the classical disc diffusion method and additional tests

When analysing the results of the different tests obtained on our collection of isolates, the best combination allowing for reaching a Se of 100% and Sp of 78.8% consisted of the combination of the disk diffusion method (temocillin <15 mm, ticarcillin/clavulanate <15 mm and, imipenem or meropenem <22 mm, cefepime <26 mm), and an additional screening, namely meropenem or imipenem <32 mm on MH containing cloxacillin (Table 2 and Fig. 1) for the species producing chromosomal AmpC but *E. coli*.

The strategy proposed by van Dijk et al. [15], which combines temocillin <11 mm and the Rosco confirmatory test with regard to isolates selected on meropenem MIC ≥0.5 mg/L (i.e. estimated inhibition zone diameter <25 mm) [14], displayed a Se of 55.8% and a Sp of 90.6% in our collection of isolates (Table 2). It has to be noted that 73.9% of the isolates of our study, including 20 of the 52 CPE, would not have been tested because they displayed a meropenem inhibition zone diameter

<table><caption>**Table 3** P-values (McNemar's test) comparing sensitivities and specificities of selected strategies for the 349 ertapenem non-susceptible Enterobacteriaceae isolates</caption><thead><tr><th rowspan="2">Specificity</th><th colspan="5">TCC 15 & TEM 15 &</th><th rowspan="2">MER 27</th><th rowspan="2">TEM 12</th><th rowspan="2">TAZ 16 & TEM 12</th><th rowspan="2">MER 25 & TEM 11 & Rosco</th><th rowspan="2">MER 27 & TEM 8 & Rosco</th><th rowspan="2">IMI 24</th></tr><tr><th>MER 22 & FEP 26ª & MER 32-Cloª</th><th>MER 22 & MER 32-Cloª</th><th>MER 22 & FEP 26ª</th><th>MER 22</th><th>-</th></tr></thead><tbody><tr><td>TCC 15 & TEM 15 & MER 22 & FEP 26ª & MER 32-Cloª</td><td></td><td>1.0</td><td>1.0</td><td>1.0</td><td>0.50</td><td>0.0005</td><td>0.004</td><td>0.0002</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td></tr><tr><td>TCC 15 & TEM 15 & MER 22 & MER 32-Cloª</td><td>0.06</td><td></td><td>1.0</td><td>1.0</td><td>0.50</td><td>0.0005</td><td>0.004</td><td>0.0002</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td></tr><tr><td>TCC 15 & TEM 15 & MER 22 & FEP 26ª</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td></td><td>1.0</td><td>0.50</td><td>0.0005</td><td>0.004</td><td>0.0002</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td></tr><tr><td>TCC 15 & TEM 15 & MER 22</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td></td><td>0.50</td><td>0.0005</td><td>0.004</td><td>0.0002</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td></tr><tr><td>TCC 15 & TEM 15</td><td>0.0001</td><td>0.0009</td><td>1.0</td><td>&lt;0.0001</td><td></td><td>0.01</td><td>0.016</td><td>0.001</td><td>0.001</td><td>&lt;0.0001</td><td>&lt;0.0001</td></tr><tr><td>MER 27</td><td>0.03</td><td>0.14</td><td>0.17</td><td>0.002</td><td>0.10</td><td></td><td>0.65</td><td>1.0</td><td>0.001</td><td>0.125</td><td>&lt;0.0001</td></tr><tr><td>TEM 12</td><td>0.90</td><td>0.80</td><td>0.0005</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>0.15</td><td></td><td>0.13</td><td>0.016</td><td>0.21</td><td>0.0008</td></tr><tr><td>TAZ 16 & TEM 12 [14]</td><td>0.06</td><td>0.01</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>0.0007</td><td>&lt;0.0001</td><td></td><td>0.08</td><td>0.68</td><td>0.005</td></tr><tr><td>MER 25 & TEM 11 & Rosco confirm kit [15]</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>0.007</td><td></td><td>0.016</td><td>0.04</td></tr><tr><td>MER 27 & TEM 8 & Rosco confirm kit [13]</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>0.001</td><td></td><td>0.0001</td></tr><tr><td>IMI 24</td><td>0.02</td><td>0.003</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>&lt;0.0001</td><td>0.026</td><td>0.62</td><td>0.007</td><td>&lt;0.0001</td><td></td></tr></tbody></table>

TCC ticarcillin/clavulanate, TEM temocillin, MER meropenem, FEP cefepime, TAZ piperacillin/tazobactam, IMI imipenem, Clo Mueller-Hinton agar containing cloxacillin

ªtest applied only to Enterobacteriaceae chromosomally encoding Amp-C
<figure><img src="image_4.png" /><figcaption>**Fig. 1** Proposed strategy to screen carbapenemase-producing Enterobacteriaceae among ertapenem non-susceptible isolates</figcaption></figure>

≥25 mm, which is used as first screening criteria by the authors (Additional file 1: Figure S1).

The strategy proposed by Hrabak et al. [13], which combines temocillin <8 mm and the Rosco confirmatory test with regard to isolates selected on meropenem MIC ≥0.25 mg/L (i.e. estimated inhibition zone diameter <27 mm) [14] displayed a Se of 69.2% and a Sp of 95.3% in our collection of isolates. However, 65.6% of our isolates, including 12 of the 52 CPE, would not have been tested because they displayed a meropenem inhibition zone diameter ≥27 mm, which is used as first screening criteria by the authors (Additional file 1: Figure S1).

## Comparison of screening tests or strategies by using a likelihood-ratios graph

The overall performances of selected strategies were plotted on a LR graph (Fig. 2) taking as reference non-susceptibility to imipenem (<24 mm) because it is a widely used test. Numerous strategies fell in the B zone, indicating that they work better than imipenem <24 mm for eliminating non-CPE isolates.

Doripenem <24 mm fell into the C zone, indicating that it performs better than the reference for retaining CPE.

All other strategies fell into the A zone indicating that they perform better than NS to imipenem alone for both selecting CPE and eliminating non-CPE isolates. Among all latters, the best characteristics (LR+ and LR-) were for the combinations temocillin <15 mm + ticarcillin/clavulanate <15 mm + meropenem or imipenem <22 mm + meropenem <32 mm on MH-cloxacillin, and temocillin <15 mm + ticarcillin/

clavulanate <15 mm + meropenem or imipenem <22 mm and cefepime <26 mm + meropenem <32 mm on MH-cloxacillin. After full implementation, the two latter strategies retained a total of 120 (34.4%) or 115 (33.0%) putative CPE isolates for further carbapenemase confirmatory tests, respectively. Hence, the post-strategy CPE proportion reached 43.3 to 45.2% as compared to the 14.9% CPE pre-test proportion.

Better LR- (i.e. higher specificity) was reached for temocillin <12 mm + Rosco KPC-MBL confirm kit [15] and temocillin <8 mm + Rosco KPC-MBL confirm kit [13]. When applied on ertapenem NS isolates, these two strategies allowed for retaining less isolates (n = 50 and n = 52, respectively) for further testing than our strategies (n = 120 and n = 115) but missed from 16 (30.8%) to 23 (44.2%) of the 52 CPE.

Applying the most comprehensive strategy, i.e. temocillin <15 mm + ticarcillin/clavulanate <15 mm + meropenem or imipenem <22 mm and cefepime <26 mm + meropenem <32 mm on MH-cloxacillin to our population with an initial pre-test probability or CPE prevalence of 14.9%, a LR+ value of 4.65 (Table 2) will be translated into a positive post-test probability or positive predictive value (PPV) of 45% (Additional file 2: Table S1), and a LR- value of 0.01 into a negative post-test probability or negative predictive value (NPV) close to 100% (Additional file 2: Table S1).

## Inoculum size

After our study, EUCAST issued new guidelines for susceptibility testing, which recommends a larger inoculum
<figure><img src="image_5.png" /></figure>

size than the CA-SFM recommendations used for our study [16, 17]. This may question the validity of our strategies from now on. Hence, we compared inhibition zone diameters for temocillin and meropenem obtained by EUCAST and CA-SFM methods on all CPE and a sample of carbapenemase-negative isolates of our collection. The correlation between both methods was very high for both antibiotics and both groups of isolates (data not shown) and all CPE isolates were classified into the same groups by both methods when using the cut-offs of our strategies. Ticarcillin/clavulanate diameters were not assessed by using EUCAST recommendations, because all CPE isolates had diameters <15 mm by CA-SFM method, which implies that diameters will be similar or smaller with EUCAST larger inoculum size. In addition, Dortet et al. recently validated our algorithm by using the larger EUCAST inoculum and testing other carbapenemase-producing isolates [22].

## Discussion

Carbapenemase detection among carbapenem NSE is a major challenge in the routine laboratory. We designed screening strategies in order to retain 100% of carbapenemase-positive isolates while reaching the highest possible specificity by using the disc diffusion method. To reach our goal, we used data-driven cut-offs of diameter zones for commonly tested antibiotics including temocillin, and combined them to design an algorithm. Our strategies, which have been compared to those proposed by others using a similar approach [13–15], are shown to be highly relevant when sensitivity is the priority.

Our study and that of Huang et al. [14] are based on a collection of unselected isolates provided by a large panel of laboratories throughout the territory. Hence, reported performances are likely to be closed to those observed in the routine laboratory on the opposite to studies that used either very selected collections of isolates with sometimes undefined selection criteria or collections derived, for theoretical strategies, from heterogeneous publications and not tested in the routine laboratory [11, 13].

Our first strategy combining temocillin <15 mm + ticarcillin/clavulanate <15 mm + meropenem or imipenem <22 mm and cefepime <26 mm, was designed to be easily implemented in the routine laboratory and to screen isolates in a single step from the disc diffusion antibiogram at the same time as carbapenem non-susceptibility is identified. This strategy confirms the interest of temocillin combined to other tests in the screening of CPE [13–15]. However, we used a higher temocillin cut-off value, which was found to increase sensitivity. By using cefepime in this strategy, the specificity of the algorithm increased from 63 to 68.7%. Consequently, 58.5% of the total isolates were not retained for confirmatory tests as compared to 53.6% without cefepime. When validating our algorithm, the French reference centre for antibiotic resistance did not use cefepime [22]. Because of the large number of *Entero-bacter* spp sent to this reference centre, it is likely that the use of cefepime would help decreasing the number of isolates submitted to a confirmatory test. To further increase the specificity of our algorithm, we used imipenem or meropenem disks on MH containing cloxacillin. This takes an additional day, similarly to strategies proposed by others who used assays designed to detect carbapenemase production [13, 15]. Of note, this additional test allowed for eliminating 67% of the total of carbapenem NSE. As a result, almost one half (45%) of retained isolates submitted to confirmatory tests are carbapenemase positive. By increasing the proportion of CPE among carbapenem NSE, the positive predictive value of confirmatory tests will significantly be increased.

Our study has some weaknesses. First, our collection of isolates does not contain the less frequent
carbapenemases because isolates were prospectively and consecutively selected from routine laboratories. For instance, GES type enzymes are lacking, mainly because to date it has not been identified in France [23]. Nevertheless, the designed strategies we are likely to miss such isolates because ertapenem MIC towards GES-producing isolates are often lower than the chosen cut-off (MIC > 0.5 mg/L) [8, 24]. Similarly, for a few OXA-48-producing Enterobacteriaceae and notably *K. pneumoniae*, ertapenem MIC is ≤0.5 mg/L. Second, we chose to analyse a randomly selected sample of all carbapenem-NS *E. cloacae* collected during the study-period. Among those isolates, none was found to produce carbapenemase, and we were not able to challenge our screening strategies against carbapenemase-positive *E. cloacae*. However, the recent study of Dortet et al. proved that our algorithm applied in a reference centre did not miss any of the 19 carbapenemase-producing *Enterobacter* spp among the 214 *Enterobacter* spp isolates tested [22]. Third, the study was performed by voluntary laboratories, that, although rather numerous, may not be representative of all French laboratories. Finally, it should be noticed that since we performed our study, new or updated commercialized versions of carbapenem hydrolysis assays have been issued and should be further tested against our strategies [25, 26].

## Conclusions

In conclusion, our study proposes strategies to screen candidates for being CPE among a large panel of carbapenem-NS isolates. The advantages of these screening strategies are to reach 100% sensitivity by keeping a rather satisfactory specificity and to be applied in the routine laboratories directly from the disk diffusion method. The strategies should be considered as a tool for selecting isolates that will be further tested with more refined techniques such as PCR-based assays or assays based on the carbapenemase activity detection. For the latter, the advent of newer and cheaper versions of these assays should facilitate their use in most laboratories, mainly after screening. The proposed strategies will also help decreasing unnecessary implementation of isolation precautions in the hospital setting.

## Additional files

**Additional file 1: Figure S1.** Distribution of inhibition zone diameters for ticarcillin/clavulanate (A), piperacillin/tazobactam (B), cefepime (C), temocillin (D), imipenem (E), and meropenem (F). (JPG 87 kb)

**Additional file 2: Table S1.** Formulas to calculate post-test probabilities with positive and negative likelihood ratios (LR+ and LR-). (DOCX 11 kb)

### Abbreviations

CA-SFM: French committee on antibiotic susceptibility testing;
CPE: Carbapenemase-producing Enterobacteriaceae; ESBL: Extended-

spectrum beta-lactamase; EUCAST: European committee on antimicrobial susceptibility testing; LR: Likelihood ratio; MBL: Metallo-β-lactamase; MH: Mueller-Hinton agar medium; MH<sub>cloxa</sub>: Mueller-Hinton agar medium containing 250 mg/L cloxacillin; MIC: Minimal inhibitory concentration; NS: Non-susceptible; NSE: Non-susceptible Enterobacteriaceae; PCR: Polymerase chain reaction; Se: Sensitivity; Sp: Specificity

### Acknowledgements

**ONERBA's carbapenem resistance study group:** city (microbiologist)
Aix-en-Provence (N. Brieu), Angers (A. Vrain), Argenteuil (A. Scanvic), Aulnay-sous-Bois (H. Porcheret), Belfort-Montbéliard (P. Garnier), Besançon (X. Bertrand), Béthune (D. Descamps), Blois (C. Hombrouck), Bordeaux-HIA (B. Soulié), Boulogne-Billancourt (B. Heym), Boulogne-sur-Mer (JG. Paul), Bourg-en-Bresse (H. de Montclos), Bry-sur-Marne (H. Garrec), Chambéry (M. Levast), Charleville-Mézières (L. Mendes-Martins), Chateaubriant (M. Langeard), Clamart (J.W. Decousser), Cherbourg (C. Huet), Clichy (F. Bert), Colmar (V. Herzig), Commercy (JP. Klein), Créteil (B. Nebbad), Douai (S. Hendrix), Dunkerque (A. Verhaeghe), Epernay (C. Lafaurie), Freyming-Merlebach (C. Lanselle), Garches (F. Elsayed), Gonesse (A. Carrer), Ivry (L. Drieux-Rouzet), Le-Havre (F. Evreux), Le-Mans (C. Varache), Lille (F. Wallet), Limoges (C. Martin), Lorient (JM Le-Bris), Metz (MC. Moulhade), Mont-Saint-Martin (E. Deville), Montceau-les-Mines (O. Menouni), Montpellier-CHU (H. Jean-Pierre), Montpellier-OC-Biologie (P. Mion), Mulhouse-Diaconat (P. Pierrot), Mulhouse-CH E. Muller (JM. Delarbre), Nantes (B. Coude), Neufchâteau (M. Foca), Nice-Archet (N. Degand), Nice-Labazur (L. Prots), Nimes (A. Pantel), Orléans (L. Bret), Orsay (MN. Adam), Perpignan (E. Laurens), Paris-Lariboisière (L. Raskine), Paris-Pitié (S. Laouira), Paris-Tenon (G. Arlet), Perigueux (R. Sanchez), Pessac (O. Peuchant), Poitiers (V. Grau), Pointe-à-Pitre (J. Jaubert), Reichshoffen (C. Laurent), Reims (C. De-Champs), Roubaix (A. Vachée), Saint-Amand-Montrond (P. Harriau), Saint-Avoid (S. Schillinger), Saint-Denis Réunion (O. Belmonte), Saint-Dié-des-Vosges (G. Michel), Saint-Mandé (A. Mérens), Saint-Nicolas-de-Port (C. Henry), Saint-Omer (S. Samaille), Saint-Pierre Réunion (S. Picot), Saintes (J. Violette), Saverne (I. Glatz), Sète (A. Barrans), Strasbourg (T. Gueudet), Suresnes (P. Honderlick), Toulouse-CHU (L. Cavalié), Toulouse-Pasteur (JL. Galinier), Tourcoing (P. Patoz), Tours-CHU (N. van-der-Mee-Marquet), Tours-LABM-Arnaud (E. Haguenoer), Valenciennes (F. Canis), Villejuif (N. Kassis-Chikhany), Vitré (Y. Le-Garrec).

### Funding

This work was supported by the French Society for Microbiology (SFM, www.sfm-microbiologie.org).

### Availability of data and materials

Crude data are available by request to the corresponding author.

### Authors' contributions

AP and JPL carried out the molecular genetic studies, and drafted the manuscript. EM and AM carried out the MIC study and the antibiotic susceptibility testing. EM and MHN participated in the molecular genetic studies. AM and JPL participated in the design of the study. JR and MHN conceived of the study, and participated in its design and coordination, and drafted the manuscript. JR performed the statistical analysis. All authors read and approved the final manuscript.

### Competing interests

The authors declare that they have no competing interests.

### Consent for publication

Not applicable.

### Ethics approval

Isolates were collected as part of standard patient care and no personal data identifiers were collected regarding the patients. As a consequence, ethical approval was not required.

### Author details

¹Sorbonne Universités, UPMC Univ Paris 06, INSERM, U1135, Centre d'Immunologie et des Maladies Infectieuses (CIMI), Eq 13, F-75013 Paris, France. ²Bactériologie-Hygiène, Hôpitaux Universitaires Pitié Salpêtrière - Charles Foix, APHP, F-75013 Paris, France. ³INSERM U1047, UFR de Médecine, Université Montpellier 1, Nîmes, France. ⁴Service de Microbiologie, CHU
Carémeau, Nîmes, France. ⁵Laboratoire de biologie, Hôpital d'Instruction des Armées Bégin, Saint- Mandé, France. ⁶Service de Microbiologie, Hôpital Beaujon AP-HP, Clichy, France. ⁷Faculté de Médecine D. Diderot - Paris 7, Paris, France. ⁸INSERM UMR 1137, Université Paris 7, Paris, France.

Received: 5 February 2016 Accepted: 27 December 2016

Published online: 17 January 2017

## References

1. Carmeli Y, Akova M, Cornaglia G, Daikos GL, Garau J, Harbarth S, et al. Controlling the spread of carbapenemase-producing Gram-negatives: therapeutic approach and infection control. Clin Microbiol Infect. 2010;16: 102–11.

2. Fournier S, Monteil C, Lep painteur M, Richard C, Brun-Buisson C, Jarlier V, Ap- Hp Outbreaks Control Group C. Long-term control of carbapenemase- producing Enterobacteriaceae at the scale of a large French multihospital institution: a nine-year experience, France, 2004 to 2012. Euro Surveill. 2014; 19:20802.

3. Huang T-D, Berhin C, Bogaerts P, Glupczynski Y. Prevalence and mechanisms of resistance to carbapenems in Enterobacteriaceae isolates from 24 hospitals in Belgium. J Antimicrob Chemother. 2013;68:1832–7.

4. Lee EH, Nicolas MH, Kitzis MD, Pialoux G, Collatz E, Gutmann L. Association of two resistance mechanisms in a clinical isolate of *Enterobacter cloacae* with high-level resistance to imipenem. Antimicrob Agents Chemother. 1991;35:1093–8.

5. Robert J, Pantel A, Mérens A, Lavigne J-P, Nicolas-Chanoine M-H. Incidence rates of carbapenemase-producing Enterobacteriaceae clinical isolates in France: a prospective nationwide study in 2011–12. J Antimicrob Chemother. 2014;69:2706–12.

6. Tenover FC, Canton R, Kop J, Chan R, Ryan J, Weir F, et al. Detection of colonization by carbapenemase-producing Gram-negative Bacilli in patients by use of the Xpert MDRO assay. J Clin Microbiol. 2013;51:3780–7.

7. Knox J, Jadhav S, Sevior D, Agyekum A, Whipp M, Waring L, et al. Phenotypic detection of carbapenemase-producing Enterobacteriaceae using MALDI-TOF MS and the Carba NP test. J Clin Microbiol. 2014;52: 4075–7.

8. Osterblad M, Hakanen AJ, Jalava J. Evaluation of the Carba NP test for carbapenemase detection. Antimicrob Agents Chemother. 2014;58:7553–6.

9. Osei Sekyere J, Govinden U, Essack SY. Review of established and innovative detection methods for carbapenemase-producing Gram-negative bacteria. J Appl Microbiol. 2015;119:1219–33.

10. Cohen Stuart J, Leverstein-Van Hall MA. Guideline for phenotypic screening and confirmation of carbapenemases in Enterobacteriaceae. Int J Antimicrob Agents. 2010;36:205–10.

11. Dortet L, Bréchard L, Cuzon G, Poirel L, Nordmann P. Strategy for a rapid detection of carbapenemase-producing Enterobacteriaceae. Antimicrob Agents Chemother. 2014;58:2441–5.

12. Doyle D, Peirano G, Lascols C, Lloyd T, Church DL, Pitout JDD. Laboratory detection of Enterobacteriaceae that produce carbapenemases. J Clin Microbiol. 2012;50:3877–80.

13. Hrabák J, Chudáčková E, Papagiannisis CC. Detection of carbapenemases in Enterobacteriaceae: a challenge for diagnostic microbiological laboratories. Clin Microbiol Infect. 2014;20:839–53.

14. Huang T-D, Poirel L, Bogaerts P, Berhin C, Nordmann P, Glupczynski Y. Temocillin and piperacillin/tazobactam resistance by disc diffusion as antimicrobial surrogate markers for the detection of carbapenemase- producing Enterobacteriaceae in geographical areas with a high prevalence of OXA-48 producers. J Antimicrob Chemother. 2014;69:445–50.

15. van Dijk K, Voets GM, Scharringa J, Voskuil S, Fluit AC, Rottier WC, et al. A disc diffusion assay for detection of class A, B and OXA-48 carbapenemases in Enterobacteriaceae using phenyl boronic acid, dipicolinic acid and temocillin. Clin Microbiol Infect. 2014;20:345–9.

16. European Committee for Antimicrobial Susceptibility Testing (EUCAST) of the European Society of Clinical Microbiology and Infectious Diseases (ESCMID). Determination of minimum inhibitory concentrations (MICs) of antibacterial agents by broth dilution. Clin Microbiol Infect. 2003;9:ix–xv.

17. Comité de l'antibiogramme de la Société Française de Microbiologie - recommandations 2011. http://www.sfm-microbiologie.org/UserFiles/files/ casfm/casfm_2011.pdf. Accessed 10 July 2017.

18. Woodford N, Pike R, Meunier D, Loy R, Hill R, Hopkins KL. In vitro activity of temocillin against multidrug-resistant clinical isolates of *Escherichia coli*,

*Klebsiella* spp. and *Enterobacter* spp., and evaluation of high-level temocillin resistance as a diagnostic marker for OXA-48 carbapenemase. J Antimicrob Chemother. 2014;69:564–7.

19. Caraguel CGB, Vanderstichel R. The two-step Fagan's nomogram: ad hoc interpretation of a diagnostic test result without calculation. Evid Based Med. 2013;18:125–8.

20. Garrec H, Drieux-Rouzet L, Golmard J-L, Jarlier V, Robert J. Comparison of nine phenotypic methods for detection of Extended-spectrum β-lactamase production by Enterobacteriaceae. J Clin Microbiol. 2011;49:1048–57.

21. Biggerstaff BJ. Comparing diagnostic tests: a simple graphic using likelihood ratios. Stat Med. 2000;19:649–63.

22. Dortet L, Cuzon G, Plésiat P, Naas T. Prospective evaluation of an algorithm for the phenotypic screening of carbapenemase-producing Enterobacteriaceae. J Antimicrob Chemother. 2016;71:135–40.

23. Dortet L, Cuzon G, Nordmann P. Dissemination of carbapenemase- producing Enterobacteriaceae in France, 2012. J Antimicrob Chemother. 2014;69:623–7.

24. Picão RC, Santos AF, Nicoletti AG, Furtado GH, Gales AC. Detection of GES-5- producing *Klebsiella pneumoniae* in Brazil. J Antimicrob Chemother. 2010;65: 796–7.

25. Poirel L, Nordmann P. Rapidec Carba NP test for rapid detection of carbapenemase producers. J Clin Microbiol. 2015;53:3003–8.

26. Pasteran F, Veliz O, Ceriana P, Lucero C, Rapoport M, Albornoz E, Gomez S, Corso A. Evaluation of the Blue-Carba test for rapid detection of carbapenemases in gram-negative bacilli. J Clin Microbiol. 2015;53:1996–8.

Submit your next manuscript to BioMed Central and we will help you at every step:

* We accept pre-submission inquiries

* Our selector tool helps you to find the most relevant journal

* We provide round the clock customer support

* Convenient online submission

* Thorough peer review

* Inclusion in PubMed and all major indexing services

* Maximum visibility for your research

Submit your manuscript at
www.biomedcentral.com/submit

BioMed Central