# Effectiveness and Acceptance of Multimodal Antibiotic Stewardship Program: Considering Progressive Implementation and Complementary Strategies

Flavien Bouchet, Vincent Le Moing, Delphine Dirand, François Cros, Alexi Lienard, Jacques Reynes, Laurent Giraudon, David Morquin

<figure><img src="image_1.png" /></figure>

## To cite this version:

Flavien Bouchet, Vincent Le Moing, Delphine Dirand, François Cros, Alexi Lienard, et al.. Effectiveness and Acceptance of Multimodal Antibiotic Stewardship Program: Considering Progressive Implementation and Complementary Strategies. Antibiotics, 2020, 9 (12), pp.848. 10.3390/antibiotics9120848. [hal-03222759](https://hal-umontpellier.fr/hal-03222759)

HAL Id: hal-03222759

https://hal.umontpellier.fr/hal-03222759

Submitted on 25 May 2021

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_3.png" /></figure>

Article

# Effectiveness and Acceptance of Multimodal Antibiotic Stewardship Program: Considering Progressive Implementation and Complementary Strategies

Flavien Bouchet<sup>1,2,*</sup>, Vincent Le Moing<sup>1</sup>, Delphine Dirand<sup>2</sup>, François Cros<sup>3</sup>, Alexi Lienard<sup>4</sup>, Jacques Reynes<sup>1</sup>, Laurent Giraudon<sup>2</sup> and David Morquin<sup>1</sup>

Received: 31 October 2020; Accepted: 25 November 2020; Published: 27 November 2020

<figure><img src="image_4.png" /></figure>

check for
updates

**Abstract:** Multiple modes of interventions are available when implementing an antibiotic stewardship program (ASP), however, their complementarity has not yet been assessed. In a 938-bed hospital, we sequentially implemented four combined modes of interventions over one year, centralized by one infectious diseases specialist (IDS): (1) on-request infectious diseases specialist consulting service (IDSCS), (2) participation in intensive care unit meetings, (3) IDS intervention triggered by microbiological laboratory meetings, and (4) IDS intervention triggered by pharmacist alert. We assessed the complementarity of the different cumulative actions through quantitative and qualitative analysis of all interventions traced in the electronic medical record. We observed a quantitative and qualitative complementarity between interventions directly correlating to a decrease in antibiotic use. Quantitatively, the number of interventions has doubled after implementation of IDS intervention triggered by pharmacist alert. Qualitatively, these kinds of interventions led mainly to de-escalation or stopping of antibiotic therapy (63%) as opposed to on-request IDSCS (32%). An overall decrease of 14.6% in antibiotic use was observed (p = 0.03). Progressive implementation of the different interventions showed a concrete complementarity of these actions. Combined actions in ASPs could lead to a significant decrease in antibiotic use, especially regarding critical antibiotic prescriptions, while being well accepted by prescribers.

**Keywords:** antibiotic stewardship program; complementarity; prospective audit and feedback

## 1. Introduction

In 2015 in Europe, 671,689 cases of infections with antibiotic-resistant bacteria features occurred, leading to 33,110 deaths, corresponding to 6.44 deaths per 100,000 population and 874,541 disability adjusted life-years (DALYs) [1]. Without any practical measures, the current state could worsen exponentially with 390,000 deaths every year expected in Europe by 2050. Moreover, this concerning healthcare issue also represents a dramatic economic burden; that is, if the antibiotic-resistant bacteria infection rate remains at the same level as today, this could lead to a loss of 100 trillion of USD

<footnote n="1">¹ Service de Maladies Infectieuses et Tropicales, Centre Hospitalier Universitaire de Montpellier, Université de Montpellier, 34000 Montpellier, France; v-le_moing@chu-montpellier.fr (V.L.M.); j-reynes@chu-montpellier.fr (J.R.); d-morquin@chu-montpellier.fr (D.M.)</footnote>

<footnote n="2">² Pôle Appui aux Fonctions Cliniques, Département de la Pharmacie, Hôpitaux du Bassin de Thau, 34200 Sète, France; ddirand@ch-bassindethau.fr (D.D.); lgiraudon@ch-bassindethau.fr (L.G.)</footnote>

<footnote n="3">³ Département Informatique, Hôpitaux du Bassin de Thau, 34200 Sète, France; fcros@ch-bassindethau.fr</footnote>

<footnote n="4">⁴ Département de Biologie Médicale, Hôpitaux du Bassin de Thau, 34200 Sète, France; alienard@ch-bassindethau.fr</footnote>

<footnote>* Correspondence: fbouchet@ch-bassindethau.fr</footnote>
worldwide [2,3]. Implementing antibiotic stewardship programs (ASPs) in hospitals is a major way to improve this issue [4–7]. Many studies have shown the positive impact of antibiotic stewardship programs (ASPs) on antibiotic use and antibiotic resistance, improvement of morbidity and mortality, reduction of *Clostridium difficile* infections incidence, and health costs savings [7–13]. One of the key points of ASP success is to gather a multidisciplinary team including pharmacists, microbiologists, and infectious diseases physicians with a specific time dedicated to this task [5,14,15].

Nowadays, cross-disciplinary medical project funding is limited by the current economic healthcare situation. Despite many warnings from French and European infectious diseases societies about the crucial need for ASPs, raising funds and dedicating time to implement these strategies are still difficult, especially when the short-term economic benefit is not obvious [16–18].

In France, ASPs are not fully implemented and the current system relies on supporting prescribers mainly through training and on-request infectious diseases specialist consulting [19]. Training may be a key point to improve antibiotics prescription, yet a recent multicenter web-based survey brings to light that most final-year European medical students feel they still need more education on antibiotic use for their future practice as junior doctors [20]. In this context, the association of the improvement of medical student training and a more interventionist strategy including microbiological laboratory alerts and prospective audit and feedback (PAF) interventions, such as prescription review with assistance by pharmacists, could be useful [6,21,22]. Indeed, PAF allows clinicians to prescribe any empiric antibiotic regimen, then the ASP can advise the clinician on discontinuing or adjusting therapy after prescription analysis. Although feedback further increased the intervention effect, it is used in only a minority of enabling interventions, as shown in a Cochrane meta-analysis [23]. This study raises the need for new studies to assess different stewardship interventions and to explore the facilitators to implementation.

Indeed, the practical way to link together these interventions is not clear and neither the complementarity of these actions nor the acceptance of physicians towards unsolicited advice have yet been evaluated. Based on recent publications [24–27], we progressively implemented an innovative multimodal ASP in 2018 in a secondary care hospital. The aim of this study was to evaluate the complementarity of different interventions in an ASP and the impact on antibiotic use. We also analyzed the impact on mean of length of stay (LOS), 30-day readmission rate (30-DRR), and mortality. Prescribers’ acceptance was also assessed in the perspective of long-term system development.

## 2. Results

### 2.1. *Interventions Complementarity*

Over the entire analysis period, 7508 stays involved the administration of antibiotic therapy, of which 1316 received an intervention. At least one intervention was carried out for 1430 stays, corresponding to 2046 interventions noted in the electronic medical records (EMRs) (Figure 1).

<figure><img src="image_5.png" /><figcaption>**Figure 1.** Interventions’ distribution. Distribution of the 2046 interventions noted in the electronic patient record related to 1430 hospital stays and 1243 patients. Abbreviations: ICU, intensive care unit; IDSCS, infectious diseases specialist consulting service.</figcaption></figure>
The overall acceptance rate for the proposals was 88%, with a variation according to intervention types ranging from 68 to 92% (Figure 2). The distribution analysis of intervention-types normalized to working days on site highlights a true complementarity between interventions (Figure 3). In summary, the implementation of PAF interventions in a second phase widens the ASP field of action without impacting other types of intervention.

<figure><img src="image_6.png" /><figcaption>**Figure 2.** Compliance depending on intervention type. Compliance rate of the 2046 interventions noted in electronic patient record. Abbreviations: ICU, intensive care unit; IDSCS, infectious diseases specialist consulting service; N = number of interventions.</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>**Figure 3.** Interventions' distribution per working days. Dotted lines represent initiation of prospective audit and feedback interventions in association with pharmacy unit members (critical antibiotics prescription review and longer than 7 days antibiotic prescription review, respectively). Abbreviations: ICU, intensive care unit; IDSCS, infectious diseases specialist consulting service.</figcaption></figure>

This complementarity is also illustrated when comparing advice type according to different kinds of interventions. Regarding IDSCS interventions, 341 of 1053 interventions (32%) were either a lack of antibiotic initiation, a therapeutic de-escalation, a cessation of all antibiotics, or a reduction in treatment duration with a 92% acceptance rate. On the other hand, 535 proposals (51%) were either a therapeutic escalation or an extension of antibiotic therapy with a 92% acceptance rate.
Of the 501 proposals made during PHARM-cATB interventions, 316 (63%) were either a therapeutic de-escalation, a cessation of all antibiotics, or a reduction in the duration of treatment with a 76% acceptance rate. Only 69 proposals (14%) consisted of a therapeutic escalation or an extension of antibiotic therapy with an 84% acceptance rate (Figure 4).

<figure><img src="image_8.png" /><figcaption>**Figure 4.** Advice type according to different kind of interventions. Distribution of the 2046 interventions noted in the electronic patient record related to 1430 hospital stays and rate of propositions according to different kind of interventions. N = number of interventions. IDSCS = infectious diseases specialist consulting service.</figcaption></figure>

## 2.2. Impact on Mortality, 30-Day Readmission Rate, and Mean Length of Stay

There were 3561 inpatients with deep infections hospitalized in the eight wards who benefited from the whole ASP from January 2016 to May 2017 versus 3839 from January 2018 to May 2019. The clinical and demographic characteristics of these patients are summarized in Table 1. There was a downward trend in the mean LOS in patients with deep infections, from an LOS of 11.03 days before the implementation of the system to a LOS of 10.44 days after implementation, but this difference was not statistically significant (p = 0.096). Nor was there any significant difference regarding in-hospital mortality in patients with deep infections (267 (7.31%) versus 266 (6.9%); p = 0.37) or 30-DRR (8.2% (293) versus 7.7% (296) in 2019, p = 0.44).
<table><caption>**Table 1.** Demographic characteristics and pre-existing medical conditions of patients with a diagnosis of deep infection before and after implementation of the antibiotic stewardship program in the eight wards that benefited from all types of interventions.</caption><thead><tr><th></th><th>Before Implementation<br>1/1/2016 to 31/5/2017</th><th>After Implementation<br>1/1/2018 to 31/5/2019</th><th>p-Value</th></tr></thead><tbody><tr><td>Number of stays</td><td>3561</td><td>3839</td><td></td></tr><tr><td>Gender</td><td></td><td></td><td></td></tr><tr><td>Female</td><td>1646 (46%)</td><td>1848 (48%)</td><td></td></tr><tr><td>Male</td><td>1915 (54%)</td><td>1991 (52%)</td><td></td></tr><tr><td>Age (years)</td><td></td><td></td><td></td></tr><tr><td>Mean (Min–Max)</td><td>73.13 (17–108)</td><td>73.30 (17–103)</td><td></td></tr><tr><td>ICU stays</td><td>600 (17%)</td><td>567 (15%)</td><td>0.015</td></tr><tr><td>Pre-existing medical conditions</td><td></td><td></td><td></td></tr><tr><td>Solid organ transplant</td><td>7 (0.2%)</td><td>14 (0.4%)</td><td>0.25</td></tr><tr><td>Immunomodulatory therapy</td><td>1 (0.03%)</td><td>9 (0.2%)</td><td>0.036</td></tr><tr><td>End stages renal disease (IV–V)</td><td>30 (0.8%)</td><td>72 (1.9%)</td><td>0.0002</td></tr><tr><td>Chronic liver disease</td><td>47 (1.3%)</td><td>39 (1%)</td><td>0.27</td></tr><tr><td>Chronic respiratory failure</td><td>187 (5.3%)</td><td>250 (6.5%)</td><td>0.025</td></tr><tr><td>Agranulocytosis</td><td>10 (0.3%)</td><td>15 (0.4%)</td><td>0.54</td></tr><tr><td>Chemotherapy during the stay</td><td>2 (0.06%)</td><td>9 (0.2%)</td><td>0.09</td></tr><tr><td>Diabetes</td><td>724 (20%)</td><td>874 (23%)</td><td>0.01</td></tr><tr><td>HIV</td><td>33 (0.9%)</td><td>24 (0.6%)</td><td>0.18</td></tr><tr><td>Infection types</td><td></td><td></td><td></td></tr><tr><td>Pyelonephritis</td><td>1124</td><td>1013</td><td></td></tr><tr><td>Intra-abdominal infections</td><td>651</td><td>673</td><td></td></tr><tr><td>Cellulitis and skin abscess</td><td>233</td><td>253</td><td></td></tr><tr><td>Meningitis</td><td>5</td><td>7</td><td></td></tr><tr><td>Endocarditis</td><td>9</td><td>10</td><td></td></tr><tr><td>Pulmonary infection</td><td>1834</td><td>1809</td><td></td></tr><tr><td>Osteomyelitis and prosthetic joint infection</td><td>62</td><td>70</td><td></td></tr></tbody></table>

Results are presented as No (and rate %). All patients with a diagnosis of deep infection regarding the International Classification of Diseases were included. Abbreviation: HIV, human immunodeficiency virus; ICU, intensive care unit.

## 2.3. Impact on Antibiotic Consumption

Overall, antibiotic use was significantly decreased by 14.6% in the whole hospital after ASP implementation (336 daily dose of antibiotics per 1000 patient-days (DDD₁₀₀₀PD) in 2017 versus 287 DDD₁₀₀₀PD in 2019; *p* = 0.03). Carbapenems use was moderate and stable over time (from 5 DDD₁₀₀₀PD in 2017 to 4 DDD₁₀₀₀PD in 2019; *p* = 0.82). A slight increase in injectable third-generation cephalosporins use was observed (from 53 DDD₁₀₀₀PD in 2017 to 60 DDD₁₀₀₀PD in 2019; *p* = 0.12). There was a significant decrease of fluoroquinolones use of 63% (51 DDD₁₀₀₀PD in 2017 versus 19 DDD₁₀₀₀PD in 2019; *p* = 0.03) (Figure 5). We also observed a significant decrease in overall antibiotic use for the eight departments included in PAF interventions from 543 DDD₁₀₀₀PD in 2017 versus 474 DDD₁₀₀₀PD in 2019 (*p* = 0.016). Moreover, the reduction in fluoroquinolones use was more noticeable between April and December 2018 (60 DDD₁₀₀₀PD versus 34 DDD₁₀₀₀PD, respectively). This decrease continued until the end of the analysis. An effect on carbapenems use took longer to appear, but a clear decrease was observed from January to June 2019 (13 DDD₁₀₀₀PD versus 7 DDD₁₀₀₀PD, respectively) (Figure 6).
<figure><img src="image_9.png" /><figcaption>**Figure 5.** Evolution over time of antibiotic consumption in secondary care hospital of Bassin de Thau. Data are presented as defined daily dose of antibiotics per 1000 patient-days (DDD₁₀₀PD).</figcaption></figure>

<figure><img src="image_10.png" /><figcaption>**Figure 6.** Evolution over time of antibiotic consumption in the eight units that tested the prospective audit and feedback intervention (antibiotics prescription review). Dotted lines represent initiation of critical antibiotics review in association with pharmacy unit members. Data are presented as defined daily dose of antibiotics per 1000 patient-days.</figcaption></figure>
## 2.4. User Experience Assessment: Satisfaction Survey

Ninety-five physicians that participated in the ASP were surveyed for satisfaction, of which 49 responded. All physicians were satisfied with the dedicated phone line provided and wanted on-request IDSCS to be continued, as well as LAB-M interventions. Regarding PAF actions, only 2/32 physicians were not satisfied with this kind of intervention and did not wish for it to be carried on. All results are summarized in Supplementary Table S1.

## 3. Discussion

We demonstrated that implementation of a whole ASP combining solicited and unsolicited interventions is possible and that the different modes of intervention are complementary. The multimodal ASP implemented in the hospital of Bassin de Thau (HBT) led to a decrease of antibiotic use, especially fluoroquinolones, without impacting deep infection mortality. We also observed a slightly decreased trend in the length of hospital stay in these patients.

Many ASP strategies have already shown their efficacy; for example, development and implementation of facility-specific clinical practice guidelines for common infectious diseases syndromes, IDS systematic referral for *Staphylococcus aureus* bacteremia clinical cases, PAF, preprescription authorization for certain antibiotics, specific interventions depending on infection type or clinical department, microbiological laboratory interventions, and so on [10, 11, 24, 28, 29]. To the best of our knowledge, our study is the first to evaluate the potential synergy between different kinds of actions. Our main contribution is to demonstrate that multimodal interventions are synergic. Indeed, opposite to former studies evaluating the impact of specific different antibiotic stewardship interventions, our global approach highlighted the complementarity of each intervention in the success of the holistic ASP. It is noteworthy that this study was set up in the French healthcare system where interfering methods are not developed [19]. Thanks to the progressive implementation of this system, we were able to highlight the complementarity of the interventions. Indeed, the on-request IDSCS, LAB-M, and ICU-M interventions number was stable overtime, even after implementation of PAF strategies, i.e., PHARM-cATB and PHARM-7d review. This highlights a cumulative effect between the different modes of intervention, suggesting that each kind of intervention responded to a specific type of problem. Indeed, on-request IDSCS led to escalation or lengthening of antibiotic therapy in more than 50% of cases, while PHARM-cATB resulted in escalation or lengthening in only 14%. Conversely, PHARM-cATB reviews resulted in de-escalation, stopping, or shortening of antibiotic therapy in 60% of cases. This proportion was even higher within PHARM-7d review. Thus, the different modes of intervention were complementary, both qualitatively and quantitatively.

Antibiotic use analysis also revealed the same pattern. Interestingly, the decreased consumption accelerated after implementation of PAF methods, suggesting a stronger impact of interfering methods on overall antibiotic use. Similar results were found by Tamma et al., whose study highlighted the effectiveness of this method and its major impact on antibiotic use in a cross-over trial [30]. According to these results, a recent retrospective study analyzed the impact of interventionist strategies as PAF or preprescription authorization on fluoroquinolone consumption in 48 U.S. hospitals [31]. Fluoroquinolone use was significantly decreased by 26% over two years between establishment with ASP targeting fluoroquinolone and those with no ASP.

We did not find evidence of any statistically significant differences on mean LOS, 30-DRR, or mortality between the two periods. However, we observed a downward trend in the mean LOS with a decrease of 0.6 days of hospitalization per stay. Indeed, the reduction in antibiotic consumption, particularly intravenous antibiotics, might lead to a reduction in adverse effects and an earlier discharge of patients. The absence of statistical significance might be because of a lack of power for this criteria; however, it was not the primary endpoint of this study. In the literature, some arguments tend to confirm this hypothesis: Sasikumar et al. showed a significant impact of IDS interventions on mortality and medical stay costs, especially for ICU stays [32]. Although there was no significant positive impact on mortality, 30-DRR, and mean LOS in our study, we did not observe any negative impact on
patients' clinical outcomes. Moreover, the high prevalence of patients with chronic respiratory failure, end-stages renal diseases, immunosuppression, and diabetes in the second analysis period could lead to an underestimation of the potential positive impact of our ASP on these outcomes.

These data highlight the importance of using a multimodal strategy when setting up an ASP, keeping in mind that different interventions would respond to different needs. The 2016 IDSA guidelines emphasized PAF and preprescription authorization methods, while underlining the potential for better acceptance of PAF as prescriber autonomy is maintained [24]. In our study, the acceptance rate of PAF intervention was high (79%), despite the fact that unsolicited specialist consulting is not culturally ingrained into the French medical community. Most physicians interviewed in the satisfaction survey agreed that on-request IDSCS and LAB-M actions were improving clinical outcomes and should be continued, whereas only two physicians viewed unsolicited interventions as intrusive to their practice and were reluctant to maintain these methods. PAF acceptance was probably better than expected thanks to its implementation over a second phase of the program, whereas more conventional methods, i.e., on-request IDSCS and LAB-M, were already set up. So, sequential implementation can be identified as a facilitator regarding acceptance of interventionist methods. These results reinforce IDSA recommendations to develop and promote PAF strategies.

We show that they may be implemented within French hospitals considering their efficiency and their complementarity to other methods. It is important to note that, without an EMR, it is challenging to set up such a program with unsolicited interventions.

Nevertheless, this kind of program is time-consuming and labor-intensive; indeed, PAF interventions represented 10 h of work per week for one IDS and one pharmacist, while LAB-M interventions counted for 5 h of work, without including intervention retranscription in the electronic patient record (about 30 min for each intervention, i.e., 25 h weekly). This organization requires dedicated medical time for this activity, as recommended by European Society of Clinical Microbiology and Infectious Diseases (ESCMID) [26].

There are limitations to our study. The impact on antibiotic resistance was not assessed because of the short-term study design. This key outcome will be analyzed after several years of operating under the program in order to compare antimicrobial resistance before and after implementation of this system. Our study did not include medico-economic analysis. Nevertheless, the 0.6 days of stay decrease for inpatients with ID diagnosis would allow some healthcare cost saving, despite this result not being statistically significant. We were also not able to set up, in parallel to our ASP, an educational program that could lead to improved practitioner adherence as well as antibiotics prescribing over the long term [33]. Indeed, in a recent Spanish study, the quality of antimicrobial prescribing improved markedly, and the inappropriate treatment rate was significantly lower over 3 years thanks to regular educational interviews [34]. In addition, we could not evaluate antibiotic prescription at the discharge because of the lack of computerization. Indeed, Vaughn et al. recently highlight that hospital-based stewardship interventions did not affect antibiotic prescription at the discharge [31]. In this study, 14/48 hospitals reported using pre-prescription approval and/or PAF to target fluoroquinolone prescriptions, but hospitals with fluoroquinolone stewardship had twice as many new fluoroquinolone starts after discharge as hospitals without. Weber et al. analyzed discharge prescriptions in a 576-bed academic hospital in Portland. Among 6701 discharges, 22.9% were prescribed antibiotics upon discharge [35]. To complete these data, Scarpato et al. analyzed the appropriateness of antimicrobial agents prescribed on discharge [36]. They found that 70% of discharge antibiotics were inappropriate in antibiotic drug choice, dose, or duration. Analysis of discharge prescriptions should be the next step of our ASP with the implementation of an educational program to improve the prescription of discharge antibiotics. Moreover, there are biases inherent to the design of our study. Indeed, as for many “before-after” studies, the two groups we compared are heterogeneous. However, we found more pre-existing medical conditions for patients in the period after implementation of our ASP; therefore, this might lead to underestimation of the impact on the mean LOS downward trend we observed.
Finally, there was a center's effect limiting the extrapolation of our results as our study took place in a small hospital with less than 300 beds for the medicine, surgery, and obstetrics departments. The small hospital size likely facilitated the rapid establishment of this multidisciplinary system. One of the reasons of our success is probably the direct and confident relationship established between the IDS, the pharmacist, the microbiologist, and the prescribers, which may not be possible to install in other settings. Additional multicentric studies are needed to confirm our results and go further.

# 4. Materials and Methods

## 4.1. Study Setting and Interventions

Two hospitals (secondary care hospital of Bassin de Thau (HBT) and university hospital of Montpellier (UHM)) created a shared infectious disease specialist (IDS) position to sequentially implement an innovative multimodal ASP within HBT. The HBT is a 938-bed hospital with establishments providing care for dependent elderly people (376 beds); psychiatric unit (57 beds); geriatric and follow-up care and rehabilitation unit (167 beds); and acute care unit, medicine, surgery, and obstetrics unit (274 beds). On the whole, 406 beds are provided with an electronic medical record (EMR).

The infectious disease EMR pattern was duplicated from UHM to HBT to allow IDS response in real time with a complete traceability in the patient EMR for each intervention [37].

Several interventions centralized by the same IDS were progressively implemented:

January 2018: Simultaneous implementation of (i) a dedicated phone line for the infectious diseases specialist consulting service (IDSCS), (ii) weekly intensive care unit multidisciplinary clinical team meetings (ICU-M), and (iii) IDS intervention triggered by a bi-weekly microbiological laboratory meeting (LAB-M) for the revision of antibiotics based on microbiological data (blood cultures, per-operative samples, lumbar, pleural, and joint punctures). In addition, monthly educational training on antibiotic use was proposed to all residents of the hospital.

April to December 2018: Establishment of PAF interventions in association with pharmacy unit members. Initiation of critical antibiotics prescription review (PHARM-cATB) in April 2018. This consists of a systematized analysis of critical antibiotics prescription (injectable third-generation cephalosporins, fluoroquinolones (FQ), and carbapenems) performed twice a week within the eight wards with the greatest antibiotics use, with feedback to the prescriber.

Initiation of longer than 7 days antibiotics prescription review (PHARM-7d) in December 2018. A systematized analysis was performed on the whole hospital with feedback to the prescriber.

Each intervention was noted in the EMR in real time and was analyzed to evaluate intervention acceptance. An intervention was defined as having been followed if the proposed antibiotic type, duration, and dosage were accepted by the prescribing physician. The whole system organization is summarized in Figure 7.

## 4.2. Outcomes

The complementarity of the different actions was assessed by the quantitative and qualitative analysis of all interventions traced in the EMR (number of different types of interventions over time, analysis of proposal for each intervention, and impact of interventions on antibiotic use). Antibiotic consumption, defined in daily dose of antibiotics per 1000 patient-days (DDD₁₀₀PD), was calculated with ConsoRes® software [38] for the years 2016–2019 in the whole hospital. The impact on mean LOS, 30-DRR, and in-hospital mortality was assessed on patients with deep infections from the eight wards (medicine, surgery, and intensive care unit) representing 274 acute care beds that benefited from all the interventions of ASP by comparing two groups of patients over two periods of 18 months: January 2016–May 2017 versus January 2018–May 2019. All patients who were diagnosed with deep infections based on the International Classification of Diseases, Information System Medicalization Program were included in this comparison.
<figure><img src="image_11.png" /><figcaption>**Figure 7.** Antibiotic stewardship program organization in the studied hospital when fully established in December 2018. Dotted lines represent pre-existent relationship before implementation of the antibiotic stewardship program. On request IDSCS: on request infectious diseases specialist consulting service via a dedicated phone line. ICU-M: intensive care unit multidisciplinary clinical team meetings for weekly antibiotics prescription review in the ward. LAB-M: microbiological laboratory meetings for bi-weekly analysis of microbiological samples with microbiologists and infectious diseases specialist. PHARM-cATB: critical antibiotics prescription review twice a week with pharmacist and infectious diseases specialist. PHARM-7d: longer than 7 days antibiotic prescriptions review twice a week with pharmacist and infectious diseases specialist. EMR: electronic medical records. ICU: intensive care unit.</figcaption></figure>

### 4.3. User Experience Assessment

An anonymous satisfaction survey was sent after 12 months of implementation of the system to all clinicians, followed by two reminder letters.

### 4.4. Statistical Approach

Comparisons between the two periods were made using a $\chi^2$ test for qualitative variables. Comparisons between the two periods were performed using a $\chi^2$ test for mortality and readmission rate, a Mann-Whitney U test for the mean LOS, and a linear regression test to analyze antibiotic consumption.

### 4.5. Ethics

This study was conducted according to the principles of the declaration of Helsinki and in compliance with International Conference on Harmonization/Good Clinical Practice regulations. According to the French law, the study was in accordance with the recommendations of the local ethics committee, without the need for consent.

## 5. Conclusions

This study is among the first to analyze the complementarity and impact of combining different strategies, especially interventionist methods, developed within ASPs. This system set up with reasonable human resources could easily be transposable to size-equivalent hospitals. A good acceptance rate of PAF interventions and clear complementarity of the different types of actions,
leading to a major decrease in fluoroquinolones use and overall antibiotic use, without a negative impact on mortality or 30-DRR, are key points of this study.

Further studies are needed to strengthen the scope of our results, including multidisciplinary and educational programs; long-stay healthcare structures; analysis of discharge prescriptions; and giving a more important role to PAF interventions, which currently are likely not sufficiently developed [39,40]. As this type of system is probably cost-effective, the economic aspect should not be an obstacle to its implementation.

**Supplementary Materials:** The following are available online at http://www.mdpi.com/2079-6382/9/12/848/s1, Table S1: Satisfaction survey regarding the antibiotic stewardship program in a tertiary hospital.

**Author Contributions:** Conceptualization, F.B., D.D., L.G., and D.M.; methodology, F.B., L.G., A.L., and D.M.; software, F.C., D.D., and A.L.; writing—original draft preparation, F.B.; writing—review and editing, V.L.M. and D.M.; supervision, V.L.M. and J.R. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Conflicts of Interest:** The authors declare no conflict of interest.

**References**

1. Cassini, A.; Högberg, L.D.; Plachouras, D.; Quattrocchi, A.; Hoxha, A.; Simonsen, G.S.; Colomb-Cotinat, M.; Kretzschmar, M.E.; Devleesschauwer, B.; Cecchini, M.; et al. Attributable deaths and disability-adjusted life-years caused by infections with antibiotic-resistant bacteria in the EU and the European Economic Area in 2015: A population-level modelling analysis. *Lancet Infect. Dis.* **2019**, *19*, 56–66. [CrossRef]

2. Publications AMR Review. Available online: https://amr-review.org/Publications.html (accessed on 29 August 2019).

3. Laxminarayan, R.; Duse, A.; Wattal, C.; Zaidi, A.K.M.; Wertheim, H.F.L.; Sumpradit, N.; Vlieghe, E.; Hara, G.L.; Gould, I.M.; Goossens, H.; et al. Antibiotic resistance—the need for global solutions. *Lancet Infect. Dis.* **2013**, *13*, 1057–1098. [CrossRef]

4. Rieg, S.; Küpper, M.F. Infectious diseases consultations can make the difference: A brief review and a plea for more infectious diseases specialists in Germany. *Infection* **2016**, *44*, 159–166. [CrossRef] [PubMed]

5. Carling, P.; Fung, T.; Killion, A.; Terrin, N.; Barza, M. Favorable impact of a multidisciplinary antibiotic management program conducted during 7 years. *Infect. Control. Hosp. Epidemiol.* **2003**, *24*, 699–706. [CrossRef]

6. DiazGranados, C.A. Prospective audit for antimicrobial stewardship in intensive care: Impact on resistance and clinical outcomes. *Am. J. Infect. Control.* **2012**, *40*, 526–529. [CrossRef]

7. Karanika, S.; Paudel, S.; Grigoras, C.; Kalbasi, A.; Mylonakis, E. Systematic Review and Meta-analysis of Clinical and Economic Outcomes from the Implementation of Hospital-Based Antimicrobial Stewardship Programs. *Antimicrob. Agents Chemother.* **2016**, *60*, 4840–4852. [CrossRef]

8. Baur, D.; Gladstone, B.P.; Burkert, F.; Carrara, E.; Foschi, F.; Döbele, S.; Tacconelli, E. Effect of antibiotic stewardship on the incidence of infection and colonisation with antibiotic-resistant bacteria and Clostridium difficile infection: A systematic review and meta-analysis. *Lancet Infect. Dis.* **2017**, *17*, 990–1001. [CrossRef]

9. Kim, J.; Joo, E.-J.; Ha, Y.E.; Park, S.Y.; Kang, C.-I.; Chung, D.R.; Song, J.-H.; Peck, K.R. Impact of a computerized alert system for bacteremia notification on the appropriate antibiotic treatment of Staphylococcus aureus bloodstream infections. *Eur. J. Clin. Microbiol. Infect. Dis.* **2013**, *32*, 937–945. [CrossRef]

10. Bai, A.D.; Showler, A.; Burry, L.; Steinberg, M.; Ricciuto, D.R.; Fernandes, T.; Chiu, A.; Raybardhan, S.; Science, M.; Fernando, E.; et al. Impact of Infectious Disease Consultation on Quality of Care, Mortality, and Length of Stay in Staphylococcus aureus Bacteremia: Results From a Large Multicenter Cohort Study. *Clin. Infect. Dis.* **2015**, *60*, 1451–1461. [CrossRef]

11. Schmitt, S.; McQuillen, D.P.; Nahass, R.; Martinelli, L.; Rubin, M.; Schwebke, K.; Petrak, R.; Ritter, J.T.; Chansolme, D.; Slama, T.; et al. Infectious diseases specialty intervention is associated with decreased mortality and lower healthcare costs. *Clin. Infect. Dis.* **2014**, *58*, 22–28. [CrossRef]

12. Cunha, C.B. The Pharmacoeconomic Aspects of Antibiotic Stewardship Programs. *Med. Clin. North Am.* **2018**, *102*, 937–946. [CrossRef]
13. Abbara, S.; Pitsch, A.; Jochmans, S.; Hodjat, K.; Cherrier, P.; Monchi, M.; Vinsonneau, C.; Diamantis, S. Impact of a multimodal strategy combining a new standard of care and restriction of carbapenems, fluoroquinolones and cephalosporins on antibiotic consumption and resistance of Pseudomonas aeruginosa in a French intensive care unit. *Int. J. Antimicrob. Agents* **2019**, *53*, 416–422. [CrossRef]

14. Dyar, O.J.; Tebano, G.; Pulcini, C.; ESGAP (ESCMID Study Group for Antimicrobial Stewardship). Managing responsible antimicrobial use: Perspectives across the healthcare system. *Clin. Microbiol. Infect.* **2017**, *23*, 441–447. [CrossRef] [PubMed]

15. Parente, D.M.; Morton, J. Role of the Pharmacist in Antimicrobial Stewardship. *Med. Clin. North Am.* **2018**, *102*, 929–936. [CrossRef] [PubMed]

16. Carlet, J.; Le Coz, P. *Proposals of the Special Working Group for Keeping Antibiotics Effective*; ESCMD: Basel, Switzerland, 2015; 150p.

17. Pulcini, C.; Morel, C.M.; Tacconelli, E.; Beovic, B.; de With, K.; Goossens, H.; Harbarth, S.; Holmes, A.; Howard, P.; Morris, A.M.; et al. Human resources estimates and funding for antibiotic stewardship teams are urgently needed. *Clin. Microbiol. Infect.* **2017**, *23*, 785–787. [CrossRef] [PubMed]

18. Amann, S.; Neef, K.; Kohl, S. Antimicrobial resistance (AMR). *Eur. J. Hosp. Pharm. Sci. Prac.* **2019**, *26*, 175–177. [CrossRef] [PubMed]

19. Binda, F.; Tebano, G.; Kallen, M.C.; Ten Oever, J.; Hulscher, M.E.; Schouten, J.A.; Pulcini, C. Nationwide survey of hospital antibiotic stewardship programs in France. *Med. Mal. Infect.* **2020**, *50*, 414–422. [CrossRef] [PubMed]

20. Dyar, O.J.; Nathwani, D.; Monnet, D.L.; Gyssens, I.C.; Stålsby Lundborg, C.; Pulcini, C.; ESGAP Student-PREPARE Working Group. Do medical students feel prepared to prescribe antibiotics responsibly? Results from a cross-sectional survey in 29 European countries. *J. Antimicrob. Chemother.* **2018**, *73*, 2236–2242. [CrossRef]

21. Mehta, J.M.; Haynes, K.; Wileyto, E.P.; Gerber, J.S.; Timko, D.R.; Morgan, S.C.; Binkley, S.; Fishman, N.O.; Lautenbach, E.; Zaoutis, T.; et al. Comparison of prior authorization and prospective audit with feedback for antimicrobial stewardship. *Infect. Control. Hosp. Epidemiol.* **2014**, *35*, 1092–1099. [CrossRef]

22. Cosgrove, S.E.; Seo, S.K.; Bolon, M.K.; Sepkowitz, K.A.; Climo, M.W.; Diekema, D.J.; Speck, K.; Gunaseelan, V.; Noskin, G.A.; Herwaldt, L.A.; et al. Evaluation of postprescription review and feedback as a method of promoting rational antimicrobial use: A multicenter intervention. *Infect. Control. Hosp. Epidemiol.* **2012**, *33*, 374–380. [CrossRef]

23. Davey, P.; Marwick, C.A.; Scott, C.L.; Charani, E.; McNeil, K.; Brown, E.; Gould, I.M.; Ramsay, C.R.; Michie, S. Interventions to improve antibiotic prescribing practices for hospital inpatients. *Cochrane Database Syst. Rev.* **2017**, *2017*. [CrossRef] [PubMed]

24. Barlam, T.F.; Cosgrove, S.E.; Abbo, L.M.; MacDougall, C.; Schuetz, A.N.; Septimus, E.J.; Srinivasan, A.; Dellit, T.H.; Falck-Ytter, Y.T.; Fishman, N.O.; et al. Implementing an Antibiotic Stewardship Program: Guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. *Clin. Infect. Dis.* **2016**, *62*, e51–e77. [CrossRef] [PubMed]

25. Pollack, L.A.; Srinivasan, A. Core elements of hospital antibiotic stewardship programs from the Centers for Disease Control and Prevention. *Clin. Infect. Dis.* **2014**, *59* (Suppl. 3), S97–S100. [CrossRef] [PubMed]

26. Pulcini, C.; Binda, F.; Lamkang, A.S.; Trett, A.; Charani, E.; Goff, D.A.; Harbarth, S.; Hinrichsen, S.L.; Levy-Hara, G.; Mendelson, M.; et al. Developing core elements and checklist items for global hospital antimicrobial stewardship programmes: A consensus approach. *Clin. Microbiol. Infect.* **2019**, *25*, 20–25. [CrossRef] [PubMed]

27. Buckel, W.R.; Veillette, J.J.; Vento, T.J.; Stenehjem, E. Antimicrobial Stewardship in Community Hospitals. *Med. Clin. N. Am.* **2018**, *102*, 913–928. [CrossRef] [PubMed]

28. Bishop, B.M. Antimicrobial Stewardship in the Emergency Department: Challenges, Opportunities, and a Call to Action for Pharmacists. *J. Pharm. Prac.* **2016**, *29*, 556–563. [CrossRef] [PubMed]

29. Morrill, H.J.; Gaitanis, M.M.; LaPlante, K.L. Antimicrobial stewardship program prompts increased and earlier infectious diseases consultation. *Antimicrob. Resist. Infect. Control.* **2014**, *3*, 12. [CrossRef]

30. Tamma, P.D.; Avdic, E.; Keenan, J.F.; Zhao, Y.; Anand, G.; Cooper, J.; Dezube, R.; Hsu, S.; Cosgrove, S.E. What is the More Effective Antibiotic Stewardship Intervention: Preprescription Authorization or Postprescription Review with Feedback? *Clin. Infect. Dis.* **2017**, *64*, 537–543. [CrossRef]
31. Vaughn, V.M.; Gandhi, T.; Conlon, A.; Chopra, V.; Malani, A.N.; Flanders, S.A. The Association of Antibiotic Stewardship With Fluoroquinolone Prescribing in Michigan Hospitals: A Multi-hospital Cohort Study. *Clin. Infect. Dis.* **2019**, *69*, 1269–1277. [CrossRef]

32. Sasikumar, M.; Boyer, S.; Remacle-Bonnet, A.; Ventelou, B.; Brouqui, P. The value of specialist care-infectious disease specialist referrals-why and for whom? A retrospective cohort study in a French tertiary hospital. *Eur. J. Clin. Microbiol. Infect. Dis.* **2017**, *36*, 625–633. [CrossRef]

33. Pulcini, C.; Gyssens, I.C. How to educate prescribers in antimicrobial stewardship practices. *Virulence* **2013**, *4*, 192–202. [CrossRef] [PubMed]

34. Rodríguez-Baño, J.; Pérez-Moreno, M.A.; Peñalva, G.; Garnacho-Montero, J.; Pinto, C.; Salcedo, I.; Fernández-Urrusuno, R.; Neth, O.; Gil-Navarro, M.V.; Pérez-Milena, A.; et al. Outcomes of the PIRASOA programme, an antimicrobial stewardship programme implemented in hospitals of the Public Health System of Andalusia, Spain: An ecologic study of time-trend analysis. *Clin. Microbiol. Infect.* **2020**, *26*, 358–365. [CrossRef] [PubMed]

35. Weber, B.R.; Noble, B.N.; Bearden, D.T.; Crnich, C.J.; Ellingson, K.D.; McGregor, J.C.; Furuno, J.P. Antibiotic Prescribing upon Discharge from the Hospital to Long-Term Care Facilities: Implications for Antimicrobial Stewardship Requirements in Post-Acute Settings. *Infect. Control. Hosp. Epidemiol.* **2019**, *40*. [CrossRef]

36. Scarpato, S.J.; Timko, D.R.; Cluzet, V.C.; Dougherty, J.P.; Nunez, J.J.; Fishman, N.O.; Hamilton, K.W.; CDC Prevention Epicenters Program. An Evaluation of Antibiotic Prescribing Practices upon Hospital Discharge. *Infect. Control. Hosp. Epidemiol.* **2017**, *38*, 353–355. [CrossRef]

37. Morquin, D.; Ologeanu-Taddei, R.; Koumar, Y.; Reynes, J. Tele-Expertise System Based on the Use of the Electronic Patient Record to Support Real-Time Antimicrobial Use. *Int. J. Technol. Assess. Health Care* **2018**, *34*, 156–162. [CrossRef]

38. Boussat, S.; Demoré, B.; Lozniewski, A.; Aissa, N.; Rabaud, C. How to improve the collection and analysis of hospital antibiotic consumption: Preliminary results of the ConsoRes software experimental implementation. *Med. Mal. Infect.* **2012**, *42*, 154–160. [CrossRef]

39. Howard, P.; Pulcini, C.; Levy Hara, G.; West, R.M.; Gould, I.M.; Harbarth, S.; Nathwani, D.; ESCMID Study Group for Antimicrobial Policies (ESGAP); ISC Group on Antimicrobial Stewardship. An international cross-sectional survey of antimicrobial stewardship programmes in hospitals. *J. Antimicrob. Chemother.* **2015**, *70*, 1245–1255. [CrossRef]

40. Perozziello, A.; Lescure, F.X.; Truel, A.; Routelous, C.; Vaillant, L.; Yazdanpanah, Y.; Lucet, J.C.; CEFECA Study Group. Prescribers' experience and opinions on antimicrobial stewardship programmes in hospitals: A French nationwide survey. *J. Antimicrob. Chemother.* **2019**, *74*, 2451–2458. [CrossRef]

<figure><img src="image_12.png" /></figure>

<footnote>**Publisher's Note:** MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.</footnote>