# Amoxicillin-Induced Neurotoxicity: Contribution of a Healthcare Data Warehouse to the Determination of a Toxic Concentration Threshold

Sébastien Lalanne, Guillaume Bouzillé, Camille Tron, Matthieu Revest, Elisabeth Polard, Eric Bellissant, M Verdier, Florian Lemaitre

<figure><img src="image_1.png" /></figure>

## ► To cite this version:

Sébastien Lalanne, Guillaume Bouzillé, Camille Tron, Matthieu Revest, Elisabeth Polard, et al. Amoxicillin-Induced Neurotoxicity: Contribution of a Healthcare Data Warehouse to the Determination of a Toxic Concentration Threshold. Antibiotics (Basel, Switzerland), 2023, 12 (4), pp.680. 10.3390/antibiotics12040680. [hal-04088383]

HAL Id: hal-04088383

https://hal.science/hal-04088383

Submitted on 4 May 2023

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_3.png" /></figure>

Brief Report

# Amoxicillin-Induced Neurotoxicity: Contribution of a Healthcare Data Warehouse to the Determination of a Toxic Concentration Threshold

Sébastien Lalanne<fnref n="1" />,*, Guillaume Bouzillé<fnref n="2" />, Camille Tron<fnref n="1" />, Matthieu Revest<fnref n="3" />, Elisabeth Polard<fnref n="1" />, Eric Bellissant<fnref n="1" />, Marie-Clémence Verdier<fnref n="1" /> and Florian Lemaitre<fnref n="1" />

**Abstract:** Background: Amoxicillin (AMX)-induced neurotoxicity is well described and may be associated with AMX overexposure. No neurotoxic concentration threshold has been determined thus far. A better knowledge of maximum tolerable AMX concentrations is of importance to improve the safety of high doses of AMX. Methods: We conducted a retrospective study using the local hospital data warehouse EhOP® to generate a specific query related to AMX neurotoxicity symptomatology. All patient medical reports containing a mention of neurotoxicity clinical symptoms coupled with AMX plasma concentration measurements were explored. Patients were classified into two groups according to the imputability of AMX in the onset of their neurotoxicity, on the basis of chronological and semiological criteria. A receiver-operating characteristic curve was performed to identify an AMX neurotoxic steady-state concentration (CsS) threshold. Results: The query identified 101 patients among 2054 patients benefiting from AMX TDM. Patients received a median daily dose of 9 g AMX, with a median creatinine clearance of 51 mL/min. A total of 17 of the 101 patients exhibited neurotoxicity attributed to AMX. The mean CsS was higher for patients with neurotoxicity attributed to AMX (118 ± 62 mg/L) than those without 74 ± 48 mg/L (*p* = 0.002). A threshold AMX concentration of 109.7 mg/L predicted the occurrence of neurotoxicity. Conclusions: This study identified, for the first time, an AMX CsS threshold of 109.7 mg/L associated with an excess risk of neurotoxicity. This approach needs to be confirmed by a prospective study with systematic neurological evaluation and TDM.

**Keywords:** amoxicillin; neurotoxicity; concentrations

<figure><img src="image_4.png" /></figure>

check for
updates

**Citation:** Lalanne, S.; Bouzillé, G.; Tron, C.; Revest, M.; Polard, E.; Bellissant, E.; Verdier, M.-C.; Lemaitre, F. Amoxicillin-Induced Neurotoxicity: Contribution of a Healthcare Data Warehouse to the Determination of a Toxic Concentration Threshold. *Antibiotics* **2023**, *12*, 680. https://doi.org/10.3390/antibiotics12040680

Academic Editors: Jeffrey Lipman
and Federico Pea

Received: 12 October 2022

Revised: 14 March 2023

Accepted: 16 March 2023

Published: 30 March 2023

<figure><img src="image_5.png" /></figure>

**Copyright:** © 2023 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).

## 1. Introduction

Amoxicillin (AMX) is a widely used beta lactam (BL). High doses of AMX are required for hospitalized patients for the management of severe infections, such as bacteremia or infective endocarditis. BL-induced neurotoxicity has been clinically described since 1945 [1], with an incidence of up to 15% in intensive care units [2]. In addition, BL-induced neurotoxicity presents a non-specific panel of clinical manifestations that do not contribute to the identification of neurotoxicity linked to this class.

The mechanisms of BL-induced neurotoxicity are generally related to the lactam ring, the ability of BLs to cross the blood-brain barrier, and their interaction with the GABA-a receptor [2]. Electroencephalogram abnormalities may help to characterize BL-induced neurotoxicity, such as for cefepime, with generalized periodic discharge and nonconvulsive status epilepticus (NCSE), but are not specific to this drug class [3].

Data supporting AMX neurotoxicity are limited, especially in clinical trials, but have already been documented in pre-clinical models [4,5]. BL therapeutic drug monitoring

<footnote n="1">¹ Department of Pharmacology, CHU Rennes, Inserm, EHESP, Irset (Institut de Recherche En Santé, Environnement et Travail) UMR_S 1085, University of Rennes, 35000 Rennes, France</footnote>

<footnote n="2">² CHU Rennes, Inserm, LTSI—UMR 1099, University of Rennes, 35000 Rennes, France</footnote>

<footnote n="3">³ CHU Rennes, Infectious Diseases and Intensive Care Unit, 2 Rue Henri Le Guilloux, University of Rennes, 35033 Rennes, France</footnote>

<footnote>* Correspondence: sebastien.lalanne@chu-rennes.fr</footnote>
(TDM) is routinely performed in numerous centers for the management of complex infec-
tions and has been the subject of guidelines to mainly reach effective concentration targets.
Neurotoxic concentration thresholds have also been identified in prospective or retrospec-
tive clinical trials for cefepime and meropenem but not for AMX [6]. TDM is proposed for
AMX for patients requiring high doses but target concentrations are determined to improve
efficacy [6]. It is assumed that neurotoxicity is associated with high concentrations, but the
threshold related to toxic concentrations is not well defined for this antibiotic. Thus, we
matched the clinical description and drug concentration data from AMX TDM to evaluate
the concentration-dependent toxicity of the drug and identify a maximum tolerable plasma
AMX concentration.

## 2. Results

Among the 2054 patients benefiting from AMX TDM in the preliminary extraction, 101 analyzable patients were identified by the “neurotoxicity query”. The median age was 73 [14–91] years and the patients received a median AMX daily dose of 9 g [2–21], and had a median estimated glomerular filtration rate (eGFR) of 51 (22–86) mL/min. The main infections were infective endocarditis (35%), osteo-articular infections (20%), and blood (16%) (n = 101). Seventeen patients presented neurotoxicity attributed to AMX (cases) and 84 did not (controls).

The median daily dose was 9 (6–12) versus 9 (6–11) g (not significant) for cases and controls, respectively. The median eGFR was statistically different, with cases having a lower eGFR (22 (12–56) mL/min) than controls (57 (28–87) mL/min) (p = 0.02) (Figure 1). The mean CsS was 118 ± 62 mg/L for cases and 74 ± 48 mg/L for controls (p = 0.002) (Figure 2). After the multivariable analysis, the only parameter that significantly influenced the occurrence of neurotoxicity was AMX CsS (p = 0.006). ROC curve analysis showed a maximal Youden Index for AMX concentration of 109.7 mg/L. This threshold provided a sensitivity of 59%, (95% confidence interval [35–82]) and high specificity (86%), (95% confi- dence interval [78–93]) to differentiate patients with neurotoxicity attributed to AMX or not. The calculated area under the ROC curve was 0.73, 95%CI (0.58–0.96) (Figure 3). ROC curve obtained by including into the model clinically relevant variables (age, sex, weight, AMX daily dose, infection type, eGFR) although not identified as statistically significant in the multivariate analysis identified the same threshold value (Figure 4).

<figure><img src="image_6.png" /><figcaption>**Figure 1.** (a) Distribution of amoxicillin median daily dose (g), (n = 86); (b) distribution of estimated glomerular filtration rate (mL/min), (n = 101) for patients with neurotoxicity attributed (cases) and non-attributed (controls) to amoxicillin. Horizontal solid lines are the median.</figcaption></figure>
<figure><img src="image_7.png" /><figcaption>**Figure 2.** Scatter dot plot of amoxicillin steady-state concentrations (mg/L) for patients with neurotoxicity attributed (cases, *n* = 17) and non-attributed (controls *n* = 84) to amoxicillin. Horizontal solid lines are the mean ± standard deviation (sd) concentrations.</figcaption></figure>

<figure><img src="image_8.png" /><figcaption>**Figure 3.** Receiver-operating characteristic curve of amoxicillin plasma concentration in relation to its attributable neurotoxicity or not. AUC: area under the curve; 95% CI, 95%: confidence interval.</figcaption></figure>
<figure><img src="image_9.png" /></figure>

<table><caption>**Figure 4.** Receiver-operating characteristic curve of amoxicillin plasma concentration in relation to its attributable neurotoxicity or not after adjustment of the potential confounding factors: age, sex, weight, AMX daily dose, infection type, eGFR.</caption><thead><tr><th>Obs</th><th>SOURCE</th><th>PROB</th><th>POS</th><th>NEG</th><th>FALPOS</th><th>FALNEG</th><th>SENSIT</th><th>1MSPEC</th><th>amoxicillin c resid</th><th>dist</th></tr></thead><tbody><tr><td>1</td><td>Model</td><td>0.18829</td><td>12</td><td>64</td><td>19</td><td>5</td><td>0.70588</td><td>0.22892</td><td>110</td><td>0.37270</td></tr><tr><td>2</td><td>Model</td><td>0.18744</td><td>12</td><td>63</td><td>20</td><td>5</td><td>0.70588</td><td>0.24096</td><td>93</td><td>0.38022</td></tr><tr><td>3</td><td>Model</td><td>0.17678</td><td>12</td><td>62</td><td>21</td><td>5</td><td>0.70588</td><td>0.25301</td><td>34</td><td>0.38797</td></tr></tbody></table>

Exceeding the 109.7 mg/L threshold was found to be associated with a 7.5-fold occurrence of AMX-induced neurotoxicity (95% confidence interval [2.38–23.44]).

### 3. Discussion

There is evidence to document a link between drug exposure and the occurrence of BL-induced neurotoxicity. For piperacillin, meropenem, and flucloxacillin, a Cmin > 361.4, 64.2, and 125.1 mg/L, respectively, were shown to be associated with a 50% risk of developing a neurotoxicity event in a retrospective study [7], whereas different thresholds were documented for cefepime (Cmin > 20 to Css > 63 mg/L) [8,9]. Mechanisms supporting BL-related neurological adverse events have been previously described in several studies and reviews and reported clinical manifestations were confusion, vigilance disorders, shaking or myoclonus, a decreased level of consciousness, and epilepsy [2,10,11]. High-dose therapy, renal impairment, preexisting or underlying neurological abnormalities, and age are the main identified risk factors for beta lactam-induced neurotoxicity [10].

Clinical symptoms related to AMX or ampicillin have already been described in clinical studies, such as myoclonia [12], delirium onset [13] (with a 95% confidence interval odds ratio of 2.13–9.45 for the ampicillin sulbactam combination), convulsions [14], and behavioral changes [15]. These data are supported by animal models with evidence for epileptogenicity and a depression-like response following direct intraventricular injections [4]. Furthermore, oral AMX administration (25 and 50 mg/kg) significantly reduced latency to the first induced seizure in a pentylenetetrazole rat model of epilepsy [5]. To date, no concentration–neurotoxicity threshold has been documented for AMX. Marti et al.
conducted a prospective trial in 156 critically ill patients and found no neurotoxicity in a cohort of 156 patients but these patients were treated with a low daily dose (4 g) of amoxicillin administered by discontinuous infusion [16].

Herein, we report a threshold concentration of 109.7 mg/L to identify patients with AMX-related neurotoxicity. The similar thresholds obtained using two approaches for ROC curve analysis strengthen this result. The adjusted ROC curve strategy allows us to exclude potential confounding factors as described by Inácio et al. [17]. The use of a data warehouse allowed us to identify a very low-frequency adverse effect (<1% of patients) within a population with documented risk factors for AMX neurotoxicity: high antibiotic daily dose (9 g/24 h), moderate renal failure, and age >65 years. This threshold is consistent with the current upper concentration threshold for AMX TDM of 80 mg/L recommended for intensive care unit patients [6]. However, this upper bound did not rely on toxicity evidence but rather on the absence of a benefit for the patient when the concentration was above eight times the minimal inhibitory concentration breakpoint for AMX. One major limitation of our study was that there was no systematic assessment of the neurological status of the patients. Our query only explored neurological disorders reported in the patient's medical record and for whom an AMX TDM was prescribed. In addition, it was difficult to estimate the burden of the infection and/or the involved pathogen in the occurrence of neurotoxicity. In certain cases, deterioration of the renal clearance of drugs is itself the consequence of an infectious process that leads to antimicrobial overexposure (e.g., septic renal embolism in infective endocarditis). Moreover, neurological secondary localization (septic embolisms) can occur in specific infections. Finally, a limitation of the study is that the analysis of the initial 2054 medical records is not permitted by the data warehouse, and we only performed an exhaustive analysis of the 101 medical records extracted by the neurotoxic query. However, the methodological approach we used for establishing AMX imputability (a blind assessment by two pharmacologists and an independent pharmacologist adjudicator in case of discrepancies between the two first experts) strengthens the confidence in our results. The method is similar to that used in pharmacovigilance studies and its validity has been largely acknowledged. Another option would have been to use the cumulative area under the curve (AUC) rather than the Css, as it may better correlate with the occurrence of neurotoxicity by taking into account the time of exposure, as suggested for cefepime-induced neurotoxicity [10], but, again, the patients of our center treated with high doses of AMX received almost exclusively continuous infusions and, thus, the measured Css correlates directly with the AUC.

## 4. Materials and Methods

This was a monocenter retrospective study. The data for patients who received AMX TDM [18] between 2009 and 2018 were primarily extracted from the local data warehouse EhOP®. EhOP® provides anonymized medical information for all computerized data from hospital and outpatient visits to Rennes University Hospital in the form of free text (clinical comments, daily hospitalization reports, drug prescriptions) or biological values. Among this patient population, a specific full-text query (“neurotoxicity query”) was generated with EhOP® to retrieve exhaustive keywords in relation to potential AMX neurotoxicity. All patient medical reports containing the terms confusion, encephalopathy, neurotoxicity, convulsion, and overdosing associated with AMX (international non-proprietary name or brand name) were extracted.

All included patient medical data containing these keywords were blindly reviewed by two pharmacologists. An objective assessment of imputability based on chronological and semiological criteria was performed to classify patients into two groups according to the imputability or not of AMX at the onset of their neurotoxicity. Patients with neurotoxicity attributed to AMX were referred to as “Cases” whereas patients for whom the role of AMX in neurotoxicity was excluded were referred to as “Controls”. In cases of disagreement between the two experts, a third independent pharmacologist was consulted. Demographic, clinical, and biological data were gathered, including maximal steady-state concentrations
(Cs) and the concomitant eGFR estimated using the CKD-EPI formula [19]. Statistical comparisons were performed using Mann-Whitney tests for continuous variables, expressed as mean ± standard deviation (sd), median [range] or (interquartile range, IQR), with a significance threshold of 0.05. The impact of baseline characteristics (age, sex, weight, AMX daily dose, infection type, eGFR) and AMX Cs as potential confounding factors on the onset of AMX-induced neurotoxicity was assessed by multivariable logistic regression analysis. The significance threshold was 0.05. The AMX plasma concentration threshold that differentiated the two groups were identified using receiver operating characteristic (ROC) curve analysis. The threshold was obtained by retaining the maximum value of the Youden Index (sensitivity + specificity-1). The AMX plasma concentrations threshold values were compared using the ROC curve built with and without adjustment of potential confounding factors listed above, in order to exclude the influence of these covariates. All statistical analyses were performed using Prism 5.0® software (GraphPad Software, La Jolla, CA, USA) and SAS statistical software, V9.4 (SAS Institute, Cary, NC, USA).

This study was approved by the Ethics Committee of Rennes (Registration number 22.172).

**5. Conclusions**

In conclusion, we identified a threshold of amoxicillin concentrations in a real-life population associated with an excess risk of neurotoxicity based on a specific search of a local data warehouse. This concentration of 109.7 mg/L is still largely above the current therapeutic concentration range and may provide a better understanding of the concentration-toxicity relationship of AMX. These data need to be confirmed by a prospective trial with systematic TDM, neurological evaluation, and determination of an imputability score.

**Author Contributions:** Conceptualization, F.L., G.B. and M.-C.V.; methodology, G.B., F.L., E.B. and S.L.; software, G.B.; validation, F.L., E.P. and S.L.; formal analysis, S.L.; investigation, M.R.; resources, S.L.; data cura-tion, S.L.; writing—original draft preparation, S.L. and F.L.; writing—review and editing, S.L. and C.T.; visualization, F.L.; supervision, F.L.; project administration, F.L. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Institutional Review Board Statement:** This study was approved by the Ethics Committee of Rennes (Registration number 22.172).

**Informed Consent Statement:** Informed consent was obtained from all subjects involved in the study.

**Data Availability Statement:** Not applicable.

**Acknowledgments:** The authors thank Jeff Morcet for his biostatistical expertise.

**Conflicts of Interest:** The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

**References**

1. Walker, A.E.; Johnson, H.C.; Kollros, J.J. Penicillin Convulsions; the Convulsive Effects of Penicillin Applied to the Cerebral Cortex of Monkey and Man. *Surg. Gynecol. Obstet.* **1945**, *81*, 692–701. [PubMed]

2. Roger, C.; Louart, B. Beta-Lactams Toxicity in the Intensive Care Unit: An Underestimated Collateral Damage? *Microorganisms* **2021**, *9*, 1505. [CrossRef] [PubMed]

3. Lee, S.-J. Cefepime-Induced Neurotoxicity. *J. Neurocrit. Care* **2019**, *12*, 74–84. [CrossRef]

4. De Sarro, A.; Ammendola, D.; Zappala, M.; Grasso, S.; De Sarro, G.B. Relationship between Structure and Convulsant Properties of Some Beta-Lactam Antibiotics Following Intracerebroventricular Microinjection in Rats. *Antimicrob. Agents Chemother.* **1995**, *39*, 232–237. [CrossRef] [PubMed]

5. Atli, O.; Demir-Ozkay, U.; Ilgin, S.; Aydin, T.H.; Akbulut, E.N.; Sener, E. Evidence for Neurotoxicity Associated with Amoxicillin in Juvenile Rats. *Hum. Exp. Toxicol.* **2016**, *35*, 866–876. [CrossRef] [PubMed]

6. Guilhaumou, R.; Benaboud, S.; Bennis, Y.; Dahyot-Fizelier, C.; Dailly, E.; Gandia, P.; Goutelle, S.; Lefeuvre, S.; Mongardon, N.; Roger, C.; et al. Optimization of the Treatment with Beta-Lactam Antibiotics in Critically Ill Patients-Guidelines from the French
Society of Pharmacology and Therapeutics (Société Française de Pharmacologie et Thérapeutique-SFPT) and the French Society of Anaesthesia and Intensive Care Medicine (Société Française d'Anesthésie et Réanimation-SFAR). *Crit. Care* **2019**, *23*, 104.
[CrossRef] [PubMed]

7. Imani, S.; Buscher, H.; Marriott, D.; Gentili, S.; Sandaradura, I. Too Much of a Good Thing: A Retrospective Study of β-Lactam Concentration-Toxicity Relationships. *J. Antimicrob. Chemother.* **2017**, *72*, 2891-2897. [CrossRef] [PubMed]

8. Vercheval, C.; Sadzot, B.; Maes, N.; Denooz, R.; Damas, P.; Frippiat, F. Continuous Infusion of Cefepime and Neurotoxicity: A Retrospective Cohort Study. *Clin. Microbiol. Infect.* **2021**, *27*, 731–735. [CrossRef] [PubMed]

9. Huwyler, T.; Lenggenhager, L.; Abbas, M.; Ing Lorenzini, K.; Hughes, S.; Huttner, B.; Karmime, A.; Uçkay, I.; von Dach, E.; Lescuyer, P.; et al. Cefepime Plasma Concentrations and Clinical Toxicity: A Retrospective Cohort Study. *Clin. Microbiol. Infect.* **2017**, *23*, 454–459. [CrossRef] [PubMed]

10. Barreto, E.F.; Webb, A.J.; Pais, G.M.; Rule, A.D.; Jannetto, P.J.; Scheetz, M.H. Setting the Beta-Lactam Therapeutic Range for Critically Ill Patients: Is There a Floor or Even a Ceiling? *Crit. Care Explor.* **2021**, *3*, e0446. [CrossRef] [PubMed]

11. Chow, K.M.; Hui, A.C.; Szeto, C.C. Neurotoxicity Induced by Beta-Lactam Antibiotics: From Bench to Bedside. *Eur. J. Clin. Microbiol. Infect. Dis.* **2005**, *24*, 649–653. [CrossRef] [PubMed]

12. Viloria-Alebesque, A.; Povar-Echeverría, M.; Bruscas-Alijarde, M.J.; Gracia-Gutiérrez, A.; Royo-Trallero, L.; Al-Cheikh-Felices, P. Myoclonus Induced by Amoxicillin-Clavulanic Acid. *Epilepsy Behav. Rep.* **2020**, *14*, 100367. [CrossRef] [PubMed]

13. Teng, C.; Frei, C.R. Delirium Associations with Antibiotics: A Pharmacovigilance Study of the FDA Adverse Event Reporting System (FAERS). *Drugs Real. World Outcomes* **2021**, *9*, 1–7. [CrossRef] [PubMed]

14. Hodgman, T.; Dasta, J.F.; Armstrong, D.K.; Visconti, J.A.; Reilley, T.E. Ampicillin-Associated Seizures. *South Med. J.* **1984**, *77*, 1323–1325. [CrossRef] [PubMed]

15. Esposito, S.; Canevini, M.P.; Principi, N. Complications Associated with Antibiotic Administration: Neurological Adverse Events and Interference with Antiepileptic Drugs. *Int. J. Antimicrob. Agents* **2017**, *50*, 1–8. [CrossRef] [PubMed]

16. Marti, C.; Stirnemann, J.; Lescuyer, P.; Tonoli, D.; von Dach, E.; Huttner, A. Therapeutic Drug Monitoring and Clinical Outcomes in Severely Ill Patients Receiving Amoxicillin: A Single-Centre Prospective Cohort Study. *Int. J. Antimicrob. Agents* **2022**, *59*, 106601. [CrossRef] [PubMed]

17. Inácio, V.; Rodríguez-Álvarez, M.X. The Covariate-Adjusted ROC Curve: The Concept and Its Importance, Review of Inferential Methods, and a New Bayesian Estimator. *Statist. Sci.* **2022**, *37*, 541–561. [CrossRef]

18. Verdier, M.-C.; Tribut, O.; Tattevin, P.; Le Tulzo, Y.; Michelet, C.; Bentué-Ferrer, D. Simultaneous Determination of 12 Beta-Lactam Antibiotics in Human Plasma by High-Performance Liquid Chromatography with UV Detection: Application to Therapeutic Drug Monitoring. *Antimicrob. Agents Chemother.* **2011**, *55*, 4873–4879. [CrossRef] [PubMed]

19. Levey, A.S.; Stevens, L.A.; Schmid, C.H.; Zhang, Y.L.; Castro, A.F.; Feldman, H.I.; Kusek, J.W.; Eggers, P.; Van Lente, F.; Greene, T.; et al. A New Equation to Estimate Glomerular Filtration Rate. *Ann. Intern. Med.* **2009**, *150*, 604–612. [CrossRef] [PubMed]

**Disclaimer/Publisher's Note:** The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.