# Bioanalytical Performance of a New Particle-Enhanced Method for Measuring Procalcitonin

Anne Marie Dupuy, Anne-Sophie Bargnoux, R. Larcher, Antoine Merindol,

Thomas Masetto, Stéphanie Badiou, Jean-Paul Cristol

► To cite this version:

Anne Marie Dupuy, Anne-Sophie Bargnoux, R. Larcher, Antoine Merindol, Thomas Masetto, et al. Bioanalytical Performance of a New Particle-Enhanced Method for Measuring Procalcitonin. Diagnostics, 2020, 10 (7), pp.461. 10.3390/diagnostics10070461. hal-02897050v2

HAL Id: hal-02897050

https://hal.science/hal-02897050v2

Submitted on 3 Mar 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Article

# Bioanalytical Performance of a New Particle-Enhanced Method for Measuring Procalcitonin

Anne Marie Dupuy <fnref n="1" />, Anne Sophie Bargnoux <fnref n="1" />,<fnref n="2" />, Romaric Larcher <fnref n="2" />,<fnref n="3" />, Antoine Merindol <fnref n="1" />,
Thomas Masetto <fnref n="4" />, Stéphanie Badiou <fnref n="1" />,<fnref n="2" /> and Jean Paul Cristol <fnref n="1" />,<fnref n="2" />,*

Received: 6 May 2020; Accepted: 2 July 2020; Published: 7 July 2020

<figure><img src="image_2.png" /></figure>

check for
updates

**Abstract:** We report the analytical performances of two particle-enhanced (PETIA) methods for measuring procalcitonin (PCT), the Diazyme PCT and the new DiaSys PCT assay, and their concordance of values with BRAHMS PCT Kryptor©. The total imprecisions onto two control levels and one serum pool were for DiaSys 5.42%, 3.3% and 7.53% and for Diazyme 10.7%, 2.9% and 13.23%, respectively. The limit of blank, limit of detection and limit of quantification were under the 0.25 cut-off for the two methods. The linearity in the lower range was acceptable for both methods. No significant effect on PCT determination was observed for DiaSys' assay upon addition of interfering substances. With the Diazyme assay, significant effects were seen with rheumatoid factor (RF), lipid and hemoglobin. Correlation studies on 136 sera showed a good correlation between PCT measurements using DiaSys assay against the Kryptor system, while only a poor correlation was observed between the Diazyme assay, especially for low values. The novel PETIA PCT assay from DiaSys shows analytical performances acceptable for clinical use and the concordance with Kryptor method was fine at all clinical cut-offs. In contrast, despite comparable analytical performances, the Diazyme PETIA method exhibited a poor concordance with the Kryptor method.

**Keywords:** PCT; correlation; precision; clinical concordance

## 1. Introduction

In the last decade, procalcitonin (PCT) has emerged as a useful biomarker in diagnosis and management of sepsis, and has become an essential parameter to differentiate bacterial from viral infections in different cohorts of patients [1,2]. Recently, the importance of PCT determination has also been highlighted for the prognosis of COVID-19 [3,4]. The availability of rapid, easy to apply and precise assay systems to check systemic inflammation are absolutely essential to diagnose and manage patients with follow-up infection for SARS-CoV-2. Meta-analyses have proven dramatically increased mortality in emergency patient populations when PCT values were higher than 0.25 µg/L and 0.5 µg/L [5]. Different cut-offs have been suggested for determining the bacterial origin of the

<footnote n="1">¹ Laboratoire de Biochimie et Hormonologie, CHU Montpellier, Université Montpellier 1, F-34295 CEDEX 5 Montpellier, France; am-dupuy@chu-montpellier.fr (A.M.D.); as-bargnoux@chu-montpellier.fr (A.S.B.); a-merindol@chu-montpellier.fr (A.M.); s-badiou@chu-montpellier.fr (S.B.)</footnote>

<footnote n="2">² Laboratoire de Biochimie et Hormonologie, PhyMedExp, Université de Montpellier, INSERM, CNRS, CHU de Montpellier, 34295 Montpellier, France; r-larcher@chu-montpellier.fr</footnote>

<footnote n="3">³ Département de Réanimation, CHU Montpellier, Université Montpellier 1, F-34295 CEDEX 5 Montpellier, France</footnote>

<footnote n="4">⁴ Institute of Molecular Medicine I, Medical Faculty, Heinrich Heine University Düsseldorf, 40225 Düsseldorf, Germany; Thomas.Masetto@hhu.de</footnote>

<footnote>* Correspondence: jp-cristol@chu-montpellier.fr</footnote>
potential infection and, as a consequence, the antibiotic stewardship. For respiratory tract infections or for meningitis, a bacterial origin is likely if the PCT value is greater than 0.25 µg/L, while for the intensive care unit, a bacterial infection is likely if the PCT is over 0.5 µg/L and very likely if the PCT level is over 1 µg/L [5–7]. In addition, PCT could be a helpful biomarker to reduce patient exposure to antibiotics without any significant effect on mortality [1,8]. A recent meta-analysis also suggests that procalcitonin-guided therapy could reduce mortality in critically ills [9]. All the clinical cut-off values have been defined according to the first available method for measuring PCT, the BRAHMS PCT assay. However, numerous assays for PCT determination have been developed and are available on different platforms in core labs or as point of care systems at the bedside. Some companies, for example Abbott, Biomérieux, Diasorin, Fujirebio, Roche and Siemens, use anti-PCT antibodies from BRAHMS. The main difference between these assays is the detection system. Recently, several companies have developed their own tests including Radiometer [10], Boditech [11], Diazyme [12–14] and more recently DiaSys, using polyclonal antibodies. The latter two use particle-enhanced turbidimetry (PETIA) and are available on open platforms. However, in the absence of standardization of PCT assays, the analytical performances of different kits should be tested and their concordance with the clinical cut-offs should be evaluated. The possibility of setting up a reliable immunoturbidimetric test has the advantages of being applicable to all the clinical chemistry analytical instruments, lower the costs and shorten the time-to-result.

Here, we report the analytical performances of the two PETIA assays for measuring PCT from Diazyme and DiaSys applied on a Roche Cobas8000© analyzer, and we evaluate the concordance with the BRAHMS PCT Kryptor CompactPlus© method, currently considered as the reference method.

## 2. Material and Methods

### 2.1. PETIA (Particle-Enhanced) Methods for PCT Measurements

PETIA (particle-enhanced) methods were conducted using the c502 Cobas 8000© from Roche (Meylan, France). All reagents, calibrators, and quality controls were distributed by DiaSys company (Holzheim, Germany). The two PETIA methods required a 6-point calibration with quite similar levels between 0.80 to 50 µg/L (0.84, 3.49, 10.93, 23.56, 53.94 for DiaSys and 0.85, 2.85, 14, 23.79, 52.37 for Diazyme). PETIA methods have 2 levels of internal quality controls; level 1 is 0.93 and 1.5 and level 2 is 10.9 and 16 for DiaSys and Diazyme, respectively.

### 2.2. BRAHMS PCT Kryptor CompactPlus© Method for PCT Measurements

PCT levels were determined using the BRAHMS© PCT assay, which is routinely used at the central laboratory. The BRAHMS© PCT assay is an approach based on time-resolved amplified cryptate emission (TRACE) that is conducted using the Kryptor Compact Plus© instrument (B.R.A.H.M.S. AG, Hennigsdorf, Germany), with an anti-calcitonin polyclonal antibody conjugated with europium cryptate and an anti-katacalcin monoclonal antibody conjugated with XL665. PCT measurements were obtained within 19 min on the Kryptor® system. The limit of blank (LoB), limit of detection (LoD) and limit of quantification (LoQ) reported by the manufacturer were 0.01 µg/L, 0.02 µg/L and 0.06 µg/L, respectively.

### 2.3. Analytical Performances of the PETIA PCT Immunoassays

Imprecision studies were conducted in accordance to the CLSI EP15 protocol (five measurements per day on two levels for 5 consecutive days) [15] with quality control materials and with serum pools. Calibrators and controls from DiaSys are ready to use while those from Diazyme are lyophilized and need to be re-suspended before each daily application or aliquoted and frozen at -20 °C. The LoD was determined according to the current CLSI standards [16]. The LoQ was calculated according to the US FDA protocol consisting of 5 times the limit of blank (LoB) [17]. A serum pool with a PCT concentration of 5.64 µg/L was used to test linearity in the lower range. The pool was diluted with
diluent provided by manufacturer to the following final concentrations: 2.82, 1.41; 0.56, 0.28, 0.14, and 0.03 µg/L. Each dilution was measured in duplicate.

## 2.4. Interference Studies on PETIA Methods for PCT Quantification

Based on serum with PCT concentration of 0.5–0.7 µg/L, the influence of rheumatoid factor, triglyceride content, conjugated and unconjugated bilirubin as well as hemolysis on PCT quantification were tested, following CLSI protocol EP 07-A2 [18]. High concentrated materials RF (rheumatoid factor; positive plasma, Biospacific, 5100 IU/mL), triglyceride extract (Technopath, 8000 mg/dl), unconjugated bilirubin (Sigma-Aldrich, St Louis, MO, USA) and conjugated bilirubin (Frontier Scientific, Logan, UT, USA) were spiked into human serum to obtain concentrated stock solutions. These stock solutions were individually mixed with non-spiked serum to gain different concentrations of interferent materials. To analyze hemolysis, washed human erythrocytes were lysed through a detergent. The hemoglobin concentration of the lysate was photometrically quantified using the hemoglobin (Hb) reagent (Bioanalytic GmbH, Umkirch, Germany). The lysate was then spiked into human serum to obtain the desired hemoglobin concentration.

The interference measurements were performed in triplicate on a Cobas c502 in parallel for DiaSys and Diazyme PCT reagents. The bias was determined as the difference between average of baseline values determined in pools free of interference (T0) and average of values obtained from each overload of pools (Tx). The percentage deviation from T0 was calculated using Equation [Tx-T0/T0] × 100. The variation corresponding to the 10% changes (±10%Δ) was considered as significant.

## 2.5. Comparison Studies

First, the comparison study between the PETIA methods and BRAHMS PCT Kryptor Compact Plus® assays was conducted using samples from 136 consecutive patients admitted to the Emergency and the Intensive Care Unit (ICU) departments of Lapeyronie university hospital (Montpellier, France) with values within the analytical range of 0.02–50 µg/L. After centrifugation, serum samples were analyzed once using a Kryptor CompactPlus® instrument and re-analyzed on Cobas8000® analyzer with the two methods, within 2 hours. No additional sampling was requested, and only residual samples were used for method comparisons of this study. The study was approved by a local ethical committee (DC-2009-1052). In the presence of discordant results between the two methods, the samples were re-analyzed on the two instruments and the clinical record of patients were examined.

Secondly, to compare the PETIA assays, the external quality assessment (EQA) specimens stored at –80 °C from 2017 and 2018 ProBioQual EQA program (ProBioQual, Lyon, France) were measured too.

## 2.6. Statistical Analysis

Passing–Bablok regression analysis was used to compare the results of the PETIA assays with the BRAHMS PCT Kryptor® assay. The scatter of differences was visualized by means of Bland–Altman plots [19]. The CUSUM test and the recommendations of Emerson et al. [20] were used to detect deviation from expected values in linearity studies. Statistical analyses were performed using XLSTAT® software, version 2016.06.35661 (Addinsoft, Paris, France).

The concordance between the methods for classification of patients according to clinical algorithms was assessed using Cohen's κ-test on the population divided into four categories: PCT values < 0.25, 0.25–0.5, 0.5–1.99, ≥ 2.0 µg/L [21]. For all comparisons, *p*-value < 0.05 was considered statistically significant.

# 3. Results

## 3.1. Analytical Performances

Analytical performances (imprecision, LoD, LoB, LoQ and linearity study) of the PETIA assays are presented in Table 1. While the CV (coefficient of variation) at level 2 was comparable for the two
PETIA methods, the CV at level 1 from PCT Diazyme assay (10.07%) was twice higher than that of PCT DiaSys assay (5.42%). The same difference was found with the serum pool (7.53 vs. 13.23% for DiaSys and Diazyme, respectively). LoB, LoD and LoQ were always largely lower than 0.25 µg/L, regardless of the assay.

<table><caption>**Table 1.** Analytical performances of the PETIA (particle-enhanced turbidimetry) PCT (procalcitonin) methods on the c502 Cobas 8000© analyzer.</caption><thead><tr><th></th><th colspan="2">DiaSys Assay</th><th colspan="2">Diazyme Assay</th></tr><tr><th>Total CV imprecision results</th><th>Mean, µg/L</th><th>CV, %</th><th>Mean, µg/L</th><th>CV, %</th></tr></thead><tbody><tr><td>Control level 1</td><td>0.99</td><td>5.42</td><td>1.50</td><td>10.70</td></tr><tr><td>Control level 2</td><td>11.80</td><td>3.30</td><td>15.20</td><td>2.90</td></tr><tr><td>Serum pool</td><td>0.61</td><td>7.53</td><td>0.77</td><td>13.23</td></tr><tr><td>LoB</td><td>0.019</td><td></td><td>0.030</td><td></td></tr><tr><td>LoD</td><td>0.053</td><td></td><td>0.140</td><td></td></tr><tr><td>LoQ</td><td>0.095</td><td></td><td>0.150</td><td></td></tr><tr><th colspan="5">Linearity</th></tr><tr><td>Theoretical values from DiaSys measurement, µg/L</td><td>Mean of observed values with DiaSys assay, µg/L (% of mean recovery)</td><td>Theoretical values from Diazyme measurement, µg/L</td><td>Mean of observed values with Diazyme assay, µg/L (% of mean recovery)</td><td></td></tr><tr><td>7.08</td><td>7.08 (100.0)</td><td>6.99</td><td>6.99 (100.0)</td><td></td></tr><tr><td>3.54</td><td>2.58 (72.8)</td><td>3.50</td><td>2.70 (77.2)</td><td></td></tr><tr><td>1.77</td><td>1.17 (66.1)</td><td>1.75</td><td>1.25 (71.5)</td><td></td></tr><tr><td>0.71</td><td>0.51 (72.0)</td><td>0.70</td><td>0.67 (95.8)</td><td></td></tr><tr><td>0.35</td><td>0.19 (53.6)</td><td>0.35</td><td>0.52 (148.7)</td><td></td></tr><tr><td>0.18</td><td>0.09 (50.8)</td><td>0.17</td><td>0.46 (263.2)</td><td></td></tr><tr><td>0.04</td><td>0.03 (67.8)</td><td>0.04</td><td>0.41 (938.4)</td><td></td></tr></tbody></table>

The Passing-Bablok regression of linearity showed a gradual decrease in recovery from 100.0% on the highest sample measured with DiaSys assay (assigned value 7.08 µg/L) to 50.8% on the low sample (assigned value 0.18 µg/L). With Diazyme assay, a positive and increasing bias was observed starting from the sample with assigned value of 0.35 (recovery 148.7%) down to the last dilution. This positive bias that may derive from some interference could affect the specificity of the test.

The DiaSys assay displayed a more acceptable linearity than Diazyme's over the most clinically relevant range for PCT (0.5 µg/L). The CUSUM test for both assays did not show significant deviation from linearity. However, the difference of recovery (%) was higher than 20% for both assays.

There were no significant effects on PCT values measured by DiaSys assay with the addition of RF, triglycerides, bilirubin (unconjugated and conjugated) and Hb. The variation in each spiked serum sample compared to the baseline sample remained much lower than 10%. No interference was observed with unconjugated and conjugated bilirubin with the Diazyme assay, as described in the technical data as well. However, the results of RF, lipid and Hb interference on the serum pool at low PCT level showed that the addition of low, mild and high concentration of these interferent materials do interfere with the results leading to a positive bias, not described by the manufacturer so far [22]. The corresponding figures are given in Supplementary Materials.

## 3.2. *Correlations between PETIA and BRAHMS PCT Assays*

The regression analyses between the PCT measurements of 136 samples on the Kryptor Compact Plus© and two PETIA methods are reported in Figures 1 and 2.

A clear correlation is obtained between DiaSys and Kryptor for the all range of measures with only a slight overestimation for the high levels ($PCT_{DIASYS} = 1.152 \times PCT_{BRAHMS} + 0.032, p < 0.002$). The analysis of a low value, lower than 2 µg/L, confirmed the good correlation between the clinical cut-offs ($PCT_{DIASYS} = 0.994 \times PCT_{BRAHMS} + 0.110$). These results were supported by Bland-Altman representation (bias at 1.37 µg/L in the entire measurement range and 0.124 µg/L for values lower
than 2 µg/L). By contrast, results with the Diazyme assay exhibited a poor correlation with a clear overestimation in the entire measurement range (PCT<sub>DIAZYME</sub> = 1.692 × PCT<sub>BRAHMS</sub> + 0.178; *p* = 0.282). These results are particularly evident for PCT levels lower than 2 µg/L (PCT<sub>DIAZYME</sub> = 2.117 × PCT<sub>BRAHMS</sub> + 0.119; *p* = 0.952). Here, again, these results are confirmed by Bland-Altman representation (bias at 4.69 µg/L in the entire measurement range and 1.06 for values lower than 2 µg/L).

<figure><img src="image_3.png" /><figcaption>**Figure 1.** Passing-Bablok regression analysis on serum samples in the range 0.02–50 µg/L of BRAHMS PCT Kryptor against (A) DiaSys PCT and (B) Diazyme PCT assay. Bland-Altman analysis of BRAHMS PCT vs (C) DiaSys PCT and (D) Diazyme PCT assay.</figcaption></figure>

<figure><img src="image_4.png" /><figcaption>**Figure 2.** Passing-Bablok regression analysis on serum samples in the range 0.02–2 µg/L of BRAHMS PCT Kryptor against (A) DiaSys PCT and (B) Diazyme PCT assay. Bland-Altman analysis of BRAHMS PCT vs (C) DiaSys PCT and (D) Diazyme PCT assay.</figcaption></figure>

### 3.3. Concordance at the Cut-Off Levels

The overall discordance between the clinical cut-offs (0.25, 0.25–0.50, 0.50–2, > 2 µg/L) was found to be 19% with DiaSys assay and 38% for Diazyme assay. The Cohen's Kappa were 0.695 [IC<sub>95%</sub>, 0.605–0.786] and 0.401 [IC<sub>95%</sub>, 0.306 to 0.496] for DiaSys and Diazyme, respectively. The detailed values in each category are reported in the Appendix A (Table A1). Then, we analyzed the discrepant results at the clinical cut-off of 0.5 µg/L (Figure 3) taking into account the CV observed for the respective
PETIA system and claimed by the manufacturer for PCT Kryptor Compact Plus©. With DiaSys assay, only 9 discordants, with an overestimation, have been observed and the clinical chart revealed for three patients a potential infection (patient with suspected meningitis, one patient receiving antibiotics in ICU and sepsis case) (Table 2). A total of 21 discordants, with an overestimation, were observed with Diazyme assay. All the discordant results obtained with DiaSys assay were also found with Diazyme assay. However, among these 21 overestimations only 6 were suspected of bacterial infection (Table 2). Generally, there were 6 false negative results with BRAHMS assay, 2 false negative results with DiaSys assay and 15 false positive results with Diazyme assay vs. 6 with DiaSys assay. No false negative results were observed with Diazyme assay.

<figure><img src="image_5.png" /><figcaption>**Figure 3.** Correlation of BRAHMS PCT assay vs (A) DiaSys PCT assay and (B) Diazyme PCT assay in the range from 0.02 to 2 µg/L: particularly noteworthy is the over all discrepancy expressed for each method in terms of CV. The grey zone reflects discordant determinations of the two assays. The white zone reflects samples which are similarly analyzed by the two assays. For BRAHMS PCT, the CV was calculated from ThermoFisher internal quality control (IQC), used in our lab over a 12-month period. For DiaSys and Diazyme PCT, the CV was calculated in this study (see Table 1).</figcaption></figure>

<table><caption>**Table 2.** Clinical data for the discrepant results and determination of false negative or positive results according to the assay.</caption><thead><tr><th>Discordants</th><th>BRAHMS PCT Values, µg/L</th><th>PCT DiaSys Values, µg/L</th><th>PCT Diazyme Values, µg/L</th><th>Final Diagnosis</th></tr></thead><tbody><tr><td>1</td><td>0.08</td><td>0.47</td><td>0.73</td><td>Infectious endocarditis <sup>a,d</sup></td></tr><tr><td>2</td><td>0.10</td><td>0.13</td><td>1.98</td><td>Pharmaco-resistant epilepsies <sup>c</sup></td></tr><tr><td>3</td><td>0.11</td><td>0.24</td><td>0.91</td><td>Cirrhosis <sup>c</sup></td></tr><tr><td>4</td><td>0.12</td><td>0.15</td><td>0.66</td><td>ARDS <sup>c</sup></td></tr><tr><td>5</td><td>0.15</td><td>0.24</td><td>1.00</td><td>Polytrauma <sup>c</sup></td></tr><tr><td>6</td><td>0.17</td><td>0.34</td><td>0.8</td><td>Bronchial surinfection <sup>a,d</sup></td></tr><tr><td>7</td><td>0.18</td><td>0.34</td><td>0.60</td><td>Repeated fall <sup>c</sup></td></tr><tr><td>8</td><td>0.18</td><td>0.49</td><td>0.87</td><td>ICU without Antibiotherapy <sup>c</sup></td></tr><tr><td>9</td><td>0.19</td><td>0.29</td><td>0.81</td><td>Leg fracture <sup>c</sup></td></tr><tr><td>10</td><td>0.22</td><td>0.6</td><td>1.88</td><td>Suspected meningitis <sup>a</sup></td></tr><tr><td>11</td><td>0.25</td><td>0.52</td><td>1.32</td><td>ARDS <sup>b,c</sup></td></tr><tr><td>12</td><td>0.26</td><td>0.34</td><td>0.64</td><td>Cirrhosis decompensation <sup>c</sup></td></tr><tr><td>13</td><td>0.26</td><td>0.83</td><td>1.09</td><td>Heart stroke <sup>b,c</sup></td></tr><tr><td>14</td><td>0.29</td><td>0.47</td><td>2.44</td><td>Complicated pneumonia with ARDS <sup>a,d</sup></td></tr><tr><td>15</td><td>0.32</td><td>0.75</td><td>1.48</td><td>ICU without Antibiotherapy <sup>b,c</sup></td></tr><tr><td>16</td><td>0.35</td><td>0.50</td><td>1.03</td><td>Sepsis from parietal origin <sup>a</sup></td></tr><tr><td>17</td><td>0.37</td><td>0.36</td><td>0.61</td><td>Complication following cardiac surgery <sup>c</sup></td></tr><tr><td>18</td><td>0.39</td><td>0.76</td><td>0.63</td><td>ICU with Antibiotherapy <sup>a</sup></td></tr><tr><td>19</td><td>0.43</td><td>0.81</td><td>0.82</td><td>Lung Adenocarcinoma <sup>b,c</sup></td></tr><tr><td>20</td><td>0.44</td><td>0.77</td><td>0.61</td><td>ICU without Antibiotherapy <sup>b,c</sup></td></tr><tr><td>21</td><td>0.49</td><td>0.51</td><td>0.65</td><td>Decompensated respiratory acidosis <sup>b,c</sup></td></tr></tbody></table>

<footnote><sup>a</sup>: false negative for the BRAHMS PCT assay. <sup>b</sup>: false positive for the PCT DiaSys assay. <sup>c</sup>: false positive for PCT Diazyme assay. <sup>d</sup>: false negative for PCT DiaSys assay. ARDS, acute respiratory distress syndrome; ICU, intensive care unit, the bold and gray highlight represent the results overestimated of PCT DiaSys and Diazyme assays compared to BRAHMS PCT assay, which were suspected of bacterial infection.</footnote>
### 3.4. Analysis of the EQA Samples

Using the EQA samples, PCT values with the two PETIA methods were always higher than those reported by Kryptor Compact Plus© instrument. In absence of a reference method we plotted the values observed with BRAHMS PCT Kryptor on the horizontal axis. The difference between PETIA assays and BRAHMS PCT assay for each sample is plotted on the vertical axis. A total of 13 different external controls are analyzed. Clearly, Diazyme assay demonstrates a huge overestimation in comparison to Kryptor, especially for EQA levels lower than 2 µg/L (see Figure A1 in Appendix A).

## 4. Discussion

This study demonstrated that the analytical performances of the PETIA method from DiaSys reagents applied on c502 Cobas 8000© from Roche are acceptable for clinical use and that the DiaSys PCT significantly improves the precision at low PCT levels in comparison to Diazyme assay. However, it must be noted that both PETIA tests display an improvable linearity in the low range. It is noteworthy that the Diazyme assay exhibits a strong positive bias at these low concentrations, which does affect the diagnostic significance of the test. In addition, comparison studies highlighted a good agreement between DiaSys assay and BRAHMS PCT Kryptor while a clear overestimation is observed for Diazyme assay. Finally, our study on the EQA samples stressed the need for standardization of PCT assays.

### 4.1. Performance Assessment

The observed level of imprecision is in line with previous publications on PETIA methods. Indeed, the CVs at level 2 (11.8 µg/L for DiaSys and 15.2 µg/L for Diazyme) were around 3% as previously described for Diazyme assays on Beckman system [12] or on Cobas c702© [13]. However, discordant results are reported for low levels of controls. In agreement with our results, Dipalo et al. [12], reported a high CV (7.7%) for low level of PCT control (1.31 µg/L) while Yuan [23] and Ceriotti [13] reported a CV lower than 6%. Few data are available on serum pools with low levels. Here, again, Diazyme assay shows an intra-laboratory CV of 10.63% for a pool at 0.61 µg/L close to our results. To the best of our knowledge, this is the first report of DiaSys PCT assay. Precision of DiaSys for low level of controls or for low level of serum pools was better than those obtained with Diazyme assay. Despite different technical principles between the latex-enhanced immunoturbidimetric assay developed by DiaSys and the sandwich immunoassay using time-resolved amplified cryptate emission technology used by Kryptor, the CVs are closed and remained largely lower than 10% at every level of control or serum pool.

The observed LoB, LoD and the functional sensitivity, defined as the lowest PCT concentration that could be analyzed with a coefficient of variation (CV) ≤ 20%, are in agreement with previous results obtained with PETIA methods [12,13,23]. Interestingly, all the LoQ are lower than the clinical cut-off of 0.25 and are closed to the reported LoQ for Kryptor PCT BRAHMS method. The absence of interference is of great interest due to the high requests for PCT by the emergency, ICU and pediatrics departments for which the samples are frequently hemolyzed, turbidimetric, icteric and with the presence of RF. There are only a few studies on interferences for PCT so far. Generally, no significant interference was reported with RF, lipid, bilirubin and Hb [24–26]. However, based on our observation about the endogenous interferences for the assay of Diazyme, its use in routine should be done with caution.

### 4.2. Comparison with BRAHMS PCT Kryptor and Clinical Concordance

No reference methods for PCT quantitation are yet available, and comparison studies could be difficult to interpret. Since all the clinical cut-offs were defined according to the first fully automated PCT assay, the BRAHMS PCT Kryptor, we decided to analyze the correlation and clinical performances against this method. In the published reports to date with PETIA methods, only Diazyme assays were analyzed. Discordant results have been published according to the correlation studies. Some studies performed on the entire measurement range reported fine correlation with
slopes ranging from 0.85 [14] to 1.1 [12] and a modest bias around 0.5 to 1 µg/L. More recently, Lippi et al. [27] reported an acceptable correlation between Diazyme and BRAHMS PCT but with a large bias resulting in an overestimation reaching 38%. Our results are in agreement with this observation, the mean bias observed with Diazyme assay in the entire measurement range (up to 50 µg/L) reaching 4.69 µg/L. By contrast, DiaSys PETIA resulted only in a modest overestimation, with the mean bias appearing limited to 1.37 µg/L. In addition and in agreement with the report of Ceriotti [13], only a poor correlation was observed for low values with Diazyme assay (Figures 1 and 2) while a good correlation ($PCT_{DIASYS} = 0.994 \times PCT_{BRAHMS} + 0.110$) with a small bias (0.124 µg/L) was observed with DiaSys assay.

The clinical concordance at each clinical cut-off was further analyzed using Kappa coefficients. The global kappa coefficients were close to 0.7 for DiaSys and, consequently, the strength of agreement is considered to be very good. On the other hand, the global kappa coefficients for Diazyme is only 0.4 which could be considered weak. This weak concordance between Diazyme and BRAHMS assays could be due to the lack of standardization and differences in the calibration process. However, some discordant results leading to a 5-fold increase between BRAHMS/DiaSys results and Diazyme assay could be also due to a potential analytical interference. The analytical performances obtained with PCT Diazyme in our study are unexpected relative to previous data already published [12,23] or to the manufacturer's claims. Several reasons may explain the decrease in bioanalytical performance of Diazyme assay. One of them could be that the analytical performance was performed on devices with not identical technical characteristics (c702 or c502 modules from Cobas Roche, AU5800 from Beckman, Vidas from Biomérieux). As suggested by Ceriotti et al. [13], it seems that a significant part of the differences at PCT concentrations <0.5 µg/L is explained by the high imprecision of Diazyme's test, combined with the relevant calibration bias (−33.7%). This notion could also explain the important loss of linearity. In addition, a lot-to-lot variation of Diazyme reagent and/or calibrator could be a reason of the poor results of Diazyme, even though we did not prove this in our work. The differences in the PETIA DiaSys assay and BRAHMS PCT Kryptor method were minimal and the use of the DiaSys PCT method would be suitable for bacterial infection diagnosis and antibiotic stewardship. In fact, considering the clinical cut-off of 0.5, only 9 discordants with an overestimation were identified and 3 had a potential risk of infection. Thus, no under-treatment could result from the DiaSys assay in clinical use.

### 4.3. Lack of Standardization

Using EQA samples shows a lack of comparability between results from PETIA, PCT assays and BRAHMS Kryptor assays. In fact, PCT values with PETIA methods were always higher than those reported by the group of Kryptor Compact Plus© instrument, clearly showing that standardization of calibration would be desirable. The same results have been previously observed with other assays [14] using BRAHMS antibodies such as Abbott, Diasorin, Siemens and Roche, or with other antibodies such as Radiometer. This result strongly suggests once again that the overestimation of Diazyme is much greater than with DiaSys assays. These differences in PCT EQA could be due not only to antibodies but also to matrix effects of EQA samples, differences in measurement methods or interferences. However, even using the same method, the results of EQA determined by Diazyme and DiaSys were largely different.

## 5. Conclusions

In summary, the novel PETIA PCT assay from DiaSys shows analytical performances acceptable for clinical use. In addition, a clear correlation was observed with the Kryptor BRAHMS assay, and the concordance with the Kryptor method was fine at all clinical cut-offs. In contrast, despite comparable analytical performances, the Diazyme PETIA method exhibited only a poor concordance with the Kryptor method and a clear overestimation. Moreover, the discordance between the PETIA systems observed with the EQA system clearly suggested that standardization of PCT assays and commutability
of EQA materials are necessary steps to understand the lack of comparability between results obtained by different PCT assays.

**Supplementary Materials:** The following are available online at http://www.mdpi.com/2075-4418/10/7/461/s1.

**Author Contributions:** Conceptualization, J.P.C. and A.M.D.; methodology, A.M.D.; software, S.B.; validation, J.P.C., A.M.D. and T.M.; formal analysis, A.M. and T.M.; investigation, A.S.B. and R.L.; data curation, S.B.; writing—original draft preparation, A.M.D.; visualization, R.L.; supervision, J.P.C. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research received no external funding.

**Acknowledgments:** Reagents for the PETIA PCT assays that were used in this study were kindly provided by DiaSys Diagnostic Systems GmbH from Germany.

**Conflicts of Interest:** The authors declare no conflict of interest.

## Appendix A

<figure><img src="image_6.png" /></figure>

<figure><img src="image_7.png" /><figcaption>**Figure A1.** Schematic representation of results obtained with ProBioQual samples with BRAHMS PCT and DiaSys and Diazyme PCT (A) for low concentrations of EQA samples; (B) for high concentrations of EQA samples. X-axis indicates the BRAHMS PCT values obtained on EQA samples; Y-axis indicates the difference between values of DiaSys or Diazyme PCT and BRAHMS PCT values.</figcaption></figure>

Repartition of the PCT results in our laboratory: (i) BRAHMS PCT assay vs. PCT DiaSys assay and (ii) BRAHMS PCT assay vs. PCT Diazyme assay on the 136 serum samples.
N = number of subjects in each category.

<table><caption>**Table A1.** Repartition of the PCT results in our laboratory (i) BRAHMS PCT assay vs PCT DiaSys assay and (ii) BRAHMS PCT assay vs PCT Diazyme assay on the 136 serum samples.</caption><thead><tr><th rowspan="2"></th><th rowspan="2">PCT DiaSys Assay</th><th colspan="5">BRAHMS PCT Assay</th></tr><tr><th>PCT &lt; 0.25</th><th>0.25 ≤ PCT &lt; 0.5</th><th>0.5 ≤ PCT &lt; 2</th><th>PCT ≥ 2</th><th>Kappa Test</th></tr></thead><tbody><tr><td rowspan="4">(i)</td><td>PCT &lt; 0.25</td><td>10</td><td>2</td><td>0</td><td>0</td><td>0.695</td></tr><tr><td>0.25 ≤ PCT &lt; 0.5</td><td>11</td><td>2</td><td>0</td><td>0</td><td>(95%CI, 0.605)</td></tr><tr><td>0.5 ≤ PCT &lt; 2</td><td>2</td><td>9</td><td>25</td><td>0</td><td>0.605</td></tr><tr><td>PCT ≥ 2</td><td>0</td><td>0</td><td>2</td><td>73</td><td>to 0.786)</td></tr><tr><td rowspan="4">(ii)</td><td>PCT Diazyme Assay</td><th colspan="5">BRAHMS PCT Assay</th></tr><tr><td>PCT &lt; 0.25</td><th>PCT &lt; 0.25</th><th>0.25 ≤ PCT &lt; 0.5</th><th>0.5 ≤ PCT &lt; 2</th><th>PCT ≥ 2</th><th>Kappa Test</th></tr><tr><td>PCT &lt; 0.25</td><td>3</td><td>0</td><td>0</td><td>0</td><td>0.401</td></tr><tr><td>0.25 ≤ PCT &lt; 0.5</td><td>7</td><td>2</td><td>0</td><td>0</td><td>(95%CI, 0.306)</td></tr><tr><td></td><td>0.5 ≤ PCT &lt; 2</td><td>15</td><td>12</td><td>14</td><td>0</td><td>0.306</td></tr><tr><td></td><td>PCT ≥ 2</td><td>4</td><td>2</td><td>12</td><td>65</td><td>to 0.496)</td></tr></tbody></table>
## References

1. Schuetz, P.; Wirz, Y.; Sager, R.; Christ-Crain, M.; Stolz, D.; Tamm, M.; Bouadma, L.; Luyt, C.E.; Wolff, M.; Chastre, J.; et al. Effect of procalcitonin-guided antibiotic treatment on mortality in acute respiratory infections: A patient level meta-analysis. *Lancet Infect. Dis.* **2018**, *18*, 95–107. [CrossRef]

2. Schuetz, P.; Beishuizen, A.; Broyles, M.; Ferrer, R.; Gavazzi, G.; Gluck, E.H.; Del Castillo, J.G.; Jensen, J.-U.; Kanizsai, P.L.; Kwa, A.L.H.; et al. Procalcitonin (PCT)-guided antibiotic stewardship: An international experts consensus on optimized clinical use. *Clin. Chem. Lab. Med.* **2019**, *27*, 1308–1318. [CrossRef] [PubMed]

3. Lippi, G.; Plebani, M. Laboratory abnormalities in patients with COVID-2019 infection. *Clin. Chem. Lab. Med.* **2020**, *58*, 1131–1134. [CrossRef] [PubMed]

4. Lippi, G.; Plebani, M. Procalcitonin in patients with severe coronavirus disease 2019 (COVID-19): A meta-analysis. *Clin. Chim. Acta* **2020**, *505*, 190–191. [CrossRef]

5. Sager, R.; Wirz, Y.; Amin, D.; Amin, A.; Hausfater, P.; Huber, A.; Haubitz, S.; Kutz, A.; Mueller, B.; Schuetz, P. Are admission procalcitonin levels universal mortality predictors across different medical emergency patient populations? Results from the multi-national, prospective, observational TRIAGE study. *Clin. Chem. Lab. Med.* **2017**, *55*, 1873–1880. [CrossRef]

6. Viallon, A.; Desseigne, N.; Marjollet, O.; Birynczyk, A.; Belin, M.; Guyomarch, S.; Borg, J.; Pozetto, B.; Bertrand, J.C.; Zeni, F. Meningitis in adult patients with a negative direct cerebrospinal fluid examination: Value of cytochemical markers for differential diagnosis. *Crit. Care* **2011**, *15*, R136. [CrossRef]

7. McGill, F.; Heyderman, R.S.; Michael, B.D.; Defres, S.; Beeching, N.J.; Borrow, R.; Glennie, L.; Gaillemin, O.; Wyncoll, D.; Kaczmarski, E.; et al. The UK joint specialist societies guideline on the diagnosis and management of acute meningitis and meningococcal sepsis in immunocompetent adults. *J. Infect.* **2016**, *72*, 405–438. [CrossRef]

8. Bouadma, L.; Luyt, C.E.; Tubach, F.; Cracco, C.; Alvarez, A.; Schwebel, C.; Schortgen, F.; Lasocki, S.; Veber, B.; Dehoux, M.; et al. Use of procalcitonin to reduce patients’ exposure to antibiotics in intensive care units (PRORATA trial): A multicentre randomised controlled trial. *Lancet* **2010**, *375*, 463–474. [CrossRef]

9. Pepper, D.J.; Sun, J.; Rhee, C.; Welsh, J.; Powers, J.H., III; Danner, R.L.; Kadri, S.S. Procalcitonin-guided antibiotic discontinuation and mortality in critically ill adults: A systematic review and meta-analysis. *Chest* **2019**, *155*, 1109–1118. [CrossRef]

10. Dupuy, A.M.; Chevrier, Q.; Olejnik, Y.; Bargnoux, A.S.; Badiou, S.; Cristol, J.P. Analytical evaluation of point-of-care procalcitonin (PCT) and clinical performances in an unselected population as compared with central lab PCT assay. *Clin. Chem. Lab. Med.* **2017**, *55*, e167–e171. [CrossRef]

11. Dupuy, A.M.; Bargnoux, A.S.; Andreeva, A.; Zins, C.; Kuster, N.; Badiou, S.; Cristol, J.P. Analytical performances of a novel point-of-care procalcitonin assay. *Pract. Lab. Med.* **2019**, *26*, e00145. [CrossRef] [PubMed]

12. Dipalo, M.; Buonocore, R.; Gnocchi, C.; Picanza, A.; Aloe, R.; Lippi, G. Analytical evaluation of Diazyme procalcitonin (PCT) latex-enhanced immunoturbidimetric assay on Beckman Coulter AU5800. *Clin. Chem. Lab. Med.* **2015**, *53*, 593–597. [CrossRef] [PubMed]

13. Ceriotti, F.; Marino, I.; Motta, A.; Carobene, A. Analytical evaluation of the performances of Diazyme and BRAHMS procalcitonin applied to Roche Cobas in comparison with BRAHMS PCT-sensitive Kryptor. *Clin. Chem. Lab. Med.* **2017**, *56*, 162–169. [CrossRef]

14. Dipalo, M.; Guido, L.; Micca, G.; Pittalis, S.; Locatelli, M.; Motta, A.; Bianchi, V.; Callegari, T.; Aloe, R.; Da Rin, G.; et al. Multicenter comparison of automated procalcitonin immunoassays. *Pract. Lab. Med.* **2015**, *2*, 22–28. [CrossRef]

15. Clinical and Laboratory Standards Institute. EP15-A3. User Verification of Precision and Estimation of Bias-Approved Guideline; Clinical and Laboratory Standards Institute: Wayne, PA, USA, 2014.

16. Clinical and Laboratory Standards Institute. EP17-A2. Protocols for Determination of Limits of Detection and Limits of Quantitation; Clinical and Laboratory Standards Institute: Wayne, PA, USA, 2004.

17. Putheti, R.R.; Okigbo, R.N.; Patil, S.C.; Advanapu, M.S.; Leburu, R. Method development and validations: Characterization of critical elements in the development of pharmaceuticals. *Int. J. Health Res.* **2008**, *1*, 5–14. [CrossRef]

18. Clinical and Laboratory Standards Institute. EP07-A2. Interference Testing in Clinical Chemistry; Approved Guideline, 2nd ed.; Clinical and Laboratory Standards Institute: Wayne, PA, USA, 2015.
19. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. *Stat. Methods Med. Res.* **1999**, *8*, 135–160. [CrossRef]

20. Emerson, J.F.; Ngo, G.; Emerson, S.S. Screening for interference in immunoassays. *Clin. Chem.* **2003**, *49*, 1163–1169. [CrossRef]

21. Guggenmoos-Holzman, I. The meaning of kappa: Probabilistic concepts of reliability and validity revisited. *J. Clin. Epidemiol.* **1996**, *49*, 775–782. [CrossRef]

22. Technical Sheet DZ062. Available online: https://www.diazyme.com/procalcitonin-pct-assay (accessed on 1 January 2020).

23. Yuan, C. Reply to: Analytical evaluation of the performances of Diazyme and BRAHMS procalcitonin applied to Roche Cobas in comparison with BRAHMS PCT-sensitive Kryptor. *Clin. Chem. Lab. Med.* **2017**, *56*, e5–e6. [CrossRef]

24. Steinbach, G.; Rau, B.; Debard, A.L.; Javourez, J.F.; Bienvenu, J.; Ponzio, A.; Bonfà, A.; Hubl, W.; Demant, T.; Külpmann, W.R.; et al. Multicenter evaluation of a new immunoassay for procalcitonin measurement on the Kryptor. System. *Clin. Chem. Lab. Med.* **2004**, *42*, 440–449. [CrossRef]

25. Hiroyuki, Y.; Shinjiro, M.; Yoshihiro, U.; Nakamura, K.; Kobatake, S.; Satomura, S.; Matsuura, S. Determination of procalcitonin concentration using the Sphere Light 180 clinical auto-analyzer. *Clin. Chim. Acta* **2008**, *388*, 38–40.

26. Agarwal, S.; Akbas, N.; Soundar, E.P.; Gonzalez, G.; Devaraj, S. Validation of the procalcitonin (PCT) assay: Experience in a pediatric hospital. *Clin. Biochem.* **2015**, *48*, 886–890. [CrossRef] [PubMed]

27. Lippi, G.; Salvagno, G.L.; Gelati, M.; Pucci, M.; Lo Cascio, C.; Demonte, D.; Faggian, D.; Plebani, M. Two-center comparison of 10 fully-automated commercial procalcitonin (PCT) immunoassays. *Clin. Chem. Lab. Med.* **2019**, *58*, 77–84. [CrossRef] [PubMed]

<figure><img src="image_8.png" /></figure>

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).