# Identifying SARS-COV-2 infected patients through canine olfactive detection on axillary sweat samples; study of observed sensitivities and specificities within a group of trained dogs

Dominique Grandjean, Capucine Gallet, Clothilde Julien, Riad Sarkis, Quentin Muzzin, Vinciane Roger, Didier Roisse, Nicolas Dirn, Clement Levert, Erwan Breton, et al.

► To cite this version:

Dominique Grandjean, Capucine Gallet, Clothilde Julien, Riad Sarkis, Quentin Muzzin, et al. Identifying SARS-COV-2 infected patients through canine olfactive detection on axillary sweat samples; study of observed sensitivities and specificities within a group of trained dogs. PLoS ONE, 2022, 17 (2), pp.e0262631. 10.1371/journal.pone.0262631. hal-04260534

HAL Id: hal-04260534

https://hal.science/hal-04260534v1

Submitted on 22 May 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
RESEARCH ARTICLE

# Identifying SARS-COV-2 infected patients through canine olfactive detection on axillary sweat samples; study of observed sensitivities and specificities within a group of trained dogs

Dominique Grandjean<sup>1*</sup>, Capucine Gallet<sup>1</sup>, Clothilde Julien<sup>1</sup>, Riad Sarkis<sup>2</sup>, Quentin Muzzin<sup>1</sup>, Vinciane Roger<sup>1</sup>, Didier Roisse<sup>3</sup>, Nicolas Dirn<sup>3</sup>, Clement Levert<sup>4</sup>, Erwan Breton<sup>4</sup>, Arnaud Galtat<sup>4</sup>, Alexandre Forget<sup>4</sup>, Sebastien Charreaudeau<sup>4</sup>, Fabien Gasmi<sup>4</sup>, Caroline Jean-Baptiste<sup>1</sup>, Sebastien Petitjean<sup>4</sup>, Katia Hamon<sup>4</sup>, Jean-Michel Duquesne<sup>4</sup>, Chantal Coudert<sup>4</sup>, Jean-Pierre Tourtier<sup>5</sup>, Christophe Billy<sup>6</sup>, Jean-Marc Wurtz<sup>7</sup>, Anthony Chauvin<sup>8</sup>, Xavier Eyer<sup>8</sup>, Sabrina Ziani<sup>9</sup>, Laura Prevel<sup>10</sup>, Ilaria Cherubini<sup>11</sup>, Enfel Khelili-Houas<sup>11</sup>, Pierre Hausfater<sup>11</sup>, Philippe Devillier<sup>10</sup>, Loic Desquilbet<sup>12</sup>

1 Ecole Nationale Vétérinaire d'Alfort (Alfort School of Veterinary Medicine), University Paris-Est, Maisons-Alfort, France, 2 Université Franco-Libanaise St Joseph (Saint Joseph University of Beirut), Beirut, Lebanon,

3 Service Départemental d'Incendie et de Secours de l'Oise (Fire and Rescue Service), Tillé, France,

4 Service Départemental d'Incendie et de Secours des Yvelines (Fire and Rescue Service), Versailles, France, 5 Hôpital d'Instruction des Armées Begin (Begin Military Hospital), Saint-Mandé, France, 6 Centre Hospitalier François Quesnay (François Quesnay Hospital Centre), GHT Yvelines, Mantes-la-Jolie, France,

7 Site d'Altkirch GHRMSA (Groupement Hospitalier Mulhouse Sud Alsace), Altkirch, France, 8 Hôpital Lariboisière APHP (Lariboisière Hospital, APHP Great Paris Hospitals), Paris, France, 9 Hôpitaux de Saint-Maurice (Saint-Maurice Hospital), Saint-Maurice, France, 10 Hôpital Foch (Foch Hospital), Suresnes, France, 11 Hôpital Pitié-Salpêtrière APHP (Pitié-Salpêtrière Hospital, APHP Great Paris Hospitals), Paris, France, 12 Ecole nationale vétérinaire d'Alfort, Univ Paris Est Créteil, INSERM, IMRB, Maisons-Alfort, France

* dominique.grandjean@vet-alfort.fr

<figure><img src="image_2.png" /></figure>

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Grandjean D, Gallet C, Julien C, Sarkis R, Muzzin Q, Roger V, et al. (2022) Identifying SARS-COV-2 infected patients through canine olfactive detection on axillary sweat samples; study of observed sensitivities and specificities within a group of trained dogs. PLoS ONE 17(2): e0262631.
https://doi.org/10.1371/journal.pone.0262631

**Editor:** Robert Jeenchen Chen, Stanford University School of Medicine, UNITED STATES

**Received:** June 22, 2021

**Accepted:** December 31, 2021

**Published:** February 14, 2022

**Copyright:** © 2022 Grandjean et al. This is an open access article distributed under the terms of the [Creative Commons Attribution License](https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability Statement:** Data are available upon request because they contain potentially sensitive patient information. Raw data are available upon request at [dominique.grandjean@vet-alfort.fr](mailto:dominique.grandjean@vet-alfort.fr) (Dominique Grandjean) or [helene.bacque@vet-alfort.fr](mailto:helene.bacque@vet-alfort.fr) (Helene Bacque) as a decision of ENVA review board.

**Funding:** Dominique Grandjean received funding in the form of a grant from the World Health Organization, Grant No: 202605592. This research

## Abstract

There is an increasing need for rapid, reliable, non-invasive, and inexpensive mass testing methods as the global COVID-19 pandemic continues. Detection dogs could be a possible solution to identify individuals infected with SARS-CoV-2. Previous studies have shown that dogs can detect SARS-CoV-2 on sweat samples. This study aims to establish the dogs' sensitivity (true positive rate) which measures the proportion of people with COVID-19 that are correctly identified, and specificity (true negative rate) which measures the proportion of people without COVID-19 that are correctly identified. Seven search and rescue dogs were tested using a total of 218 axillary sweat samples (62 positive and 156 negative) in olfaction cones following a randomised and double-blind protocol. Sensitivity ranged from 87% to 94%, and specificity ranged from 78% to 92%, with four dogs over 90%. These results were used to calculate the positive predictive value and negative predictive value for each dog for different infection probabilities (how likely it is for an individual to be SARS-CoV-2 positive), ranging from 10–50%. These results were compared with a reference diagnostic tool which has 95% specificity and sensitivity. Negative predictive values for six dogs ranged from
has been supported by German Federal Ministry of Health (BMG) COVID-19 research and development funding to World Health Organization. The authors alone are responsible for the views expressed in this publication and they do not necessarily represent the views, decisions or policies of WHO. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests:** The authors have declared that no competing interests exist.

≥98% at 10% infection probability to ≥88% at 50% infection probability compared with the reference tool which ranged from 99% to 95%. Positive predictive values ranged from ≥40% at 10% infection probability to ≥80% at 50% infection probability compared with the reference tool which ranged from 68% to 95%. This study confirms previous results, suggesting that dogs could play an important role in mass-testing situations. Future challenges include optimal training methods and standardisation for large numbers of detection dogs and infrastructure supporting their deployment.

## Introduction

As the global COVID-19 pandemic continues, there is an ever-present need for fast, reliable, and inexpensive testing methods.

One possible solution involves using detection dogs to identify individuals infected with SARS-CoV-2. SARS-CoV-2 generates signature volatile organic compounds (VOC) which are volatile at ambient temperatures, and may be detectable by dogs in breath, urine, tears, saliva, faeces and sweat. VOCs emanating from the skin contribute to an individual's body odour and may convey information about metabolic processes [1,2]. For many years, it has been suggested that VOCs could revolutionise non-invasive medical diagnostics in humans. Several studies have demonstrated positive results using dogs for early detection of colorectal cancer [3,4], and encouraging results for lung cancer [5-8], melanoma [9,10], prostate cancer [11-13] and liver cancer [14]. Detection dogs are commonly used to identify hypoglycaemic episodes in diabetic patients [15-18] and epileptic fits [19]. Canine olfactory detection is also expanding for infectious diseases. In 2014, Aksenov et al. [20,21] found the VOCs produced by B-lymphocyte cultures infected by avian H9N2, H6N2 and human H1N1 influenza viruses were unique and specific to each viral subtype. Recently, Abd El Qader et al. [22] showed cell cultures infected by bacterial and viral species produced specific VOCs.

It was hypothesised that COVID-19 would produce a specific VOC resulting in the Nosaïs-COVID-19 program being launched by the Alfort School of Veterinary Medicine (France) and the Saint-Joseph University of Beirut (Lebanon) in March 2020. It aims to train dogs to detect SARS-CoV-2 carriage in asymptomatic or subclinical individuals using axillary sweat samples, under controlled conditions. An initial proof-of-concept study led by our team [23] provided evidence that detection dogs could identify a specific scent in COVID-19 patient sweat samples tested positive using the Pasteur Institute Reverse Transcription Polymerase Chain Reaction (RT-PCR) SARS-CoV-2-IP24 technique, recommended by the World Health Organisation [24,25]. The success rate ranged from 84% to 100%. Articles from other teams following this proof-of-concept study, showed similar results with saliva [26], respiratory secretions [27,28] and urine samples [29].

This study is the project validation stage and aims to establish sensitivity and specificity values for canine detection of COVID-19.

## Materials and methods

This research is the COVIDOG ancillary study to the COVIDEF study (Cohort of patients infected by the virus SARS-CoV-2 or suspected to be infected), promoted by Assistance Publique Hôpitaux de Paris (Parisian hospitals) and led by Professor Hausfater.
## Patient recruitment

COVID-19 positive and negative patients were recruited from 13 centres including hospitals, COVID-19 screening centres, and fire departments around Paris, France. Patients presenting to one of these participating centres with COVID-19 clinical symptoms (fever, cough, sore throat, fatigue, or body aches), and having tested positive for SARS-CoV-2 using a RT-PCR or PCR test were included as positive individuals. COVID-19 positive individuals were excluded if they had received a medical treatment for more than 36 hours prior to sampling to prevent interference from long-term medical treatments in the sample.

Matched COVID-19 negative controls (medical staff or inpatients) were recruited from the same centre as each COVID-19 positive participant to avoid confounding with background hospital odour [30,31].

All individuals meeting these inclusion criteria were invited to participate in the study and signed an individual informed consent form approved by the national ethics committee.

## Samples

Trained health care professionals collected axillary sweat samples from all participants without contaminating them with their own scent. Each hospital used their own gloves which were identical for sampling COVID-19 positive and negative patients. Sufficient samples were obtained for training and the validation steps. Sweat sample choice, sampling site, sampling method, and biological safety measures have been previously published [23].

## Patient data collection

Demographic and medical data were collected for each recruited patient, included age, gender, clinical signs (dyspnoea, fatigue, fever, dry cough, muscular pain, headache, loss of smell, loss of taste, diarrhoea, nasal discharge, colic and migraine), medical history (including hypertension, diabetes, obesity, and arthrosis), and concomitant medication at the time of sampling (analgesics, anti-coagulants, anti-hypertensive drugs, anti-inflammatory drugs, antibiotics, antacids, anti-diabetic drugs, statins, bronchodilators, antidepressants, thyroid hormones, anxiolytics, and spasmolytics).

## Canine resources and initial training

Seven search and rescue dogs trained to seek human scent (Table 1) from two French fire departments were trained for this study. The 8-week training course followed the protocol developed in our previous publication [23], with lines of olfaction cones (Fig 1), positive alert response by sitting in front of the cone (Fig 2) and positive reinforcement.

Training started on September 14, 2020 for the first dog and ended on November 6, 2020 for the last dog. The training process followed a five-step procedure:

1. Learning line work with olfaction cones

2. Imprinting (memorisation) COVID-19 sample odour (positive samples and empty cones in the line)

3. Introduction of mocks (positive sample and clean swabs in the line)

4. Introduction of negatives with no mocks in the line

5. Removing all positive samples (only negative samples in the line)
<table><caption>Table 1. Characteristics of the seven COVID-19 detection dogs.</caption><thead><tr><td>Name</td><td>Gender</td><td>Breed</td><td>Age (years)</td><td>Organisation</td><td>Speciality</td></tr></thead><tbody><tr><td>Leyko</td><td>M</td><td>Malinois</td><td>5</td><td>SDIS78*</td><td>SAR****</td></tr><tr><td>Jinko</td><td>M</td><td>Groenendael</td><td>6</td><td>SDIS78</td><td>SAR</td></tr><tr><td>Ortie</td><td>F</td><td>Malinois</td><td>2.5</td><td>SDIS78</td><td>SAR</td></tr><tr><td>Oska</td><td>F</td><td>Malinois</td><td>2.5</td><td>SDIS78</td><td>SAR</td></tr><tr><td>Oxmo</td><td>M</td><td>Malinois</td><td>2.5</td><td>SDIS78</td><td>SAR</td></tr><tr><td>Ouija</td><td>M</td><td>Dutch Shepherd</td><td>2</td><td>ENVA**</td><td>None</td></tr><tr><td>Joye</td><td>F</td><td>Malinois</td><td>6</td><td>SDIS60***</td><td>SAR</td></tr></tbody></table>

* Service Départemental d'Incendie et de Secours 78 (Fire and Rescue Service 78).

** Ecole Nationale Vétérinaire d'Alfort (Alfort School of Veterinary Medicine).

*** Service Départemental d'Incendie et de Secours 60 (Fire and Rescue Service 60).

**** Search and Rescue Dog.

https://doi.org/10.1371/journal.pone.0262631.t001

<figure><img src="image_4.png" /><figcaption>Fig 1. Olfaction cone line in the training room.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0262631.g001
<figure><img src="image_5.png" /><figcaption>Fig 2. Dog showing a positive alert response in front of a cone containing a positive sample.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0262631.g002

Handlers judged when each dog was ready for the validation testing session. All seven dogs were deemed trained and ready for the testing session after the 8 weeks.

Dog welfare was fully respected, with toy rewards and no induced physical or mental fatigue. A total of 106 positives and 242 negative samples were used during training.

## Biological safety of dogs and humans

We assumed that like SARS-CoV-1, SARS-CoV-2 would not survive longer than several hours on cotton [32]. For safety reasons, samples (stored at +4°C) were not used for training or testing sessions within 24 hours of collection. The olfaction cone prevented dogs from coming in direct contact with the samples (Fig 3).

## Testing protocol

The testing sessions took place in the Poissy Fire Department where lines of five to eight cones were set up in a dedicated room (Fig 4).

Each cone contained either a COVID-19 negative or positive sample. The number of positive and negative samples and their position in the line were randomised using a dedicated
<figure><img src="image_6.png" /><figcaption>Fig 3. Olfaction cone with double sample protection and no possibility of direct contact with the dog.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0262631.g003

website and double-blinded to the handler, dog and data-recorder, as recommended by Johannen [33]. This randomised sample distribution ensured that each line contained at least one positive and one negative COVID-19 sample. The number of COVID-19 positive and negative samples used for the 30 testing session lines are shown in Table 2.

A dedicated person placed the samples while the room was empty, and then immediately left the room without any contact with other investigators or handlers. For each new sample placement, this person wore new disposable gloves (same brand throughout the testing sessions) and a mask to prevent contaminating the olfactive environment. After sample placement, the data recorder sat behind one-way glass so they could not be seen by the dog or handler (Fig 5).

The dog entered the room with their handler and sniffed each cone, one by one. When the dog thought the cone contained a positive sample, a positive alert response was given such as sitting, barking, or scratching in front of the concerned cone. The handler then rewarded the dog and announced the positive alert response to the data recorder. The handler then asked the dog to resume the task for the remaining cones in the line (sequential line). Once all dogs had completed the line, the dog handlers were informed of the COVID-19 positive sample(s) location or absence.
<figure><img src="image_7.png" /><figcaption>Fig 4. Testing room with its olfaction cones.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0262631.g004

Six dogs each completed 30 lines and one dog completed 28 as it was required for an emergency. Once a dog had sniffed all the cones in the line, the pair left the room, and the data recorder cleaned the cones with water to remove traces left by the previous dog. The next dog then entered the room and sniffed the cones in the same line.

Once the seven dogs had completed the line, the cones were cleaned with 3% concentrated acetone solution. New randomised samples were placed in the cones ten minutes after cleaning and a new trial cycle could start.

None of the samples used for the testing sessions had ever been used during the training sessions, and no dog ever sniffed a sample more than once.

## Statistical analysis

Statistical analyses were performed using SAS® University Edition (SAS Institute Inc., Cary, NC, USA). Sensitivity was calculated for each dog by dividing the number of COVID-19 positive samples the dog correctly identified by the total number of COVID-19 positive samples the dog sniffed during the testing sessions. Specificity was calculated for each dog by dividing
<table><caption>Table 2. Characteristics of the 30 lines used for testing sessions.</caption><thead><tr><th>Characteristics</th><th>Overall (n = 30)</th></tr></thead><tbody><tr><td>Number of cones, n (%)</td><td></td></tr><tr><td>5 cones</td><td>6 (20)</td></tr><tr><td>6 cones</td><td>2 (7)</td></tr><tr><td>8 cones</td><td>22 (73)</td></tr><tr><td>Number of COVID-19 negative samples in the line, n (%)</td><td></td></tr><tr><td>3</td><td>3 (10)</td></tr><tr><td>4</td><td>6 (20)</td></tr><tr><td>5</td><td>6 (20)</td></tr><tr><td>6</td><td>12 (40)</td></tr><tr><td>7</td><td>3 (10)</td></tr><tr><td>Number of COVID-19 positive samples in the line, n (%)</td><td></td></tr><tr><td>1</td><td>6 (20)</td></tr><tr><td>2</td><td>17 (57)</td></tr><tr><td>3</td><td>6 (20)</td></tr><tr><td>4</td><td>1 (3)</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0262631.t002

the number of COVID-19 negative samples the dog correctly identified by the total number of COVID-19 negative samples the dog sniffed during the testing sessions.

To remove potential confounding bias, sensitivity and specificity were also calculated separately for samples from:

* Male participants

* Female participants

* Individuals under 50 years of age

* Individuals over 50 years of age

* Participants recruited from Foch and Rambouillet hospitals (hospitals with the highest positive participant recruitment)

* Individuals not presenting the most frequently reported clinical signs (dyspnoea, fatigue, fever, dry cough, and muscular pain)

* Individuals without the most frequently reported past or current medical conditions (hyper-tension and diabetes)

* Individuals not treated with the most frequently reported drugs (analgesics, anti-coagulants, anti-hypertensive drugs, anti-inflammatory drugs, and antibiotics).

The 95% confidence interval (CI) was calculated using Jeffreys' method [34].

Positive and negative predictive values were calculated for each dog using their observed sensitivity and specificity and according to five infection probability scenarios reflecting the risk of an individual being SARS-CoV-2 positive [35,36]. These infection probabilities ranged from 10% to 50% and were based on clinical symptoms and SARS-CoV-2 prevalence in the area where the patient lives and works. This range covers the expected range for settings where COVID-19 detection dogs are likely to work (such as airports or mass events). Positive and negative predictive values are also presented for a reference diagnostic tool with 95% sensitivity and specificity as a comparison.

Binary and qualitative variables were presented as numbers and proportions, and the quantitative variable (age) was presented as medians and interquartile ranges.
<figure><img src="image_8.png" /><figcaption>Fig 5. One way glass hiding the data recorder in the testing room.</figcaption></figure>

https://doi.org/10.1371/journal.pone.0262631.g005

## Ethics

This study was conducted in strict accordance with the Guide for the Care and Use of Animals recommendations (articles R214-87 to R214-137 of the rural code), updated by decree 2013-118 and five decrees edited on February 1, 2013. The Alfort School of Veterinary Medicine animal experiment ethics committee) and the Ile-de-France Protection of Persons Committee approved the protocol on March 30, 2020. It also follows the French Public Health Code (article L1121-1/2).

## Results

A total of 62 COVID-19 positive patients and 156 COVID-19 negative patients were recruited for this study, producing 218 sweat samples used in testing sessions. The proportion of females was slightly higher among COVID-19 negative patients (50%) compared with COVID-19 positive patients (44%; Table 3).

Age distribution was similar between the two groups (medians of 50 years old for COVID-19 negative patients and 56 years old for COVID-19 positive patients). Patients were recruited
<table><caption>Table 3. Baseline characteristics of the 218 COVID-19 positive and negative patients.</caption><thead><tr><th>Variables</th><th>Overall (n = 218)</th><th>COVID-19 negative (n = 156)</th><th>COVID-19 positive (n = 62)</th></tr></thead><tbody><tr><td>Female, n (%)</td><td>100 (46)</td><td>69 (44)</td><td>31 (50)</td></tr><tr><td>Age (years)*</td><td>51 [37; 70]</td><td>50 [37; 70]</td><td>56 [40; 69]</td></tr><tr><td>Hospital, n (%)</td><td></td><td></td><td></td></tr><tr><td>Foch</td><td>36 (17)</td><td>17 (11)</td><td>19 (31)</td></tr><tr><td>Rambouillet</td><td>34 (16)</td><td>24 (15)</td><td>10 (16)</td></tr><tr><td>Houilles</td><td>32 (15)</td><td>27 (17)</td><td>5 (8)</td></tr><tr><td>Other hospitals</td><td>82 (38)</td><td>60 (28)</td><td>22 (35)</td></tr><tr><td>Missing data</td><td>34 (16)</td><td>28 (18)</td><td>6 (10)</td></tr><tr><td>Most frequently reported clinical signs, n (%)</td><td></td><td></td><td></td></tr><tr><td>Dyspnoea</td><td>41 (19)</td><td>8 (5)</td><td>33 (53)</td></tr><tr><td>Fatigue</td><td>35 (16)</td><td>6 (4)</td><td>29 (47)</td></tr><tr><td>Fever</td><td>31 (14)</td><td>4 (3)</td><td>27 (44)</td></tr><tr><td>Dry cough</td><td>30 (14)</td><td>4 (3)</td><td>26 (42)</td></tr><tr><td>Muscular pain</td><td>27 (12)</td><td>8 (5)</td><td>19 (31)</td></tr><tr><td>Most frequently reported past or current diseases, n (%)</td><td></td><td></td><td></td></tr><tr><td>Hypertension</td><td>57 (26)</td><td>36 (23)</td><td>21 (34)</td></tr><tr><td>Diabetes</td><td>29 (13)</td><td>13 (8)</td><td>16 (26)</td></tr><tr><td>Current treatments, n (%)</td><td></td><td></td><td></td></tr><tr><td>Analgesics</td><td>42 (19)</td><td>30 (19)</td><td>12 (19)</td></tr><tr><td>Anti-coagulant</td><td>32 (15)</td><td>12 (8)</td><td>20 (32)</td></tr><tr><td>Anti-hypertensive drugs</td><td>28 (13)</td><td>21 (13)</td><td>7 (11)</td></tr><tr><td>Anti-inflammatory drugs</td><td>23 (11)</td><td>11 (7)</td><td>12 (19)</td></tr><tr><td>Antibiotics</td><td>22 (10)</td><td>8 (5)</td><td>14 (23)</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0262631.t003

mainly from Foch hospital (17%), Rambouillet hospital (16%), and Houilles Rescue Centre (15%; Table 3). Hospital data were missing for 16% of the recruited patients, mainly because recruitment was from many hospitals where samplers did not complete the requested documents correctly. The most frequently reported clinical signs were dyspnoea (19%), fatigue (16%), fever (14%), dry cough (14%) and muscular pain (12%). The most frequently reported past or current medical conditions were hypertension (26%) and diabetes (13%). Each of these clinical signs and medical conditions were more frequent among COVID-19 positive patients than negative patients. The most frequently reported drugs used were analgesics (19%), anti-coagulants (15%), anti-hypertensive drugs (13%), anti-inflammatory drugs (11%), and antibiotics (10%; Table 3).

The overall sensitivity was equal or higher than 87% for all but one dog (Ortie), where sensitivity was 60%. The overall specificity was equal or higher than 85% for all but one dog (Joye), where specificity was 78% (Table 4).

Sensitivity remained virtually the same after stratification for patient gender, age (≤50 years old versus > 50 years old), recruitment from Foch or Rambouillet hospitals, absence of the most frequently reported health conditions, and no use of the most frequently reported drugs (Tables 5 and 6).

After restricting to hospitals, sensitivity was close to the overall sensitivity, but may lack accuracy due to the small number of COVID-19 positive patients in each hospital. Sensitivity calculated after restricting to patients without diabetes were slightly lower than the overall sensitivity, although all but one remained equal or higher than 85% (57% for Ortie). Specificity

<footnote>*Median [interquartile range].</footnote>
<table><caption>Table 4. Overall sensitivities and specificities of the seven dogs calculated from the 218 patients.</caption><thead><tr><th>Dog</th><th>n+</th><th>N+</th><th>Overall Se (95% CI)</th><th>n-</th><th>N-</th><th>Overall Sp (95% CI)</th></tr></thead><tbody><tr><td>Leyko</td><td>54</td><td>62</td><td>87 (77-94)</td><td>144</td><td>156</td><td>92 (87-96)</td></tr><tr><td>Jinko</td><td>55</td><td>62</td><td>89 (79-95)</td><td>135</td><td>156</td><td>87 (81-91)</td></tr><tr><td>Ortie</td><td>37</td><td>62</td><td>60 (47-71)</td><td>141</td><td>156</td><td>90 (85-94)</td></tr><tr><td>Oska</td><td>53</td><td>58</td><td>91 (82-97)</td><td>122</td><td>144</td><td>85 (78-90)</td></tr><tr><td>Oxmo</td><td>58</td><td>62</td><td>94 (85-98)</td><td>142</td><td>156</td><td>91 (86-95)</td></tr><tr><td>Ouija</td><td>56</td><td>62</td><td>90 (91-96)</td><td>142</td><td>156</td><td>91 (86-95)</td></tr><tr><td>Joye</td><td>55</td><td>62</td><td>89 (79-95)</td><td>122</td><td>156</td><td>78 (71-84)</td></tr></tbody></table>

n+: Number of COVID-19 positive samples the dog correctly identified; N+: Total number of COVID-19 positive samples sniffed by the dog; n-: Number of COVID-19 negative samples the dog correctly identified; N-: Total number of COVID-19 negative samples sniffed by the dog; Se: Sensitivity; Sp: Specificity; CI: Confidence interval.

https://doi.org/10.1371/journal.pone.0262631.t004

remained virtually the same after the previously listed stratifications (Tables 5 and 6). The only exception was slightly lower specificity after restricting to patients recruited from Foch hospital, but this was not the case after restricting to Rambouillet hospital.

Positive and negative predictive values for each dog with infection probability ranging from 10% to 50% are shown in Table 7. The negative predictive values for all but one dog (Ortie) for a sample with ≤40% infection probability were ≥91% and almost the same as the reference diagnostic tool (97%). Three dogs maintained a good negative predictive value of ≥90% when the sample had >50% infection probability, which is close to the reference diagnostic tool (95%). Positive predictive values were good but to a lesser extent. When the infection probability was low (10%), the positive predictive values ranged from 40% to 55% for all dogs compared with 68% for the reference diagnostic tool. As expected, positive predictive value increases with increased infection probability and could be considered good (≥ 90%) for three dogs (Leyko, Oxmo, and Ouija) when the infection probability reaches 50%.

Discussion

This validation study aimed to determine the individual sensitivity and specificity values for the seven participating dogs. We found sensitivity ranged from 87% to 94% for six of the dogs and was above 90% for three dogs. Specificity results range from 78% to 92%, six dogs being above 85% and four above 90%. Our results were not affected by patient gender, age (over or under 50 years old) or by the hospital sampling site (Table 5). Furthermore, participants

<table><caption>Table 5. Sensitivities and specificities for the seven dogs with the 218 patients stratified according to sex and age, and for patients recruited from Foch and Rambouillet hospitals.</caption><thead><tr><th>Dog*</th><th>Females</th><th>Males</th><th>≤ 50 years</th><th>> 50 years</th><th>Foch Hospital</th><th>Rambouillet Hospital</th></tr></thead><tbody><tr><td>Leyko (87/92)</td><td>84/94</td><td>90/91</td><td>86/91</td><td>90/95</td><td>100/88</td><td>90/100</td></tr><tr><td>Jinko (89/87)</td><td>87/88</td><td>90/85</td><td>86/86</td><td>90/89</td><td>84/71</td><td>91/88</td></tr><tr><td>Ortie (60/90)</td><td>65/88</td><td>55/92</td><td>59/92</td><td>62/88</td><td>74/88</td><td>60/92</td></tr><tr><td>Oska (91/85)</td><td>90/88</td><td>93/82</td><td>95/85</td><td>89/85</td><td>88/76</td><td>100/83</td></tr><tr><td>Oxmo (94/91)</td><td>90/90</td><td>97/92</td><td>95/91</td><td>92/91</td><td>95/82</td><td>90/92</td></tr><tr><td>Ouija (90/91)</td><td>87/90</td><td>94/92</td><td>86/91</td><td>92/91</td><td>100/88</td><td>80/83</td></tr><tr><td>Joye (89/78)</td><td>90/78</td><td>87/78</td><td>82/81</td><td>92/74</td><td>95/88</td><td>80/67</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0262631.t005

<footnote>*Overall sensitivities/specificities from Table 3 are provided for each dog in parentheses. Numbers are expressed as sensitivities/specificities.</footnote>
<table><caption>**Table 6.** Sensitivities and specificities for the seven dogs for patients without clinical signs, past or current medical conditions and not using the most frequently reported drugs.</caption><thead><tr><th rowspan="2">Dog*</th><th colspan="5">Absence of clinical signs</th><th colspan="2">Absence of past or current diseases</th><th colspan="4">Not using drugs</th></tr><tr><th>Dyspnoea</th><th>Fatigue</th><th>Fever</th><th>Dry cough</th><th>Muscular pain</th><th>Hypertension</th><th>Diabetes</th><th>Analgesics</th><th>Anti-coagulant</th><th>Anti-hypertensive drugs</th><th>Anti-inflammatory drugs</th><th>Antibiotics</th></tr></thead><tbody><tr><td>Leyko (87/92)</td><td>93/93</td><td>89/92</td><td>89/92</td><td>86/92</td><td>93/92</td><td>85/93</td><td>85/92</td><td>90/93</td><td>88/93</td><td>85/93</td><td>86/93</td><td>85/93</td></tr><tr><td>Jinko (89/87)</td><td>90/88</td><td>88/86</td><td>89/86</td><td>90/87</td><td>91/87</td><td>93/87</td><td>85/87</td><td>94/85</td><td>90/88</td><td>89/87</td><td>88/88</td><td>85/86</td></tr><tr><td>Ortie (60/90)</td><td>52/91</td><td>61/91</td><td>66/91</td><td>58/90</td><td>63/91</td><td>68/91</td><td>57/91</td><td>62/91</td><td>62/91</td><td>62/91</td><td>56/90</td><td>56/91</td></tr><tr><td>Oska (91/85)</td><td>89/86</td><td>94/86</td><td>91/86</td><td>94/86</td><td>98/87</td><td>95/85</td><td>88/86</td><td>94/83</td><td>89/86</td><td>96/83</td><td>89/84</td><td>89/86</td></tr><tr><td>Oxmo (94/91)</td><td>93/92</td><td>91/91</td><td>94/91</td><td>94/91</td><td>95/91</td><td>95/92</td><td>91/90</td><td>96/93</td><td>95/92</td><td>96/91</td><td>92/92</td><td>92/91</td></tr><tr><td>Ouija (90/91)</td><td>90/91</td><td>85/91</td><td>91/92</td><td>94/91</td><td>88/91</td><td>90/91</td><td>87/91</td><td>92/91</td><td>93/90</td><td>91/90</td><td>92/91</td><td>86/88</td></tr><tr><td>Joye (89/78)</td><td>79/78</td><td>88/79</td><td>89/79</td><td>86/78</td><td>86/78</td><td>88/81</td><td>85/77</td><td>88/80</td><td>90/78</td><td>89/79</td><td>86/79</td><td>90/77</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0262631.t006

without associated clinical signs, concurrent conditions (diabetes, hypertension) or not taking medication do not impact the results (Table 6). These results validate the acuity of the data obtained in our previous publication [23].

The positive and negative predictive values for each dog if they were used for mass detection in areas with infection probability rates ranging from 10% to 50%, compared with a reference diagnostic test (95% sensitivity and specificity), are shown in Table 7. This reveals that while the positive predictive value of the dog is lower than the reference test, the negative predictive value is similar. The canine olfactory test therefore appears to be more accurate than RT-PCR tests, for which the false negative rate can range from 2% to 30% [37].

Our sensitivity and specificity results appear consistent with those from other sweat sample studies including Jendrny et al. [26], Eskandari et al. [28], Bjorkman et al. [38], Sarkis et al.

<table><caption>**Table 7.** Positive and negative predictive values for the seven dogs according to infection probability (ranging from 10% to 50%) based on clinical signs and/or prevalence rate in the area where the patient lives and works.</caption><thead><tr><th rowspan="2">Dog or almost perfect diagnostic tool*</th><th colspan="2">10%</th><th colspan="2">20%</th><th colspan="2">30%</th><th colspan="2">40%</th><th colspan="2">50%</th></tr><tr><th>PPV</th><th>NPV</th><th>PPV</th><th>NPV</th><th>PPV</th><th>NPV</th><th>PPV</th><th>NPV</th><th>PPV</th><th>NPV</th></tr></thead><tbody><tr><td>Almost perfect diagnostic tool (95/95)</td><td>68%</td><td>99%</td><td>83%</td><td>99%</td><td>89%</td><td>98%</td><td>93%</td><td>97%</td><td>95%</td><td>95%</td></tr><tr><td>Leyko (87/92)</td><td>55%</td><td>98%</td><td>73%</td><td>97%</td><td>82%</td><td>94%</td><td>88%</td><td>91%</td><td>92%</td><td>88%</td></tr><tr><td>Jinko (89/87)</td><td>43%</td><td>99%</td><td>63%</td><td>97%</td><td>75%</td><td>95%</td><td>82%</td><td>92%</td><td>87%</td><td>89%</td></tr><tr><td>Ortie (60/90)</td><td>40%</td><td>95%</td><td>60%</td><td>90%</td><td>72%</td><td>84%</td><td>80%</td><td>77%</td><td>86%</td><td>69%</td></tr><tr><td>Oska (91/85)</td><td>40%</td><td>99%</td><td>60%</td><td>97%</td><td>72%</td><td>96%</td><td>80%</td><td>93%</td><td>86%</td><td>90%</td></tr><tr><td>Oxmo (94/91)</td><td>54%</td><td>99%</td><td>72%</td><td>98%</td><td>82%</td><td>97%</td><td>87%</td><td>96%</td><td>91%</td><td>94%</td></tr><tr><td>Ouija (90/91)</td><td>53%</td><td>99%</td><td>71%</td><td>97%</td><td>81%</td><td>96%</td><td>87%</td><td>93%</td><td>91%</td><td>90%</td></tr><tr><td>Joye (89/78)</td><td>53%</td><td>99%</td><td>50%</td><td>97%</td><td>81%</td><td>96%</td><td>87%</td><td>93%</td><td>80%</td><td>88%</td></tr></tbody></table>

https://doi.org/10.1371/journal.pone.0262631.t007

<footnote>*Overall sensitivities/specificities from Table 3 are provided for each dog in parentheses. Numbers are expressed as sensitivities/specificities.</footnote>

<footnote>*Overall sensitivities/specificities from Table 6 are provided for each dog in parentheses. Numbers are expressed as sensitivities/specificities. PPV: Positive predictive value; NPV: Negative predictive value.</footnote>
[39] and Grandjean et al. [40]. Essler et al. [29] obtained more mixed results when using urine samples and then saliva samples, deactivated by detergent, whereas Vesga et al. [27] used respiratory secretions and saliva revealing sensitivity results ranging from 90.4% to 97.7% and specificity results ranging from 99.5% to 99.8%.

In March 2021, the World Health Organisation [41] provided a comprehensive summary of the COVID-19 olfactory detection results obtained in several countries. However, the results in this summary use the nasopharyngeal RT-PCR as a reference despite having variable results. Axell-House et al. [42] evaluated over 200 molecular diagnostic tests approved by the Food and Drug Administration (FDA) in the USA and concluded that many studies lack solidity. Zhang et al. [43] confirmed this finding and added that clinical and public health decisions cannot be solely based on RT-PCR tests. For example, Arevalo-Rodriguez et al. [44] revealed a 54% false-positive rate from RT-PCR tests in a meta-analysis of nearly 13000 patients from 34 different studies.

For a RT-PCR to be reliable, it is dependent on having enough viral genetic material in the test sample. Cycle threshold (Ct) is the number of cycles required to increase viral RNA to detectable levels. In the USA, the Centre for Disease Control and Prevention (CDC) recommends using a Ct under 30 because the false positive rate is very low below this level [45]. However, since the summer of 2020, most tests have a Ct of 40 thus increasing the false positive rate [37]. Surkova et al. [46] found that false positives can also come from various technical issues including external contamination during sampling and reagent contamination. Currently, the false positive rate could be over 4% in the United Kingdom [47], and even higher in the USA [48]. Furthermore, Kanji et al. [37] demonstrated that the false negative rate can reach 30%. This phenomenon appears to be accentuated as the COVID-19 prevalence decreases in the population [49].

In addition to related public health and ethical issues, these factors have also hindered our proof-of-concept work [23] since reliable results from the nasopharyngeal PCR analysis are needed for training dogs in olfactory viral detection. The significant number of false negatives and the increasing false positive rate as prevalence decreases complicate this training. Problems include dogs not showing a positive alert response for samples that were identified as positive and having to include new criteria which consider PCR Ct values for future samples used to train new dogs. We have therefore narrowed the positive sample inclusion criteria for the training stage (pathognomonic clinical symptomatology, and PCR Ct of ≤30) and routinely request repeat PCR tests when the dogs show a positive alert response for a negative sample.

Moving into the operational stage with six of the seven dogs tested in this study should allow more specific analysis of the possible interferences between concurrent medical conditions (including obesity, diabetes, hypertension, and respiratory diseases) and positive canine olfactive COVID-19 tests.

The strengths of this study include using different samples for training and validation, randomised sample position, one sweat sample per individual, samples only being sniffed once by each dog, double-blind study design and a large number of recruited individuals (n = 218). However, this study does present its own limitations. The number of COVID-19 positive samples (n = 62) prevented us from estimating sensitivities with accuracy, especially after stratifications on potential confounders. Increasing this number was however not possible due to the situation at the time, as it would have been too much work for the centres involved. Furthermore, COVID-19 positive and negative samples were only matched on hospital. Samples had to be sniffed within days making it impossible to wait for an appropriate matched sample, this may have created confounding bias. However, stratification (on age and sex) and restriction (hospital, clinical signs, and drugs) during statistical analysis should have accounted for this to a certain degree. Specifically, if a characteristic was a confounding factor causing high
sensitivities and specificities, stratification or restriction to one characteristic would reduce sensitivity and specificity for all seven dogs, but this was not the case. Additionally, many positive samples obtained through RT-PCR had a high Ct (over 40) meaning accuracy was significantly altered so they could not be used. Another limitation is the heterogeneity of the COVID-19 negative individuals. Although these individuals presented a negative RT-PCR test at the time of inclusion, some may have had a positive RT-PCR test a few days or weeks later. Misclassification errors like this have a negative impact on specificity values. Therefore, without such misclassification errors, the specificities would have been higher than those estimated in our study. One solution to limit the impact of false positives and false negatives in COVID-19 detection dog studies would be to have a maximum acceptable Ct number to identify COVID-19 positive individuals. Furthermore, COVID-19 negative but symptomatic individuals could be included based on a negative RT-PCR test performed one or two weeks after the onsets of symptoms.

Our goal was to validate the acuity of the data obtained in our previous publication [23]. This work is an essential step before considering a study examining how the dogs respond in the presence of other viral diseases, particularly respiratory diseases. There are further studies we also plan to conduct. These include focusing on asymptomatic or subclinical cases of COVID-19 since these are the individuals most likely to spread infection, and simplifying the operational set-up by reducing contact duration with the swabs and using olfactory test lines that are faster to set-up and clean.

During our study, all seven dogs showed a confident positive alert response for several negative samples. Subsequently, a repeat nasopharyngeal RT-PCR test was performed on each patient and were positive. In three of these cases, the patients had returned to the hospital several days after the canine olfactory test, presenting COVID-19 respiratory or digestive symptoms. As Essler et al. [29] commented, dogs appear to detect the SARS-CoV-2 infection earlier than RT-PCR. Considering this finding, we are also planning a chronological approach based on the SARS-CoV-2 latency period.

## Conclusion

In our study, seven dogs successfully detected SARS-CoV-2, with sensitivity ranging from 87% to 94% for six dogs and specificity ranged from 78% to 92%. Canine detection could be a useful testing option as it is non-invasive, inexpensive compared to dedicated laboratory equipment, and provides immediate results. Remaining research challenges include optimal training methods and their standardisation for large numbers of detection dogs, and infrastructure supporting their deployments.

## Acknowledgments

The authors thank Charlotte Wright BVM&S (hons) MRCVS DipTrans of Speak the Speech Consulting for providing medical writing and editorial support in accordance with Good Publication Practice (GPP3) guidelines.

## Author Contributions

**Conceptualization:** Dominique Grandjean, Clothilde Julien, Riad Sarkis, Jean-Pierre Tourtier, Philippe Devillier.

**Data curation:** Capucine Gallet, Clothilde Julien, Quentin Muzzin, Vinciane Roger, Philippe Devillier.

**Formal analysis:** Capucine Gallet, Quentin Muzzin, Philippe Devillier, Loic Desquilbet.
**Investigation:** Capucine Gallet, Clothilde Julien, Vinciane Roger, Philippe Devillier.

**Methodology:** Dominique Grandjean, Riad Sarkis, Pierre Hausfater, Philippe Devillier, Loic Desquilbet.

**Project administration:** Clothilde Julien, Sebastien Petitjean, Jean-Michel Duquesne, Chantal Coudert, Pierre Hausfater.

**Resources:** Capucine Gallet, Clothilde Julien, Vinciane Roger, Didier Roisse, Nicolas Dirn, Clement Levert, Erwan Breton, Arnaud Galtat, Alexandre Forget, Sebastien Charreaudeau, Fabien Gasmi, Caroline Jean-Baptiste, Katia Hamon, Jean-Pierre Tourtier, Christophe Billy, Jean-Marc Wurtz, Anthony Chauvin, Xavier Eyer, Sabrina Ziani, Laura Prevel, Ilaria Cherubini, Enfel Khelili-Houas, Pierre Hausfater, Philippe Devillier.

**Software:** Loic Desquilbet.

**Supervision:** Dominique Grandjean, Riad Sarkis, Pierre Hausfater.

**Validation:** Capucine Gallet, Clothilde Julien, Pierre Hausfater, Loic Desquilbet.

**Writing – original draft:** Dominique Grandjean.

**Writing – review & editing:** Dominique Grandjean.

## References

1. Amann A, Costello Bde L, Miekisch W, Schubert J, Buszewski B, Pleil J, et al. The human volatilome: volatile organic compounds (VOCs) in exhaled breath, skin emanations, urine, feces and saliva. Journal of breath research. 2014; 8(3):034001. https://doi.org/10.1088/1752-7155/8/3/034001 PMID: 24946087

2. Grabowska-Polanowska B, Miarka P, Skowron M, Sulowicz J, Wojtyna K, Moskal K, et al. Development of sampling method and chromatographic analysis of volatile organic compounds emitted from human skin. Bioanalysis. 2017; 9(19):1465–75. https://doi.org/10.4155/bio-2017-0128 PMID: 29056065

3. Sonoda H, Kohnoe S, Yamazato T, Satoh Y, Morizono G, Shikata K, et al. Colorectal cancer screening with odour material by canine scent detection. Gut. 2011; 60(6):814–9. https://doi.org/10.1136/gut.2010.218305 PMID: 21282130

4. Sarkis R, Khazen J, Issa M, Khazzaka A, Hilal G, Grandjean D. Dépistage du cancer colorectal par détection olfactive canine. J Chir Visc. 2017; 154(Supp 1):22.

5. Boedeker E, Friedel G, Walles T. Sniffer dogs as part of a bimodal bionic research approach to develop a lung cancer screening. Interactive cardiovascular and thoracic surgery. 2012; 14(5):511–5.

6. Buszewski B, Ligor T, Jezierski T, Wenda-Piesik A, Walczak M, Rudnicka J. Identification of volatile lung cancer markers by gas chromatography-mass spectrometry: comparison with discrimination by canines. Analytical and bioanalytical chemistry. 2012; 404(1):141–6.

7. Ehmann R, Boedeker E, Friedrich U, Sagert J, Dippon J, Friedel G, et al. Canine scent detection in the diagnosis of lung cancer: revisiting a puzzling phenomenon. The European respiratory journal. 2012; 39 (3):669–76. https://doi.org/10.1183/09031936.00051711 PMID: 21852337

8. Guirao A, Molins L, Ramon I, Sunyer G, Vinolas N, Marrades R, et al. Trained dogs can identify malignant solitary pulmonary nodules in exhaled gas. Lung Cancer. 2019; 135:230–3. https://doi.org/10.1016/j.lungcan.2019.06.008 PMID: 31235316

9. Pickel D, Manucy GP, Walker DB, Hall SB, Walker JC. Evidence for canine olfactory detection of melanoma. Appl Anim Behav Sci. 2004; 89(1–2):107–16.

10. Campbell LF, Farmery L, George SM, Farrant PB. Canine olfactory detection of malignant melanoma. BMJ case reports. 2013;2013.

11. Bjartell AS. Dogs sniffing urine: a future diagnostic tool or a way to identify new prostate cancer markers? European urology. 2011; 59(2):202–3.

12. Cornu JN, Cancel-Tassin G, Ondet V, Girardet C, Cussenot O. Olfactory detection of prostate cancer by dogs sniffing urine: a step forward in early diagnosis. European urology. 2011; 59(2):197–201. https://doi.org/10.1016/j.eururo.2010.10.006 PMID: 20970246
13. Taverna G, Tidu L, Grizzi F, Torri V, Mandressi A, Sardella P, et al. Olfactory system of highly trained dogs detects prostate cancer in urine samples. J Urol. 2015; 193(4):1382-7. https://doi.org/10.1016/j.juro.2014.09.099 PMID: 25264338

14. Kitiyakara T, Redmond S, Unwanatham N, Rattanasiri S, Thakkinstian A, Tangtawee P, et al. The detection of hepatocellular carcinoma (HCC) from patients' breath using canine scent detection: a proof-of-concept study. Journal of breath research. 2017; 11(4):046002. https://doi.org/10.1088/1752-7163/aa7b8e PMID: 28649095

15. Wells DL, Lawson SW, Siriwardena AN. Canine responses to hypoglycemia in patients with type 1 diabetes. J Altern Complement Med. 2008; 14(10):1235-41.

16. Rooney NJ, Guest CM, Swanson LCM, Morant SV. How effective are trained dogs at alerting their owners to changes in blood glycaemic levels?: Variations in performance of glycaemia alert dogs. PLoS ONE. 2019; 14(1):e0210092. https://doi.org/10.1371/journal.pone.0210092 PMID: 30645613

17. Rooney NJ, Morant S, Guest C. Investigation into the value of trained glycaemia alert dogs to clients with type I diabetes. PLoS ONE. 2013; 8(8):e69921. https://doi.org/10.1371/journal.pone.0069921 PMID: 23950905

18. Wilson C, Morant S, Kane S, Pesterfield C, Guest C, Rooney NJ. An Owner-Independent Investigation of Diabetes Alert Dog Performance. Frontiers in veterinary science. 2019; 6:91. https://doi.org/10.3389/fvets.2019.00091 PMID: 30972346

19. Kirton A, Winter A, Wirrell E, Snead OC. Seizure response dogs: evaluation of a formal training program. Epilepsy & behavior: E&B. 2008; 13(3):499-504.

20. Aksenov AA, Sandrock CE, Zhao W, Sankaran S, Schivo M, Harper R, et al. Cellular scent of influenza virus infection. Chembiochem: a European journal of chemical biology. 2014; 15(7):1040-8. https://doi.org/10.1002/cbic.201300695 PMID: 24719290

21. Aksenov AA, Gojova A, Zhao W, Morgan JT, Sankaran S, Sandrock CE, et al. Characterization of volatile organic compounds in human leukocyte antigen heterologous expression systems: a cell's "chemical odor fingerprint". Chembiochem: a European journal of chemical biology. 2012; 13(7):1053-9. https://doi.org/10.1002/cbic.201200011 PMID: 22488873

22. Abd El Qader A, Lieberman D, Shemer Avni Y, Svobodin N, Lazarovitch T, Sagi O, et al. Volatile organic compounds generated by cultures of bacteria and viruses associated with respiratory infections. Bio-medical chromatography: BMC. 2015; 29(12):1783-90. https://doi.org/10.1002/bmc.3494 PMID: 26033043

23. Grandjean D, Sarkis R, Lecoq-Julien C, Benard A, Roger V, Levesque E, et al. Can the detection dog alert on COVID-19 positive persons by sniffing axillary sweat samples? A proof-of-concept study. PLoS ONE. 2020; 15(12):e0243122. https://doi.org/10.1371/journal.pone.0243122 PMID: 33301539

24. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. 2020; 25(3).

25. Hantz S. Diagnostic biologique de l'infection à Sars-CoV-2: stratégies et interprétation des résultats. Rev Francoph Lab. 2020; 526:48-56.

26. Jendry P, Schulz C, Twele F, Meller S, von Kockritz-Blickwede M, Osterhaus A, et al. Scent dog identification of samples from COVID-19 patients—a pilot study. BMC infectious diseases. 2020; 20(1):536. https://doi.org/10.1186/s12879-020-05281-3 PMID: 32703188

27. Vesga O, Valencia AF, Mira A, Ossa F, Ocampo E, Agudelo M, et al. Dog Savior: Immediate Scent-Detection of SARS-COV-2 by Trained Dogs. BioRxiv. 2020.

28. Eskandari E, Ahmadi Marzaleh M, Roudgari H, Hamidi Farahani R, Nezami-Asl A, Laripour R, et al. Sniffer dogs as a screening/diagnostic tool for COVID-19: a proof of concept study. BMC infectious diseases. 2021; 21(1):243. https://doi.org/10.1186/s12879-021-05939-6 PMID: 33673823

29. Essler JL, Kane SA, Nolan P, Akaho EH, Berna AZ, DeAngelo A, et al. Discrimination of SARS-CoV-2 infected patient samples by detection dogs: A proof of concept study. PLoS ONE. 2021; 16(4): e0250158.

30. Pirrone F, Albertini M. Olfactory detection of cancer by trained sniffer dogs: A systematic review of the literature. J Vet Behav. 2017; 19:105-17.

31. Walczak M, Jezierski T, Górecka-Bruzda A, Sobczyńska M, Ensminger J. Impact of individual training parameters and manner of taking breath odor samples on the reliability of canines as cancer screeners. J Vet Behav. 2012; 7(5):283-94.

32. Ren SY, Wang WB, Hao YG, Zhang HR, Wang ZC, Chen YL, et al. Stability and infectivity of coronaviruses in inanimate environments. World J Clin Cases. 2020; 8(8):1391-9. https://doi.org/10.12998/wjcc.v8.i8.1391 PMID: 32368532

33. Johnen D, Heuwieser W, Fischer-Tenhagen C. An approach to identify bias in scent detection dog testing. Appl Anim Behav Sci. 2017; 189:1-12.
34. Brown LD, Cai TT, DasGupta A. Interval Estimation for a Binomial Proportion. Stat Sci. 2001; 16 (2):101-17.

35. Altman DG, Bland JM. Diagnostic tests. 1: Sensitivity and specificity. BMJ. 1994; 308(6943):1552. https://doi.org/10.1136/bmj.308.6943.1552 PMID: 8019315

36. Altman DG, Bland JM. Diagnostic tests 2: Predictive values. BMJ. 1994; 309(6947):102. https://doi.org/10.1136/bmj.309.6947.102 PMID: 8038641

37. Kanji JN, Zelyas N, MacDonald C, Pabbaraju K, Khan MN, Prasad A, et al. False negative rate of COVID-19 PCR testing: a discordant testing analysis. Virol J. 2021; 18(1):13.

38. Hielm-Bjorkman A. COVID-19 detection dogs studies in Finland. International k9 working group against COVID-19 symposium, Dubaï (UAE). 2020.

39. Sarkis R. COVID-19 detection dogs studies in Lebanon. International k9 working group against COVID-19 symposium, Dubaï (UAE). 2020.

40. Grandjean D, Humaid Al Marzooqi D, Lecoq-Julien C, Muzzin Q, Katir Al Hammadi H, Alvergnat G, et al. Use of Canine Olfactory Detection for Covid-19 Testing Study on U.A.E. Trained Detection Dog Sensitivity. J Vet Sci Res. 2021; 6(1).

41. World Health Organization. Consultation on the use of trained dogs for screening COVID-19 cases 2021 [Available from: https://www.who.int/publications/m/item/consultation-on-the-use-of-trained-dogs-for-screening-covid-19-cases].

42. Axell-House DB, Lavingia R, Rafferty M, Clark E, Amirian ES, Chiao EY. The estimation of diagnostic accuracy of tests for COVID-19: A scoping review. J Infect. 2020; 81(5):681-97. https://doi.org/10.1016/j.jinf.2020.08.043 PMID: 32882315

43. Zhang Z, Bi Q, Fang S, Wei L, Wang X, He J, et al. Insight into the practical performance of RT-PCR testing for SARS-CoV-2 using serological data: a cohort study. Lancet Microbe. 2021; 2(2):e79-e87. https://doi.org/10.1016/S2666-5247(20)30200-7 PMID: 33495759

44. Arevalo-Rodriguez I, Buitrago-Garcia D, Simancas-Racines D, Zambrano-Achig P, Del Campo R, Ciapponi A, et al. False-negative results of initial RT-PCR assays for COVID-19: A systematic review. PLoS ONE. 2020; 15(12):e0242958. https://doi.org/10.1371/journal.pone.0242958 PMID: 33301459

45. Centers for Diseases Control and Prevention. Calculating SARS-CoV-2 Laboratory Test Percent Positivity: CDC Methods and Considerations for Comparisons and Interpretation. 2021.

46. Surkova E, Nikolayevskyy V, Drobniewski F. False-positive COVID-19 results: hidden problems and costs. The Lancet Respiratory medicine. 2020.

47. Cohen AN, Kessel B. False positives in reverse transcription PCR testing for SARS-CoV-2. medRxiv [Preprint]. 2020:Available at: https://www.medrxiv.org/content/10.1101/2020.04.26.20080911v1.

48. Willman D. Contamination at CDC lab delayed rollout of coronavirus tests 2020 [Available from: https://www.washingtonpost.com/investigations/contamination-at-cdc-lab-delayed-rollout-of-coronavirus-tests/2020/04/18/fd7d3824-7139-11ea-aa80-c2470c6b2034_story.html].

49. Skitrall JP, Wilson M, Smielewska AA, Parmar S, Fortune MD, Sparkes D, et al. Specificity and positive predictive value of SARS-CoV-2 nucleic acid amplification testing in a low-prevalence setting. Clin Microbiol Infect. 2021; 27(3):469 e9-e15.