# Diagnostic Assays for Crimean-Congo Hemorrhagic Fever

Jessica Vanhomwegen, Maria João Alves, Tatjana Avšič Županc, Silvia Bino, Sadegh Chinikar, Helen Karlberg, Gülay Korukluoğlu, Miša Korva, Masoud Mardani, Ali Mirazimi, et al.

<figure><img src="image_1.png" /></figure>

To cite this version:

Jessica Vanhomwegen, Maria João Alves, Tatjana Avšič Županc, Silvia Bino, Sadegh Chinikar, et al. Diagnostic Assays for Crimean-Congo Hemorrhagic Fever. Emerging Infectious Diseases, 2012, 18 (12), pp.1958-1965. 10.3201/eid1812.120710. pasteur-03112961

HAL Id: pasteur-03112961

https://pasteur.hal.science/pasteur-03112961

Submitted on 18 Jan 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Diagnostic Essays for Crimean-Congo Hemorrhagic Fever

Jessica Vanhomwegen, Maria João Alves, Tatjana Avšič Županc, Silvia Bino, Sadegh Chinikar, Helen Karlberg, Gülay Korukluoğlu, Miša Korva, Masoud Mardani, Ali Mirazimi, Mehrdad Mousavi, Anna Papa, Ana Saksida, Batool Sharifi-Mood, Persofoni Sidira, Katerina Tsergouli, Roman Wölfel, Hervé Zeller, and Philippe Dubois

Crimean-Congo hemorrhagic fever (CCHF) is a highly contagious viral tick-borne disease with case-fatality rates as high as 50%. We describe a collaborative evaluation of the characteristics, performance, and on-site applicability of serologic and molecular assays for diagnosis of CCHF. We evaluated ELISA, immunofluorescence, quantitative reverse transcription PCR, and low-density macroarray assays for detection of CCHF virus using precharacterized archived patient serum samples. Compared with results of local, in-house methods, test sensitivities were 87.8%–93.9% for IgM serology, 80.4%–86.1% for IgG serology, and 79.6%–83.3% for genome detection. Specificity was excellent for all assays; molecular test results were influenced by patient country of origin. Our findings demonstrate that well-characterized, reliable tools are available for CCHF diagnosis and surveillance. The on-site use of such assays by health laboratories would greatly diminish the time, costs, and risks posed by the handling, packaging, and shipping of highly infectious biologic material.

Crimean-Congo hemorrhagic fever (CCHF) is a tick-borne zoonotic disease caused by a virus (CCHFV)

Author affiliations: Institut Pasteur, Paris, France (J. Vanhomwegen, P. Dubois); European Centre for Disease Control, Stockholm, Sweden (J. Vanhomwegen, H. Zeller); National Institute of Health Dr. Ricardo Jorge, Lisbon, Portugal (M.J. Alves); Faculty of Medicine, Ljubljana, Slovenia (T. Avšič Županc, M. Korva, A. Saksida); Institute of Public Health, Tirana, Albania (S. Bino); Pasteur Institute of Iran, Tehran, Iran (S. Chinikar); Swedish Institute for Infectious Disease Control, Solna, Sweden (H. Karlberg, A. Mirazimi, M. Mousavi); Refik Saydam National Public Health Agency, Ankara, Turkey (G. Korukluoğlu); Shahid Beheshti University of Medical Sciences, Tehran, Iran (M. Mardani, B. Sharifi-Mood); Aristotle University of Thessaloniki, Thessaloniki, Greece (A. Papa, P. Sidira, K. Tsergouli); and Bundeswehr Institute of Microbiology, Munich, Germany (R. Wölfel)

DOI: http://dx.doi.org/10.3201/eid1812.120710

belonging to the *Nairovirus* genus (1). The disease is asymptomatic in infected animals but can develop into severe illness in humans, with case-fatality rates as high as 50% in some outbreaks (2,3). The incubation period is typically 3–7 days, with sudden onset of myalgia, headache, and fever that can develop into a severe hemorrhagic syndrome (4,5). CCHFV is transmitted by tick bite (from mainly *Hyalomma* spp. ticks) or by contact with blood or tissues from infected livestock or patients with CCHF (2,6).

Sporadic cases of CCHF and community and nosocomial outbreaks have been increasingly reported, and the disease's geographic distribution is the most extensive among tick-borne diseases. Currently, CCHFV is enzootic in southeastern Europe (Bulgaria, Albania, Kosovo, and Greece), southern Russia, and several countries in the Middle East, Africa, and Asia (7–9). Given the abundance of vectors, potential hosts, favorable climate and ecology, and intensified human travel, emergence and rapid establishment of new CCHF foci in other countries are substantial risks (10). Emergence or reemergence of CCHF poses a serious public health threat because it is highly contagious and highly lethal, has the potential to cause nosocomial infection, and is difficult to treat, prevent, and control. In addition to enhanced surveillance and development of therapeutics, access to early, sensitive, and specific laboratory diagnosis is a key factor in increasing preparedness in Europe and other countries at risk (11–13).

Although viral isolation is the standard for CCHF diagnosis, because it has to be done in high-containment biosafety level 4 facilities, the number of laboratories that can perform this technique is limited. Moreover, because cell cultures lack sensitivity and usually only detect the relatively high viremia level encountered during the first 5 days of illness, viral isolation is not without error or uncertainty. As a consequence, reference laboratories have been using the best available practicable methods to determine the presence or absence of infection (11).
These methods include conventional and real-time quantitative reverse transcription PCR (RT-PCR and qRT-PCR) for detection of the viral genome (14–18) and indirect immunofluorescence assays (IFAs) or ELISAs for detection of specific IgM and IgG antibodies (19–22). No consensus on the most efficient molecular and serologic testing method has been reached.

In this context, a working group of experts from reference laboratories was constituted under the initiative of the European Network for Diagnostics of Imported Viral Diseases to take part in a multicenter study of CCHF diagnostic tests. The aim of this study was to evaluate and compare the performance of, and review the operational characteristics of, available CCHF diagnostic tests by using panels of well-characterized, archived serum samples from patients from geographically diverse settings.

## Materials and Methods

### Study Participants and Diagnostic Tools

Experts from 5 institutions participated in this study: Bundeswehr Institute of Microbiology, Munich, Germany; Department of Microbiology, Aristotle University of Thessaloniki, Thessaloniki, Greece; Center for Vectors and Infectious Diseases Research, National Institute of Health, Águas de Moura, Portugal; Institute of Microbiology and Immunology, Medical Faculty, Ljubljana, Slovenia; and Center for Microbiological Preparedness, Swedish Institute for Infectious Disease Control, Solna, Sweden. Diagnostic methods that could be performed in standard laboratory facilities were selected on the basis of a systematic review of the literature and the experiences of the members of the working group. During April 2010, an extensive search of available CCHF diagnostic tools was performed by using both generic (Google) and scientific (PubMed) Internet-based search engines. To meet the selection criteria, assays had to be commercially available or in the prerelease phase at the time of our assessment (or have quality assessed reagents and well-defined protocols for noncommercial assays); yield early and rapid results (within 5 hours); not require the purchase of specific equipment; and

have demonstrated sufficient scope to detect diverse CCHFV variants or antibodies. The reporting of results was conducted according to Standards for Reporting of Diagnostic Accuracy criteria (www.stard-statement.org; online Technical Appendix Table 1, wwwnc.cdc.gov/EID/pdfs/12-0710-Techapp.pdf).

### Patient Status Definition and Samples

Because no reference test for CCHF is universally accepted, patients with clinically suspected CCHF were confirmed on the basis of results of serologic and molecular diagnostic tests that were in use in the CCHF reference laboratories at the time of the study (Table 1). These cases were defined by the either positive rule: detection of CCHFV genome or CCHFV-specific IgM, IgG, or both, during either the acute or convalescent phase of the disease. Each participant in the working group contributed a panel of archived serum samples that had tested positive for CCHFV by IgM, IgG, or both, and a panel of archived serum RNA extracts from which CCHFV genome had been detected; samples were collected from patients with laboratory-confirmed CCHF infection. Negative controls were samples from healthy persons who originated from disease-endemic or at-risk areas (e.g., blood donors) and samples from febrile patients with a diagnosis of 1 of the conditions that can produce symptoms similar to those of CCHFV infection (e.g., hemorrhagic fever with renal syndrome, leptospirosis, West Nile fever, chikungunya). All samples were included in the study with the consent of the patients.

### Assay Methodology and Data Collection

Tests were performed according to the manufacturers' instructions or according to validated protocols provided by the developer. Working group members tested the selected assays in duplicate on their respective sample panels within their facilities. Results of qualitative assays (IFAs and low-cost, low-density [LCD] arrays) were read by 2 independent readers. Results were collected at the end of each testing session by using a standard report datasheet and combined into a final database.

<table><caption>Table 1. Reference methods used by the reference laboratories that participated in evaluation of serologic and molecular assays for diagnosis of CCHF</caption><thead><tr><td>Laboratory</td><td>Reference IgM serologic tests</td><td>Reference IgG serologic tests</td><td>Reference molecular tests</td></tr></thead><tbody><tr><td>1</td><td>In-house IFA (CCHFV-infected cells)</td><td>In-house IFA (CCHFV-infected cells)</td><td>Nested RT-PCR (23) and qRT-PCR (24)</td></tr><tr><td>2</td><td>In-house IgM capture ELISA (CCHFV strain IbAr10200 antigen)</td><td>In-house sandwich ELISA (CCHFV strain IbAr10200 antigen)</td><td>Nested RT-PCR (25) and qRT-PCR (17)</td></tr><tr><td>3</td><td>In-house IFA (CCHFV strain ArD39554 infected cells)</td><td>In-house IFA (CCHFV strain ArD39554 infected cells)</td><td>qRT-PCR (18)</td></tr><tr><td>4</td><td>In-house IFA (CCHFV infected cells)</td><td>In-house IFA (CCHFV infected cells)</td><td>qRT-PCR (18)</td></tr><tr><td>5</td><td>Testing performed by external reference laboratory</td><td>Testing performed by external reference laboratory</td><td>qRT-PCR (18)</td></tr></tbody></table>

<footnote>*CCHF, Crimean-Congo hemorrhagic fever; IFA, immunofluorescence assay; CCHFV, CCHF virus; RT-PCR, reverse transcription PCR; qRT-PCR, quantitative RT-PCR.</footnote>
## Data Analysis

Results obtained for each selected diagnostic tool were compared in a 2×2 table with results from the reference in-house diagnostic to estimate indices of sensitivity, specificity, and corresponding 95% CIs. In addition, test results were compared with the results of a composite reference standard (positive if detection of specific CCHFV genome or specific CCHF IgM or IgG antibodies by in-house reference methods; negative otherwise) to confirm the specificity estimates and corresponding 95% CIs. Statistical analysis was performed in STATA/ SE version 12.0 software (StataCorp, College Station, TX, USA). CIs were calculated by using binomial exact methods. A univariate analysis was conducted by using the Fisher exact test to identify factors influencing test sensitivity (i.e., patient country of origin, severity of disease, number of days after illness onset that sample was collected, and sample storage time before testing); p<0.05 was considered significant. A multinomial exact logistic regression analysis was performed to identify independent factors influencing sensitivity, including all variables associated with sensitivity in the univariate analysis (p<0.1). Data on operational characteristics of each test (i.e., ease-of-use, level of staff training required, time, ease of interpretation) were gathered through a questionnaire. Tests were scored on operational characteristics.

## Results

### Selected Diagnostic Methods

Six diagnostic assays met the criteria for inclusion in the study. For specific CCHF serodiagnosis, a commercial IgM and IgG ELISA (Vector-Best, Novosibirsk, Russia) and a commercial IgM and IgG IFA (Euroimmun, Luebeck, Germany) were selected. For detection of the CCHFV genome, a commercial real-time RT-PCR (Altona-Diagnostics, Hamburg, Germany) and a low-cost, low-density macroarray (26) were used. Characteristics of the selected tests are shown in Table 2. After selection, assays were purchased directly from the manufacturers and shipped according to their instructions to the working group members by express delivery.

### Characteristics of Study Population and Sample Panels

The serum panel constituted for the evaluation of the serologic tests consisted of 66 stored serum samples from acute-phase CCHF patients (those who recovered or died) and patients with confirmed CCHF diagnosis who had an early recovery; 32 samples from febrile patients who had symptoms compatible with CCHFV infection; and 41 samples from healthy persons. Molecular tests were evaluated by using a panel of RNA extracts from acute-phase patient serum samples: 54 samples from patients with confirmed CCHF diagnosis, 16 samples from febrile patients who had symptoms compatible with CCHFV infection, and 5 samples from healthy persons. Characteristics of

<table><caption>Table 2. Characteristics of selected assays compared in study of CCHF diagnostic tools</caption><thead><tr><th>Characteristics</th><th>IgM ELISA</th><th>IgG ELISA</th><th>IgM IFA</th><th>IgG IFA</th><th>qRT-PCR</th><th>LCD array</th></tr></thead><tbody><tr><td>Assay (manufacturer, location or reference)</td><td>VectoCrimea-CHF ELISA (Vector-Best, Novosibirsk, Russia)</td><td></td><td>Crimean-Congo Fever Mosaic 2 IFA (Euroimmun, Luebeck, Germany)</td><td></td><td>RealStar CCHFV RT-PCR Kit 1.2 (Altona-Diagnostics, Hamburg, Germany)</td><td>CCHFV2006 1.5 LCD Kit (26)</td></tr><tr><td>Reference no.</td><td>D-5054</td><td>D-5056</td><td>FI 279a-1010-2M</td><td>FI 279a-1010-2G</td><td>181203</td><td>NA</td></tr><tr><td>Target</td><td>CCHFV-specific IgM</td><td>CCHFV-specific IgG</td><td>CCHFV-specific IgM</td><td>CCHFV-specific IgG</td><td>CCHFV S segment</td><td>CCHFV S segment</td></tr><tr><td>Shelf life, mo</td><td>9</td><td>9</td><td>18</td><td>18</td><td>12</td><td>Unknown</td></tr><tr><td>Storage temperature, °C</td><td>2 to 8</td><td>2 to 8</td><td>2 to 8</td><td>2 to 8</td><td>-15 to -25</td><td>2 to 8, -20</td></tr><tr><td>Quoted accuracy, %</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Sensitivity</td><td>100</td><td>100</td><td>97.2</td><td>89.5</td><td>Unknown</td><td>100</td></tr><tr><td>Specificity</td><td>100</td><td>100</td><td>97.5</td><td>100</td><td>Unknown</td><td>100</td></tr><tr><td>Sample type</td><td>Serum, plasma</td><td>Serum, plasma</td><td>Serum, plasma</td><td>Serum, plasma</td><td>RNA extract from serum or blood</td><td>RNA extract from serum or blood</td></tr><tr><td>Sample volume, µL</td><td>10</td><td>10</td><td>5</td><td>5</td><td>10</td><td>10</td></tr><tr><td>Minimum kit format (no. reactions)</td><td>12 strips × 8 tests (96)</td><td>12 strips × 8 tests (96)</td><td>10 slides × 5 tests (50)</td><td>10 slides × 5 tests (50)</td><td>8 tubes × 12 tests (96)</td><td>4 slides × 8 tests (32)</td></tr><tr><td>Price, Euros†</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Per kit</td><td>139.2</td><td>139.2</td><td>326</td><td>326</td><td>1,200</td><td>Unknown</td></tr><tr><td>Per reaction</td><td>1.45</td><td>1.45</td><td>6.51</td><td>6.51</td><td>12.50</td><td>Unknown</td></tr><tr><td>Estimated run time, min</td><td>175</td><td>175</td><td>70</td><td>70</td><td>58</td><td>175</td></tr></tbody></table>

<footnote>*CCHFV, Crimean-Congo hemorrhagic fever virus; IFA, immunofluorescence assay; qRT-PCR, quantitative reverse transcription PCR; LCD, low-cost, low-density; NA, not applicable; S segment, small segment.</footnote>

<footnote>†Does not include shipping costs.</footnote>
the patient population and the sample panels are shown in Table 3. Confirmed CCHF case-patients originated from Iran, Kosovo, Albania, Turkey, and sub-Saharan Africa; most had moderate CCHF. Patients with symptoms compatible with CCHF infection included patients who had a diagnosis of leptospirosis, chikungunya fever, hemorrhagic fever with renal syndrome (HFRS), Q fever, tularemia, brucellosis, and West Nile encephalitis. Serum samples were collected 5–49 days after onset of symptoms; RNA extracts were obtained from serum samples collected 2–14 days after onset of symptoms. Storage time until testing ranged from 1 to 23 years for serum samples and 1 to 4 years for RNA extracts.

## Performances of Selected CCHF IgM Serology Assays

A total of 138 and 90 samples from the collected patient serum panels were tested for CCHFV-specific IgM by the Vector-Best ELISA and the Euroimmun IFA, respectively. Because of limited sample amounts, IFA could not be

performed on all collected samples. When compared with the reference IgM serology tests, the sensitivity of the IgM ELISA ranged from 75.0% to 100.0% for different laboratories, with an overall sensitivity of 87.8% (95% CI 78.6%–96.9%). For the IgM IFA, sensitivity ranged from 75.0% to 100.0%, with an overall sensitivity of 93.9% (95% CI 85.8%–100.0%). Overall specificity was estimated to be 98.9% (95% CI 96.7%–100.0%) for the IgM ELISA and 100% for the IgM IFA (Table 4). When a composite reference standard (described in the Methods section) was used as reference, the observed specificity was 100% for both tests.

## Performances of Selected CCHF IgG Serology Assays

A total of 137 and 92 samples from the collected patient serum panel were tested for CCHFV-specific IgG by the Vector-Best ELISA and the Euroimmun IFA, respectively. When compared with the reference IgG serology tests, the estimated sensitivity for the IgG ELISA ranged from 75.0%

<table><caption>Table 3. Patient characteristics and sample storage information for samples tested for CCHFV</caption><thead><tr><th rowspan="2">Characteristics</th><th colspan="2">Sample panel 1, serology, no. (%)</th><th colspan="2">Sample panel 2, genome detection, no. (%)</th></tr><tr><th>CCHFV positive, n = 66</th><th>CCHFV negative, n = 73</th><th>CCHFV positive, n = 54</th><th>CCHFV negative, n = 21</th></tr></thead><tbody><tr><td><strong>Conditions</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>CCHF</td><td>66 (100.0)</td><td>0</td><td>54 (100.0)</td><td>0</td></tr><tr><td>Brucellosis</td><td>0</td><td>2 (2.7)</td><td>0</td><td>2 (9.5)</td></tr><tr><td>Chikungunya</td><td>0</td><td>1 (1.4)</td><td>0</td><td>1 (4.8)</td></tr><tr><td>HFRS</td><td>0</td><td>13 (17.8)</td><td>0</td><td>7 (33.3)</td></tr><tr><td>Leptospirosis</td><td>0</td><td>13 (17.8)</td><td>0</td><td>3 (14.3)</td></tr><tr><td>Q fever</td><td>0</td><td>1 (1.4)</td><td>0</td><td>1 (4.8)</td></tr><tr><td>Tularemia</td><td>0</td><td>1 (1.4)</td><td>0</td><td>1 (4.8)</td></tr><tr><td>West Nile fever</td><td>0</td><td>1 (1.4)</td><td>0</td><td>1 (4.8)</td></tr><tr><td>Healthy or non-CCHF</td><td>0</td><td>41 (56.2)</td><td>0</td><td>5 (23.8)</td></tr><tr><td><strong>Patient country of origin</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>Albania</td><td>9 (13.6)</td><td>0</td><td>8 (14.8)</td><td>0</td></tr><tr><td>Germany</td><td>0</td><td>23 (31.5)</td><td>0</td><td>7 (33.3)</td></tr><tr><td>Greece</td><td>0</td><td>9 (12.3)</td><td>0</td><td>9 (42.9)</td></tr><tr><td>Iran</td><td>32 (48.5)</td><td>0</td><td>31 (57.4)</td><td>0</td></tr><tr><td>Kosovo</td><td>21 (31.8)</td><td>20 (27.4)</td><td>7 (13.0)</td><td>4 (19.0)</td></tr><tr><td>Portugal</td><td>0</td><td>20 (27.4)</td><td>0</td><td>0</td></tr><tr><td>Sub-Saharan Africa</td><td>4 (6.1)</td><td>0</td><td>0</td><td>0</td></tr><tr><td>Turkey</td><td>0</td><td>1 (1.4)</td><td>8 (14.8)</td><td>1 (4.8)</td></tr><tr><td><strong>CCHF disease severity</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>Moderate</td><td>49 (74.2)</td><td>0</td><td>37 (68.5)</td><td>0</td></tr><tr><td>Severe</td><td>11 (16.7)</td><td>0</td><td>2 (3.7)</td><td>0</td></tr><tr><td>Fatal</td><td>3 (4.5)</td><td>0</td><td>6 (11.1)</td><td>0</td></tr><tr><td>Asymptomatic</td><td>3 (4.5)</td><td>0</td><td>7 (13.0)</td><td>0</td></tr><tr><td>Unknown</td><td>0</td><td>0</td><td>2 (3.7)</td><td>0</td></tr><tr><td><strong>Length of illness, d</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>&lt;15 d</td><td>46 (69.7)</td><td>0</td><td>43 (79.6)</td><td>0</td></tr><tr><td>≥15 d</td><td>12 (18.2)</td><td>0</td><td>0</td><td>0</td></tr><tr><td>Asymptomatic</td><td>3 (4.5)</td><td>0</td><td>7 (13.0)</td><td>0</td></tr><tr><td>Unknown</td><td>5 (7.6)</td><td>0</td><td>4 (7.4)</td><td>0</td></tr><tr><td><strong>Sample storage time, y</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>&lt;10</td><td>49 (74.2)</td><td>64 (87.7)</td><td>54 (100.0)</td><td>10 (47.6)</td></tr><tr><td>≥10</td><td>17 (25.8)</td><td>0</td><td>0</td><td>2 (9.5)</td></tr><tr><td>Unknown</td><td>0</td><td>9 (12.3)</td><td>0</td><td>9 (42.9)</td></tr><tr><td><strong>Sample storage temperature, °C</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>-80</td><td>34 (51.5)</td><td>49 (67.1)</td><td>9 (16.7)</td><td>4 (19.1)</td></tr><tr><td>-70</td><td>32 (48.5)</td><td>0</td><td>45 (83.3)</td><td>9 (42.9)</td></tr><tr><td>-20</td><td>0</td><td>24 (32.9)</td><td>0</td><td>8 (38.1)</td></tr></tbody></table>

<footnote>*CCHF, Crimean-Congo hemorrhagic fever; CCHFV, CCHF virus; HFRS, hemorrhagic fever with renal syndrome.</footnote>
<table><caption>Table 4. Overall performance of assays compared in study of CCHF diagnostic tools</caption><thead><tr><th rowspan="2">Parameter</th><th colspan="2">IgM serology</th><th colspan="2">IgG serology</th><th colspan="2">Genome detection</th></tr><tr><th>ELISA</th><th>IFA</th><th>ELISA</th><th>IFA</th><th>qRT-PCR</th><th>LCD array</th></tr></thead><tbody><tr><td>No. samples tested</td><td>138</td><td>90</td><td>137</td><td>92</td><td>71</td><td>70</td></tr><tr><td>No. true positive</td><td>43</td><td>31</td><td>41</td><td>31</td><td>39</td><td>40</td></tr><tr><td>No. false negative</td><td>6</td><td>2</td><td>10</td><td>5</td><td>10</td><td>8</td></tr><tr><td>No. true negative</td><td>88</td><td>57</td><td>86</td><td>56</td><td>21</td><td>21</td></tr><tr><td>No. false positive</td><td>1</td><td>0</td><td>0</td><td>0</td><td>1</td><td>1</td></tr><tr><td>Sensitivity, % (95% CI)</td><td>87.8<br>(75.2–95.3)</td><td>93.9<br>(79.8–99.3)</td><td>80.4<br>(66.9–90.2)</td><td>86.1<br>(70.5–95.3)</td><td>79.6<br>(65.7–89.8)</td><td>83.3<br>(69.8–92.5)</td></tr><tr><td>Specificity, % (95% CI)</td><td>98.9<br>(93.9–100.0)</td><td>100.0<br>(93.7–100.0)†</td><td>100.0<br>(95.8–100.0)</td><td>100.0<br>(93.6–100.0)</td><td>95.5<br>(77.2–99.9)</td><td>95.5<br>(77.2–99.9)</td></tr></tbody></table>

to 100.0%, with an overall sensitivity of 80.4% (95% CI 69.5%–91.3%). For the IgG IFA, sensitivity ranged from 40.0% to 100.0%, with an overall sensitivity of 86.1% (95% CI 74.8%–97.4%). Specificity was estimated to be 100% for both assays (Table 4).

## Performances of Selected CCHF Molecular Assays

A total of 71 and 70 samples, respectively, from the collected panel of serum RNA extracts were tested for the presence of the CCHF genome by the Altona-Diagnostics CCHFV qRT-PCR and the CCHF LCD array. When compared with the results of the reference genome detection methods, sensitivity ranged from 42.9% to 100%, with an overall sensitivity of 79.6% (95% CI 68.3%–90.9%) for the qRT-PCR and from 25.0% to 100% with an overall sensitivity of 83.3% (95% CI 72.8%–95.5%) for the LCD array. Both assays demonstrated a specificity of 95.5% (95% CI 90.6%–100%) (Table 4), which increased to 100% when the results of a composite reference standard were used as reference.

## Factors Influencing Diagnostic Sensitivity

The influence of several patient and sample characteristics on the sensitivity of the selected assays was analyzed by univariate analysis (online Technical Appendix Table 2). The country of origin of the patient was found to be significantly associated with the sensitivity of the IgG IFA (p = 0.02), the qRT-PCR (p<0.001), and the LCD array (p = 0.02). However, after multivariate analysis, this association only remained significant for the qRT-PCR assay (p<0.001). In particular, the qRT-PCR was found to be less sensitive for samples from patients originating from Turkey (adjusted odds ratio [OR] 0.04, 95% CI 0.00–0.87) and from Albania (adjusted OR 0.02, 95% CI 0.00–0.16).

## Operational Characteristics of the CCHF Diagnostics

Scores for operational characteristics are summarized in Table 5. The ELISA test obtained a higher overall score (8.5/10) compared with the IFA (6.7/10). The IFA scored lowest in the ease of interpretation of results (1.3/2) and in

the requirement for specific technical training (0.3/1). The observed scores for molecular tests were within the same range (6.0–6.3/10). Both molecular assays demonstrated low scores for technical complexity (1.3–1.5/2) and training requirements for equipment and technique (0.3–0.5/1).

## Discussion

A number of published studies have described major epidemics, community and nosocomial outbreaks, and the ecology of CCHF (4,7,8,27–30). These reports have shown that a distinct epidemiologic situation can arise in regions where the virus is endemic but also that new foci can emerge (10,31). The World Health Organization has listed CCHF among the emerging diseases for which control and prevention measures should be renewed and intensified (13,32). In addition, an assessment of the importance and magnitude of vector-borne diseases initiated by the European Centre for Disease Prevention and Control identified CCHF as a priority disease for the European Union (33).

A strong laboratory capacity, in particular standardized approaches for diagnostic methods and assay validation, has been identified as a short-term priority in CCHF-endemic areas and regions where CCHFV could be expected to circulate (11,12). The aim of this study was to identify and evaluate easily available, simple-to-perform CCHF diagnostic methods considered most suitable for widespread use in CCHF-endemic areas and countries at risk.

We assessed the performances of 2 commercially available IgM and IgG serologic tests, the Vector-Best CCHF ELISA and the Euroimmun CCHF IFA, and 2 assays for viral genome detection, the Altona-diagnostics CCHF qRT-PCR and a CCHF LCD array. The IgM and IgG ELISAs showed a sensitivity of 88% and 80%, respectively, lower than the numbers given by the manufacturer. These assays were validated by the manufacturer by using serum panels from CCHF cases originating from southwestern Russia (S. Suchkov, pers. comm.). Therefore, lower sensitivity for certain serum samples tested in this study

<footnote>*CCHF, Crimean-Congo hemorrhagic fever; IFA, immunofluorescent assay; qRT-PCR, quantitative reverse transcription PCR; LCD, low-cost, low-density.</footnote>

<footnote>†One-sided 95% CI.</footnote>
<table><caption>Table 5. Operational characteristics of selected CCHF diagnostic assays*</caption><thead><tr><th rowspan="2">Operational characteristic</th><th colspan="4">Mean score</th></tr><tr><th>VectoCrimea-CHF ELISA†</th><th>Crimean-Congo Fever Mosaic 2 IFA‡</th><th>RealStar CCHFV RT-PCR Kit 1.2§</th><th>CCHF<sup>2006</sup> 1.5 LCD Kit (26)</th></tr></thead><tbody><tr><td><strong>Equipment¶</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>Maintenance of equipment required</td><td>0.8</td><td>0.3</td><td>0.3</td><td>0.3</td></tr><tr><td>Training for equipment required</td><td>0.8</td><td>0.7</td><td>0.3</td><td>0.5</td></tr><tr><td>Additional equipment required</td><td>0.8</td><td>1.0</td><td>0.5</td><td>0.8</td></tr><tr><td><strong>Technique</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>Clarity of instructions¶¶</td><td>1.0</td><td>0.7</td><td>1.0</td><td>1.0</td></tr><tr><td>Technical training required¶¶</td><td>0.8</td><td>0.3</td><td>0.3</td><td>0.3</td></tr><tr><td>Technical complexity#</td><td>2.0</td><td>1.7</td><td>1.5</td><td>1.3</td></tr><tr><td><strong>Interpretation</strong></td><td></td><td></td><td></td><td></td></tr><tr><td>Training required for result interpretation¶¶</td><td>1.0</td><td>0.7</td><td>0.8</td><td>0.8</td></tr><tr><td>Ease of interpretation of results#</td><td>1.5</td><td>1.3</td><td>1.5</td><td>1.5</td></tr><tr><td><strong>Total score</strong></td><td>8.5/10</td><td>6.7/10</td><td>6.0/10</td><td>6.3/10</td></tr></tbody></table>

may reflect antigenic variation among CCHFVs circulating in other countries.

Observed sensitivities of the IgM and IgG IFA were 93.9% and 86.1%, respectively. Although these estimates are higher than those observed for the IgM and IgG ELISAs, these results may have had a sampling bias because not all serum samples tested by ELISA could be tested by IFA. This bias was, however, minimized, because the tested serum panel included 15/16 false-negative samples observed for the ELISAs.

The sensitivity of the selected molecular assays was found to be more modest (79.6% for qRT-PCR and 83.3% for LCD array) than for serologic methods and to be associated with the patient country of origin. This result is consistent with the finding that the application of molecular assays in different settings is hampered by the high diversity of the CCHFV genomes, whereas serologic methods can have a broader use due to cross-reactivities. In particular, the qRT-PCR seems to be less sensitive for patients originating from the Balkans region and Turkey than for patients from other countries compared with in-house reference molecular methods. The in-house methods developed by reference laboratories are optimized for detection of strains circulating in that area, which may result in a lower detection limit when compared with methods that cover a broader spectrum. However, other factors, such as RNA degradation due to freezing and thawing cycles or inhibition of PCR reactions because of inhibitory compounds in the samples, may have contributed to decreased sensitivity of molecular methods compared with serologic methods.

The observed specificity was excellent for all assays, ranging from 95.5% to 100% when compared with the

reference method and equal to 100% when compared with a composite reference standard. However, predictive positive and negative values for the different assays could not be calculated because precise prevalence data are not available for most CCHF-endemic areas, and these data cannot be predicted for areas where the virus could emerge.

The CCHF IFA demonstrated a higher complexity in equipment, technique, and interpretation. However, the interpretation of fluorescence patterns may enable trained users to differentiate positive from cross-reactive serum samples, whereas such false positives may not be avoided with the ELISA. The operational characteristics of the molecular assays were comparable. Both methods required regular equipment maintenance and specific training for appropriate use of the equipment; however, this was more apparent for the real-time qRT-PCR method. The LCD array technique was considered to be complex but acceptable. Training for technique and result interpretation was recommended for each method.

All participating laboratories are reference centers for CCHF laboratory diagnosis and surveillance in their respective countries, and some are World Health Organization collaborating centers. The protocols from reference methods in use at each site have been extensively validated previously (16–20,24). In addition, the laboratories participated in a recent international external quality assessment (34). Therefore, local conditions at the participating sites and validity of reference methods were considered comparable.

The multicenter design of this study enabled the testing of a large sample size, representative of ≥1 population, so findings could be more generally applicable. In addition, sample panels were constituted without any selection for

<footnote>*CCHF, Crimean-Congo hemorrhagic fever; IFA, immunofluorescent assay; CCHFV, CCHF virus; RT-PCR, reverse transcription PCR; LCD, low-cost, low-density.</footnote>

<footnote>†Vector-Best, Novosibirsk, Russia.</footnote>

<footnote>‡Euroimmun, Luebeck, Germany.</footnote>

<footnote>§Altona-Diagnostics, Hamburg, Germany.</footnote>

<footnote>¶A score of 1 was attributed when instructions were sufficiently clear or when no specific training, no additional equipment, or no regular equipment maintenance were necessary.</footnote>

<footnote>\#Score was attributed according to the degree of simplicity of the technique or interpretation: 2 if it was considered easy, 1 if it was considered acceptable, and 0 if it was considered difficult.</footnote>
disease severity, and negative controls included not only healthy patients but also patients who had a wide range of other conditions, thereby avoiding inflated estimates of diagnostic accuracy.

Our study has some limitations. Because archived samples were used for the study, specimen quality could have been affected; however, statistical analysis demonstrated that sample storage time and temperature did not influence sensitivity. Also, the use of different sample panels for serologic and molecular testing did not enable calculation of the added value of combining the serologic and molecular CCHF diagnostic methods evaluated.

The results of this study give additional guidance on the type of CCHF diagnostic tools that could be used in different contexts. During a large outbreak, easily interpretable tests for simultaneous analysis of numerous samples, such as the ELISA and real-time qRT-PCR, might be considered useful tools to identify CCHF cases. Methods available in smaller format size and demonstrating a long shelf life, such as the IFA and LCD array, could be used to identify sporadic cases or to confirm single cases as part of a larger outbreak.

This study demonstrates that efficient, well-characterized serologic and molecular assays and protocols are available for CCHF diagnosis. The on-site use of such assays by outbreak assistance laboratories would greatly diminish the risks posed by the handling, packaging, and shipping of highly infectious samples. Moreover, acquiring diagnostic reagents would be more time- and cost-effective for laboratories than would the organization of compliant packaging and shipment of hazardous biologic material to reference laboratories abroad. Nevertheless, laboratory personnel should receive the appropriate training to perform the different assays (e.g., during international workshops or network meetings). Collaborative evaluations of diagnostic methods remain essential to guide decision-making, especially with emerging diseases, where a standard is frequently missing, and laboratory expertise is rare.

This work was supported by the European Network for Diagnostics of Imported Viral Diseases project, funded by the European Centre for Disease Prevention and Control under the Framework Service (contract ref. no. ECDC/2008/011); and the CCH Fever network (collaborative project), funded by the European Commission under the Health Cooperation Work Programme of the 7th Framework Programme (grant agreement no. 260427).

Dr Vanhomwegen is a research fellow at Institut Pasteur, Paris. Her research interests include the development and validation of tools for rapid detection and characterization of emerging pathogens.

## References

1. Morikawa S, Saijo M, Kurane I. Recent progress in molecular biology of Crimean-Congo hemorrhagic fever. Comp Immunol Microbiol Infect Dis. 2007;30:375-89. http://dx.doi.org/10.1016/j.cimid.2007.07.001

2. Whitehouse CA. Crimean-Congo hemorrhagic fever. Antiviral Res. 2004;64:145-60. http://dx.doi.org/10.1016/j.antiviral.2004.08.001

3. Episouth. Epidemiology of Crimean-Congo haemorrhagic fever virus: Albania, Bulgaria, Greece, Islamic Republic of Iran, Kosovo, Russian Federation, Turkey. 2008 Oct 1 [cited 2011 Nov 15]. http://www.episouth.org/outputs/wp6/Episouth_CCHF_01_10_2008_final.pdf

4. Hoogstraal H. The epidemiology of tick-borne Crimean-Congo hemorrhagic fever in Asia, Europe, and Africa. J Med Entomol. 1979;15:307-417.

5. Ergonul O, Whitehouse CH, editors. Crimean-Congo hemorrhagic fever: a global perspective. Dordrecht (the Netherlands): Springer; 2007.

6. Appannanavar SB, Mishra B. An update on Crimean Congo hemorrhagic fever. J Glob Infect Dis. 2011;3:285-92. http://dx.doi.org/10.4103/0974-777X.83537

7. Leblebicioglu H. Crimean-Congo haemorrhagic fever in Eurasia. Int J Antimicrob Agents. 2010;36(Suppl 1):S43-6. http://dx.doi.org/10.1016/j.ijantimicag.2010.06.020

8. Chinikar S, Ghiasi SM, Hewson R, Moradi M, Haeri A. Crimean-Congo hemorrhagic fever in Iran and neighboring countries. J Clin Virol. 2010;47:110-4. http://dx.doi.org/10.1016/j.jcv.2009.10.014

9. Ergönül O. Crimean-Congo haemorrhagic fever. Lancet Infect Dis. 2006;6:203-14. http://dx.doi.org/10.1016/S1473-3099(06)70435-2

10. Maltezou HC, Papa A. Crimean-Congo hemorrhagic fever: Risk for emergence of new endemic foci in Europe? Travel Med Infect Dis. 2010;8:139-43. http://dx.doi.org/10.1016/j.tmaid.2010.04.008

11. Maltezou HC, Andonova L, Andraghetti R, Bouloy M, Ergonul O, Jongejan F, et al. Crimean-Congo hemorrhagic fever in Europe: current situation calls for preparedness. Euro Surveill. 2010;15:19504.

12. European Center for Disease Control and Prevention. Consultation on Crimean-Congo haemorrhagic fever prevention and control. Meeting report. 2008 Sep [cited 2011 Nov 15]. http://ecdc.europa.eu/en/publications/Publications/0809_MER_Crimean_Congo_Haemorragic_Fever Prevention and Control.pdf

13. World Health Organization. Fièvre hémorragique Crimée-Congo, hantavirus et fièvre hémorragique Alkhurma—menaces de maladies infectieuses émergentes. Rapport du Secrétariat. 2010 Apr 15 [cited 2011 Nov 16]. http://apps.who.int/gb/ebwha/pdf_files/EB127/B127_3-fr.pdf

14. Ke R, Zorzet A, Göransson J, Lindegren G, Sharifi-Mood B, Chinikar S, et al. A colorimetric nucleic acid testing assay for RNA virus detection based on circle-to-circle amplification of padlock probes. J Clin Microbiol. 2011;49:4279-85. http://dx.doi.org/10.1128/JCM.00713-11

15. Drosten C, Kümmerer BM, Schmitz H, Günther S. Molecular diagnostics of viral hemorrhagic fevers. Antiviral Res. 2003;57:61-87. http://dx.doi.org/10.1016/S0166-3542(02)00201-2

16. Burt FJ, Leman P, Smith J, Swanepoel R. The use of a reverse transcription-polymerase chain reaction for the detection of viral nucleic acid in the diagnosis of Crimean-Congo haemorrhagic fever. J Virol Methods. 1998;70:129-37. http://dx.doi.org/10.1016/S0166-0934(97)00182-1

17. Duh D, Saksida A, Petrovec M, Ahmeti S, Dedushaj I, Panning M, et al. Viral load as predictor of Crimean-Congo hemorrhagic fever outcome. Emerg Infect Dis. 2007;13:1769-72. http://dx.doi.org/10.3201/eid1311.070222
18. Wölfel R, Paweska JT, Petersen N, Grobbelaar AA, Leman PA, Hewson R, et al. Virus detection and monitoring of viral load in Crimean-Congo hemorrhagic fever virus patients. Emerg Infect Dis. 2007;13:1097-100. http://dx.doi.org/10.3201/eid1307.070068

19. Saijo M, Qing T, Niikura M, Maeda A, Ikegami T, Sakai K, et al. Immunofluorescence technique using HeLa cells expressing recombinant nucleoprotein for detection of immunoglobulin G antibodies to Crimean-Congo hemorrhagic fever virus. J Clin Microbiol. 2002;40:372-5. http://dx.doi.org/10.1128/JCM.40.2.372-375.2002

20. Saijo M, Qing T, Niikura M, Maeda A, Ikegami T, Prehaud C, et al. Recombinant nucleoprotein-based enzyme-linked immunosorbent assay for detection of immunoglobulin G antibodies to Crimean-Congo hemorrhagic fever virus. J Clin Microbiol. 2002;40:1587-91. http://dx.doi.org/10.1128/JCM.40.5.1587-1591.2002

21. Emmerich P, Avsic-Zupanc T, Chinikar S, Saksida A, Thomé-Bolduan C, Parczany-Hartmann A, et al. Early serodiagnosis of acute human Crimean-Congo hemorrhagic fever virus infections by novel capture assays. J Clin Virol. 2010;48:294-5. http://dx.doi.org/10.1016/j.jcv.2010.05.002

22. Samudzi RR, Leman PA, Paweska JT, Swanepoel R, Burt FJ. Bacterial expression of Crimean-Congo hemorrhagic fever virus nucleoprotein and its evaluation as a diagnostic reagent in an indirect ELISA. J Virol Methods. 2012;179:70-6. http://dx.doi.org/10.1016/j.viromet.2011.09.023

23. Schwarz TF, Nsanze H, Longson M, Nitschko H, Gilch S, Shurie H, et al. Polymerase chain reaction for diagnosis and identification of distinct variants of Crimean-Congo hemorrhagic fever virus in the United Arab Emirates. Am J Trop Med Hyg. 1996;55:190-6.

24. Papa A, Drosten C, Bino S, Papadimitriou E, Panning M, Velo E, et al. Viral load and Crimean-Congo hemorrhagic fever. Emerg Infect Dis. 2007;13:805-6. http://dx.doi.org/10.3201/eid1305.061588

25. Rodriguez LL, Maupin GO, Ksiazek TG, Rollin PE, Khan AS, Schwarz TF, et al. Molecular investigation of a multisource outbreak of Crimean-Congo hemorrhagic fever in the United Arab Emirates. Am J Trop Med Hyg. 1997;57:512-8.

26. Wölfel R, Paweska JT, Petersen N, Grobbelaar AA, Leman PA, Hewson R, et al. Low-density macroarray for rapid detection and identification of Crimean-Congo hemorrhagic fever virus. J Clin Microbiol. 2009;47:1025-30. http://dx.doi.org/10.1128/JCM.01920-08

27. Papa A. Crimean-Congo hemorrhagic fever virus, northeastern Greece. Emerg Infect Dis. 2011;17:141-3. http://dx.doi.org/10.3201/eid1701.100073

28. Humolli I, Dedushaj I, Zupanac TA, Muçaj S. Epidemiological, serological and herd immunity of Crimean-Congo haemorrhagic fever in Kosovo. Med Arh. 2010;64:91-3.

29. Suleiman MN, Muscat-Baron JM, Harries JR, Satti AG, Platt GS, Bowen ET, et al. Congo/Crimean haemorrhagic fever in Dubai. An outbreak at the Rashid Hospital. Lancet. 1980;2:939-41.

30. Zakhashvili K. Crimean-Congo hemorrhagic fever in man, Republic of Georgia, 2009. Emerg Infect Dis. 2010;16:1326-8. http://dx.doi.org/10.3201/eid1608.100181

31. Randolph SE, Rogers DJ. The arrival, establishment and spread of exotic diseases: patterns and predictions. Nat Rev Microbiol. 2010;8:361-71. http://dx.doi.org/10.1038/nrmicro2336

32. World Health Organization. International Health Regulations (2005), 2nd ed. 2008 [cited 2012 Feb 15]. http://whqlibdoc.who.int/publications/2008/9789241580410_eng.pdf

33. European Center for Disease Control and Prevention. Strategies for disease-specific programmes 2010-2013. 2010 Jul [cited 2012 Feb 15]. http://ecdc.europa.eu/en/publications/Publications/100714 COR_Strategies_for_disease-specific_programmes_2010-2013.pdf

34. Escadafal C, Öhlschläger S, Avšič-Županc T, Vanhomwegen J, Mirazimi A, Teichmann A, et al. First international external quality assessment of molecular detection of Crimean-Congo hemorrhagic fever virus. PLoS Negl Trop Dis. 2012;6:e1706. Epub 2012 Jun 26. http://dx.doi.org/10.1371/journal.pntd.0001706

Address for correspondence: Jessica Vanhomwegen, CIBU, Institut Pasteur, 25-28 Rue du Dr. Roux, 75015 Paris, France; email: jvhomweg@pasteur.fr

Table of Contents

<figure><img src="image_3.png" /></figure>

Emailed to you

GovDelivery

Manage your email alerts so you only receive content of interest to you.

Sign up for an Online Subscription:
wwwnc.cdc.gov/eid/subscribe.htm
# Diagnostic Assays for Crimean-Congo Hemorrhagic Fever

## Technical Appendix

<table><caption>Technical Appendix Table 1. STARD checklist for reporting of studies of diagnostic accuracy</caption><thead><tr><th>Section and Topic</th><th>Item no.</th><th>Category</th><th>On page no.</th></tr></thead><tbody><tr><td>TITLE/ABSTRACT/ KEYWORDS</td><td>1</td><td>Identify the article as a study of diagnostic accuracy (recommend MeSH heading "sensitivity and specificity").</td><td>1, 2, 3</td></tr><tr><td>INTRODUCTION</td><td>2</td><td>State the research questions or study aims, such as estimating diagnostic accuracy or comparing accuracy between tests or across participant groups.</td><td>5</td></tr><tr><td>METHODS Participants</td><td>3</td><td>Describe<br/>The study population: The inclusion and exclusion criteria, setting and locations where data were collected.</td><td>5, 6</td></tr><tr><td></td><td>4</td><td>Participant recruitment: Was recruitment based on presenting symptoms, results from previous tests, or the fact that the participants had received the index tests or the reference standard?</td><td>6</td></tr><tr><td></td><td>5</td><td>Participant sampling: Was the study population a consecutive series of participants defined by the selection criteria in item 3 and 4? If not, specify how participants were further selected.</td><td>6</td></tr><tr><td></td><td>6</td><td>Data collection: Was data collection planned before the index test and reference standard were performed (prospective study) or after (retrospective study)?</td><td>5, 6</td></tr><tr><td>Test methods</td><td>7</td><td>The reference standard and its rationale.</td><td>6</td></tr><tr><td></td><td>8</td><td>Technical specifications of material and methods involved including how and when measurements were taken, and/or cite references for index tests and reference standard.</td><td>5, 7</td></tr><tr><td></td><td>9</td><td>Definition of and rationale for the units, cutoffs and/or categories of the results of the index tests and the reference standard.</td><td>6</td></tr><tr><td></td><td>10</td><td>The number, training and expertise of the persons executing and reading the index tests and the reference standard.</td><td>6, 11</td></tr><tr><td></td><td>11</td><td>Whether or not the readers of the index tests and reference standard were blind (masked) to the results of the other test and describe any other clinical information available to the readers.</td><td>—</td></tr><tr><td>Statistical methods</td><td>12</td><td>Methods for calculating or comparing measures of diagnostic accuracy, and the statistical methods used to quantify uncertainty (e.g., 95% CIs).</td><td>6, 7</td></tr><tr><td></td><td>13</td><td>Methods for calculating test reproducibility, if done.</td><td>NA</td></tr><tr><td>RESULTS Participants</td><td>14</td><td>Report<br/>When study was performed, including beginning and end dates of recruitment.</td><td>5</td></tr><tr><td></td><td>15</td><td>Clinical and demographic characteristics of the study population (at least information on age, gender, spectrum of presenting symptoms).</td><td>7, 8</td></tr><tr><td></td><td>16</td><td>The number of participants satisfying the criteria for inclusion who did or did not undergo the index tests and/or the reference standard; describe why participants failed to undergo either test (a flow diagram is strongly recommended).</td><td>7, 8</td></tr><tr><td>Test results</td><td>17</td><td>Time-interval between the index tests and the reference standard, and any treatment administered in between.</td><td>NA</td></tr><tr><td></td><td>18</td><td>Distribution of severity of disease (define criteria) in those with the target condition; other diagnoses in participants without the target condition.</td><td>8</td></tr><tr><td></td><td>19</td><td>A cross tabulation of the results of the index tests (including indeterminate and missing results) by the results of the reference standard; for continuous results, the distribution of the test results by the results of the reference standard.</td><td>8, 9</td></tr><tr><td>Estimates</td><td>20</td><td>Any adverse events from performing the index tests or the reference standard.</td><td>NA</td></tr><tr><td></td><td>21</td><td>Estimates of diagnostic accuracy and measures of statistical uncertainty (e.g., 95% confidence intervals).</td><td>8, 9</td></tr><tr><td></td><td>22</td><td>How indeterminate results, missing data and outliers of the index tests were handled.</td><td>8, 9, 10</td></tr><tr><td></td><td>23</td><td>Estimates of variability of diagnostic accuracy between subgroups of participants, readers or centers, if done.</td><td>8, 9</td></tr><tr><td></td><td>24</td><td>Estimates of test reproducibility, if done.</td><td>NA</td></tr><tr><td>DISCUSSION</td><td>25</td><td>Discuss the clinical applicability of the study findings.</td><td>12</td></tr></tbody></table>

<footnote>*STARD, Standards for Reporting of Diagnostic Accuracy (www.stard-statement.org); NA, not applicable.</footnote>
<table><caption>Technical Appendix Table 2. Univariate analysis of factors influencing the sensitivity of CCHF diagnostic assays*</caption><thead><tr><th rowspan="3">Patient and sample characteristics</th><th colspan="4">IgM serology</th><th colspan="4">IgG serology</th><th colspan="4">Genome detection</th></tr><tr><th colspan="2">ELISA</th><th colspan="2">IFA</th><th colspan="2">ELISA</th><th colspan="2">IFA</th><th colspan="2">qRT-PCR</th><th colspan="2">LCD array</th></tr><tr><th>Se, %†</th><th>p value‡</th><th>Se, %†</th><th>p value‡</th><th>Se, %†</th><th>p value‡</th><th>Se, %†</th><th>p value‡</th><th>Se, %†</th><th>p value‡</th><th>Se, %†</th><th>p value‡</th></tr></thead><tbody><tr><td>Country of origin</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Albania</td><td>80.0</td><td>0.07</td><td>80.0</td><td>0.13</td><td>83.3</td><td>0.90</td><td>83.3</td><td>0.02</td><td>62.5</td><td>&lt;0.001</td><td>71.4</td><td>0.02</td></tr><tr><td>Iran</td><td>75.0</td><td></td><td>75.0</td><td></td><td>75.0</td><td></td><td>40.0</td><td></td><td>100.0</td><td></td><td>96.2</td><td></td></tr><tr><td>Kosovo</td><td>100.0</td><td></td><td>100.0</td><td></td><td>81.0</td><td></td><td>95.2</td><td></td><td>71.4</td><td></td><td>57.1</td><td></td></tr><tr><td>Sub-Saharan Africa</td><td>100.0</td><td></td><td>100.0</td><td></td><td>100.0</td><td></td><td>100.0</td><td></td><td>—</td><td></td><td>—</td><td></td></tr><tr><td>Turkey</td><td>—</td><td></td><td>—</td><td></td><td>—</td><td></td><td>—</td><td></td><td>37.5</td><td></td><td>75.0</td><td></td></tr><tr><td>Disease severity</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Asymptomatic</td><td>50.0</td><td>0.11</td><td>50.0</td><td>0.12</td><td>50.0</td><td>0.32</td><td>50.0</td><td>0.36</td><td>57.1</td><td>0.09</td><td>66.7</td><td>0.16</td></tr><tr><td>Moderate</td><td>85.3</td><td></td><td>94.4</td><td></td><td>83.3</td><td></td><td>85.7</td><td></td><td>87.5</td><td></td><td>90.6</td><td></td></tr><tr><td>Severe or fatal</td><td>100.0</td><td></td><td>100.0</td><td></td><td>76.9</td><td></td><td>92.3</td><td></td><td>62.5</td><td></td><td>75.0</td><td></td></tr><tr><td>Unknown§</td><td>—</td><td></td><td>—</td><td></td><td>—</td><td></td><td>—</td><td></td><td>100.0</td><td></td><td>50.0</td><td></td></tr><tr><td>Length of illness, d</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&lt;15</td><td>83.9</td><td>0.2</td><td>93.3</td><td>0.58</td><td>78.1</td><td>0.09</td><td>76.5</td><td>0.10</td><td>86.8</td><td>—</td><td>92.1</td><td>—</td></tr><tr><td>≥15</td><td>100.0</td><td></td><td>100.0</td><td></td><td>100.0</td><td></td><td>100.0</td><td></td><td>—</td><td></td><td>—</td><td></td></tr><tr><td>Unknown or asymptomatic§</td><td>85.7</td><td></td><td>85.7</td><td></td><td>57.1</td><td></td><td>85.7</td><td></td><td>54.5</td><td></td><td>50.0</td><td></td></tr><tr><td>Sample storage time, y</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>&lt;10</td><td>81.3</td><td>0.07</td><td>87.50</td><td>0.23</td><td>76.5</td><td>0.27</td><td>79.0</td><td>0.21</td><td>79.6</td><td>—</td><td>83.3</td><td>—</td></tr><tr><td>≥10</td><td>100.0</td><td></td><td>100.0</td><td></td><td>88.2</td><td></td><td>94.1</td><td></td><td>—</td><td></td><td>—</td><td></td></tr></tbody></table>

<footnote>*CCHF, Crimean-Congo hemorrhagic fever; se, sensitivity; IFA, immunofluorescence assay; qRT-PCR, quantitative reverse transcription PCR; LCD, low-cost, low-density.</footnote>

<footnote>†Sensitivity compared with reference test results.</footnote>

<footnote>‡One-tailed Fisher exact test p value.</footnote>

<footnote>§Not included in the Fisher exact test calculations.</footnote>