# Classification and specific primer design for accurate detection of SARS-CoV-2 using deep learning

Alejandro Lopez-Rincon, Alberto Tonda, Lucero Mendoza-Maldonado, Daphne Mulders, Richard Molenkamp, Carmina Perez-Romero, Eric Claassen, Johan Garssen, Aletta Kraneveld

► To cite this version:

Alejandro Lopez-Rincon, Alberto Tonda, Lucero Mendoza-Maldonado, Daphne Mulders, Richard Molenkamp, et al. Classification and specific primer design for accurate detection of SARS-CoV-2 using deep learning. Scientific Reports, 2021, 11, pp.947. 10.1038/s41598-020-80363-5. hal-03122094

HAL Id: hal-03122094

https://hal.science/hal-03122094

Submitted on 4 Nov 2021

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

Check for updates

OPEN

# Classification and specific primer design for accurate detection of SARS-CoV-2 using deep learning

Alejandro Lopez-Rincon<sup>1,2</sup>, Alberto Tonda<sup>2</sup>, Lucero Mendoza-Maldonado<sup>3</sup>, Daphne G. J. C. Mulders<sup>4</sup>, Richard Molenkamp<sup>4</sup>, Carmina A. Perez-Romero<sup>5</sup>, Eric Claassen<sup>6</sup>, Johan Garssen<sup>1,7</sup> & Aletta D. Kraneveld<sup>1</sup>

In this paper, deep learning is coupled with explainable artificial intelligence techniques for the discovery of representative genomic sequences in SARS-CoV-2. A convolutional neural network classifier is first trained on 553 sequences from the National Genomics Data Center repository, separating the genome of different virus strains from the Coronavirus family with 98.73% accuracy. The network's behavior is then analyzed, to discover sequences used by the model to identify SARS-CoV-2, ultimately uncovering sequences exclusive to it. The discovered sequences are validated on samples from the National Center for Biotechnology Information and Global Initiative on Sharing All Influenza Data repositories, and are proven to be able to separate SARS-CoV-2 from different virus strains with near-perfect accuracy. Next, one of the sequences is selected to generate a primer set, and tested against other state-of-the-art primer sets, obtaining competitive results. Finally, the primer is synthesized and tested on patient samples (n = 6 previously tested positive), delivering a sensitivity similar to routine diagnostic methods, and 100% specificity. The proposed methodology has a substantial added value over existing methods, as it is able to both automatically identify promising primer sets for a virus from a limited amount of data, and deliver effective results in a minimal amount of time. Considering the possibility of future pandemics, these characteristics are invaluable to promptly create specific detection methods for diagnostics.

The Coronaviridae family presents a positive sense, single-strand RNA genome. These viruses have been identified in avian and mammal hosts, including humans. Coronaviruses have genomes from 26.4 kilo base-pairs (kbps) to 31.7 kbps, with G + C contents varying from 32 to 43%; human-infecting coronaviruses belonging to this family include SARS-CoV, MERS-CoV, HCoV-OC43, HCoV-229E, HCoV-NL63 and HCoV-HKU1¹. In December 2019, SARS-CoV-2, a novel, human-infecting Coronavirus was identified in Wuhan, China, using Next Generation Sequencing (NGS)². As of the 12th August of 2020, the new SARS-CoV-2 has 20,162,474 confirmed cases across almost all countries, with 3,641,603 cases in the European region³. In addition, SARS-CoV-2 has an estimated mortality rate of 3–4%, and it is spreading faster than SARS-CoV and MERS-CoV⁴.

As a typical RNA virus, new mutations appear every replication cycle of Coronavirus, and its average evolutionary rate is roughly 10⁻⁴ nucleotide substitutions per site each year². In the specific case of SARS-CoV-2, RT-qPCR testing using primers in ORF1ab and N genes have been used to identify the infection in humans⁵. This method has come into question; Yang et al. in a study from 866 respiratory specimens showed that for 0–7 days after onset of illness, the sputum samples had a negative rate of 11.1% in severe and 17.8% in mild cases, follow by 26.7% and 27.0% in nasal swabs and finally 40% and 38.7% for throat swabs⁶. Zhao et al. reports that 35.2% of 173 patients did not show positive in RT-PCR test⁷, which has been further explored by Arevalo et al.⁸ and Woloshin et al.⁹. These problems could be the result of the variation of viral RNA sequences within virus species, and the viral load in different anatomic sites¹⁰. It has been noted that, population mutation frequency

<footnote n="1">¹Division of Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Faculty of Science, Utrecht University, Universiteitsweg 99, 3584 CG Utrecht, The Netherlands. ²UMR 518 MIA-Paris, INRAE, c/o 113 rue Nationale, 75103 Paris, France. ³Hospital Civil de Guadalajara "Dr. Juan I. Menchaca", Salvador Quevedo y Zubieta 750, Independencia Oriente, C.P. 44340 Guadalajara, Jalisco, México. ⁴Department of Viroscience, Erasmus Medical Center, Rotterdam, The Netherlands. ⁵Departamento de Investigación, Universidad Central de Queretaro (UNICEQ), Av. 5 de Febrero 1602, San Pablo, 76130 Santiago de Querétaro, QRO, Mexico. ⁶Athena Institute, Vrije Universiteit, De Boelelaan 1085, 1081 HV Amsterdam, The Netherlands. ⁷Department Immunology, Danone Nutricia research, Uppsalalaan 12, 3584 CT Utrecht, The Netherlands. ⁸email: a.lopezrincon@uu.nl</footnote>
of site 8872 located in ORF1ab gene and site 28,144 located in ORF8 gene gradually increased from 0 to 29% as the epidemic progressed¹¹. Apart from the false negative test problems, SARS-CoV-2 assays can yield a small portion of false positives through nonspecific detection of other Coronaviruses, as the virus is closely related to other Coronavirus organisms¹². In addition, SARS-CoV-2 may be present with other respiratory infections, hindering its identification¹³,¹⁴.

Thus, it is fundamental to improve existing diagnostic tools to contain the spread. For example, diagnostic tools combining computed tomography (CT) scans with deep learning have been proposed, achieving an improved detection accuracy of 82.9%¹⁵. Another solution being used for studying SARS-CoV-2, is sequencing of the viral complementary DNA (cDNA). For example, we can use this sequencing data with cDNA, resulting from the PCR of the original viral RNA; e.g. Real-Time PCR amplicons to identify the SARS-CoV-2¹⁶.

Classification using viral sequencing techniques is mainly based on alignment methods such as FASTA¹⁷ and BLAST¹⁸. These methods rely on the assumption that cDNA sequences share common features, and their order prevails among different sequences¹⁹,²⁰. However, these methods suffer from the necessity of needing base sequences for the detection²¹. Nevertheless, it is necessary to develop innovative improved diagnostic tools that target the genome to improve the identification of pathogenic variants, as sometimes several tests are needed to have an accurate diagnosis. Therefore, as an alternative, deep learning methods have been suggested for classification of DNA sequences. The advantage of these methods are that they do not need pre-selected features to identify or classify DNA sequences. Deep Learning has been efficiently used for classification of DNA sequences, using one-hot label encoding and Convolutional Neural Networks (CNN)²²,²³, albeit the examples in literature are featuring DNA sequences of length up to 500 bps, only.

In particular, for the case of viruses, NGS genomic samples might not be identified by BLAST, as there are no reference sequences valid for all genomes, as viruses have high mutation frequency²⁴. Alternative solutions based on deep learning have been proposed to classify viruses, by dividing sequences into pieces of fixed length, ranging from 300 bps²⁴ to 3000 bps²⁵. However, this approach has the negative effect of potentially ignoring part of the information contained in the input sequence, that is disregarded if it cannot completely fill a piece of fixed size. The global impact of SARS-CoV-2 prompted researchers to apply effective alignment-free methods to the classification of the virus: for example, in²⁶ the authors propose the use of Machine Learning Digital Signal Processing for separating the virus from similar strains, with remarkable accuracy. Nevertheless, there is no human-readable information that can be extracted from their black-box procedure, so the biological insight provided by their approach is limited. In order to offer further understanding to experts, techniques from the field of explainable AI (XAI)²⁷,²⁸ could be potentially effective; and it is interesting to remark that similar consideration specifically for the medical domain have already appeared in literature²⁹.

Given the impact of the world-wide outbreak, international efforts have been made to simplify the access to viral genomic data and metadata through international repositories, such as the National Genomics Data Center (NGDC) repository¹¹, the National Center for Biotechnology Information (NCBI) repository³⁰ and the Global Initiative on Sharing All Influenza Data (GISAID) repository³¹, expecting that the ease of access to information would make it possible to develop medical countermeasures to control the disease worldwide, as it happened in similar cases earlier³²⁻³⁴. Thus, taking advantage of the available information of international resources without any political and/or economic borders, we propose an innovative system based on viral gene sequencing.

Using a CNN to separate Coronaviruses belonging to different strains³⁵, including SARS-CoV-2, we apply techniques inspired by XAI in computer vision to discover representative cDNA sequences that the network uses to classify SARS-CoV-2. We then validate the discovered sequences on datasets not used during the training of the CNN, and show how to exploit them to create a novel, highly informative set of sequence features (e.g. viral sequences). Such sequences can be later inspected and analyzed by human experts. Experimental results show that the new set of sequence features leads traditional, simple classifiers, to correctly assess SARS-CoV-2 with remarkable accuracy (> 99%). A few of the discovered sequences also possess the correct characteristics for potentially becoming primers, as just checking for their presence in samples is enough to specifically identify SARS-CoV-2. Laboratory testing on the most promising sequences identified, showed that the primers found by our approach can be a viable alternative to the commonly adopted primers at the time of writing. These results could pave the way to an automatic procedure for the design of primers, see Fig. 1 for the proposed workflow.

## Results

**CNN classification and feature construction.** The trained CNN described in the “Methods” section obtained a mean accuracy of 98.73% in a 10-fold stratified cross-validation. Observing the confusion matrix for the 5 considered classes, reported in Fig. 2 it is remarkable to notice that even samples from underrepresented classes were mostly correctly positioned. Such an encouraging result can indicate that the network was routinely able to uncover meaningful sequences to separate the different classes of viruses.

Once the network is trained, in a first analysis, we plot the inputs and outputs of the convolutional layer, to visually inspect for patterns. As an example, in Fig. 3a we report the visualization of the first 1250 bps of each of the 553 samples from the NGDC¹¹ repository.

Since each filter in the network slides a 21-bps window over the input, and for each step produces a single value, the output of a filter is a sequence of values in (0, 1). The output of the max pooling for each of the 12 filters is then further inspected for patterns. It is noticeable how samples belonging to different classes can be already visually distinguished. At this step, we identify filter 0 as the most promising, as it seems to focus on a few relevant points in the genome, that could correspond to meaningful cDNA sequences.

Given this data, it is now possible to identify the 21-bps sequences that obtained the highest output values in the max pooling layer of filter 0, in a section of 148 positions. This process results in 210 (31,029 divided by 148) *max pooling features*, each one identifying the 21-bps sequence that obtained the highest value from the
<figure><img src="image_3.png" /><figcaption>(a) Proposed workflow for automated primer design.</figcaption></figure>

<figure><img src="image_4.png" /><figcaption>(b) Summary of the experiments and corresponding datasets used in the paper.</figcaption></figure>

**Figure 1.** On the left, (a) shows the proposed workflow for the automated design of primers for viruses. On the right, (b) summarizes the different experiments reported in the paper, along with the datasets used in each trial.

convolutional filter, in a specific 148-position interval of the original genome: the first max pooling feature will cover positions 1–148, the second will cover position 149–296, and so on. We show the complete set of max pooling features for the complete data 4410 (210\*21) arranged one after the other, in Fig. 3b. The CNN architecture is described in the methods section, the visualization of the filter, and max pooling are available in the Supplementary Materials, Section 1.

Analyzing the different sequence values appearing in the max pooling feature space, we get a total of 3827 unique 21-bps cDNA sequences, that can potentially be informative for identifying different virus strains. For example, sequence **AGG TAA CAA ACC AAC CAA CTT** is only found inside the class of SARS-CoV-2, in 59 out of the 66 available samples. Sequence **CAC GAG TAA CTC GTC TAT CTT** is present again only in SARS-CoV-2, in 63 out of the 66 samples.
<figure><img src="image_5.png" /><figcaption>**Figure 2.** Confusion Matrix of the 10-fold stratified cross-validation for the CNN classifier in the original 553 SARS-CoV-2 sequences.</figcaption></figure>

The combination of the convolutional and max pooling layer allows the CNN to identify sequences even if they are slightly displaced in the genome (by up to 148 positions in the genome). Thus, we create a table of feature appearance of each of the sequences selected from the previous step. This results in a set of features able to differentiate SARS-CoV-2 from other viruses.

The experiments presented in the following subsections to validate our method have different objectives and make use of different datasets. A summary of all the experiments and datasets used is shown in Fig. 1.

**Identifying SARS-CoV-2.** Recapitulating the results of experiments 1–4 (see Fig. 1), we discovered 12 meaningful 21-bps sequences that best characterize SARS-CoV-2. For all the analyzed data, these sequences appear only in SARS-CoV-2 samples and not in any other viruses, as summarized in Table 1. Remarkably, our results outperform earlier publications using machine learning for identifying SARS-CoV-2 (see for example²⁶), with the added benefit of producing human-readable results instead of a plain black box classifier.

**Laboratory validation of the candidate primer set.** We calculated the frequency of appearance of different primer sets' sequences used in SARS-CoV-2 RT-PCR tests developed by World Health Organization (WHO) referral laboratories, and compared it to our primer design on the GISAID dataset (Table 2). All of the sequences have a frequency of appearance of > 99%, with the exception of CHINA-CDC-N-F, with a 68.52%. This is consistent with the percentage of genomes with mutation in the primer region, as stated by latest GISAID update summary of August 11th, 2020³¹. For the in-silico analysis of specificity, we compared all the primers sets' sequences with the NCBI-B and NGDC dataset, and the results show that HKU-N-F, HKU-N-R, Charite-E-F, Charite-E-R and US-CDC-N2-F are not specific to SARS-CoV-2, as they bind to SARS-CoV, too. The rest of the sequences, including our design, only appear in SARS-CoV-2. In summary, of the 8 different primer sets, 3 of them appear to not be specific to SARS-CoV-2; and by frequency of appearance, our design is the 3rd best option among the remaining 5, considering the lowest frequency between the -F and -R primer. This is a remarkable result, considering that the proposed primer set has been extracted by an almost completely automated procedure.

To validate the data obtained in-silico by laboratory methods, a conventional PCR was performed on cDNA obtained from RNA from SARS-CoV-2 and other human coronaviruses. In addition, RNAs from nasopharyngeal swabs from six patients previously diagnosed with SARS-CoV-2 infection and four patients negative for SARS-CoV-2 by routine diagnostic method⁵ were analyzed with the same conventional PCR (Fig. 4). Different dilutions of SARS-CoV-2 RNA were detected with similar sensitivity compared to the diagnostic reference assay. (Fig. 4, lanes 1–8). Our candidate primer set exclusively detected SARS-CoV-2 and did not amplify RNA from other human coronaviruses (Fig. 4, lanes 9–14). The candidate primer set was able to detect SARS-CoV-2 RNA from patient samples previously found positive for SARS-CoV-2, but not in patients previously found negative (Fig. 4, lanes 15–24). Although further validation will be required to develop this candidate primer set into a diagnostic assay, our results clearly demonstrate the power of our method to select potential sequences for further validation.

**Discussion**

Being able to reliably identify SARS-CoV-2 and distinguish it from other similar pathogens is important to contain its spread. The time of processing samples and the availability of reliable diagnostic tests is a challenge during an outbreak. Developing innovative diagnostic tools that target the genome to improve the identification of pathogens, can help reduce health costs and time to identify the infection, instead of using unsuitable treatments
<figure><img src="image_6.png" /><figcaption>(a) cDNA visualization for the first 1,250 bps from the input NGDC dataset, for each of the 553 samples. Each sample is represented by a horizontal line of pixels.</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>(b) cDNA visualization for the first 105 out of 210 21-bps-long sequences selected from the input dataset. Each sample is represented by a horizontal line of pixels.</figcaption></figure>

**Figure 3.** Input 3a, and output 3b of the methodology in colored pixels represent bases: G = green, C = blue, A = red, T = orange, missing = black. The data is separated by class SARS-CoV1: SARS-CoV, SARS-CoV P2, SARS-CoV HKU-39849 and SARS-CoV GDH-BJH01. For visualization purposes we do not show HCoV-EMC and HCoV-4408, given the number of samples. From visual inspection, it is possible to notice the similarity of patterns between samples belonging to the same class.

or testing. Moreover, it is necessary to perform an accurate classification to identify the different species of Coronavirus, the genetic variants that could appear in the future, and the co-infections with other pathogens.

Given the high transmissibility of the SARS-CoV-2, the proper diagnosis of the disease is urgent, to stop the virus from spreading further. Considering the false negatives given by the standard RT-qPCR detection, better implementations such as using deep learning are necessary in order to properly detect the virus. While the accuracy of current RT-qPCR testing is around 70%, and CT scans with deep learning go up at 83%, we believe that the use of the sequences detected by a CNN-based methodology has the potential to improve the accuracy of the diagnosis.

Our results, show that by targeting one out of the 12 selected 21-bps specific sequences, we are able to distinguish SARS-CoV-2, from any other virus (> 99%). Further testing is necessary to confirm these promising results so it is essential to create multidisciplinary groups that work to stop the outbreak. Finally, as an interesting remark, by comparing the discovered sequences against other hosts, we noticed that from the 12 sequences
<table><caption>**Table 1.** Percentage of appearance for each of the 12 discovered 21-bps sequences across the different datasets, and comparison to similar viruses in nature and other hosts. ¹²¹-bps sequence resulting from experiment 2. ² 21-bps sequence resulting from experiment 3.</caption><thead><tr><th>Source</th><th>GISAID</th><th>NCBI</th><th>NCBI</th><th>NGDC</th><th>NGDC</th><th>GISAID</th><th>GISAID</th><th>GISAID</th><th>GISAID</th></tr></thead><tbody><tr><td>Virus</td><td>SARS-CoV-2</td><td>Other Taxa</td><td>SARS-CoV-2</td><td>Other Taxa</td><td>SARS-CoV-2</td><td>Betacoronavirus</td><td>Betacoronavirus</td><td>Betacoronavirus</td><td>Betacoronavirus</td></tr><tr><td>Host</td><td>Homo Sapiens</td><td>Homo Sapiens</td><td>Homo Sapiens</td><td>Homo Sapiens</td><td>Homo Sapiens</td><td>Manis javanica</td><td>Rhinolophus affinis</td><td>Canine</td><td>Felis Catus</td></tr><tr><td># Samples</td><td>52,645</td><td>20,572</td><td>32</td><td>487</td><td>96</td><td>17</td><td>1</td><td>2</td><td>6</td></tr><tr><td><sup>1</sup>CAC GTA GGA ATG TGG CAA CTT</td><td>99.84%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>100.00%</td><td>100.00%</td><td>50.00%</td></tr><tr><td><sup>1</sup>TAT TAG TGA TAT GTA CGA CCC</td><td>99.73%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>50.00%</td></tr><tr><td><sup>1</sup>AAT GAA TTA TCA AGT TAA TGG</td><td>99.94%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>96.88%</td><td>76.47%</td><td>0.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>1</sup>CAA CTT TTA ACG TAC CAA TGG</td><td>99.55%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>50.00%</td></tr><tr><td><sup>1</sup>CTA AAG CAT ACA ATG TAA CAC</td><td>99.76%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>1</sup>TAG CAC TCT CCA AGG GTG TTC</td><td>99.57%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>1</sup>TGC CAC TTG GCT ATG TAA CAC</td><td>99.90%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>100.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>1</sup>CAT CTA CTG ATT GGA CTA GCT</td><td>99.79%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>100.00%</td><td>100.00%</td><td>50.00%</td></tr><tr><td><sup>1</sup>TGA GCA GTG CTG ACT CAA CTC</td><td>99.56%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>98.96%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>1</sup>GAT GGT CAA GTA GAC TTA TTT</td><td>99.69%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>96.88%</td><td>0.00%</td><td>0.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>2</sup>AAT AGA AGA ATT ATT CTA TTC</td><td>99.73%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>96.88%</td><td>0.00%</td><td>100.00%</td><td>100.00%</td><td>66.67%</td></tr><tr><td><sup>2</sup>CGA TAA CAA CTT CTG TGG CCC</td><td>99.06%</td><td>0.00%</td><td>100.00%</td><td>0.00%</td><td>97.92%</td><td>0.00%</td><td>100.00%</td><td>50.00%</td><td>50.00%</td></tr></tbody></table>

exclusive to SARS-CoV-2, one of them appears in 13 of 17 samples from Manis Javanina. In contrast, 5 of the sequences of SARS-CoV-2 appear in the only sample available from Rhinolophus Affinis and 11 out of 12 in 2 Canine samples (Table 1). This is consistent with the findings of Zhang et al.³⁶,³⁷, and could point to the zootonic origin of the virus. Nevertheless, more data is necessary.

As a result of the high density populations, and ever growing interaction between people, it is possible that other pandemics may occur. We believe that our methodology has a substantial added value over traditional methods, because it is a fast method and only limited set of viral sequencing data is needed. Moreover, this procedure led to a primer set with a very high specificity for SARS-CoV-2 with at least the same accuracy as the best primers sets in the world developed by WHO referral laboratories. Thus, thinking forward, our methodology can be applied in future viral pandemics to speed up the development of accurate detection methods for diagnosis and thereby contribute to limit the spread of a virus.

## Methods

The CNN used during all the experiments is composed of one convolutional layer with 12 different filters or weights (each with window size 21, and an even padding of 10 steps on each side) with maxpooling (pool size 148 and stride 1), a fully connected layer (196 rectified linear units with dropout probability 0.5), and a final softmax layer with 5 units, to differentiate the different classes of Coronavirus strains. The optimizer used is Adaptive Momentum (ADAM)³⁸, with learning rate 10⁻⁵ and a batch size of 50 samples, run for 1000 epochs³⁵. A graphical summary of the CNN used in the experiments is reported in Fig. 5.

The convolutional layer of the network, in simple terms, is analyzing subsequences of 21 base pairs that can appear in different points of the virus genome. We selected 21 as designed primers for RT-PCR tests have a length of 18–22 bps normally. The pool size of the maxpooling represents the interval in which a specific 21-bps
<table><caption>**Table 2.** Comparison of primer sets developed by WHO referral labs, against the primer set obtained by the proposed approach, listed as *UtrechtU-ORF3a*. The Frequency column indicates frequency of appearance of the sequence among samples of the GISAID dataset. The Specific (Yes/No) column shows whether the sequence appears to be unique to SARS-CoV-2 samples, or can also be found in other viruses, according to the evaluation on the NCBI-B and NGDC datasets.</caption><thead><tr><td>Primer</td><td>Sequence</td><td>Frequency (%)</td><td>Specific (Yes/No)</td></tr></thead><tbody><tr><td>Charite-E-F</td><td>5'-ACA GGT ACG TTA ATA GTT AAT AGC GT-3'</td><td>99.90</td><td>No</td></tr><tr><td>Charite-E-R</td><td>5'-ATA TTG CAG CAG TAC GCA CAC A-3'</td><td>99.90</td><td>No</td></tr><tr><td>CHINA-CDC-ORF1ab-F</td><td>5'-CCC TGT GGG TTT TAC ACT TAA-3'</td><td>99.90</td><td>Yes</td></tr><tr><td>CHINA-CDC-ORF1ab-R</td><td>5'-ACG ATT GTG CAT CAG CTG A-3'</td><td>99.59</td><td>Yes</td></tr><tr><td>HKU-N-F</td><td>5'-TAA TCA GAC AAG GAA CTG ATT A-3'</td><td>99.56</td><td>No</td></tr><tr><td>HKU-N-R</td><td>5'-CGA AGG TGT GAC TTC CAT G-3'</td><td>99.58</td><td>No</td></tr><tr><td>US-CDC-N1-F</td><td>5'-GAC CCC AAA ATC AGC GAA AT-3'</td><td>99.71</td><td>Yes</td></tr><tr><td>US-CDC-N1-R</td><td>5'-TCT GGT TAC TGC CAG TTG AAT CTG-3'</td><td>99.57</td><td>Yes</td></tr><tr><td>US-CDC-N2-F</td><td>5'-TTA CAA ACA TTG GCC GCA AA-3'</td><td>99.43</td><td>No</td></tr><tr><td>US-CDC-N2-R</td><td>5'-GCG CGA CAT TCC GAA GAA-3'</td><td>99.74</td><td>Yes</td></tr><tr><td>UtrechtU-ORF3a-F</td><td>5'-TAG CAC TCT CCA AGG GTG TTC-3'</td><td>99.57</td><td>Yes</td></tr><tr><td>UtrechtU-ORF3a-R</td><td>5'-GCA AAG CCA AAG CCT CAT TA-3'</td><td>99.48</td><td>Yes</td></tr><tr><td>US-CDC-N3-F</td><td>5'-GGG AGC CTT GAA TAC ACC AAA A-3'</td><td>99.09</td><td>Yes</td></tr><tr><td>US-CDC-N3-R</td><td>5'-TGT AGC ACG ATT GCA GCA TTG-3'</td><td>99.72</td><td>Yes</td></tr><tr><td>CHINA-CDC-N-F</td><td>5'-GGG GAA CTT CTC CTG CTA GAA T-3'</td><td>68.52</td><td>Yes</td></tr><tr><td>CHINA-CDC-N-R</td><td>5'-CAG ACA TTT TGC TCT CAA GCT G-3'</td><td>99.20</td><td>Yes</td></tr></tbody></table>

<figure><img src="image_8.png" /><figcaption>**Figure 4.** Laboratory validation of the candidate primer set by conventional PCR. MM, molecular weight marker; lanes 1–8, 10-fold dilutions of SARS-CoV-2 RNA (corresponding to Ct values 26–39 in the diagnostic reference assay); lanes 9–14, RNA from different human coronaviruses (hCoV-OC43, hCoV-229E, hCoV-NL63, MERS-CoV, SARS-1, SARS-CoV-2, respectively); lanes 15, 16, 17, 19, 20, 21, patient samples previously found positive for SARS-CoV-2; lanes 18, 22, 23, 24, patient samples previously found negative for SARS-CoV-2.</figcaption></figure>

<figure><img src="image_9.png" /><figcaption>**Figure 5.** Graphical representation of the architecture of the CNN used in the experiments.</figcaption></figure>
<table><caption>**Table 3.** Organism, assigned label, and number of samples in the unique sequences for the NGDC repository (left) and query: gene = "ORF1ab" AND host = "homo sapiens" AND "complete genome" in the NCBI repository (right). We use the NCBI organism naming convention<sup>44</sup>.</caption><thead><tr><th>Organism</th><th>Label</th><th>Number of samples</th><th>Organism</th><th>Label</th><th>Number of samples</th></tr></thead><tbody><tr><td>SARS-CoV-2</td><td>0</td><td>96</td><td>SARS-CoV-2</td><td>0</td><td>68</td></tr><tr><td>MERS-CoV</td><td>1</td><td>236</td><td>MERS-CoV</td><td>1</td><td>180</td></tr><tr><td>HCoV-EMC</td><td>1</td><td>4</td><td>HCoV-HKU1</td><td>1</td><td>13</td></tr><tr><td>HCoV-OC43</td><td>2</td><td>138</td><td>HCoV-OC43</td><td>1</td><td>105</td></tr><tr><td>HCoV-229E</td><td>2</td><td>22</td><td>HCoV-NL63</td><td>1</td><td>29</td></tr><tr><td>HCoV-4408</td><td>2</td><td>2</td><td>HCoV-4408</td><td>1</td><td>2</td></tr><tr><td>HCoV-NL63</td><td>3</td><td>58</td><td>HCoV-229E</td><td>1</td><td>3</td></tr><tr><td>HCoV-HKU1</td><td>3</td><td>17</td><td>HCoV-EMC</td><td>1</td><td>3</td></tr><tr><td>SARS-CoV</td><td>4</td><td>7</td><td>HAstV-VA1</td><td>1</td><td>1</td></tr><tr><td>SARS-CoV P2</td><td>4</td><td>1</td><td>HAstV-BF34</td><td>1</td><td>1</td></tr><tr><td>SARS-CoV HKU-39849</td><td>4</td><td>1</td><td>HMO-A</td><td>1</td><td>1</td></tr><tr><td>SARS-CoV GDH-BJH01</td><td>4</td><td>1</td><td>HAstV-SG</td><td>1</td><td>1</td></tr><tr><td>Total samples</td><td>-</td><td>583</td><td>Total samples</td><td>-</td><td>407</td></tr></tbody></table>

sequence can be recognized (in this case, 148 positions). Through the training process, the convolutional layer is de-facto learning new features to characterize the problem, directly from the data. In this specific case, the new features are 21-bps sequences that can more easily separate different virus strains. By analyzing the result of each filter in a convolutional layer, and how its output interacts with the corresponding max pooling, it is possible to detect human-readable sequences of base pairs that might provide domain experts with relevant information. It is important to notice that these sequences are not bound to specific locations of the genome; thanks to its structure, the CNN is able to detect them and recognize their importance even if their position is displaced in different samples.

We downloaded 583 sequences (\*.fsta files) from the NGDC on March 15th, 2020 (Table 3). We divided the samples into 5 classes, taking into account both the number of available samples, and the seasonality of the related diseases. SARS-CoV-2 on its own as class 0, as the main objective is to separate this virus from all the others. The 240 samples from MERS-CoV/HCoV-EMC were assigned to class 1, as the related disease is mostly geographically limited to areas of Saudi Arabia<sup>39</sup>. HCoV-OC43, HCoV-229E and HCoV-NL63 have been reported to have winter seasonality, while HCoV-HKU1 has spring-summer seasonality. Nevertheless, there are instances where HCoV-NL63 had a spring-summer seasonality closer to HCoV-HKU1<sup>40-42</sup>. Thus, also considering the number of samples, we grouped together HCoV-OC43, and HCoV-229E as class 2, while HCoV-HKU1 and HCoV-NL63 were grouped as class 3. We included HCoV-4408 in class 2 as well, as there were only 2 samples available: HCoV-4408 is subgroup A of the betacoronavirus genus, as HCoV-OC43<sup>43</sup>. Finally, as we deemed important to distinguish SARS-CoV-2 from SARS-CoV, SARS-CoV was assigned to its own class (class 4) even if only 10 samples were available.

We left out 30 SARS-CoV-2 sequences and then performed a 10-fold stratified cross-validation, with the remaining data divided into 80% training (8 folds), 10% validation (1 fold), 10% testing (1 fold). The stratified cross-validation preserves the ratio of classes in the original dataset for each fold, thus making the final accuracy more reliable.

**Identifying SARS-CoV-2.** *Experiment 1: Validation on the NGDC dataset.* We downloaded the dataset from the NGDC repository<sup>11</sup> on March 15th, 2020. We removed repeated sequences and applied the procedure to translate the data into the sequence feature space. This leaves us with a frequency table of 3827 features (21-bps sequences) with 583 samples (Table 3 (left)). Next, we ran a state-of-the-art feature selection algorithm<sup>45,46</sup>, to reduce the sequences needed to identify different virus strain to the bare minimum. Remarkably, we are then able to correctly differentiate all the coronavirus (MERS-CoV, SARS-CoV-2, SARS-CoV-1, etc) samples using only 53 of the original 3827 sequences, obtaining a 100% accuracy in a 10-fold cross-validation with a simpler and more traditional classifier, such as Logistic Regression. The list of the 53 features is available in the Supplementary Materials, Section 2.

*Experiment 2: Validation on the NCBI dataset.* We downloaded data from the NCBI<sup>30</sup> repository on March 15th, 2020, with the following query: gene = "ORF1ab" AND host = "homo sapiens" AND "complete genome". The query resulted in 407 non-repeated sequences (Table 3 (right)). We call this dataset NCBI-A, where 68 sequences belong to SARS-CoV-2. Then, we applied the procedure to translate the data into the set of sequence features, and we run the same state-of-the-art feature selection algorithm<sup>45</sup>. The result is a list of 10 different sequences (Table 1), for which just checking for their presence is enough to differentiate between SARS-CoV-2 and other viruses in the dataset, with a 100% accuracy. Each of the sequences, in fact, only appears in SARS-CoV-2 samples.
**Experiment 3: Further validation on the NCBI dataset.** We downloaded data from NCBI³⁰ on March 17th, 2020, with the following query: "virus" AND host = "homo sapiens" AND "complete genome", restricting the size from 1000 to 35,000 bps (NCBI-B). The query returns 20,603 samples, of which only 32 belong to SARS-CoV-2, and 20,571 are from other taxa, including Hepatitis B, Dengue, Human immunodeficiency, Human orthopneumovirus, Enterovirus A, Hepacivirus C, Chikungunya virus, Zaire ebolavirus, Human respirovirus 3, Orthohepevirus A, Norovirus GII, Hepatitis delta virus, Mumps rubulavirus, Enterovirus D, Zika virus, Measles morbillivirus, Enterovirus C, Human T-cell leukemia virus type I, Yellow fever virus, Adeno-associated virus, rhinovirus (A, B and C), for a total of more than 584 other viruses (not considering strains and isolates). Then, we applied the procedure to translate the data into the sequence feature space and run the feature reduction algorithm⁴⁵. This results in 2 extra sequences of 21 bps: just by checking for their presence, we are able to separate SARS-CoV-2 from the rest of the samples with a 100% accuracy (Table 1).

**Experiment 4: Validation on the GISAID dataset.** From the GISAID repository³¹, we downloaded 53,183 sequences available on August 10th, for SARS-CoV-2, from different countries, from there 52,645 have as < 1% Ns, high coverage and host = "homo sapiens". Then, we calculated the frequency table of the 21-bps sequences obtained from experiments 2 and 3, to verify which sequences remain and could be used for detection. The appearance frequency of the target sequences among the samples in the GISAID dataset is reported in Table 1, second column. In addition, we downloaded 26 sequences from GISAID repository of other hosts (manis javanica, rhinolophus affinis, canine and felis catus) to make a comparison in the sequences from experiment 2 and 3.

**Laboratory validation of the candidate primer set.** Experiment 5: Design of the candidate primer set. After the analysis carried out on the deep learning model, we ran an analysis with Primer3plus⁴⁷, to see which of the sequences could be used as a forward primer, using sample NCBI NC045512.2 as the reference SARS-CoV-2 sequence. We uncover the sequence TAG CAC TCT CCA AGG GTG TTC that shows a frequency of appearance of 99.57% in viral genomes available from different countries in GISAID³¹ and 100.0% in the NCBI³⁰ datasets. Using the reference SARS-CoV-2 sequence, we identify that this discovered sequence is located between nucleotides 25,604 and 25,624 in the ORF3a gene. In SARS-CoV, this gene encodes a protein of 274 aa, that is related with necrotic cell death⁴⁸,⁴⁹, chemokine production like interleukin 8 (IL-8) and RANTES/CCL5, NFκB activation resulting in an inflammatory response⁵⁰ and may play an important role in the virus life cycle⁵¹. We design a specific primer set for detection of SARS-CoV-2 using Primer3plus⁴⁷. We use TAG CAC TCT CCA AGG GTG TTC as forward primer and GCA AAG CCA AAG CCT CAT TA as reverse primer, obtaining an amplicon size of 179 bps. Then, we run an in-silico PCR test using FastPCR 6.7⁵² with default parameters in NC045512.2 used as a reference SARS-CoV-2 sequence, this yields Tm = 56.2 °C for the forward primer, Tm = 53.1 °C for the reverse primer and Ta = 58 °C.

In addition, we calculated the frequency of appearance of different primers sets' sequences used in SARS-CoV-2 RT-qPCR tests developed by WHO referral laboratories and compared it to our primer design sequences in 52,645 sequences from the GISAID repository and the 583 samples of different coronaviruses from the NGDC dataset from experiment 1. The used primers set are developed by University of Hong Kong (HKU-N); Charite, Berlin, Germany (Charite-E); US-CDC, United States (US-CDC-N1, US-CDC-N2, US-CDC-N3) and China CDC, China (China-CDC-ORF1ab, China-CDC-N) (Table 2). We selected this primers as they are the ones more commonly used as stated in the GISAID status update of August 11, 2020. We do not consider degenerate primer sets.

**Experiment 6: Validation of the candidate primer set in biological samples.** Viral RNA was isolated from cell-cultured SARS-CoV-2, SARS-1, MERS-CoV, hCoV-NL63, hCoV-OC43, hCoV-229E, and from nasopharyngeal swabs from n = 10 patients by MagNA Pure LC (Roche Diagnostics, The Netherlands) using the total nucleic acid isolation kit. The RNA was converted into cDNA using SuperscriptIII (Thermo-Fisher Scientific, USA) and random hexamers. Subsequently, conventional PCR was performed on the cDNA using HotStar Taq DNA polymerase (Qiagen, The Netherlands) with 400 nM forward primer (5'-AG CAC TCT CCA AGG GTG TTC-3') and 400 nM reverse primer (5'-GCA AAG CCA AAG CCT CAT TA-3') and the following cycling conditions: 15 min at 95°C, followed by 40 cycles of 1 min at 95°C, 1 min at 5°C and 1 min at 72°C. The PCR products were visualized by electrophoresis. The same RNA was used in a diagnostics reference assay by Corman et al.⁵ and the Cycle threshold values form this reference assay were used for estimating sensitivity.

**Data availability**

All the necessary scripts to reproduce the experiments are stored on the public GitHub repository: https://github.com/steppenwolf0/primers-sars-cov-2. Due to storage limits, while the data to reproduce Experiment 1 is included in the repository, for Experiments 2–5 only the IDs of the samples used are listed in file sample-ids.xlsx. Given their IDs, samples for Experiments 2–5 can be downloaded from the corresponding open repositories: GISAID (https://www.gisaid.org/), NCBI (https://www.ncbi.nlm.nih.gov/), NGDC (https://bigd.big.ac.cn/ncov/?lang=en).

Received: 5 October 2020; Accepted: 21 December 2020

Published online: 13 January 2021

**References**

1. Woo, P. C., Huang, Y., Lau, S. K. & Yuen, K.-Y. Coronavirus genomics and bioinformatics analysis. *Viruses* 2, 1804–1820 (2010).

2. Lu, R. et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: Implications for virus origins and receptor binding. *Lancet* 395, 565–574 (2020).
3. World Health Organization. WHO Report Coronavirus Disease 2019 (COVID-19) (World Health Organization, Geneva, 2020).

4. Wang, Y., Kang, H., Liu, X. & Tong, Z. Combination of RT-qPCR testing and clinical features for diagnosis of COVID-19 facilitates management of SARS-CoV-2 outbreak. *J. Med. Virol.* **20**, 20 (2020).

5. Corman, V. M. et al. Detection of 2019 novel coronavirus (2019-ncov) by real-time RT-PCR. *Eurosurveillance* **25**, 20 (2020).

6. Yang, Y. et al. Evaluating the accuracy of different respiratory specimens in the laboratory diagnosis and monitoring the viral shedding of 2019-ncov infections. medRxiv https://doi.org/10.1101/2020.02 (2020).

7. Zhao, J. et al. Antibody responses to SARS-CoV-2SARS-CoV-2 in patients of novel coronavirus disease 2019. *Clin. Infect. Dis.* **20**, 20 (2020).

8. Arevalo-Rodriguez, I. et al. False-negative results of initial RT-PCR assays for COVID-19: A systematic review. medRxiv **20**, 20 (2020).

9. Woloshin, S., Patel, N. & Kesselheim, A. S. False negative tests for SARS-CoV-2 infection—challenges and implications. *N. Engl. J. Med.* **20**, 20 (2020).

10. Marston, D. A. et al. Next generation sequencing of viral rna genomes. BMC Genom. **14**, 444 (2013).

11. Beijing Institute of Genomics, Chinese Academy of Science. China National Center for Bioinformation & National Genomics Data Center. https://bigd.big.ac.cn/ncov/?lang=en (2013). Accessed 27 Jan 2020.

12. Ai, T. et al. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases. *Radiology* **200642**, 20 (2020).

13. Lansbury, L., Lim, B., Baskaran, V. & Lim, W. S. Co-infections in people with COVID-19: A systematic review and meta-analysis. *J. Infect.* **20**, 20 (2020).

14. Wang, M. et al. Clinical diagnosis of 8274 samples with 2019-novel coronavirus in Wuhan. medRxiv **20**, 20 (2020).

15. Wang, S. et al. A deep learning algorithm using CT images to screen for corona virus disease (COVID-19). medRxiv **20**, 20 (2020).

16. Kim, J. Y. et al. The first case of 2019 novel coronavirus pneumonia imported into Korea from Wuhan, China: Implication for infection prevention and control measures. *J. Korean Med. Sci.* **35**, 20 (2020).

17. Pearson, W. R. Rapid and sensitive sequence comparison with fastp and fasta. *Methods Enzymol.* **20**, 20 (1990).

18. Altschul, S. F., Gish, W., Miller, W., Myers, E. W. & Lipman, D. J. Basic local alignment search tool. J. Mol. Biol. **215**, 403–410 (1990).

19. Pinello, L., Lo Bosco, G. & Yuan, G.-C. Applications of alignment-free methods in epigenomics. Brief. Bioinform. **15**, 419–430 (2014).

20. Vinga, S. & Almeida, J. Alignment-free sequence comparison—a review. *Bioinformatics* **19**, 513–523 (2003).

21. Bzhalava, D. et al. Phylogenetically diverse tt virus viremia among pregnant women. *Virology* **432**, 427–434 (2012).

22. Nguyen, N. G. et al. Dna sequence classification by convolutional neural network. J. Biomed. Sci. Eng. **9**, 280 (2016).

23. Rizzo, R., Fiannaca, A., La Rosa, M. & Urso, A. A deep learning approach to dna sequence classification. In *International Meeting on Computational Intelligence Methods for Bioinformatics and Biostatistics* 129–140 (Springer, Berlin, 2015).

24. Tampuu, A., Bzhalava, Z., Dillner, J. & Vicente, R. Viraminer: Deep learning on raw dna sequences for identifying viral genomes in human samples. *PLoS One* **14**, 20 (2019).

25. Ren, J. et al. Identifying viruses from metagenomic data by deep learning. arXiv:1806.0781 (arXiv preprint) (2018).

26. Randhawa, G. S. et al. Machine learning using intrinsic genomic signatures for rapid classification of novel pathogens: COVID-19 case study. *PLoS One* **15**, e0232391 (2020).

27. Gunning, D. Explainable artificial intelligence (xai). *Defense Advanced Research Projects Agency (DARPA), nd Web 2*, 2 (2017).

28. Samek, W., Montavon, G., Vedaldi, A., Hansen, L. K. & Müller, K.-R. *Explainable AI: Interpreting, Explaining and Visualizing Deep Learning* Vol. 11700 (Springer, Berlin, 2019).

29. Holzinger, A., Biemann, C., Pattichis, C. S. & Kell, D. B. What do we need to build explainable AI systems for the medical domain? *arXiv:1712.09923* (arXiv preprint) (2017).

30. Sherry, S. T. et al. dsbpn: The NCBI database of genetic variation. *Nucleic Acids Res.* **29**, 308–311 (2001).

31. Shu, Y. & McCauley, J. GISAID: Global initiative on sharing all influenza data-from vision to reality. *Eurosurveillance* **22**, 20 (2017).

32. Ribeiro, C. D. S. et al. How ownership rights over microorganisms affect infectious disease control and innovation: A root-cause analysis of barriers to data sharing as experienced by key stakeholders. *PLoS One* **13**, 20 (2018).

33. Simon, J. H., Claassen, E., Correa, C. E. & Osterhaus, A. D. Managing severe acute respiratory syndrome (SARS) intellectual property rights: The possible role of patent pooling. *Bull. World Health Organ.* **83**, 707–710 (2005).

34. Ribeiro, C. D. S., Koopmans, M. P. & Haringhuizen, G. B. Threats to timely sharing of pathogen sequence data. *Science* **362**, 404–406 (2018).

35. Lopez-Rincon, A. et al. Accurate identification of SARS-CoV-2 from viral genome sequences using deep learning. bioRxiv https://doi.org/10.1101/2020.03.13.990242 (2020).

36. Zhang, Y.-Z. & Holmes, E. C. A genomic perspective on the origin and emergence of SARS-CoV-2. *Cell* **20**, 20 (2020).

37. Xia, X. Extreme genomic cpg deficiency in SARS-CoV-2 and evasion of host antiviral defense. Mol. Biol. Evol. **20**, 20 (2020).

38. Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv:1412.6980 (arXiv preprint) (2014).

39. Organization, W. H. et al. Middle east respiratory syndrome coronavirus (MERS-CoV) (2019).

40. Friedman, N. et al. Human coronavirus infections in Israel: Epidemiology, clinical symptoms and summer seasonality of HCoV-HKU1. *Viruses* **10**, 515 (2018).

41. Killerby, M. E. et al. Human coronavirus circulation in the United States 2014–2017. *J. Clin. Virol.* **101**, 52–56 (2018).

42. Stefanea, R. L., Binnicker, M. J., Thomas, A. S. & Patel, R. Seasonality of coronavirus 229e, hku1, nl63 and oc43 from 2014–2020. In *Mayo Clinic Proceedings* (Elsevier, 2020).

43. Amoroso, M. G. et al. Fatal interstitial pneumonia associated with bovine coronavirus in cows from southern Italy. *Viruses* **12**, 1331 (2020).

44. Mizrachi, I. Genbank: The nucleotide sequence database. NCBI Handb. **22**, 20 (2007).

45. Lopez-Rincon, A., Martinez-Archundia, M., Martinez-Ruiz, G. U., Schoenhuth, A. & Tonda, A. Automatic discovery of 100-MIRNA signature for cancer classification using ensemble feature selection. BMC Bioinform. **20**, 480 (2019).

46. Lopez-Rincon, A. et al. Machine learning-based ensemble recursive feature selection of circulating mirnas for cancer tumor classification. *Cancers* **12**, 1785 (2020).

47. Untergasser, A. et al. Primer3plus, an enhanced web interface to primer3. *Nucleic Acids Res.* **35**, W71–W74 (2007).

48. Shi, C.-S., Nabar, N. R., Huang, N.-N. & Kehrl, J. H. SARS-coronavirus open reading frame-8b triggers intracellular stress pathways and activates nlrp3 inflammasomes. *Cell Death Discov.* **5**, 1–12 (2019).

49. Ren, Y. et al. The ORF3a protein of SARS-CoV-2 induces apoptosis in cells. *Cell. Mol. Immunol.* **17**, 881–883 (2020).

50. Kanzawa, N. et al. Augmentation of chemokine production by severe acute respiratory syndrome coronavirus 3a/x1 and 7a/x4 proteins through nf-κb activation. *FEBS Lett.* **580**, 6807–6812 (2006).

51. Padhan, K. et al. Severe acute respiratory syndrome coronavirus ORF3A protein interacts with caveolin. *J. Gener. Virol.* **88**, 3067–3077 (2007).

52. Kalendar, R. et al. Fastpcr software for pcr primer and probe design and repeat search. *Genes Genomes Genom.* **3**, 1–14 (2009).
## Acknowledgements

The daily board of the Medical Ethics Committee Erasmus MC (METC-2015-306) of Rotterdam, The Netherlands, has reviewed the above mentioned research. As a result of this review, the Committee informs you that the rules laid down in the Medical Research Involving Human Subjects Act (informed consent), do not apply to this research proposal. The samples are from anonymized leftover material from patients for the purpose of improving diagnostics. All experiments were performed in accordance with relevant guidelines and regulations.

## Author contributions

L.M.M., C.A.P. made the biological analysis, and primer design. A.L.R. and A.T. made the programming, data collection and experiments in silico. D.M. and R.M. made the PCR validation. E.C., A.D.K. and J.G. made the experiment and study design. All the authors contributed to the writing.

## Competing interests

The authors declare no competing interests.

## Additional information

**Supplementary Information** The online version contains supplementary material available at https://doi.org/10.1038/s41598-020-80363-5.

Correspondence and requests for materials should be addressed to A.L.-R.

Reprints and permissions information is available at www.nature.com/reprints.

**Publisher's note** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_10.png" /></figure>

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

© The Author(s) 2021