# Reliability of RT-PCR tests to detect SARS-CoV-2: risk analysis

Clément Bezier, Géraldine Anthoine, Abdérafi Charki

► To cite this version:

Clément Bezier, Géraldine Anthoine, Abdérafi Charki. Reliability of RT-PCR tests to detect SARS-CoV-2: risk analysis. International Journal of Metrology and Quality Engineering, 2020, 11, 10.1051/ijmqe/2020009. hal-03024227

HAL Id: hal-03024227

https://univ-angers.hal.science/hal-03024227

Submitted on 25 Nov 2020

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Reliability of RT-PCR tests to detect SARS-CoV-2: risk analysis

Clément Bezier<fnref n="1" />, Géraldine Anthoine<fnref n="2" />, and Abdérafi Charki<fnref n="1" />,*

Received: 5 September 2020 / Accepted: 23 October 2020

**Abstract.** The rapid escalation of the number of COVID-19 (Coronavirus Disease 2019) cases has forced countries around the world to implement systems for the widest possible testing of their populations. The World Health Organization (WHO) has in fact urged all countries to carry out as many tests as they can. Clinical laboratories have had to respond urgently to numerous and rising demands for diagnostic tests for SARS-CoV-2. The majority of laboratories have had to implement the RT-PCR (Reverse Transcriptase – Polymerase Chain Reaction) test method without the benefit of adequate experimental feedback. It is hoped that this article will make a useful contribution in the form of a methodology for the risk analysis of SARS-CoV-2 testing by RT-PCR and at the same time result reliability analysis of diagnostic tests, via an approach based on a combination of Fishbone Diagram and FMECA (Failure Mode, Effects, and Criticality Analysis) methods. The risk analysis is based on lessons learned from the actual experience of a real laboratory, which enabled the authors to pinpoint the principal risks that impact the reliability of RT-PCR test results. The probability of obtaining erroneous results (false positives or negatives) is implicit in the criticality assessment obtained via FMECA. In other words, the higher the criticality, the higher the risk of obtaining an erroneous result. These risks must therefore be controlled as a priority. The principal risks are studied for the following process stages: nucleic acid extraction, preparation of the mix and validation of results. For the extraction of nucleic acids, highly critical risks (exceeding the threshold set from experimentation) are the risk of error when depositing samples on the extraction plate and sample non-conformity. For the preparation of the mix the highest risks are a non-homogenous mix and, predominantly, errors when depositing samples on the amplification plate. For the validation of results, criticality can reach the maximum severity rating: here, the risks that require particular attention concern the interpretation of raw test data, poor IQC (Internal Quality Control) management and the manual entry of results and/or file numbers. Recommendations are therefore made with regard to human factor influences, internal contamination within the laboratory, management of reagents, other consumables and critical equipment, and the effect of sample quality. This article demonstrates the necessity to monitor, both internally and externally, the performance of the test process within a clinical laboratory in terms of quality and reliability.

**Keywords:** Risks / reliability / quality / test / analysis / RT-PCR / SARS-CoV-2 / COVID-19 / FMECA / fishbone diagram

## 1 Introduction

In the face of the SARS-CoV-2 epidemic, on 25 January 2020, the World Health Organization (WHO) alerted the world to the necessity of rapidly implementing mass screening for SARS-CoV-2 via the real time reverse transcription PCR method, known for short as RT-qPCR [1]. Clinical laboratories are obviously in the front line when it comes to implementing this policy of mass screening and testing.

In France, clinical laboratories are inter-coordinated at regional level by Regional Health Agencies (Agences Régionales de Santé, or ARS) in order to ensure the efficient distribution of testing across the country. These laboratories answer to the ARS on matters of numbers of tests and collection-to-result turnaround time. In common with other health facilities, they also receive recommendations from the French National Authority for Health (Haute Autorité de la Santé, or HAS), as well as from the French Ministry of Health. The laboratories routinely communicate their results to the prescribers and, in certain cases, patients directly. They also transmit their epidemiological data to Public Health France (Santé Publique

<footnote n="1">¹ POLYTECH Angers, LARIS – University of Angers, 62 Avenue Notre Dame du Lac, 49000 Angers, France</footnote>

<footnote n="2">² ANSES-LSV, 7 Rue Jean Dixmeras, 49044 Angers Cedex 01, France</footnote>

<footnote>* Corresponding author: abderafi.charki@univ-angers.fr</footnote>
*France*, or SPF), which collects national data each day before sending it to the French Ministry of Health, thus enabling day by day monitoring of the national situation [2].

Faced with this epidemic and the abnormally high demand for diagnosis, the laboratories have had to implement brand new molecular tests, which creates huge challenges in terms of staff, equipment and logistics if the demands are to be met [3].

Adapting to this situation often forces clinical laboratories to:

- Reduce their usual activity so as to concentrate efforts on SARS-CoV-2 testing;

- Divert existing staff or recruit and train new staff to carry out the tests;

- Select, purchase, implement and validate new molecular tests for the detection of SARS-CoV-2 in a short space of time;

- Manage stocks and plan orders while facing reagent shortage. The worldwide testing policy has forced laboratories to rapidly acquire a lot of supplies of, notably, extraction reagents, creating a global shortage [4,5]. Due to the restrictions imposed by border closures and the slowdown in global trade, French laboratories have also had trouble ordering from suppliers outside France.

Given the urgency of the situation and the rapid change in configuration that clinical laboratories have had to put into effect, the time spent on the acquisition, validation and control of new processes has undoubtedly been insufficient. The risk, therefore, of erroneous results (false positives or negatives) is real.

According to the literature, the reliability limits of tests for SARS-CoV-2 by real-time RT-PCR derive, amongst others, from the choice of anatomical site for sample collection [5-7], the quality of the collection process, the sample collected and its transportation [8,9], the evolution of viral load over time [9,10], the performance of the detection test and PCR kits, particularly as regards sensitivity [11-13], the choice of molecular targets of the detection tool [3,8,9,14-16] and the genetic diversity of SARS-CoV-2 [17-19]. It is vital for laboratories to be aware of these limitations and adjust their practices in order to optimize accurate interpretation of real-time RT-PCR results.

Real-time RT-PCR (Reverse Transcription – real time Polymerase Chain Reaction) is a complex method comprising several stages. To ensure the reliability of test results, it is important to manage the risks that arise at each stage of the process, from first contact with the patient to the transmission of the diagnostic test report.

The twofold object of this article is to identify and analyze the principal risks encountered with the SARS-CoV-2 detection process by real-time RT-PCR and to suggest ways of dealing with them. The approach used for the first part is the Fishbone Diagram (5M method), as it offers rapid identification of potential risks. For the second part, the identified risks are analyzed in detail through Failure Mode, Effect, and Criticality Analysis (FMECA) and prioritized in terms of the threat they pose, a process

that brings to light the corrective and preventive actions that are most urgently needed. The results of the analysis are discussed, and solutions are suggested for each risk.

# 2 Detection of SARS-CoV-2 by real-time RT-PCR and risk analysis

## 2.1 Molecular biology techniques in medical biology

PCR (Polymerase Chain Reaction) is a recent molecular biology technique, discovered by Mullis [20] in 1985, and which earned him the Nobel Prize in Chemistry in 1993. The principle of this technique is the amplification of specific DNA (Deoxyribo Nucleic Acid) sequences with the help of a DNA polymerase enzyme, which allows the synthesis of a complementary strand from a template strand [21].

Following the discovery, numerous methods derived from PCR have been developed, such as RT-PCR, the principle of which is shown in Figure 1 [22]. Prior to PCR, the conversion of a single stranded RNA (Ribo Nucleic Acid) into a double stranded complementary DNA occurs through the action of a different enzyme, a reverse transcriptase. This makes the PCR reaction possible with fragments of single stranded RNA.

The nucleic acids that are to be amplified can be found in the nucleus of cells or within virus particles and are therefore not directly accessible. An extraction stage of the nucleic acids is necessary first, which is achieved through chemical lysis of the membranes and proteins, making the nucleic acids accessible for synthesis reactions such as PCR [23].

Since its invention, PCR, in particular real-time PCR, has become extremely widely used in clinical laboratories, especially in the field of clinical microbiology. Compared with traditional methods of culture and identification of microorganisms and viruses, molecular biology offers alternatives that are fast,

<figure><img src="image_2.png" /><figcaption>Fig. 1. Principle of RT-PCR with single stranded RNA [22].</figcaption></figure>
<figure><img src="image_3.png" /><figcaption>Fig. 2. Process mapping of a Clinical Laboratory.</figcaption></figure>

sensitive, specific and reproducible [24], and for various types of sample: urine, respiratory specimens, stools, blood, etc. It can rapidly detect pathogenic agents that are difficult to cultivate or observe (fastidious bacteria on ordinary culture media, or parasites and eggs that are not easily detectable under a microscope). In the case of viral diseases, PCR means that viral culture in cell lines, which is long, costly and of questionable reliability, can be avoided.

As with any particularly sensitive test method, PCR is very susceptible to the risk of contamination, which causes false positives. At the other end of the scale, the method is also very vulnerable to amplification inhibitors, which causes false negatives. To offset these risks, laboratory good practices must include the following with standard test series:

- A positive control: a known sample containing the target pathogen or target DNA or RNA fragment;

- A negative control: a sample without the target analyte, or ultra-pure water. In the latter case, the negative control is called a “blank”;

- An internal control: a known sequence, normally amplified using collected samples (human sequences or sequences deliberately added to the sample as a control). This is a means of checking the conformity of the PCR reaction and the absence of inhibitors before concluding a result to be negative [25].

PCR is also very sensitive to the quality of sample collected, which is to some extent linked to the quality of transportation and storage of samples, especially with RNA. PCR necessitates specific equipment and reagents, experienced specialist staff, clearly defined and presented operating procedures, and specific dedicated workspaces [24].

Finally, a PCR result must only be used within the limits of the information it offers: PCR allows the detection of the presence or absence of a target nucleic acid, but does

not generally permit conclusions to be drawn as to the viability of a pathogen responsible for a pathology.

## 2.2 Test process for the detection of SARS-CoV-2 by real-time RT-PCR

SARS-CoV-2 is an RNA virus, and for that reason detection of the virus today is accomplished primarily through a molecular biology approach, real-time RT-PCR, as described in Figure 1. The usual approach is a multiplex system allowing the detection of multiple targets.

Before analyzing the risks associated with the detection of SARS-CoV-2, it is important to look at the context of medical biology tests.

Medical diagnostic tests are carried out in three processes, in accordance with the ISO 15189 Standard [26]: pre-analytical, analytical and post-analytical. These three processes are successive and dependent: the quality of the input at each stage directly impacts the quality of the output. Each process, therefore, has the ability to affect the reliability of the analytical report established at the end.

A process mapping [27] for a clinical laboratory is illustrated in Figure 2. This overview of the different activities of this type of laboratory shows the diversity of jobs and missions (nurses to take samples, secretaries, technicians, biologists, etc.), all of whom directly or indirectly influence the internal and external quality of the process, and *in fine* the conformity of the test results (positive or negative), in relation to the actual status of the patient (infected or not). For this reason, a smooth and controlled operation from start to finish is essential, as is the fluid and reliable transmission of information relating to both the samples and the execution of the tests.

Each process comprises steps that must be carefully outlined if the step itself, what is at stake, the role and
<figure><img src="image_4.png" /><figcaption>**Fig. 3.** Description of the analytical process: object of risk analysis.</figcaption></figure>

influence of the human participants and the equipment and materials are to be fully understood.

The pre-analytical process involves all the steps of sample collection, sample transportation and recording of patient files, up to but not including the start of the test phase. This is the process that involves the broadest range of specialist skills and trades (nurses who take samples, secretaries, etc.). The description of the pre-analytical process is provided in Appendix 1 of this article.

The analytical process involves the detection of SARS-CoV-2 by real-time RT-PCR from, typically, nasopharyngeal swab samples. The analytical process comprises the viral inactivation, extraction of nucleic acids, preparation of PCR mix, Reverse Transcription reaction (RT) then PCR (or amplification) and, finally, validation of results. The example used in our risk analysis is a PCR method comprising both manual and automated steps, with inactivated samples placed in ready-to-use extraction plates and undergoing automated extraction. In the example configuration, preparation and distribution of the mix are carried out manually, and the patient samples are also manually distributed in PCR strips that are specifically designed for thermal cyclers. The thermal cycler is linked to the LIMS (Laboratory Information Management System) of the laboratory, so the amplification results can be exported directly to patient files via unique case numbers. These files then require a technical validation followed by a biological validation before the diagnostic test report can be compiled and sent out. The description of this analytical process is shown in Figure 3. Any risk analysis is of course specific to the particular method implemented, but a certain number of risks are common to all comparable methods used to detect SARS-CoV-2 by means of PCR.

Finally, the post-analytical process concerns the communication of the results. This final stage plays a role in the external quality of the result (i.e. ability of the laboratory to provide a result that is compliant with the actual status of the patient: infected or not), in other words, the quality perceived by the stakeholders (pre-scribers and patients). The description of the post-analytical process is provided in Appendix 2.

## 2.3 Risk identification and analysis methods

According to the ISO 31000 Standard [28], a risk is the effect of uncertainty, this effect being a deviation from what is expected. A risk is generally expressed in terms of risk sources, potential events, their consequences and their likelihood. A source of risk, in other words the cause of a risk, covers any factor or factors that, singly or collectively, can engender a risk.

In our assessment, a risk is the probability of an undesirable event being able to cause a non-compliant test result to be reported, or in other words:

- A result that does not correspond to the actual state of the patient: carrier or non-carrier of SARS-CoV-2 (false positives or false negatives);

- A result reported to the prescriber outside reasonable time limits: more than the statutory deadline of 24 h after sample collection, as indicated in Île-de-France Regional Health Agency (ARS) recommendations [29].

To be able to take into account all the different types of risk sources that exist, both technical and organizational, a transversal vision of all the activities of the clinical laboratory is needed. It is therefore essential for a laboratory to have a process approach.

In what follows, the analytical process defined above is the object of a risk analysis. For the purposes of the first part of this analysis, the Fishbone Diagram, also known as “5M Method” or “Ishikawa diagram” or “Cause and Effect diagram” has been applied to each stage of the process. This method is commonly used by the French National Authority for Health (HAS) for problem solving [30].

This method, based on a process approach, serves as part of the continuous improvement policy for quality in a laboratory as detailed in the ISO 15189 Standard [26], and facilitates implementation of the Deming PDCA method (Plan, Do, Check, Act) [31], the sequence of which is as follows:

- Identify potential sources of weakness or error of a system (a priori risk analysis);

- Develop plans for the implementation of improvements;

- Implement the action plan;
<table><caption>**Table 1.** FMECA rating.</caption><thead><tr><th>Rating</th><th>Frequency</th><th>Severity</th><th>Non-detection</th></tr></thead><tbody><tr><td>1</td><td>Less than once in 14 000 tests (1 month)</td><td>No direct consequences on result<br>No lost time for laboratory<br>No extra costs</td><td>Problem can be seen directly</td></tr><tr><td>2</td><td>Once in 14 000 tests (1 month)</td><td>No direct consequences on result<br>Loss of time<br>(But can be overcome internally)</td><td>Problem can be detected within the hour through simple verification (IT, rapid)</td></tr><tr><td>3</td><td>Once in 3500 tests (1week)</td><td>No direct consequences on result<br>Loss of time and resources<br>Risk of deadline failure</td><td>Investigation needed to identify failure, may be several hours before it is detected</td></tr><tr><td>4</td><td>Once in 500 tests (1day)</td><td>Indirect consequences on result<br>possibly leading to a false result<br>Loss of time and resources<br>Risk of deadline failure</td><td>Problem difficult to detect, involves extra costs (Observation by a technician, contamination tests)</td></tr><tr><td>5</td><td>Once in 42 tests (1series)</td><td>Potentially direct consequences on result<br>Loss of time and resources<br>High risk of deadline failure</td><td>Problem almost impossible to detect</td></tr></tbody></table>

- Review the effectiveness of the action via a targeted review process or audit;

- Adjust the action plan and modify the system in accordance with results of the review and/or audit.

For the second part of the risk analysis detailed in this study, an in-depth analysis is made using FMECA (Failure Mode, Effects, and Criticality Analysis) [32,33], which is highly complementary to the 5M method: it allows the classification of identified risks in different categories, the distinction between different causes, the study of their effects and an assessment of their criticality relative to a criticality threshold set beforehand, and the proposal of corrective and/or preventive measures with a view to eliminating risks or reducing their criticality.

Each cause described is associated with its consequences (local effect followed by final effect) and a criticality calculated from three indices [34], in the following manner:

$$ \text{CRITICALITY} = \text{FREQUENCY} \times \text{SEVERITY} \times \text{NON-DETECTION} $$

The frequency measures the number of occurrences of the cause versus the number of tests carried out. What need to be identified are the risks that can cause a non-compliant result to be reported, and the number of occurrences per number of tests expresses this quantity. In the case under study, it is assumed that average daily activity (Sundays and public holidays included) amounts to 500 tests per day.

The severity describes the magnitude of local and end effects. The severity is measured against three important criteria, all of which play a role in the internal and external quality of the process:

- Impact on the result. A direct consequence would be certain to provoke an erroneous result without any other condition being necessary (for example, misinterpretation of a positive or negative case). By contrast, an indirect consequence is an effect that may modify a result but that needs other conditions to be present for that to occur (for example, the risk of contamination of a sample);

- Loss of time and resources for the laboratory. The term "resources" makes it clear that each test represents a real cost for the laboratory that must be taken into account;

- The risk of a result being reported outside the defined turnaround time. Turnaround time is exceeded when outside the deadline of 24 h following sample collection recommended by the ARS.

Finally, non-detection of a failure mode takes account of our capacity to detect it. The higher the non-detection rating, the lower the likelihood or means of detecting the failure.

Each of these criticality categories is detailed in Table 1, which shows the FMECA rating chosen. The ratings are defined arbitrarily (generally based on experience) to prioritize them and allow the calculation of criticality.

The FMECA risk analysis thus makes it possible to prioritize risks identified, highlighting:

- Those with a maximum severity rating, in other words corresponding to category 5 on rating Table 1;

- Those with a high criticality that exceeds a given threshold, here arbitrarily set at 75.

The ratings shown in Table 1 and the criticality threshold can be modified or may evolve over time as experience is acquired and data accumulated in the laboratory.

# 3 Results

## 3.1 Risk identification with the 5M method

In order to describe the risks related to the analytical process comprehensively, the 5M method (Manpower, Mother-nature (Environment), Machinery (Equipment), Materials, (Method) has been used.

In the context of molecular biology diagnostics, “Manpower” refers to the laboratory technicians who carry out the test process, “Mother-nature (Environment)” refers to the technical workspace and environment in which the
<figure><img src="image_5.png" /><figcaption>Fig. 4. Description of the risks related to the overall process using the 5M method.</figcaption></figure>

tests are conducted, “Machinery (Equipment)” refers to consumables, reagents, automated machines, etc., “Materials” refers to the samples taken from patients or the product of the preceding stage of the process, and “Method” refers to the organizational and optimization aspects of the laboratory diagnostic process.

First of all, the general risks are described, which are not specific to any particular analytical stage but concern the overall process and influence the reliability of the detection test for SARS-CoV-2 by real-time RT-PCR. These risks are shown in Figure 4.

Since each stage of the analytical process has its own characteristics and purpose, the risks specific to each of them have been considered separately. The stages in question are viral inactivation, extraction of nucleic acids, preparation of the PCR mix, amplification and validation of results.

As can be seen in Figure 5, the main source of risk at the inactivation stage is the contamination of samples (by virions from other samples, present in the environment or carried by the technician on laboratory coats, gloves, etc.), which can result in a false positive. The material (samples) may, however, be affected by identification problems, labeling and traceability.

At the extraction stage, to the issue of contamination are added the risks related to patient identification and the need for traceability throughout the analytical process, as shown in Figure 6. In addition, clinical laboratories can be faced with equipment and logistics issues: the use of an automatic device needs to be included in a flow study to ensure it does not end up delaying results. Moreover, these devices are subject to a real risk of breakdown. If a piece of equipment is essential but out of service, without the

availability of a backup plan the breakdown renders the laboratory incapable of carrying out tests and reporting results.

Aside from the contamination and organization issues, the preparation of the mix is a crucial process that demands great rigor. Any technical error can compromise the PCR reaction, which in turn can invalidate the tests of an entire series of samples, an event that engenders significant cost and deadline problems for the laboratory. The risks related to the preparation of the mix are shown in Figure 7.

The amplification stage is also vulnerable to human error, even if it takes place inside a thermal cycler. The main risks are the conformity of the PCR program and the PCR strips (a critical consumable in this stage), and once again the matter of patient identification. What is more, a laboratory may have several thermal cyclers working in relay, a situation that requires careful flow and utilization management to exploit the full potential for testing without compromising the quality of results. All of these risks are shown in Figure 8. Finally, just as much as the extraction machines, the thermal cyclers need regular checks and maintenance in order to avoid technical failure.

The results validation stage marks the border between the analytical and post-analytical processes, being the final step before the transmission of results. It is a crucial stage in itself, while also a source of numerous risks, related to human error, in terms of patient identification, interpretation of results, etc. The analysis of results by a technician will trigger one of a range of significant actions for the sample, which must be carried out with rigor: report a result (positive or negative), retest, request a new sample, etc. These risks are shown in Figure 9.
<figure><img src="image_6.png" /><figcaption>Fig. 5. Description of the risks related to the viral inactivation stage using the 5M method.</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>Fig. 6. Description of the risks related to the viral RNA extraction stage using the 5M method.</figcaption></figure>

The 5M method, as has been demonstrated, allows rapid identification of the risks related to the analytical process.

## 3.2 Risk analysis using the FMECA method

All the FMECA results based on the risks identified using the 5M method can be found in the table provided in

Appendix 3 of this article. The analysis comprises 103 risks spread across the stages of the analytical process: viral inactivation, extraction of nucleic acids, preparation of the PCR mix, amplification and validation of results. Of the many risks studied, some are critical. The risks confirmed as critical, in other words those with a criticality that exceeds the threshold set arbitrarily at 75 or a severity at maximum (i.e. 5 on the rating scale), are shown in Table 2.
<figure><img src="image_8.png" /><figcaption>Fig. 7. Description of the risks related to the mix preparation stage using the 5M method.</figcaption></figure>

<figure><img src="image_9.png" /><figcaption>Fig. 8. Description of the risks related to the amplification stage using the 5M method.</figcaption></figure>

These risks were analyzed for each stage of the analytical
process in order to demonstrate the key principles of a
FMECA analysis.

When all the risks are taken into account it becomes
fairly obvious that critical risks are in the minority, since
they represent only 18% of the total risks studied, as shown
in Table 3. On the other hand, it should also be noted that

each stage of the analytical process with critical risks still
had residual risks that were unacceptable after the
application of the measures recommended in this study.
The risk analysis given in Appendix 3 reveals that the viral
inactivation stage is not a major source of risks, since no
critical risk was found among the 18 studied. It remains a
key stage nonetheless from the point of view of staff
<figure><img src="image_10.png" /><figcaption>**Fig. 9.** Description of the risks related to the results validation stage using the 5M method.</figcaption></figure>

biosafety. In the manual stages (inactivation, extraction and mix preparation), the risk related to method and organization is low: no critical risk observed and a maximum criticality of 64 established for the risk of contamination. They have an effect on the fluidity of the analytical process but do not directly influence the reliability of the result.

The risk of contamination is very present at every stage of the analytical process. On the other hand, the risks where the consequence is contamination do not have significant criticality. This is primarily due to the fact that the frequency of the undesirable events is low – not surprisingly, since the risk of contamination is well-known in clinical laboratories and a great deal of care is taken to avoid it. A number of preventive measures exist that effectively reduce the frequency of contaminations and, therefore, the criticality.

The nucleic acid extraction and mix preparation stages carry the highest number of risks. Moreover, each one has two residual risks that need to be dealt with again in order to bring them into line and make them acceptable. In addition, the validation of results stage has four critical risks:

- Series validated despite non-compliant IQC (Internal Quality Control);

- Misinterpretation of amplification curves and Ct;

- Procedure allowing manual entry of results and/or file numbers (risk of human error);

- Poor management of risk of human error (lack of traceability of the actions carried out, too little automation, etc.).

None of the risks related to this stage were able to be corrected by the measures suggested in FMECA. This stage of the process therefore needs particular attention.

### 3.2.1 Risks related to the extraction of nucleic acids

The criticality of the risks related to the extraction of nucleic acids is shown in Figure 10. For this stage, the causes that had a criticality above the threshold of 75 and a residual criticality that did not drop below that figure were those involving patient switching and poor sample quality. In fact, switching patients reached the maximum criticality observed of 100. As for the quality of the sample to be tested, this is one of the most essential conditions for a reliable result. Uncertainty related to the sample impacts on the reliability of the diagnostic test as a whole, which creates a high criticality, and notably a high risk of a falsely negative result. These are two critical risks, therefore, that require particular care and attention.

### 3.2.2 Risks related to preparation of the PCR mix

The criticality of the risks related to preparation of the mix are shown in Figure 11. This stage contains numerous risks that equal or exceed the threshold of 75, notably when it comes to initial criticality.

The risk of switching patients is still present, and indeed has a maximum initial criticality of 100, and a residual criticality that is still 75. This is the same profile that was found at the extraction stage. Given that there are both manual and automated stages, involving numerous and repetitive operations, switching two samples or
<table><caption>Table 2. FMEA matrix of critical risks for SARS-CoV-2 detection by real-time RT-PCR.</caption><thead><tr><th>Stage of analytical process</th><th>Function</th><th>Failure mode</th><th>5M</th><th>Causes</th><th>Local effect</th><th>End effect</th><th>Initial frequency</th><th>Initial severity</th><th>Initial non-detection</th><th>Initial criticality</th><th>Threshold old</th><th>Measure(s) recommended</th><th>Follow-up</th><th>Person responsible for corrective measures</th><th>Residual frequency</th><th>Residual severity</th><th>Residual non-detection</th><th>Residual criticality</th><th>Threshold old</th></tr></thead><tbody><tr><td rowspan="2">Manpower</td><td rowspan="2">Loss of sample traceability during testing process</td><td rowspan="2">Position of samples in testing process not known</td><td rowspan="2">Complete retest of several series, loss of time and resources, high risk of deadline failure</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2">2</td><td rowspan="2">5</td><td rowspan="2">2</td><td rowspan="2">20</td><td rowspan="2">75</td><td rowspan="2">Create "plate plans" with essential information: series number, all patients in the series, with their names, file numbers, barcodes and exact position in the corresponding extraction plate that is identified by the series number</td><td rowspan="2">Supervisory technician</td><td rowspan="2">1</td><td rowspan="2">5</td><td rowspan="2">1</td><td rowspan="2">5</td><td rowspan="2">75</td></tr><tr><td>File the day's plate plan in a suitable filing tray</td><td>Laboratory technician</td><td>3</td><td>5</td><td>5</td><td>75</td><td>75</td></tr><tr><td rowspan="2">Extraction RNA of vision to make it detectable by RT-PCR</td><td rowspan="2">Error depositing, sample in extraction plate (patients switched)</td><td rowspan="2">Results of two patients switched</td><td rowspan="2">High risk of reporting an erroneous result</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2">4</td><td rowspan="2">5</td><td rowspan="2">5</td><td rowspan="2">100</td><td rowspan="2">75</td><td rowspan="2">Follow plate plan meticulously (see above), printed out to show correct position for each patient</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td></tr><tr><td>Verification of pre-synautical deadlines for samples. If the pre-synautical deadline has been exceeded, it may be decided to process the sample, but it should be mentioned up to validation in case the result is invalid, no retest, instead request for a new sample</td><td>Mention of these measures in the Test Operating Procedure</td><td>Laboratory technician</td><td>4</td><td>3</td><td>1</td><td>12</td><td>75</td></tr><tr><td rowspan="2">Extraction stage poorly executed</td><td rowspan="2">Pre-analytical deadlines exceeded</td><td rowspan="2">Viral RNA is very unstable, may not be detected despite having been initially present in the sample</td><td rowspan="2">Risk of false negatives</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2">4</td><td rowspan="2">5</td><td rowspan="2">2</td><td rowspan="2">40</td><td rowspan="2">75</td><td rowspan="2">Verification of pre-synautical deadlines for samples. If the pre-analytical deadline has been exceeded, it may be decided to process the sample, but it should be mentioned up to validation in case the result is invalid, no retest, instead request for a new sample</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td></tr><tr><td>Training of sample-takers by biologists; provision of a clear and comprehensive sample collection manual that can assist</td><td>Validation of an extra qualification to cover masculinization and stabilizing for the detection of SRAS-CoV2</td><td>Biologists responsible for the Method</td><td>3</td><td>4</td><td>5</td><td>60</td><td>75</td></tr><tr><td rowspan="2">Extraction Materials</td><td rowspan="2">Poor quality sample</td><td rowspan="2">The virus was not isolated from the sample whereas the patient is infected</td><td rowspan="2">Risk of false negatives</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2">4</td><td rowspan="2">4</td><td rowspan="2">5</td><td rowspan="2">80</td><td rowspan="2">75</td><td rowspan="2">Use of back-up method indicated on patient files if this is the case</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td></tr><tr><td>Implementation of back-up solution if available and unavailable. If not, urgent purchase of manual extraction kits with microdumas</td><td>Biologists responsible for the Method</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><td>Extraction stage not carried out</td><td>Machinery</td><td>Technical failure, machine backed</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td rowspan="2">Mix preparation</td><td rowspan="2">Prep the reaction mixture containing all the reagents necessary for the reverse transcription</td><td rowspan="2">PCR mix preparation stage poorly executed</td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td><td rowspan="2"></td></tr><tr><td>Complete retest of several series, loss of time and resources for the laboratory, unavailable deadline failures</td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>
<table><caption>Table 2. (continued).</caption><thead><tr><th>Stage of analytical process</th><th>Function</th><th>Failure mode</th><th>5M</th><th>Causes</th><th>Local effect</th><th>End effect</th><th>Initial frequency</th><th>Initial severity</th><th>Initial non-detection</th><th>Initial criticality</th><th>Threshold</th><th>Measure(s) recommended</th><th>Follow-up</th><th>Person responsible for corrective measures</th><th>Residual frequency</th><th>Residual severity</th><th>Residual non-detection</th><th>Residual criticality</th><th>Threshold old</th></tr></thead><tbody><tr><td rowspan="2">Technically validated results so diagnostic reports can be sent out</td><td rowspan="2">Validation of results stage poorly executed</td><td rowspan="2">Series validated where controls were non-compliant</td><td rowspan="2">Patient results may be disordered by contamination (false positives) or reaction failure (false negatives)</td><td rowspan="2">High risk of reporting an erroneous result</td><td>2</td><td>5</td><td>3</td><td>30</td><td>75</td><td>purchase or line of new thermal cycles</td><td rowspan="2">Create list of criteria to be validated when validating a test series</td><td rowspan="2">Update Test Operating Procedure with these organizational concepts and create a traceability sheet with the verification criteria to be checked off by the technician for each series</td><td rowspan="2">Supervisory technician</td><td>1</td><td>5</td><td>3</td><td>15</td><td>75</td></tr><tr><td>4</td><td>5</td><td>3</td><td>60</td><td>75</td><td>Creation of a table with all results that may be encountered, with the action to take for each possibility; positive to validate, negative to validate, retest necessary or biologis's opinion needed</td><td>2</td><td>5</td><td>3</td><td>30</td><td>75</td></tr><tr><td rowspan="2">Human power</td><td rowspan="2">Misinterpretation of curves and Ct</td><td rowspan="2">Risk of misinterpretation of results (false positives/ false negatives/ retests necessary)</td><td rowspan="2">High risk of reporting an erroneous result</td><td>3</td><td>5</td><td>3</td><td>45</td><td>75</td><td>Creation of rules of expectation for interpretation of results directly in the LIMS with raw values from thermal cycles</td><td rowspan="2">IT (Information Technology) project to be validated for new configuration</td><td rowspan="2">Supervisory IT technician</td><td>2</td><td>5</td><td>3</td><td>30</td><td>75</td></tr><tr><td>3</td><td>5</td><td>3</td><td>45</td><td>75</td><td>Keep a record of entry errors in order to highlight critical flows that need to be overcome with a view to conformity of results, and implement specific measures to reduce this risk of human error</td><td>1</td><td>5</td><td>3</td><td>15</td><td>75</td></tr><tr><td>Method / organization</td><td>Poor management of human error risk (lack of traceability of actions carried out, too little automation, etc.)</td><td>Human errors become difficult to detect and a test result may be sent out before a potential error is found</td><td>Risk of reporting an erroneous result or sending result to wrong patient</td><td>3</td><td>5</td><td>3</td><td>45</td><td>75</td><td>Update Method Operating Procedure and Workplace Information Sheets with these organizational concepts</td><td>Supervisory technicians</td><td>1</td><td>5</td><td>3</td><td>15</td><td>75</td></tr></tbody></table>
<figure><img src="image_11.png" /><figcaption>**Fig. 10.** Risks related to the extraction of nucleic acids and associated criticality.</figcaption></figure>

<figure><img src="image_12.png" /><figcaption>**Fig. 11.** Risks related to mix preparation and associated criticality.</figcaption></figure>

forgetting to pipette are both possible. In either of these events the impact is serious, with the real possibility of erroneous results, whether false positives or false negatives.

There are also risks due to what are called “technical” errors (problems of pipetting and bench organization): these are poor homogenization of the mix and samples, and PCR strips being left open for too long and causing a risk of contamination. Since the mix takes the form of a master

mix that is distributed among a large number of samples, correct preparation of this mix, though not necessarily an easy matter, is crucial. Poor mix homogenization, for example, can inhibit the PCR reaction, meaning no interpretable results can be obtained for an entire series of samples, all of which need to be retested, and this obviously translates into extra costs and time loss for the laboratory. Meeting the turnaround time for testing is of critical importance.
<table><caption>**Table 3.** Summary of risks analyzed using the FMECA method, showing breakdown of risks according to the stage of analytical process.</caption><thead><tr><td>Stage of analytical process</td><td>Number of risks analyzed</td><td>Number of initially identified critical risks</td><td>Number of critical risks after application of measures</td></tr></thead><tbody><tr><td>Viral inactivation</td><td>19</td><td>0</td><td>0</td></tr><tr><td>Extraction of nucleic acids</td><td>25</td><td>5</td><td>2</td></tr><tr><td>Preparation of mix</td><td>24</td><td>5</td><td>2</td></tr><tr><td>Amplification</td><td>15</td><td>2</td><td>1</td></tr><tr><td>Validation of results</td><td>19</td><td>4</td><td>4</td></tr></tbody></table>

### 3.2.3 Risks related to validation of results

Four risks were identified at the validation of results stage, all related to human error. These were the interpretation of data (amplification and Ct (Cycle threshold) curves), poor IQC management, manual entry of results and/or file numbers and, in addition to these three, poor error risk control, all of which can have serious and direct consequences for a test result, and thus for a patient. In fact, these four critical risks all reach a maximum severity of five when an event occurs. However, if the criticality of these risks does not exceed 60, this is because the non-detection factor is low. In practice, LIMS and computerized laboratory management contribute considerably to the traceability of raw results and of actions carried out on files, making it possible to pinpoint a human error rapidly. Nevertheless, finding the error still takes time, and in that interval the technical validation may already have taken place, with a distinct likelihood of the diagnostic test report having been sent out. It is important not to be misled by these low criticalities, which are to some extent due to the limitations of calculating criticality through multiplication and the influence of the non-detection factor. It is important to take risks with a severity of 5, such as those noted here, seriously.

Finally, at several stages of the analytical process, critical risks due to machine issues were observed. As with any method involving automated stages, correct functioning of the process depends on correctly functioning equipment, in this case, the extraction machine and thermal cyclers, as well as ancillary equipment (refrigerators, freezers and Microbiological Safety Stations). If diagnostic equipment shuts down it is impossible to produce test results unless a back-up solution exists (reversion to an analogous method, provision of replacement equipment by the supplier, etc.) and can be deployed rapidly. In our investigation, machine failures represent critical risks.

## 4 Discussion and recommendations

Despite the volume of scientific literature available, there are few articles that deal in detail with the subject of risk analysis, central as that consideration is to the issue of testing for SARS-CoV-2 by real-time RT-PCR.

The 5M and FMECA methods used in this article are standard tools for a priori risk analysis and eminently suited to the investigation described, since they enable the

comprehensive identification and analysis of the risks that exist, and at the same time allow their prioritization via an assessment of their criticality. Further methods (HACCP, APR, HAZOP, etc.) that are commonly applied in other sectors might be able to add other complementary or more specific facets to this study.

The evidence of the risk analysis suggests that the risks involved in SARS-CoV-2 detection by PCR are not fundamentally different from those encountered with other PCR tests carried out in clinical laboratories.

What the methodology presented in this article effectively does is to highlight the serious risks that need to be taken care of in the context of the clinical laboratory.

### 4.1 Influence of the human factor

The risks of human error linked to the manual entry of results and/or patient file numbers are very real. These risks can cause undesirable events such as the entry of an erroneous result (positive instead of negative or vice versa) or the input of a result in the wrong file and hence for the wrong person. To diminish these risks, which can have serious consequences for patients, it is important to keep manual data entry (of results, patient numbers, important information, etc.) to a minimum and opt for automated reporting wherever possible.

To limit human intervention in the management of patient files and data, and even in the interpretation of results, an IT tool is indispensable, all the more so when very large numbers of samples are to be tested. This IT tool encompasses:

- A barcode scanning system (with codes specific to the patient or the analytical process stage) in order to avoid having to enter file numbers, which can be long and thus a source of error risk;

- The availability of a good connection between the machines and the LIMS, with raw results transferred automatically for appraisal, in order to avoid manual entry of results or file numbers. Once again, if a low number of samples is handled, manual entry of results can be envisaged but should, for example, be subject to double checking by two separate technicians;

- The creation of computer settings to enhance interpretation of the Ct (cycle threshold) values once the curves have been analyzed by the technician. It is nevertheless
essential for amplification curves to be analyzed one by one first, because, as mentioned above, their appearance plays an important role in the interpretation of results, as well as the Ct value of a sample. The practice in the laboratory thus benefits from a result validation process that is optimized, with rules of expertise to facilitate the interpretation of results, the handling of a positive case, or the handling of an invalid case needing to be retested. Traceability is needed for every action, on every tube and every patient file. Nevertheless, it is important to maintain a balance so as to implement a solution proportional to the size of the task (volume of samples to be treated) and the organization of other laboratories (Information Technology and human resources available).

The interpretation of results, both of series controls and patient results, should be carried out in accordance with a decision flowchart in order to harmonize practices and keep human error to a minimum [35]. This flow chart should mention all possible cases, number them, and define the appropriate action to be taken by the technician for each one: for example, "Report a positive (or negative) result", "Send sample for retest", "Controls non-compliant: series to be retested".

The result validation stage is a crucial part of the test process. It is the final stage before the definitive transmission of results to prescribers and patients in the form of diagnostic reports.

An increase in the overall activity of clinical laboratories necessitates the deployment of additional material, but also human resources. Apart from the need for a large number of nurses to carry out sample collection at different sites, the implementation of a new test method often obliges laboratories to recruit new staff. For this reason, laboratories need to give thought to a specific staff training program to meet the new need, which can then become an integral part of the Quality Assurance system. The WHO, in its Laboratory Quality Management System manual, also makes recommendations for the training and qualification of laboratory staff [31].

The increase in team sizes, organizational changes and new work patterns (round-the-clock, seven days a week) create a need for fluent, continuous and efficient communication to facilitate the numerous and often urgent decisions that need to be made. It is also helpful to hold frequent brainstorming sessions to facilitate tactical or operational decisions, in other words those that affect the organization and efficiency of resources. Certain decisions may be taken without the presence of every individual concerned, but there should be adequate means of communication to ensure any team-members affected are informed, via an instruction book, a whiteboard fitted to a wall, emails, etc. Finally, a flow chart for the resolution of problems, indicating the corrective and preventive actions that need to be implemented, should also be created as part of the laboratory's Quality Assurance system. The main aim is to harmonize practices so as to limit inter-operator uncertainty and formalize practices so they match what has been discussed and agreed.

## 4.2 Risk of false-positives and contamination

A number of scientific articles highlight the risk of contamination during detection tests for SARS-CoV-2. The question of sample contamination is ever-present, as with any highly sensitive molecular biology process. Quantification of SARS-CoV-2 RNA per ddPCR in the work environment dedicated to the detection of SARS-CoV-2 has revealed the presence of RNA of the virus in the following proportions: up to 37.4 copies/cm² on workers' gloves; 26.25 copies/cm² on refrigerator door handles; 22.16 copies/cm² on goggles; 19.95 copies/cm² on the external surface of the centrifuge, not to mention on walls and so on [36]. Therefore, incidences of sample contamination by viral RNA (or, more realistically, PCR products in the form of double stranded DNA, which is more stable in the environment) at the time of mixing or during other steps are probable, with the direct consequence on the result at the end of a false positive.

Besides, primers and probes reagent could be a source of contamination and false-positive results. Positive results (with Ct value close to 22 or even 17) can occur with negative samples, because of contaminations of reagents [37]. The synthesis of long oligonucleotides containing SARS-CoV-2 sequences, often used as positive controls, have contaminated reagents (primers and probes) distributed to laboratories. This impacts the predictive value (POD) of a positive test. In this study, the diagnostic specificity reached 97.56%. With a prevalence of infection of 9.00%, the predictive value of a positive test was 0.802, which represents 20% false positives among the positive results obtained. As the prevalence of infection decreases, the POD ratio increases. In fact, when the prevalence of infection reaches 2.7%, the predictive value of a positive test is only 0.5319, i.e. almost half of false positives among the positive results obtained [37]. Among other measures, this article recommends checking each new batch of reagents, with negative controls, to ensure that they are not contaminated. Obviously, all potentially false positive samples should be re-tested, if possible, by another laboratory [37].

Contamination control is therefore essential to avoid the risk of error. It might, for example, involve the carefully thought-out organization of the laboratory benches used for mix preparation in such a way as to avoid the contamination of cones, pipettes, supports and samples. As well as good spatial organization, good temporal organization is another means to avoid leaving reaction tubes or strips open longer than necessary.

The WHO, moreover, recommends at least three physically separate rooms for the PCR operation [38]:

- PCR master mix preparation room;

- A room for the extraction of nucleic acids and addition of the DNA or RNA template;

- A room for amplification and manipulation of the amplified product.

Ideally, the workflow is unidirectional from clean areas (which are the first stages) towards the nucleic acid amplification room, a principle described as "forward motion". In this way, only samples and operators move
from one room to another, with specific precautions taken, such as changing laboratory coats. In the event of breaking this rule, any movement in the opposite direction requires a thorough disinfection process prior to entering an area considered to be clean [38]. Experience shows that implementing this type of protocol often calls for a reorganization of the workspace, to avoid having to convert portions of corridor away from their usual function to fit into the new scheme, and so that traffic through dedicated areas is completely controlled and regulated.

The formation of aerosol from contaminant products (RNA or DNA) means that practices limiting its formation must be adopted, which includes the quality of the pipetting. For the performance monitoring of the diagnostic process, the systematic use of blanks for every series and at every stage of the process guarantees early detection of a possible contamination and can even identify its origin. An "extraction blank", composed of UltraPure™ RNase-Free water for molecular biology, in the place of a sample at the extraction stage makes it possible to eliminate any hypothesis of contamination at this stage. The blank should exhibit no amplification whatsoever (even of the internal control target, which sometimes amplifies human sequences or all RNA in a non-specific way). However, any contamination of the blank by human cells or microorganisms, which is possible, can be observed by amplification of the internal control target of the process (and not the specific SARS-CoV-2 targets). In practice, using a new pack or batch of ultra-pure water soon restores the integrity of the blank. It should be remembered that this consumable is particularly subject to contamination due to the fact of being used multiple times.

A "PCR blank", containing only PCR mix and no nucleic acid, makes it possible to eliminate the hypothesis of contamination at this stage related to the PCR mix. As with the extraction blank, this control should exhibit no amplification whatsoever, even of the internal control substance.

To avoid contamination, it is essential to regularly disinfect laboratory benches, pipettes, supports and other equipment with a nucleic acid degradation product. The adoption of essential practices and good habits will be all the more successful if they are clearly set out in a comprehensive procedure and documented via maintenance traceability.

The process reliability limits can be improved through strict management of sample retests: in the absence of compliant amplification curves or in the event of a doubtful result, sending samples back for a retest can confirm (or otherwise) the initial result.

The nature of most PCR methods and kits on the market also helps reduce the risk of erroneous results by offering multiplex amplification aimed at two or even three SARS-CoV-2 molecular targets. In fact, the WHO stresses the importance of amplifying at least two molecular targets in order to increase the sensitivity of the test [39]. Even with this stringency, doubtful cases do arise, in particular when there is a conflict between the results obtained for each target. To deal with this eventuality, the laboratory needs to have established

criteria for the definition of "doubtful cases", and these cases need to be subjected to a retest in order to arrive at an interpretable result.

Practical experience in laboratories has shown that amplification curves that were initially non-compliant were replaced by readable plots after a second test, and that this was due to low initial efficiency of the PCR. The "doubtful" cases (amplification of only one out of two molecular targets, for example, curves with a non-standard shape, or late Ct values) are either positive after the second pass or are again doubtful. In both cases, the doubtful results were undoubtedly due to a low viral load in the sample, which gave late Ct values. In this situation, it is very important not to consider these results as negative. If a result is doubtful several times in a row, a new sample may have to be requested in order achieve a reliable diagnosis.

### 4.3 Management of reagents, consumables and critical equipment

To meet the growing demand for tests, many clinical laboratories have had to acquire new reagents and PCR kits for the detection of SARS-CoV-2. These kits and reagents have to be stored in accordance with the recommendations of the suppliers in order to ensure the product performance described by them.

To achieve this, an efficient system for the management of stock is essential, and this also forms part of the Quality Assurance system that the WHO recommends for molecular biology methods [38]. Up-to-date stock lists need to be maintained, as well as the storage requirements provided with the kits and reagents. However, this management system is not easy to maintain when no-one knows the usual delivery times (if dealing with a new supplier) or can forecast consumption in view of changes in demand. The management of stock to begin with is to some extent trial and error, until the balance between under stock and overstock can be established. General guidelines for the stock management policy of a laboratory do exist, however, notably in the Laboratory Quality Management System manual published by the WHO for clinical laboratories [31].

When it comes to critical machines (extraction devices, automated pipette machines and thermal cyclers), except in the case of planned maintenance outages, the whole process can come to a standstill if they breakdown for any reason, causing considerable delays and almost inevitable risk of deadline failure. For this reason, it is very important to anticipate this eventuality with the provision of a back-up method in case of problems with the normal machines and, if necessary, be prepared to subcontract certain stages to other laboratories.

As was stated in the section above about the influence of the human factor on the reliability of the analytical process, automation (or something at least approaching it) offers advantages when it comes to the practical organization of tests. This can take the form of:

- Standardized automated plate plans with the full name of the patient, their file number, the associated barcode, its position in the series and the corresponding series
number. The data sheet is stored in a computer to ensure
the traceability of each test series, is printed out and
accompanies the series through every stage of the process
up to and including validation of results, and is a way to
control the risk related to patient identification by
avoiding manual entry through the scanning system;

- Recourse to any automated approach, large or small, such as, for example the use of multichannel pipettes, which enable the physical activity to mirror the standardized plate plans.

## 4.4 Internal and external monitoring of the test process

For early and reliable detection of a disease, the analytical sensitivity of the diagnostic test must be optimal. To ensure this, it is vital to have access to the individual and comparative performance characteristics of the PCR kits available, and in particular their LOD (Limit of Detection) values.

It is also important to monitor the performance of the PCR kits in use throughout their life cycle and across different batches. The way this is done is to plot the Ct values (Cycle threshold) of the IQC obtained from positive and negative controls for each series, which define the limit values to be used as a reference for each test series. With this approach a potential deviation of the PCR system and, more generally, of the analytical process can be detected [40]. These values may, for example, be expressed in the form of a Levey-Jennings chart, used in conjunction with the Westgard rules [41]. Generally, decision rules are defined to adjudicate when a deviation is detected in a system, and to set out actions that will contribute to the reliability of the process during the term of its use.

Moreover, among the IQC used, it is a good idea to use a positive control with a very low viral load (close to the detection limit of the method) in order to confirm that the PCR technique is capable of detecting viral loads that are low but still above the defined detection limit. The absence of amplification in this detection-limit positive control indicates that the samples in the series being analyzed need to be retested in order to eliminate any risk of false negative results.

The quality assurance processes in place in clinical laboratories helps provide guarantees with regard to the identification and management of specific risks. But the very high societal expectation of receiving reliable results and of transparent processes makes external assessment of the organization of the laboratory a virtual necessity. For this reason, in addition to the internal monitoring process, a laboratory should be analyzed by external assessors, thus benefitting from an outside perspective on the quality of the testing process as well as from suggestions for other measures for improvement. Inter-laboratory comparisons, which are an integral part of the validation of the method and of good laboratory practices, also contribute to this external assessment of laboratory practices, while, ultimately, fostering improvements in and harmonization of the technical practices used for the detection of SARS-CoV-2 for the participating laboratories. It is at this point

worth mentioning the works of Görzer et al. [42], and the results of an external assessment of 52 clinical laboratories, which included remarkable diversity of nucleic extraction kits as well as diagnostic kits. The fact that this work was carried out at the request of the Austrian public authorities and in consultation with the Austrian national accreditation body further underlines the importance of these external assessments.

## 4.5 Sample quality

Besides the analytical process, which is the main object of this risk analysis, many aspects of the pre-analytical process significantly condition the final test result. The quality of any process depends directly on the quality of the output data of the process preceding it. It is evident, therefore, that the slightest uncertainty related to the quality of a sample will have repercussions on the analytical process.

In the case of tests to detect SARS-CoV-2, a number of studies describe the sensitivity limits of the nasal swab method [8,9]. These are dependent on the quality of physical penetration during sample collection, which may not probe deep enough or may be of too short duration, to the point where it can be impossible to detect and isolate the virus in a person who is nonetheless a carrier. In this case, reporting a false negative result is highly probable. It is worth noting that nasopharyngeal sample collection is described as potentially painful, at the very least unpleasant, both physically and psychologically for those experiencing it, even with an experienced nurse [43].

Practical experience of screening has demonstrated that, for a vulnerable population such as the residents of a retirement home, the fear of physical pain mingles with confusion and apprehension at the arrival of sample-takers from the laboratory. These are outsiders, unfamiliar to them, not to mention the fact that they are dressed in coverall suits and have come to do a job the residents have probably never had done before. Understandably, the residents might feel anxious and perhaps threatened. In this situation, the following problematic situations can arise:

- Simple and categorical refusal to allow the sample to be taken. In this event, no-one can force the person to go ahead with the test;

- Abrupt gestures from the person, which can be a hazard to themselves and to the sample-taker;

- Tenseness, making it impossible to reach the furthest part of the nasal passages, which is necessary for a quality sample collection;

- Inability to take a sample from the second nostril if there is a need.

To minimize these difficulties, good training for sample-takers from qualified staff who know the local anatomy of the upper respiratory tract is essential [43].

Also, in order to harmonize practices, the clinical laboratory should have a sample collection manual that gives clear and easy to follow instructions, backed up by the recommendations in force, such as those published by the CDC (Centers for Disease Control and Prevention), for example [44].
The second aspect of the pre-analytical process concerns the transportation and storage conditions of the samples, which considerably condition the quality of the samples when presented for analysis.

Samples should be taken to the laboratory without delay in order to keep deterioration to a minimum. If the virions degrade and no longer protect their RNA, which is very unstable in the environment, the RNA may become inaccessible or degraded, rendering it non-amplifiable by PCR and increasing the likelihood of a falsely negative result. The CDC recommends that samples reach the laboratory as quickly as possible to ensure rapid storage between 2°C and 8°C. At this temperature, they can be kept for 72 h following collection. Beyond that timescale, the samples should be stored at -18°C at least, or ideally -70°C or less, according to the recommendations of the CDC and the WHO [39,44]. The WHO recommendations also state that freeze-thaw cycles should be avoided. The storage phase is all the more important in the light of evidence that longer storage at 4°C (several days) of samples with a low viral load can be responsible for an increase in Ct during real-time RT-PCR and can, therefore, alter the status of the sample [45]. With a great many detection methods, a result is considered positive when its Ct are below a predefined threshold. The Ct for a sample taken from a person who is a carrier of SARS-CoV-2 yet incorrectly stored may be outside the defined limits and thus give rise to a false negative result. In practice, it can be difficult for clinical laboratories to comply with ideal transportation and storage conditions: collection is a continuous process carried out throughout the day, with samples stored in disinfected boxes, which are in turn stored in ice boxes, and then taken to the laboratory in the evening after as long as 10 h. This is due to the logistics of sample collection, and a lack of couriers and regular trips to allow the transportation of samples to the laboratory in a shorter time. Where transportation and/or storage conditions have not been optimal, extra attention should be paid to the results from the samples involved, with verification of the successful amplification of the internal control (indicating that the nucleic acids in the sample were still intact), that the Ct is not exceeded, etc. Caution and discernment need to be exercised and the result judged in the light of other clinical data, so as not to draw inappropriate diagnostic conclusions [6,9,46]. A detailed analysis of the results may lead to a decision to proceed with a thorough retest, in the expectation that a second pass will provide additional information regarding the presence or otherwise of SARS-CoV-2 in the sample.

## 5 Conclusion

This article presents an analysis of the risks of real time RT-PCR SARS-CoV-2 testing methods and of the reliability of the results thus obtained. Two methods were used: Fishbone Diagram (5M method) and FMECA (Failure mode, effects, and criticality analysis). The 5M method allows rapid identification of the risks that impact on the conformity of results of SARS-CoV-2 diagnostic tests. FMECA is highly complementary to the 5M method

in adding detail to the findings and allowing the distinction and categorization of the different causes associated with the risks, as well as an assessment of their criticality.

While the methodology presented here is intended as a contribution to the scientific research into risks related to the diagnosis of SARS-CoV-2 by PCR, it can be used for other test methods and also serve as part of the Quality Assurance of a laboratory.

In this present instance, the risk analysis of the SARS-CoV-2 test process was conducted so as to take into account the interactions between the different intra-process (analytical process) and inter-process stages (pre-analytical, analytical and post-analytical). For example, the role of sample collection and management of reagents has been taken into account in the investigation of risks.

The investigation shows that the principal risks that impact on the conformity of the results of the diagnostic test concern the extraction of nucleic acids, the preparation of mix, and the validation of results. For the extraction of nucleic acids, high criticality risks (exceeding the threshold set from experimentation) are the risk of error when depositing samples on the extraction plate and sample non-conformity. For the preparation of the mix the highest risks are a non-homogenous mix and, predominantly, errors when distributing samples on the amplification plate. When it comes to the validation of results, the criticality is increased by the presence of a maximum severity index. The associated risks requiring particular attention concern the interpretation of test data, poor IQC (Internal Quality Control) management and manual entry of results and/or file numbers.

Recommendations are made to diminish the influence of the human factor, the risk of false-positives and internal contamination in the laboratory, the influence of the management of reagents and other consumables and critical equipment, as well as the influence of a poor sample. Attention is also drawn to the need to monitor, both internally and externally, the performance of the test process within a clinical laboratory in terms of quality and reliability.

The results and recommendations included in this article are based on lessons learned from the actual experience of a real clinical laboratory that carries out diagnostic tests for SARS-CoV-2 by RT-PCR. It is perhaps worth pointing out that a number of our conclusions on the risks and reliability of tests are shared by others. A literature review on the reliability of PCR tests is proposed to you by Bezier et al. [47] in addition to this article.

The reliability limits of diagnostic tests for SARS-CoV-2 are a reminder that a diagnostic result should not be interpreted on its own but viewed within the broader clinical context, taking into account symptoms, the medical state of the patient (chronic diseases, etc.), and thoracic CT (computerized tomography) scan imagery. If a negative result is obtained from a sample from the upper respiratory tract whereas there is serious suspicion of COVID-19, the WHO recommends laboratories to take other samples, notably from the lower respiratory tract, if that has not already been done.
References

1. Statement – Novel coronavirus outbreak: Preparing now as one, 2020, October 11. https://www.euro.who.int/en/media-centre/sections/statements/2020/statement-novel-coronavirus-outbreak-preparing-now-as-one (accessed October 11, 2020)

2. Coronavirus (COVID-19), 2020, August 31. https://www.santepubliquefrance.fr/dossiers/coronavirus-covid-19 (accessed August 31, 2020)

3. D.E. Tadini, M. Papamidimitriou-Olivgeris, O. Opota, E. Moulin, F. Lamoth, O. Manuel, L. Senn, SARS-CoV-2, un point dans la tourmente, Rev. Méd. Suisse **16**, 917-923 (2020)

4. D. Ferrari, A. Motta, M. Strollo, G. Banfi, M. Locatelli, Routine blood tests as a potential diagnostic tool for COVID-19, Clin. Chem. Lab. Med. **58**, 1095-1099 (2020)

5. M.J. Loeffelholz, Y.-W. Tang, Laboratory diagnosis of emerging human coronavirus infections – the state of the art. Emer. Microbes Infect. **9**, 747-756 (2020)

6. A. Tahamtan, A. Ardebili, Real-time RT-PCR in COVID-19 detection: issues affecting the results. Expert Rev. Mol. Diagnos. **20**, 453-454 (2020)

7. W. Wang, Y. Xu, R. Gao, R. Lu, K. Han, G. Wu, W. Tan. Detection of SARS-CoV-2 in different types of clinical specimens. JAMA. https://doi.org/10.1001/jama.2020.3786

8. Y.-W. Tang, J.E. Schmitz, D.H. Persing, C.W. Stratton, Laboratory diagnosis of COVID-19: current issues and challenges, J. Clin. Microbiol. **58**, e00512-20 (2020)

9. G. Lippi, A.-M. Simundic, M. Plebani, Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of coronavirus disease2019 (COVID-19), Clin. Chem. Lab. Med. **58**, 1070-1076 (2020)

10. L.M. Kucirka, S.A. Lauer, O. Laeyendecker, D. Boon, J. Lessler, Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure, Ann. Int. Med. **173**, 262-267 (2020)

11. T. Ishige, S. Murata, T. Taniguchi, A. Miyabe, K. Kitamura, K. Kawasaki, K. Matsushita, Highly sensitive detection of SARS-CoV-2 RNA by multiplex rRT-PCR for molecular diagnosis of COVID-19 by clinical laboratories, Clin. Chim. Acta **507**, 139-142 (2020)

12. C.-C. Lai, C.-Y. Wang, W.-C. Ko, P.-R. Hsueh, In vitro diagnostics of coronavirus disease 2019: Technologies and application. J. Microb. Immun. Infect., (2020). https://doi.org/10.1016/j.jmii.2020.05.016

13. J.J. LeBlanc, J.B. Gubbay, Y. Li, R. Needle, S.R. Arneson, D. Marcino, N. Bastien, Real-time PCR-based SARS-CoV-2 detection in Canadian laboratories. J. Clin. Virol. **128**, 104433 (2020)

14. H. Colton, M. Ankcorn, M. Yavuz, L. Tovey, A. Cope, M. Raza, C. Evans, Improved sensitivity using a dual target, E and RdRp assay for the diagnosis of SARS-CoV-2 infection: experience at a large NHS foundation trust in the UK. J. Infect. (2020), https://doi.org/10.1016/j.jinf.2020.05.061

15. V.M. Corman, O. Landt, M. Kaiser, R. Molenkamp, A. Meijer, D.K. Chu, C. Drosten, Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro-surveillance **25**, 2000045 (2020)

16. J.F.-W. Chan, C.C.-Y. Yip, K.K.-W. To, T.H.-C. Tang, S.C.-Y. Wong, K.-H. Leung, K.-Y. Yuen, Improved molecular diagnosis of COVID-19 by the novel, highly sensitive

and specific COVID-19-RdRp/Hel real-time reverse transcription-PCR assay validated *in vitro* and with clinical specimens, J. Clin. Microbiol. **58**, e00310-20 (2020)

17. C.C.-Y. Yip, C.-C. Ho, J.F.-W. Chan, K.K.-W. To, H.S.-Y. Chan, S.C.-Y. Wong, K.-Y. Yuen, Development of a novel, genome subtraction-derived, SARS-CoV-2-specific COVID-19-nsp2 real-time RT-PCR assay and its evaluation using clinical specimens, Int. J. Mol. Sci. **21**, 2574 (2020)

18. Z. Shen, Y. Xiao, L. Kang, W. Ma, L. Shi, L. Zhang, M. Li, Genomic diversity of severe acute respiratory syndrome-coronavirus 2 in patients with coronavirus disease 2019, Clin. Infect. Dis **71**, 713-720 (2020)

19. D.A. Álvarez-Díaz, C. Franco-Muñoz, K. Laiton-Donato, J.A. Usme-Ciro, N.D. Franco-Sierra, A.C. Flórez-Sánchez, M. Mercado-Reyes, Molecular analysis of several in-house rRT-PCR protocols for SARS-CoV-2 detection in the context of genetic variability of the virus in Colombia. Inf. Genet. Evol. **84**, 104390 (2020)

20. K.B. Mullis, F.A. Faloona, Specific synthesis of DNA in vitro via a polymerase-catalyzed chain reaction. Methods Enzymol. **155**, 335-350 (1987)

21. E. Oksuz, S. Malhan, S. Unal, H. Arslan, G. Metan, S. Kavuncubasi, R. Department, Health Technology Assessment Report on the Rapid Molecular Diagnostic Tests Used for Identifying the Causing Agent in the Blood Sample in Sepsis (2019)

22. Difference Between RT-PCR and QPCR 2020, August 31. http://www.differencebetween.net/science/difference-between-rt-PCR-and-qPCR/

23. B. Flora, Vérification en portée A d'une méthode de PCR en temps réel multiplexe: Chlamydia trachomatis, Neisseria gonorrhoeae et Mycoplasma genitalium. PICARDIE JULES VERNE, 2018, January 19. https://dumas.ccsd.cnrs.fr/dumas-02019209/document

24. J. Lamoril, M. Bogard, N. Ameziane, J.-C. Deybach, P. Bouizegarène, Biologie moléculaire et microbiologie clinique en 2007, Immuno anal. Bio. Spéc. **22**, 5-18 (2007)

25. X. He, X. Shi, Internal amplification control and its applications in PCR detection of foodborne pathogens. Wei Sheng Wu Xue Bao Acta Microbiol. Sinica **50**, 141-147 (2010)

26. ISO 15189:2012, 2020, August 31. ISO. https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/05/61/56115.html (accessed August 31, 2020)

27. V. Molinéro-Demilly, A. Charki, C. Jeoffrion, B. Lyonnet, S. O'Brien, L. Martin, An overview of Quality Management System implementation in a research laboratory, Int. J. Metrol. Qual. Eng. **9**, 2 (2018)

28. ISO 31000:2018, 2020, August 31. ISO. https://www.iso.org/cms/render/live/en/sites/isoorg/contents/data/standard/06/56/65694.html (accessed August 31, 2020)

29. ARS Ile de France, 2020, May 15. Recommandations Regionales Covid-19 Periode De Deconfinement

30. Agence Nationale d'Accréditation et d'Evaluation en Santé (ANAES), Acta Endoscop. **28**, 151-155 (1998)

31. Laboratory Quality Management System, Handbook, 2011. WHO. https://apps.who.int/iris/bitstream/handle/10665/44665/9789241548274_eng.pdf?sequence=1

32. T.A. Pollack, V. Illuri, R. Khorzad, G. Aleppo, D.J. Oakes, J.L. Holl, A. Wallia, Risk assessment of the hospital discharge process of high-risk patients with diabetes, BMJ Open Qual. **7**, e000224 (2018)
33. G. Coles, B. Fuller, K. Nordquist, A. Kongslie, Using failure mode effects and criticality analysis for high-risk processes at three community hospitals, Joint Comm. J. Qual. Patient Safety **31**, 132–140 (2005)

34. C. Vidali, M. Severgnini, M. Urbani, L. Toscano, A. Perulli, M. Bortul, FMECA application to intraoperative electron beam radiotherapy procedure as a quality method to prevent and reduce patient's risk in conservative surgery for breast cancer, Front. Med. **4**, (2017)

35. C.-J. Chen, L.-L. Hsieh, S.-K. Lin, C.-F. Wang, Y.-H. Huang, S.-Y. Lin, P.-L. Lu, Optimization of the CDC protocol of molecular diagnosis of COVID-19 for timely diagnosis, Diagnostics **10**, 333 (2020)

36. J. Lv, J. Yang, J. Xue, P. Zhu, L. Liu, S. Li, Detection of SARS-CoV-2 RNA residue on object surfaces in nucleic acid testing laboratory using droplet digital PCR, Sci. Total Environ. **742**, 140370 (2020)

37. K. Wernike, M. Keller, F.J. Conraths, T.C. Mettenleiter, M.H. Groschup, M. Beer, Pitfalls in SARS-CoV-2 PCR diagnostics, Transbound. Emer. Dis. (2020). https://doi.org/10.1111/tbed.13684

38. WHO|Dos and Don'ts for molecular testing, 2020, October 12. World Health Organization. https://www.who.int/malaria/areas/diagnosis/molecular-testing-dos-donts/en/(accessed October 12, 2020)

39. Laboratory testing for 2019 novel coronavirus (2019-nCoV) in suspected human cases, 2020, September 2. World Health Organization. https://www.who.int/publications-detail-redirect/10665-331501 (accessed September 2, 2020)

40. C.C.-Y. Yip, S. Sridhar, A.K.-W. Cheng, K.-H. Leung, G.K.-Y. Choi, J.H.-K. Chen, J.F.-W. Chan, Evaluation of the commercially available LightMix® Modular E-gene kit using clinical and proficiency testing specimens for SARS-CoV-2 detection, J. Clin. Virol. **129**, 104476 (2020)

41. M. Germa, Présentation de quelques cartes de contrôle (1407), 10, 2015. https://www-techniques-ingenieur-fr.bua.distant.univ-angers.fr/fiche-pratique/mesures-analyses-th1/des-bonnes-pratiques-en-laboratoire-a-l-accreditation-dt108/presentation-de-quelques-cartes-de-controle-1407/1407.pdf

42. I. Görzer, Ch. Buchta, P. Chiba, B. Benka, J.V. Camp, H. Holzmann, S.W. Aberle, First results of a national external quality assessment scheme for the detection of SARS-CoV-2 genome sequences, J. Clin. Virol. **129**, 104537 (2020)

43. A. Piras, D. Rizzo, S. Uzzau, G. De Riu, S. Rubino, F. Bussu, Inappropriate Nasopharyngeal Sampling for SARS-CoV-2 Detection Is a Relevant Cause of False-Negative Reports, Otolaryngol.-Head Neck Surg., 019459982093179 (2020)

44. Interim Guidelines for Clinical Specimens for COVID-19 | CDC, 2020, August 31. Centers for Disease Control and Prevention. https://www.cdc.gov/coronavirus/2019-nCoV/lab/guidelines-clinical-specimens.html (accessed August 31, 2020)

45. Y. Pan, L. Long, D. Zhang, T. Yuan, S. Cui, P. Yang, S. Ren, Potential false-negative nucleic acid testing results for severe acute respiratory syndrome coronavirus 2 from thermal inactivation of samples with low viral loads, Clin. Chem. **66**, 794–801 (2020)

46. Y. Li, L. Yao, J. Li, L. Chen, Y. Song, Z. Cai, C. Yang, Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19, J. Med. Virol. **92**, 903–908 (2020)

47. C. Bézier, G. Anthoine, A. Charki, Reliability of real-time RT-PCR tests to detect SARS-CoV-2: A literature review, Int. J. Metrol. Qual. Eng. **11**, 13 (2020)

**Cite this article as:** Clément Bezier, Géraldine Anthoine, Abdérafi Charki, Reliability of RT-PCR tests to detect SARS-CoV-2: risk analysis, Int. J. Metrol. Qual. Eng. **11**, 15 (2020)
<figure><img src="image_13.png" /><figcaption>## Appendix 2: Description of the post-analytical process</figcaption></figure>

<figure><img src="image_14.png" /></figure>
<table><caption>Appendix 3: FMECA matrix of risks related to SARS-CoV-2 detection by real-time RT-PCR</caption><thead><tr><th>Analytical process stage</th><th>Function</th><th>Failure mode</th><th>5M</th><th>Causes</th><th>Local effect</th><th>End effect</th><th>Initial frequency</th><th>Initial severity</th><th>Initial non-detection</th><th>Initial criticality</th><th>Measures(s) recommended</th><th>Follow-up</th><th>Person responsible for corrective measures</th><th>Residual frequency</th><th>Residual severity</th><th>Residual non-detection</th><th>Residual criticality</th><th>Thres hold</th></tr></thead><tbody><tr><td rowspan="2">Inactivation</td><td rowspan="2">Inactivate any virions present in the samples</td><td rowspan="2">Inactivation stage poorly executed</td><td rowspan="2">Manpower</td><td>Lack of technical skills, inadequate training, slack practices</td><td>Poor pipetting (incorrect volume of lysis buffer deposited)</td><td>Inactivation incomplete or absent, risk of contamination of samples by the virion or its RNA</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Include time in the training of the technician to verify knowledge of the techniques needed for the past</td><td>Add a "technical skills" section to the technician qualification document</td><td>Quality officer responsible for issuing qualification document</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr><tr><td>Lack of staff compared with amount of activity</td><td>Delay of inactivation</td><td>Slowdown of overall process and risk of deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Internal recruitment if there are not enough staff for the needs of the activity</td><td>Feedback from those concerned on the differences observed since arrival of new personnel</td><td>Biologists responsible for the Method</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td rowspan="2">Human error</td><td rowspan="2">Human error (inattention or lack of information)</td><td rowspan="2">Human error</td><td rowspan="2">Manpower</td><td>Inactivation of a tube inadvertently forgotten</td><td>Inactivation incomplete or absent, risk of contamination of samples by the virion or its RNA</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Organize racks of "tubes or inactivated tubes"; as the technician inactivates a tube, the tube is passed tube from one rack to the other</td><td>Practical feedback from technician</td><td>Technicians</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr><tr><td>Biologists not available when needed / scheduling difficulties</td><td>Poor communication between various parties, delays implementing measures, leading to practical problems</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Organize a weekly meeting with the biologists during the implementation period</td><td>Meeting reports detailing the measures taken each week</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Human contamination of samples by virion or its RNA</td><td>A viral RNA may be amplified in a sample from which it was initially absent</td><td>Risk of false positives</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td><td>Manpower</td></tr></tbody></table>
<table><tbody><tr><td></td><td>Poor organization on the part of the technician</td><td>Loss of time</td><td>Slowdown of overall process and risk of deadline failure</td><td>3</td><td>2</td><td>4</td><td>24</td><td>Revision of relevant components of technician training, harmonization of practices</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Supervisory technician</td><td>1</td><td>2</td><td>4</td><td>8</td><td>75</td></tr><tr><td rowspan="2">Environment</td><td>Need for three separate molecular biology rooms ignored (extraction-mix-amplification) and forward motion ignored</td><td>Contamination of samples at the start by PCR products from amplification room</td><td>Risk of false positives</td><td>4</td><td>4</td><td>4</td><td>64</td><td>Organization of workstations to ensure forward motion</td><td>Mention of these measures in the Workplace Information Sheets</td><td>Biologists responsible for the Method</td><td>3</td><td>4</td><td>4</td><td>48</td><td>75</td></tr><tr><td>Environment contaminated (ambient air, laboratory bungeels): disinfection and cleaning procedures inadequate</td><td>Contamination of samples by virions or their RNA</td><td>Risk of false positives</td><td>2</td><td>4</td><td>5</td><td>40</td><td>Cleaning of laboratory bench, pipettes, cones, etc. with alcohol and an anti-nucleic acid product between each series</td><td>Mention in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>5</td><td>20</td><td>75</td></tr><tr><td rowspan="2">Machinery</td><td>Lack of protective gear (PPE): FFP2 masks, gloves, gown, etc.</td><td>Risk of contamination of laboratory technicians</td><td>Risk for their health and the integrity of the samples they manipulate</td><td>2</td><td>4</td><td>1</td><td>8</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><td>Lack of practical equipment: racks, filing trays, computers</td><td>Lack of organization and loss of time</td><td>Indirect risk of slowdown of overall process and therefore deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td>Malfunction of MSS through lack of equipment maintenance</td><td>Samples are opened by technicians without airflow to protect them and the samples</td><td>Risk of sample contamination by technician and propagation of virions or their RNA by technicians; indirect risk of false positives</td><td>1</td><td>4</td><td>1</td><td>4</td><td>Ensure maintenance technician comes regularly to check MSS is working properly</td><td>Traceability sheet for maintenance technician visits</td><td>Equipment manager</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><td>MSS contaminated by whole SRAS-CoV2 or its RNA</td><td>Contamination of samples by virions or their RNA</td><td>Risk of false positives</td><td>3</td><td>4</td><td>4</td><td>48</td><td>Daily decontamination of MSS with alcohol</td><td>Should be part of daily maintenance of workstation</td><td>Laboratory technician</td><td>2</td><td>4</td><td>4</td><td>32</td><td>75</td></tr><tr><td>Contamination of LB by the virion or its RNA</td><td>Contamination of samples by virions or their RNA</td><td>Risk of false positives</td><td>3</td><td>4</td><td>5</td><td>60</td><td>Organize laboratory workstations so that hands and dirty cones do not pass over exposed LB..</td><td>Cf. Organization of laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>2</td><td>4</td><td>5</td><td>40</td><td>75</td></tr><tr><td>Defective batch of LB: does not lyse all the virions</td><td>Risk of propagation of virions by technicians and therefore contamination of samples</td><td>Risk of false positives</td><td>1</td><td>4</td><td>4</td><td>16</td><td>Ensure traceability so as to pinpoint the tubes that have been "inactivated" using this batch, find them and inactivate them again.</td><td>Declare a "non-conformity" in connection with the LB</td><td>Supervisory technician</td><td>1</td><td>3</td><td>3</td><td>9</td><td>75</td></tr><tr><td>Contamination of pipette cones by whole SRAS-CoV2 or its RNA</td><td>A vital RNA may be amplified in a sample from which it was initially absent</td><td>Risk of false positives</td><td>1</td><td>4</td><td>4</td><td>16</td><td>Disinfect all laboratory benches and equipment to avoid the risk of contamination of samples</td><td>Cf. Organization of laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td>Extraction</td><td>Poor organization of laboratory benches leading to contamination by SRAS COV-2 or its RNA</td><td>Samples may be contaminated at every stage of the process</td><td>Risk of false positives</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Create organization models for the laboratory benches: RMW, cone boxes, pipetting etc., so as to avoid contamination of samples. Draw the proper plate for each item with a marker directly on the laboratory bench</td><td>Organizational diagram of the laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr><tr><td>Extraction</td><td>Method / organization</td><td>Lack of time and resources</td><td>Technical work under pressure, which increases the risk of error</td><td>Risk of reporting erroneous results</td><td>2</td><td>3</td><td>1</td><td>6</td><td>Extend working hours: early shift / late shift</td><td>Practical feedback from technicians about new organization of workstations</td><td>HR department</td><td>1</td><td>3</td><td>1</td><td>3</td><td>75</td></tr><tr><td>Extraction</td><td>Materials</td><td>Inappropriate use of workstations</td><td>Problems with team organization and therefore fluidity of the process</td><td>Slowdown of overall process and risk of deadline failure</td><td>2</td><td>2</td><td>2</td><td>8</td><td>Workstations need to be thought out from point of view of flow management: hourly capacity of each stage, limiting steps defined, etc. for smooth transition where different workstations intersect</td><td>Creation of Workplace Information Sheets to sort out these problems, with Workplace Information Sheets read out at meetings so as to be sure everyone understands</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Extraction</td><td>Extraction stage poorly executed</td><td>Tube not labeled or wrongly labeled: lack of traceability of patient information</td><td>Loss of time and patient identification risk</td><td>Indirect risk of reporting an erroneous result</td><td>4</td><td>2</td><td>2</td><td>16</td><td>When unpacking, check conformity of samples from point of view of patient identification. Resolve problems with the secretary who recorded the file without delay so as not to hold up processing of the sample</td><td>Mention in the Method Operating Procedure</td><td>Laboratory technician</td><td>4</td><td>1</td><td>1</td><td>4</td><td>75</td></tr><tr><td>Extraction</td><td>Manpower</td><td>Lack of technical skills, inadequate training, slack practices</td><td>Poor pipetting (incorrect volume of sample deposited)</td><td>Risk of invalid result and therefore retest</td><td>3</td><td>2</td><td>4</td><td>24</td><td>Include time in the training of the technician to verify knowledge of the techniques needed for the post</td><td>Add a "technical skills" section to the technician qualification document</td><td>Quality officer responsible for issuing qualification document</td><td>2</td><td>2</td><td>4</td><td>16</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td rowspan="2">Human contamination of samples by virus or its RNA</td><td>A viral RNA may be amplified in a sample from which it was initially absent</td><td>Risk of false positives</td><td>3</td><td>4</td><td>5</td><td>60</td><td>Gown used during inactivation should be removed before going to another stage; gloves should be changed at each stage</td><td>Mention of these measures in the Workplace Information Sheets and the Method Operating Procedure</td><td>Supervisory technician</td><td>2</td><td>4</td><td>5</td><td>40</td><td>75</td></tr><tr><td>Series launched without taking into consideration sample priorities (urgent, samples of that day / previous day, etc.)</td><td>High risk of deadline failure</td><td>3</td><td>3</td><td>3</td><td>27</td><td>Add training module to cover samples: types, priorities, etc. with real cases, to ensure appropriate reactions in workplace situations</td><td>Add a "sample study" section to the technician qualification document</td><td>Biologists not available when needed / scheduling difficulties</td><td>1</td><td>3</td><td>3</td><td>9</td><td>75</td></tr><tr><td>Lack of training in how the laboratory operates</td><td>The test series are not started up quickly enough</td><td>Slowdown of overall process and risk of deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Internal recruitment if there are not enough staff for the needs of the activity</td><td>Feedback from those concerned on the differences observed since arrival of new personnel</td><td>Biologists responsible for the Method</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Lack of staff compared with amount of activity</td><td>Lack of time to discuss measures to implement at time of adopting the Method</td><td>Poor communication between various parties, delays implementing measures, leading to practical problems</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Organize a weekly meeting with the biologists during the implementation period</td><td>Meeting reports detailing the measures taken each week</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Biologists not available when needed / scheduling difficulties</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>
<table><tbody><tr><td></td><td>Loss of sample traceability during testing process</td><td>Position of samples in testing process not known</td><td>Complete retest of several series, loss of time and resources, high risk of deadline failure</td><td>2</td><td>5</td><td>2</td><td>20</td><td>Create "plate plans" with essential information: series number, all patients in the series, with their names, file numbers, barcodes and exact position in the corresponding extraction plate that is identified by the series number</td><td>Mention of these measures in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>5</td><td>1</td><td>5</td><td>75</td></tr><tr><td></td><td>Error depositing samples in extraction plate (patients switched)</td><td>Results of two patients switched</td><td>High risk of reporting an erroneous result</td><td>4</td><td>5</td><td>5</td><td>100</td><td>Follow plate plan meticulously (see above), printed out to show correct position for each patient</td><td>File the day's plate plans in a suitable filing tray</td><td>Laboratory technician</td><td>3</td><td>5</td><td>5</td><td>75</td><td>75</td></tr><tr><td></td><td>Poor organization on the part of the technician</td><td>Loss of time</td><td>Slowdown of overall process and risk of deadline failure</td><td>3</td><td>2</td><td>4</td><td>24</td><td>Revision of relevant components of technician training, harmonization of practices</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Supervisory technician</td><td>1</td><td>2</td><td>4</td><td>8</td><td>75</td></tr><tr><td rowspan="2">Environment</td><td>Need for three separate molecular biology rooms ignored (extraction, amplification) and forward motion ignored</td><td>Contamination of sample wells by PCR products from amplification room</td><td>Risk of false positives</td><td>4</td><td>4</td><td>4</td><td>64</td><td>Organization of workstations to ensure forward motion</td><td>Mention of these measures in the Workplace Information Sheets</td><td>Biologists responsible for the Method</td><td>3</td><td>4</td><td>4</td><td>48</td><td>75</td></tr><tr><td>Contamination of samples by virions or their RNA</td><td>Risk of false positives</td><td></td><td>2</td><td>4</td><td>5</td><td>40</td><td>Cleaning of laboratory bench, pipettes, cones, etc. with alcohol and an anti-nucleic acid product between each series</td><td>Mention in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>5</td><td>20</td><td>75</td></tr><tr><td></td><td>Environment contaminated (ambient air, laboratory benches): disinfection and cleaning procedures inadequate</td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td><td></td></tr></tbody></table>
<table><thead><tr><th>Materials</th><th>Pre-analytical deadlines exceeded</th><th>Viral RNA is very unstable, may not be detected despite having been initially present in the sample</th><th>Risk of false negatives</th><th>4</th><th>5</th><th>2</th><th>40</th><th>Verification of pre-analytical deadlines for samples, if the pre-analytical deadline has been exceeded, it may be decided to process the sample, but it should be monitored up to validation in case the result is incorrect, no recent, instead request for a new sample</th><th>Mention of these measures in the Method Operating Procedure</th><th>Laboratory technician</th><th>4</th><th>3</th><th>1</th><th>12</th><th>75</th></tr></thead><tbody><tr><th>Method / organization</th><td>Poor quality sample</td><td>The virus was not isolated from the sample, whereas the person is a carrier</td><td>Risk of false negatives</td><td>4</td><td>4</td><td>5</td><td>80</td><td>Training of sample-takers by biologists; provision of a clear and comprehensive sample collection manual that sample-takers can consult</td><td>Validation of an extra qualification to cover nasal-pharyngeal swabbing for the detection of SRAS-CoV2</td><td>Biologists responsible for the Method</td><td>3</td><td>4</td><td>5</td><td>60</td><td>75</td></tr><tr><th></th><td>Poor organization leading to contamination by SRAS COV-2 or its RNA</td><td>Samples may be contaminated at every stage of the process</td><td>Risk of false positives</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Create organization models for the laboratory benches: RMW, cone boxes, plating etc. so as to avoid contamination of samples. Draw the proper place for each item with a marker directly on the laboratory bench</td><td>Organizational diagram of the laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr><tr><th></th><td>Lack of time and resources</td><td>Technical work under pressure, which increases the risk of error</td><td>Risk of reporting erroneous results</td><td>2</td><td>4</td><td>1</td><td>8</td><td>Extend working hours, early shift / late shift</td><td>Practical feedback from technicians about new organization of workstations</td><td>HR department</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><th></th><td>File incorrectly recorded by secretaries</td><td>The raw results do not transfer into LIMS as the patient file does not exist; series cannot be launched as it is.</td><td>Loss of time, slowdown of overall process, risk of deadline failure</td><td>4</td><td>2</td><td>1</td><td>8</td><td>Creation of a "files incorrectly recorded" rack so as to take them to the secretaries as they arise and minimize delays</td><td>Mention of these measures in the Method Operating Procedure</td><td>Laboratory technician</td><td>4</td><td>1</td><td>1</td><td>4</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td></td><td>Inappropriate use of workstations</td><td>Problems with team organization and therefore fluidity of the process</td><td>Slowdown of overall process and risk of deadline failure</td><td>2</td><td>2</td><td>2</td><td>8</td><td>Workstations need to be thought out from point of view of flow management: hourly capacity of each stage, limiting stops, defined, etc., for smooth transition where different workstations intersect</td><td>Creation of Workplace Information Sheets to sort out these problems, with Workplace Information Sheets read out at meetings so as to be sure everyone understands</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td></td><td>Poor organization of the workstation</td><td>Risk of contaminating samples with the pipeline, cones or RMW</td><td>Risk of false positives</td><td>4</td><td>4</td><td>4</td><td>64</td><td>Organize laboratory workbenches so that hands and dirty cones do not pass over clean the extraction plate, clean cones, etc.</td><td>CL, Organization of laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>3</td><td>4</td><td>4</td><td>48</td><td>75</td></tr><tr><td rowspan="2">Machinery</td><td>Lack of practical equipment: racks, filing trays, computers</td><td>Lack of organization and loss of time</td><td>Indirect risk of slowdown of overall process and therefore deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Lack of PPE (masks, gloves, gowns, etc.)</td><td>Risk of contamination of laboratory technicians</td><td>Risk for their health and the integrity of the samples they manipulate</td><td>2</td><td>4</td><td>1</td><td>8</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td rowspan="2"></td><td rowspan="2">Malfunction of refrigerators and freezers not detected due to poor calibration/monitoring of these items</td><td>Poor storage of controls (deteriorated or contaminated). Risk of non-compliant controls, inability to validate series, series to be retested</td><td>Loss of time and slowdown of overall process, high risk of deadline failure</td><td>1</td><td>3</td><td>2</td><td>6</td><td>Discard defective batch of reagents. Retest all patients that have been tested with what has been tested. Check kit storage conditions in supplier file and that these are met. If not, check temperature sensor registers for problems. If necessary, have the affected enclosure temperature mapped. Implement more regular monitoring of enclosure temperatures to make drift easier to detect</td><td>Declare a "non-conformity"</td><td>Supervisory technician</td><td>1</td><td>1</td><td>2</td><td>2</td><td>75</td></tr><tr><td>Poor storage of samples (recommended temperatures for sample storage exceeded)</td><td>Risk of invalid result. If sample is degraded, a new sample needs to be collected</td><td>1</td><td>4</td><td>2</td><td>8</td><td>Examine recommendations in force for the storage of nasopharyngeal samples. Check temperature sensor registers for problems. If necessary, have the affected enclosure temperature mapped. Implement more regular monitoring of enclosure temperatures to make drift easier to detect</td><td>Declare a "non-conformity"</td><td>Supervisory technician</td><td>1</td><td>4</td><td>2</td><td>8</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td rowspan="2">Biologists not available when needed / scheduling difficulties</td><td rowspan="2">Lack of time to discuss risk of contamination during this stage</td><td>Risk of propagation of virions by technicians and therefore contamination of samples</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Organize a weekly meeting with the biologists during the implementation period</td><td>Meeting reports detailing the measures taken each week</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Series needs to be retested, loss of time and resources and high risk of deadline failure</td><td>4</td><td>4</td><td>5</td><td>80</td><td>Ensure traceability so as to know who prepared the mix for each series. If the series is no good because of a mix problem, find the source of the problem and harmonize practices</td><td>Creation of a shared "problems encountered" document that everyone can fill in, with a solutions column</td><td>Supervisory technician</td><td>3</td><td>4</td><td>4</td><td>48</td><td>75</td></tr><tr><td>Poor homogenization of mix</td><td>Risk of non-functional mix (that does not permit amplification of the target RNA fragment)</td><td>Loss of time and resources, risk of deadline failure</td><td>3</td><td>4</td><td>5</td><td>60</td><td>Ensure traceability so as to know who prepared the mix for each series. If the series is no good because of a mix problem, find the source of the problem and harmonize practices</td><td>Creation of a shared "problems encountered" document that everyone can fill in, with a solutions column</td><td>Supervisory technician</td><td>2</td><td>4</td><td>5</td><td>40</td><td>75</td></tr><tr><td>Poor preparation of mix (a PCR reagent forgotten, or wrong volumes deposited)</td><td>Amplification reaction not possible, series needs to be retested</td><td>Loss of time and resources, risk of deadline failure</td><td>1</td><td>4</td><td>4</td><td>16</td><td>Check kit storage conditions in supplier file and that these are met. If not, check temperature sensor registers for problems. If necessary, have the affected enclosure temperature mapped</td><td>Add record of actions carried out to the device monitoring file</td><td>Supervisory technician</td><td>1</td><td>4</td><td>3</td><td>12</td><td>75</td></tr><tr><td>Poor storage of reagents for the mix (deteriorated or contaminated)</td><td>Risk of not being able to validate the series and/or risk of contamination of samples</td><td>Loss of time and resources, risk of deadline failure, risk of false results.</td><td>1</td><td>4</td><td>4</td><td>16</td><td>Check kit storage conditions in supplier file and that these are met. If not, check temperature sensor registers for problems. If necessary, have the affected enclosure temperature mapped</td><td>Add record of actions carried out to the device monitoring file</td><td>Supervisory technician</td><td>1</td><td>4</td><td>3</td><td>12</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td>Strips with mix left open to the air for too long</td><td>Risk of contamination of PCR wells by RNA of SRAS-Cov2</td><td>Risk of false positives</td><td>4</td><td>4</td><td>5</td><td>80</td><td>Revise operating procedure for this stage to ensure mix is distributed at the last moment and strips are closed with proper caps as quickly as possible without compromising flow</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Supervisory technician</td><td>3</td><td>4</td><td>5</td><td>60</td><td>75</td></tr><tr><td>Poor homogenization of patient samples in the mix</td><td>Amplification reaction not possible, patient sample needs to be retested</td><td>Less of time and resources, risk of deadline failures</td><td>5</td><td>3</td><td>5</td><td>75</td><td>Ensure traceability so as to know who prepared the mix for each series. If the series is no good because of a mix problem, find the source of the problem and harmonize practices</td><td>Creation of a shared "problems encountered" document that everyone can fill in, with a solutions column</td><td>Supervisory technician</td><td>4</td><td>3</td><td>5</td><td>60</td><td>75</td></tr><tr><td>Error depositing: samples in PCR strips: patients switched</td><td>Results of two patients switched</td><td>High risk of reporting an erroneous result</td><td>4</td><td>5</td><td>5</td><td>100</td><td>Use of 8-channel multichannel pipette to avoid pipetting patient samples one by one, thus avoiding error risk by 8</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Laboratory technician</td><td>3</td><td>5</td><td>5</td><td>75</td><td>75</td></tr><tr><td>Need for three separate molecular biology rooms ignored (extraction-time-amplification) and forward motion (ignored)</td><td>Contamination of sample wells by PCR products from amplification room</td><td>Risk of false positives</td><td>4</td><td>4</td><td>4</td><td>64</td><td>Organization of workstations to ensure forward motion</td><td>Mention of these measures in the Workplace Information Sheets</td><td>Biologists responsible for the Method</td><td>3</td><td>4</td><td>4</td><td>48</td><td>75</td></tr><tr><td>Environment</td><td>Contamination of samples by viruses or their RNA</td><td>Risk of false positives</td><td>2</td><td>4</td><td>5</td><td>40</td><td>Cleaning of laboratory bench, pipettes, cones, etc. with alcohol and an antinucleic acid product between each series</td><td>Mention in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>5</td><td>20</td><td>75</td></tr><tr><td>Environment contaminated (ambient air, laboratory benches): disinfection and cleaning procedures inadequate</td><td>Contamination of samples by viruses or their RNA</td><td>Risk of false positives</td><td>2</td><td>4</td><td>5</td><td>40</td><td>Cleaning of laboratory bench, pipettes, cones, etc. with alcohol and an antinucleic acid product between each series</td><td>Mention in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>5</td><td>20</td><td>75</td></tr></tbody></table>
<table><thead><tr><th>Contamination of pipette cones by whole SARS-CoV2 or its RNA</th><th>A viral RNA may be amplified in a sample from which it was initially absent</th><th>Risk of false positives</th><th>1</th><th>4</th><th>4</th><th>16</th><th>Organize laboratory workbenches so that hands and dirty cones do not pass over clean cones, strips, etc.</th><th>Cf. Organization of laboratory benches in the Method Operating Procedure</th><th>Supervisory technician</th><th>1</th><th>4</th><th>4</th><th>16</th><th>75</th></tr></thead><tbody><tr><td>Insufficient volume in the extraction plate (as volume too low in the plate at the start: sample viscous)</td><td>Amplification reaction not possible, patient sample needs to be retested</td><td>Loss of time and resources, risk of deadline failures</td><td>4</td><td>3</td><td>1</td><td>12</td><td>Pointers to proceed to following stage for this patient as is. But a tube for retest immediately so as to lose as little time as possible.</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Laboratory technician</td><td>4</td><td>1</td><td>1</td><td>4</td><td>75</td></tr><tr><td>Poor organization leading to contamination by SRAS COV-2 or its RNA</td><td>Samples may be contaminated at every stage of the process</td><td>Risk of false positives</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Create organization models for the laboratory benches: RWV, cone boxes, pleating, etc., so as to avoid contamination of samples. Draw the proper place for each item with a marker directly on the laboratory bench</td><td>Organizational diagram of the laboratory benches in the Method Operating Procedure</td><td>Supervisory technician</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr><tr><td>Lack of time and resources</td><td>Technical work under pressure, which increases the risk of error</td><td>Risk of reporting erroneous results</td><td>2</td><td>4</td><td>1</td><td>8</td><td>Extend working hours: early shift / late shift</td><td>Practical feedback from technicians about new organization of workstations</td><td>HR department</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><td>Inappropriate use of workstations</td><td>Problems with team organization and therefore fluidity of the process</td><td>Slowdown of overall process and risk of deadline failure</td><td>2</td><td>2</td><td>2</td><td>8</td><td>Workstations need to be thought out from point of view of flow management: hourly capacity of each stage, limiting steps defined, etc. for smooth transition where different workstations intersect</td><td>Creation of Workplace Information Sheets to sort out these problems, with Workplace Information Sheets read out at meetings so as to be sure everyone understands</td><td>Supervisory technician</td><td>1</td><td>2</td><td>2</td><td>4</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td></td><td>Poor scheduling and coordination of thermal cycler use</td><td>Loss of fluidity of overall process</td><td>Patients having to be retested, risk of deadline failures</td><td>3</td><td>3</td><td>2</td><td>18</td><td>Reflection on the organization of the overall process from the point of view of flow management, to ensure best possible organization of thermal cycler use and avoid waiting times</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Supervisory technician</td><td>1</td><td>3</td><td>1</td><td>3</td><td>75</td></tr><tr><td></td><td>Poor organization on the part of the technician</td><td>The test series are not started up quickly enough</td><td>Slowdown of overall process, risk of deadline failure</td><td>3</td><td>2</td><td>4</td><td>24</td><td>Revision of relevant components of technician training, harmonization of practices</td><td>Update Method Operating Procedure with these organizational concepts</td><td>Supervisory technician</td><td>1</td><td>2</td><td>4</td><td>8</td><td>75</td></tr><tr><td rowspan="2">Machinery</td><td>Lack of practical equipment: racks, filing trays, computers</td><td>Lack of organization and loss of time</td><td>Indirect risk of slowdown of overall process and therefore deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>0</td><td>2</td><td>1</td><td>0</td><td>75</td></tr><tr><td>Lack of PPE (masks, gloves, gowns, etc.)</td><td>Risk of contamination of laboratory technicians</td><td>Risk for their health and the integrity of the samples they manipulate</td><td>2</td><td>4</td><td>1</td><td>8</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>4</td><td>1</td><td>4</td><td>75</td></tr><tr><td></td><td>Machine contaminated by viral RNA from PCR products</td><td>Risk of contamination of samples with viral RNA that was not initially present</td><td>Risk of false positives</td><td>2</td><td>4</td><td>4</td><td>32</td><td>Schedule a complete decontamination of the device once a day. If the machine has a program for UV disinfection, make sure it is run at least 4 times per day</td><td>Traceability of maintenance carried out on machines by the laboratory technician</td><td>Supervisory technician</td><td>1</td><td>4</td><td>4</td><td>16</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td>Lack of staff compared with amount of activity</td><td>Test series are not validated quickly enough</td><td>Stowdown of overall process at the very end, risk of deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Internal recruitment if there are not enough staff for the needs of the activity</td><td>Feedback from those concerned on the differences observed since arrival of new personnel</td><td>Biologists responsible for the Method</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Biologists not available / scheduling difficulties</td><td>Lack of time to consult biologists on cases that need their opinion before being validated</td><td>Delay in reporting a result, risk of deadline failure</td><td>2</td><td>2</td><td>1</td><td>4</td><td>Organize a weekly meeting with the biologists during the implementation period</td><td>Meeting reports detailing the measures taken each week</td><td>Supervisory technician</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Series validated whereas controls were non-compliant</td><td>Patient results may be distorted by contamination (false positives) or reaction failure (false negatives)</td><td>High risk of reporting an erroneous result</td><td>2</td><td>5</td><td>3</td><td>30</td><td>Create list of criteria to be verified when validating a test series</td><td>Update Method Operating Procedure with these organizational concepts and create a traceability sheet with the verification criteria to be checked off by the technician for each series</td><td>Supervisory technician</td><td>1</td><td>5</td><td>3</td><td>15</td><td>75</td></tr><tr><td>Validation oversight for one or more series</td><td>Results are not transferred into LIMS</td><td>Risk of deadline failure</td><td>3</td><td>3</td><td>3</td><td>27</td><td>Transit of "plate plan" and extraction stage information sheets for each series, to make it easy to see which is validated, which is waiting, with labeled filing trays...</td><td>Update Method Operating Procedure and Workplace Information Sheets with these organizational concepts</td><td>Supervisory technician</td><td>2</td><td>3</td><td>2</td><td>12</td><td>75</td></tr></tbody></table>
<table><tbody><tr><td></td><td>Poor sorting of positive and negative samples in terms of storage</td><td>Reduced traceability of, notably, positive cases</td><td>Epidemiological statistics reports distorted</td><td>Creation of an automatic "CORONA+" reference for all patient files with a positive result. This ensures all positive files of the day, the week, the month, and so forth, can be found quickly. Creation of "CORONA+" racks is the freezer, for the storage of positive samples from each series</td><td>Update Method Operating Procedure and Workplace Information Sheets with these organizational concepts</td><td>Supervisory technician</td><td>2</td><td>3</td><td>2</td><td>12</td><td>75</td></tr><tr><td rowspan="2">Machinery</td><td>Lack of practical equipment: racks, filing trays, computers</td><td>Lack of organization and loss of time</td><td>Indirect risk of slowdown of overall process and therefore deadline failure</td><td>Assessment and purchase of necessary equipment</td><td>Set upper and lower critical thresholds for stock management and regulation of purchasing</td><td>Laboratory stock manager</td><td>1</td><td>2</td><td>1</td><td>2</td><td>75</td></tr><tr><td>Records for a series lost (not recorded in the computer / recorded in the wrong location)</td><td>Loss of traceability</td><td>Risk of being refused COFRAC accreditation for the Method</td><td>Creation of files on the computer with YYYY/MM/DD format for all series</td><td>Update Method Operating Procedure and Workplace Information Sheets with these organizational concepts</td><td>Supervisory technicians</td><td>1</td><td>3</td><td>2</td><td>6</td><td>75</td></tr><tr><td></td><td>Series recording with wrong name</td><td>Loss of traceability, transparency and time</td><td>Risk of being refused COFRAC accreditation for the Method</td><td>Use series numbers that are always formatted the same way: YYYY.MM.DD.SeriesX</td><td>Update Method Operating Procedure and Workplace Information Sheets with these organizational concepts</td><td>Laboratory technician</td><td>1</td><td>3</td><td>2</td><td>6</td><td>75</td></tr></tbody></table>