Sensitivity evaluation of 2019 novel coronavirus (SARS-CoV-2) RT-PCR detection kits and strategy to reduce false negative

Abstract

The early detection and differential diagnosis of respiratory infections increase the chances for successful control of COVID-19 disease. The nucleic acid RT-PCR test is regarded as the current standard for molecular diagnosis. However, the maximal specificity confirmation target ORF1ab gene is considered to be less sensitive than other targets in clinical application. In addition, recent evidence indicated that the initial missed diagnosis of asymptomatic patients with SARS-CoV-2 and discharged patients with “re-examination positive” might be due to low viral load, and the ability of rapid mutation of SARS-CoV-2 also increases the rate of false-negative results. Moreover, the mixed sample nucleic acid detection is helpful in seeking out the early community transmission of SARS-CoV-2 rapidly, but the detection kit needs ultra-high detection sensitivity. Herein, the lowest detection concentration of different nucleic acid detection kits was evaluated and compared to provide direct evidence for the selection of kits for mixed sample detection or make recommendations for the selection of validation kit, which is of great significance for the prevention and control of the current epidemic and the discharge criteria of low viral load patients.

About the Authors:

Yunying Zhou

Roles Project administration

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China, Research Center of Basic Medicine, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Fengyan Pei

Roles Writing – original draft

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Mingyu Ji

Roles Resources

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Li Wang

Roles Supervision

Affiliation: Jinan Infectious Disease Hospital, Shandong University, Jinan, Shandong, China

Huailong Zhao

Roles Validation

Affiliation: Jinan Center for Disease Control and Prevention, Jinan, Shandong, China

Huanjie Li

Roles Investigation

Affiliation: Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China

Weihua Yang

Roles Supervision

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Qingxi Wang

Roles Visualization

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Qianqian Zhao

Roles Formal analysis

* E-mail: [email protected] (QZ); [email protected], [email protected] (YW)

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Yunshan Wang

Roles Conceptualization

* E-mail: [email protected] (QZ); [email protected], [email protected] (YW)

Affiliations Medical Research & Laboratory Diagnostic Center, Jinan Central Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China, Microbiology Department, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China, Research Center of Basic Medicine, Jinan Central Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China

Introduction

The coronavirus that caused the outbreak was identified in the case of viral pneumonia in Wuhan in 2019 [1–3] and was named as 2019-nCoV/SARS-CoV-2 by the World Health Organization (WHO) [2–5]. SARS-CoV-2 belongs to the coronavirus genus β with a single-stranded, non-segmented positive-sense RNA genome [6], which is the seventh known coronavirus that can infect humans [1, 7]. Similar to the other pathogenic RNA viruses, the genetic RNA material is the earliest marker to be detected. The nucleic acid detection or sequencing is currently used in conjunction with pulmonary CT for the clinical diagnosis of COVID-19 [8, 9]. As the disease progresses, antibodies IgM and IgG were produced by the human immune system. Although antibody tests play a major role in monitoring the response to future immunization strategies and demonstrating previous exposure/immunity, the antibody-positive rate often lags behind the nucleic acid detection [10–12], and the cross-reactions were detected in SARS-CoV antigen with autoantibodies [13].

Theoretically, real-time PCR detection is widely used as the molecular diagnosis standard for SARS-CoV-2 [14, 15]. Recently, the analysis showed that the pattern of viral load change in COVID-19 patients was similar to that in patients with influenza; however, it was different from that in SARS and MERS (whose viral load peaked about 10 days after the onset of symptoms) [16–19]. In COVID-19 patients, RT-PCR was detected as positive one day before the onset of symptoms, while most COVID-19 patients cannot be detected before premorbid because of the low copy number of the virus [7, 17, 20]. In addition, some discharged patients appearing “re-examination-positive” could be attributed to the persistence of a small number and low copy number of the viruses. However, the false-negative rate is about 20–40% in the highly suspicious cases in China [21–23] due to improper sample collection, storage, personnel operation, and low sensitivity test kit [24]. Furthermore, mutation or deletion in the target gene leads to false-negative results [25, 26].

The current RT-PCR nucleic acid detection has not only a high false-negative rate but also a low sensitivity rate [23]. The target genes for SARS-CoV-2 are based on the conserved and specific open reading frame 1ab (ORF1ab), spike (S), RNA-dependent RNA polymerase (RdRp), envelope (E), and nucleocapsid (N) genes [6, 27–31]. Although ORF1ab is the highest specificity confirmation target gene, it is considered to be less sensitive than other targets in clinical application [28]. Recently, mixed sample testing has been widely used in large-scale population testing (http://www.nhc.gov.cn/yzygj/s7659/202008/fa5057afe4314ef8a9172edd6c65380e.shtml). However, some studies propose that although this method improves the detection efficiency, it might miss the individuals with low viral load [29, 32]. In addition, none of the approved nucleic acid test kits mentioned whether they could be used for mixed sample detection. Thus, the pattern of ORF1ab-positive reports cause missed tests? Is it feasible to report based on positive N or E genes? Clinically, it is recommended that samples with suspicious results or single-channel positive results should be re-examined with another manufacturer’s kit or method. Nonetheless, the basis for selecting a specific validation kit is yet to be elucidated.

Materials and methods

Patients

A total of 10 confirmed cases of COVID-2019 patients (2 females and 8 males, 5–50-years-old) were collected from January to February 2020, in Jinan Central Hospital Affiliated to Shandong University and Jinan Infectious Disease Hospital, Shandong University. These patients were diagnosed based on the clinical symptoms, lung computed tomography (CT), and nucleic acid test. Also, 100 suspected cases (symptoms of fever, dry cough, and pneumonia images) were collected from the first institute listed above.

Ethics statement

This study was approved by the Ethics Commission of Jinan Central Hospital. The written informed consent was obtained from all study participants, and the written parental consent were obtained from the minors before the study was begun.

Specimen collection

The specimens were collected according to the guidelines of the Chinese Center for Disease Control and Prevention (CCDC) (http://www.chinacdc.cn/jkzt/crb/zl/szkb_11803/jszl_11815/202003/t20200309_214241.html). Nasopharyngeal and oropharyngeal swabs were inserted into one sterile tube containing 3 mL of virus preservation solution. The positive specimens were obtained from the patient 2 days after they were diagnosed as COVID-19. In the case of highly suspicious patients, the nucleic acid testing for SARS-CoV-2 was repeated on new nasopharyngeal samples and oropharyngeal swabs, and the serum for antibody testing was collected at an interval of 24 h, until it was confirmed to be positive or negative. In addition, environmental specimens were collected from the surface in direct contact with the patient, such as the inner side of the mask, phone, doorknob, and bedside. Each surface was wiped with one synthetic fiber swab that was then inserted into a sterile tube.

Virus RNA extraction

Then RNA extraction, gradient dilution and PCR amplification were performed within two hours after specimen collection. The virus RNA was extracted using the magnetic beads method, according to the instructions of the nucleic acid extraction kit (Shanghai Zhijiang Biotechnology Co., Ltd, Shanghai, China), and then diluted with RNA extraction of negative samples. RNA concentration of the extraction were 20~100ng/μL detected by Nanodrop 2000.

Real-time PCR

To verify the sensitivity of SARS-CoV-2 nucleic acid detection kits, five kits were selected. Kit-1 and kit-2 were designed according to the primer and probe sequences published by China’s CDC and were the first kits approved by the National Medical Products Administration (NMPA) and subsequently received European Confirmity (CE) marking. Kit-3 designed according to the primer and probe sequences published by WHO [6], was also approved by NMPA. Kit-4 and kit-5 were self-designed kits based on the genomes of SARS-CoV-2. The name, source, and catalog number of the five test kits are as follows: Kit-1 (BioGerm, Shanghai BioGerm Medical Co., Ltd, SJ-HX-226-1,2), Kit-2 (Liferiver, Shanghai Liferiver Biotech Co., Ltd, Z-RR-0479-02-50), Kit-3 (ACV, Shandong ACV Biotech Co., Ltd, B7200118-0102), Kit-4 (XABTBeijing ZCHS Biotech Co., Ltd, ZCHS-C-YF-JC19-01), and Kit-5 (bioPerfectus, Jiangsu bioPerfectus Biotech Co., Ltd, JC10223-1N). Each kit contained 25 μL of the reaction system, including 5 μL of the RNA template. The amplification reaction was set according to the instructions of the kits and carried out on the ABI7500 Real-time PCR system (Applied Biosystems, USA). The information for the five amplification kits is shown in Table 1.

[Figure omitted. See PDF.]

Table 1. Information for the amplification kits of SARS-CoV-2.

https://doi.org/10.1371/journal.pone.0241469.t001

Defined criteria of PCR results

The sensitivity comparison of multiple samples and kits should ensure that the initial concentration of samples is consistent. Then, to set the threshold and analyze each target separately for PCR amplification, the threshold should be adjusted to fall within the PCR exponential phase and higher than any background noise. Finally, the data were judged according to the Ct value and the shape of the curve, and the lowest detection concentration of positive data was used as the standard to judge the sensitivity of the kits. The positive result must be a typical S curve, and the Ct value must be within the positive reporting region according to each kit’s instructions (Table 1). For instance, the Ct value is ≤35 for kit-1 and kit-4, ≤40 for kit-2, ≤38 for kit-3, and ≤37 for kit-5.

Continuous amplification

The RT-PCR products were re-amplified for another 40 cycles under the same amplification conditions. A total of 53 nucleic acid samples of other respiratory pathogens with known concentrations were used for specificity test.

Laboratory quality-control

Respiratory specimens include nasopharyngeal and oropharyngeal swabs, bronchoalveolar lavage fluid, tracheal aspirates, and sputum. However, cotton swab heads are not allowed for swab specimens. Also, serum specimens were collected. Specimens should not be stored for more than 72 h at 4 °C. Positive and negative controls should be tested simultaneously with the samples. The fluorescence amplification curve of the negative control should not exceed the threshold. The Ct value of all the targets in the positive control should be within the expected range. The detection kit should contain the internal target gene, and the amplification curve should exceed the threshold line.

Statistical methods

SPSS18.0 software was used for statistical analysis. The Student’s t-test was used to evaluate the differences between Ct values.

Results

Sensitivity evaluation of SARS-CoV-2 detection kits

The lowest detection concentration is a critical performance parameter to evaluate the sensitivity of the kit. Viral RNA was extracted from a patient with SARS-CoV-2 and diluted according to the following proportion gradient: 1:5, 1:10, 1:20, 1:40, 1:80, 1:160, and 1:320. Each concentration was detected three times with five kits. Fig 1A shows a decreasing trend of virus level that disappears with the increase in the dilution concentration in different kits. The lowest detection concentration of ORF1ab and N genes was maximal in the kit-1, deeming it as the most sensitive to SARS-CoV-2, followed by kit-4, kit2, kit3, and kit5. In addition, the Ct value of the amplification curve was found to be positively correlated with the dilution gradient (Fig 1B). The comparison of the Ct values of each target gene in kit-1 and kit-2 revealed that the Ct value of ORF1ab and N genes in kit-1 were still within the positive reportable region at 1:20 and 1:160 dilution, respectively, while it exceeded the detection limit in kit-2 at 1:5 and 1:40 dilutions.

[Figure omitted. See PDF.]

Fig 1. Sensitivity evaluation of SARS-CoV-2 detection kits.

(A) Virus level that disappears with the increase in the dilution concentration in different kits. (B) The Ct value of the amplification curve was positively correlated with the dilution gradient. The red asterisk represents the comparison of Ct values of N gene, while the green asterisk represents the comparison of Ct values of ORF1ab/RdRp gene between the two kits. *P < 0.05; **P < 0.01. (C) Kit-1 has the highest sensitivity based on the verification of multiple positive samples. (D) Selection strategies of validation kit.

https://doi.org/10.1371/journal.pone.0241469.g001

To further verify the applicability of the kits, another 9 positive samples were tested. The positive RNA extract was first quantified by digital PCR and then diluted to the same initial concentration. The results showed that the ORF1ab gene can still be reported as positive at 1:10 dilution and the N gene at 1:40 dilution (Fig 1C) with kit-1, while they exceeded the detection limit at 1:5 and 1:20, respectively, with kit-2. Hence, we presumed that kit-1 has the highest sensitivity based on the verification of multiple positive samples.

The above results showed that the sensitivity of ORF1ab gene was the lowest as compared to the other target genes of SARS-CoV-2, using all the detection kits. Then, if the N or E gene is positive and the ORF1ab gene is negative (three cases were presented in Fig 1A), how to judge the result and select the validation kit needs to be addressed. Our solution is as follows (Fig 1D): 1. Both ORF1ab and N genes can be converted to positive after verification with kit 1; 2. When N gene is in a suspicious region, as determined by kit 2, it can be converted to positive after verification with kit 1; 3. When the N gene is deemed negative with kit 2, it can be converted to positive after verification with kit 1.

Clinical validation and application.

In addition to choosing a sensitive kit for validation, is there an easier method to increase the positive detection rate? First, the RT-PCR products of the above-diluted samples in the suspicious range were amplified for another 40 cycles. It was found that for the samples with dilution gradients of 1:10 and 1:20, the ORF1ab and N genes with large original amplified Ct values were expanded to the positive reporting region, while the other dilution gradients only with N or E genes were significantly amplified (Fig 2A). Moreover, 100 patients with clinical fever and dry cough, who were suspected to be infected with the SARS-CoV-2, were enrolled for RT-PCR, and 2 positive cases and 2 suspicious cases were identified (Table 2). Then, the suspicious cases were re-amplified and found to be positive by continuous amplification (Fig 2B and S1 Fig).

[Figure omitted. See PDF.]

Fig 2. Strategies to reduce false negatives of SARS-CoV-2.

(A) Continuous amplification of PCR products for gradient dilution samples. (B) Continuous amplification of PCR products for suspicious specimens. (C) Continuous amplification of PCR products for the environmental samples of 3 positive patients. Kit 1 was used for A and B, while kit 2 for C.

https://doi.org/10.1371/journal.pone.0241469.g002

[Figure omitted. See PDF.]

Table 2. Detection results of clinical environmental specimens by real-time PCR.

https://doi.org/10.1371/journal.pone.0241469.t002

Moreover, the environmental samples from 3 COVID-19 patients were subjected to nucleic acid testing. It was found that the sample inside the mask of 1 patient was weakly positive, which could be reported as positive after another re-amplification (Fig 2C). Further analysis revealed that each target gene could reach the amplification plateau by adding another 30 cycles. Also, we added the initial RT-PCR amplification products of positive patients into a new amplification reaction system, albeit the results were not reliable.

Strategies to reduce false negatives of SARS-CoV-2.

Herein, we suggested that the sensitivity of the detection kits should be evaluated before their routine usage, and the sensitivity of the validation kit must be higher than that of the test kit. In mixed samples, the ultra-high sensitivity kit should be preferred. For specimens with suspicious interval region or single-channel positive results, the continuous amplification can be used to increase the detection rate of low viral load specimens and greatly reduce the false-negative rate of SARS-CoV-2.

Discussion

As of September 2, 2020, statistical data showed that the global number of confirmed cases of COVID-19 had surpassed 25 million with >800,000 deaths [33]. With an increasing number of potential cases, the SARS-CoV-2 poses a major threat to global public health [34]. Currently, a large number of diagnostic tools, such as virus isolation, PCR-based assays, IHC, and antibody assays, have been developed across various diagnostic laboratories worldwide [35–39]. The detection rate of viral nucleic acid is closely related to the course of viral infection, and the optimal sampling time is uncertain; however, the period of the high viral load will be missed, resulting in false-negatives [40]. Although RT-PCR is challenged by the false-negative results [41], in view of the past major epidemic outbreaks [42], the method is still the preferred tool for detection. Therefore, how to ensure the accuracy of nucleic acid test results is currently under investigation.

Theoretically, the primers and probes of the target genes should have not only high specificity but also high sensitivity. The most conserved ORF1ab gene presents low sensitivity, while the other target genes, such as N or E, are less conservative but more sensitive. The current results showed that the lowest detection concentration of each kit differs substantially. If a low sensitivity kit is selected to detect SARS-CoV-2 infection, it may lead to false-negative results. In addition, multiple mutations were detected over the entire genomes of SARS-CoV-2 [43–45]. Variations are speculated to influence the rate of disease transmission and mortality [6, 30, 46] and also that the false-negative rate might be elevated if the mutation occurs at the current target genes of SARS-CoV-2. Except for the variations found throughout the genome, mutations of SARS-CoV-2 virus were also found at the primer- or probe-binding sites [47], which might lower the sensitivity of the current targeting genes. Furthermore, we speculated that the detection of Nsp1 could avoid false-negative results caused by mutations at the primer- or probe-binding sites [48]. Notably, the deletion of 382 nucleotides in the ORF8 gene enhances the transcription of the downstream N gene [26], which might increase the false-negative detection rate of SARS-CoV-2. Thus, attention should be focused on the abnormally amplified N gene in clinical detection.

As a prospective method to resolve the dilemma of SARS-CoV-2 nucleic acid screening, mixed sample detection could be adopted for the low-risk population according to the regulations of the National Health Commission of the People’s Republic of China (http://www.nhc.gov.cn/yzygj/s7659/202008/fa5057afe4314ef8a9172edd6c65380e.shtml). The mixed samples include samples for mixed-collection and samples for mixed-detection. To simulate the mixed-collection, the swabs of confirmed positive and negative samples were mixed in a tube with a virus preservation solution. Subsequently, the Ct value of the amplification curve was unchanged, which indicated that the mixed-collection sample did not affect the positive detection rate. To simulate mixed-detection, the virus preservation solution of positive and negative samples was mixed equally and found that the Ct value increased correspondingly, which indicated that the sensitivity was reduced by mixed-detection (S1 Table). It is noteworthy that mixed-collection is not simply increase the number of swabs in the collection tube, but to carefully consider and design the specification and material of collection tube, the composition and content of virus preservation solution, the material of swab and the type of swab head, so as to ensure the accuracy of detection results. Therefore, in order to avoid false-negative results, sensitive detection kits should be used in mixed-detection.

Similar to all the viral nucleic acid testing projects, the RT-PCR results of SARS-CoV-2 are affected by various factors before, during, and after detection, and hence, laboratory quality-control measures should be implemented. In addition, extending amplification cycles do increase sensitivity, but may also reduce specificity. Nucleic acid samples of other respiratory pathogens with known concentrations were used for specificity testing and results showed there was no cross-reaction with other pathogens and the specificity did not decrease (S2 Table). Moreover, the continuous amplification and other detection methods of SARS-CoV exhibited false-positive results [49, 50]; thus, we recommended using it only when the amplification curve of the target gene is in the specious region.

Conclusions

The emergence of mixed sample detection challenges the sensitivity of nucleic acid detection kits. We speculated that the detection of mixed samples is only applicable to low-risk populations using the high-sensitivity kits. Importantly, the antibody and nucleic acid tests should complement each other to improve the diagnosis, especially to screen the asymptomatic patients better and reduce the false-negative phenomenon of “false recovered patients” or premorbid patients with low virus latency.

Supporting information

[Figure omitted. See PDF.]

S1 Fig. Continuous amplification of PCR product for another suspected specimen.

https://doi.org/10.1371/journal.pone.0241469.s001

(TIF)

S1 Table. The results of samples for mixed-collection and mixed-detection with kit-1.

https://doi.org/10.1371/journal.pone.0241469.s002

(PDF)

S2 Table. Cross-reactive results with other pathogens.

https://doi.org/10.1371/journal.pone.0241469.s003

(PDF)

Citation: Zhou Y, Pei F, Ji M, Wang L, Zhao H, Li H, et al. (2020) Sensitivity evaluation of 2019 novel coronavirus (SARS-CoV-2) RT-PCR detection kits and strategy to reduce false negative. PLoS ONE 15(11): e0241469. https://doi.org/10.1371/journal.pone.0241469

References

1. Munster VJ, Koopmans M, van Doremalen N, van Riel D, de Wit E (2020) A Novel Coronavirus Emerging in China—Key Questions for Impact Assessment. N Engl J Med 382: 692–694. pmid:31978293

2. Zhu N, Zhang D, Wang W, Li X, Yang B, et al. (2020) A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med 382: 727–733. pmid:31978945

3. Wang D, Hu B, Hu C, Zhu F, Liu X, et al. (2020) Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA. pmid:32031570

4. Ashour HM, Elkhatib WF, Rahman MM, Elshabrawy HA (2020) Insights into the Recent 2019 Novel Coronavirus (SARS-CoV-2) in Light of Past Human Coronavirus Outbreaks. Pathogens 9. pmid:32143502

5. Lu R, Zhao X, Li J, Niu P, Yang B, et al. (2020) Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. Lancet 395: 565–574. pmid:32007145

6. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, et al. (2020) Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill 25.

7. Pan Y, Zhang D, Yang P, Poon LLM, Wang Q (2020) Viral load of SARS-CoV-2 in clinical samples. Lancet Infect Dis. pmid:32105638

8. Wang Y, Kang H, Liu X, Tong Z (2020) Combination of RT-qPCR testing and clinical features for diagnosis of COVID-19 facilitates management of SARS-CoV-2 outbreak. J Med Virol. pmid:32096564

9. Wang XF, Yuan J, Zheng YJ, Chen J, Bao YM, et al. (2020) [Retracted: Clinical and epidemiological characteristics of 34 children with 2019 novel coronavirus infection in Shenzhen]. Zhonghua Er Ke Za Zhi 58: E008. pmid:32062875

10. Li Z, Yi Y, Luo X, Xiong N, Liu Y, et al. (2020) Development and Clinical Application of A Rapid IgM-IgG Combined Antibody Test for SARS-CoV-2 Infection Diagnosis. J Med Virol. pmid:32104917

11. Xiang F, Wang X, He X, Peng Z, Yang B, et al. (2020) Antibody Detection and Dynamic Characteristics in Patients with COVID-19. Clin Infect Dis.

12. Zhao J, Yuan Q, Wang H, Liu W, Liao X, et al. (2020) Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. Clin Infect Dis. pmid:32221519

13. Wang Y, Sun S, Shen H, Jiang L, Zhang M, et al. (2004) Cross-reaction of SARS-CoV antigen with autoantibodies in autoimmune diseases. Cell Mol Immunol 1: 304–307. pmid:16225774

14. Jiang G, Ren X, Liu Y, Chen H, Liu W, et al. (2020) Application and optimization of RT-PCR in diagnosis of SARS-CoV-2 infection. medRxiv: 2020.2002.2025.20027755.

15. Saiki RK, Gelfand DH, Stoffel S, Scharf SJ, Higuchi R, et al. (1988) Primer-directed enzymatic amplification of DNA with a thermostable DNA polymerase. Science 239: 487–491. pmid:2448875

16. Peiris JS, Chu CM, Cheng VC, Chan KS, Hung IF, et al. (2003) Clinical progression and viral load in a community outbreak of coronavirus-associated SARS pneumonia: a prospective study. Lancet 361: 1767–1772. pmid:12781535

17. Zou L, Ruan F, Huang M, Liang L, Huang H, et al. (2020) SARS-CoV-2 Viral Load in Upper Respiratory Specimens of Infected Patients. N Engl J Med. pmid:32074444

18. Peeri NC, Shrestha N, Rahman MS, Zaki R, Tan Z, et al. (2020) The SARS, MERS and novel coronavirus (COVID-19) epidemics, the newest and biggest global health threats: what lessons have we learned? Int J Epidemiol. pmid:32086938

19. Prompetchara E, Ketloy C, Palaga T (2020) Immune responses in COVID-19 and potential vaccines: Lessons learned from SARS and MERS epidemic. Asian Pac J Allergy Immunol. pmid:32105090

20. Gao WJ, Li LM (2020) [Advances on presymptomatic or asymptomatic carrier transmission of COVID-19]. Zhonghua Liu Xing Bing Xue Za Zhi 41: 485–488. pmid:32141279

21. Li Y, Yao L, Li J, Chen L, Song Y, et al. (2020) Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19. J Med Virol. pmid:32219885

22. Li D, Wang D, Dong J, Wang N, Huang H, et al. (2020) False-Negative Results of Real-Time Reverse-Transcriptase Polymerase Chain Reaction for Severe Acute Respiratory Syndrome Coronavirus 2: Role of Deep-Learning-Based CT Diagnosis and Insights from Two Cases. Korean J Radiol 21: 505–508. pmid:32174053

23. Ai T, Yang Z, Hou H, Zhan C, Chen C, et al. (2020) Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology 296: E32–E40. pmid:32101510

24. Dong X, Cao YY, Lu XX, Zhang JJ, Du H, et al. (2020) Eleven faces of coronavirus disease 2019. Allergy.

25. Angeletti S, Benvenuto D, Bianchi M, Giovanetti M, Pascarella S, et al. (2020) COVID-2019: The role of the nsp2 and nsp3 in its pathogenesis. J Med Virol. pmid:32083328

26. Su YC, Anderson DE, Young BE, Zhu F, Linster M, et al. (2020) Discovery of a 382-nt deletion during the early evolution of SARS-CoV-2. bioRxiv: 2020.2003.2011.987222. pmid:32694143

27. Lan L, Xu D, Ye G, Xia C, Wang S, et al. (2020) Positive RT-PCR Test Results in Patients Recovered From COVID-19. JAMA. pmid:32105304

28. (2020) Database Resources of the National Genomics Data Center in 2020. Nucleic Acids Res 48: D24–D33. pmid:31702008

29. Chan JF, Yuan S, Kok KH, To KK, Chu H, et al. (2020) A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster. Lancet 395: 514–523. pmid:31986261

30. Chan JF, Yip CC, To KK, Tang TH, Wong SC, et al. (2020) Improved Molecular Diagnosis of COVID-19 by the Novel, Highly Sensitive and Specific COVID-19-RdRp/Hel Real-Time Reverse Transcription-PCR Assay Validated In Vitro and with Clinical Specimens. J Clin Microbiol 58. pmid:32132196

31. World Health organization. Coronavirus disease (COVID-19) technical guidance: Laboratory testing for 2019-nCoV in humans. https://www.who.int/docs/default-source/coronaviruse/whoinhouseassays.pdf?sfvrsn=de3a76aa_2. Accessed on April 18, 2020. 2020;

32. Hogan CA, Sahoo MK, Pinsky BA (2020) Sample Pooling as a Strategy to Detect Community Transmission of SARS-CoV-2. JAMA 323: 1967–1969. pmid:32250394

33. WHO Coronavirus Disease (COVID-2019) Situation Reports. https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200831-weekly-epi-update-3.pdf?sfwrsn=d7032a2a_4.

34. Zhang W, Du RH, Li B, Zheng XS, Yang XL, et al. (2020) Molecular and serological investigation of 2019-nCoV infected patients: implication of multiple shedding routes. Emerg Microbes Infect 9: 386–389. pmid:32065057

35. Tang YW, Schmitz JE, Persing DH, Stratton CW (2020) The Laboratory Diagnosis of COVID-19 Infection: Current Issues and Challenges. J Clin Microbiol. pmid:32245835

36. Patel R, Babady E, Theel ES, Storch GA, Pinsky BA, et al. (2020) Report from the American Society for Microbiology COVID-19 International Summit, 23 March 2020: Value of Diagnostic Testing for SARS-CoV-2/COVID-19. MBio 11. pmid:32217609

37. Broughton JP, Deng X, Yu G, Fasching CL, Singh J, et al. (2020) Rapid Detection of 2019 Novel Coronavirus SARS-CoV-2 Using a CRISPR-based DETECTR Lateral Flow Assay. medRxiv: 2020.2003.2006.20032334. pmid:32511449

38. Lamb LE, Bartolone SN, Ward E, Chancellor MB (2020) Rapid Detection of Novel Coronavirus (COVID-19) by Reverse Transcription-Loop-Mediated Isothermal Amplification. medRxiv: 2020.2002.2019.20025155. pmid:32530929

39. Yu L, Wu S, Hao X, Li X, Liu X, et al. (2020) Rapid colorimetric detection of COVID-19 coronavirus using a reverse tran-scriptional loop-mediated isothermal amplification (RT-LAMP) diagnostic plat-form: iLACO. medRxiv: 2020.2002.2020.20025874.

40. Lin C, Xiang J, Yan M, Li H, Huang S, et al. (2020) Comparison of throat swabs and sputum specimens for viral nucleic acid detection in 52 cases of novel coronavirus (SARS-Cov-2) infected pneumonia (COVID-19). medRxiv: 2020.2002.2021.20026187.

41. Wikramaratna P, Paton RS, Ghafari M, Lourenco J (2020) Estimating false-negative detection rate of SARS-CoV-2 by RT-PCR. medRxiv: 2020.2004.2005.20053355.

42. Niu P, Lu R, Lan J, Liu G, Wang W, et al. (2016) [Development of Novel Multiplex Real-time RT-PCR Assays for Detection of MERS-CoV Infection]. Bing Du Xue Bao 32: 349–354. pmid:29963823

43. Pachetti M, Marini B, Benedetti F, Giudici F, Mauro E, et al. (2020) Emerging SARS-CoV-2 mutation hot spots include a novel RNA-dependent-RNA polymerase variant. J Transl Med 18: 179. pmid:32321524

44. Benvenuto D, Angeletti S, Giovanetti M, Bianchi M, Pascarella S, et al. (2020) Evolutionary analysis of SARS-CoV-2: how mutation of Non-Structural Protein 6 (NSP6) could affect viral autophagy. J Infect 81: e24–e27. pmid:32283146

45. Phan T (2020) Genetic diversity and evolution of SARS-CoV-2. Infect Genet Evol 81: 104260. pmid:32092483

46. Khan MI, Khan ZA, Baig MH, Ahmad I, Farouk AE, et al. (2020) Comparative genome analysis of novel coronavirus (SARS-CoV-2) from different geographical locations and the effect of mutations on major target proteins: An in silico insight. PLoS One 15: e0238344. pmid:32881907

47. Kaden R (2020) Early Phylogenetic Diversification of SARS-CoV-2: Determination of Variants and the Effect on Epidemiology, Immunology, and Diagnostics. J Clin Med 9.

48. Chan WM, Ip JD, Chu AW, Yip CC, Lo LS, et al. (2020) Identification of nsp1 gene as the target of SARS-CoV-2 real-time RT-PCR using nanopore whole-genome sequencing. J Med Virol. pmid:32501535

49. Maache M, Komurian-Pradel F, Rajoharison A, Perret M, Berland JL, et al. (2006) False-positive results in a recombinant severe acute respiratory syndrome-associated coronavirus (SARS-CoV) nucleocapsid-based western blot assay were rectified by the use of two subunits (S1 and S2) of spike for detection of antibody to SARS-CoV. Clin Vaccine Immunol 13: 409–414. pmid:16522785

50. Woo PC, Lau SK, Wong BH, Chan KH, Hui WT, et al. (2004) False-positive results in a recombinant severe acute respiratory syndrome-associated coronavirus (SARS-CoV) nucleocapsid enzyme-linked immunosorbent assay due to HCoV-OC43 and HCoV-229E rectified by Western blotting with recombinant SARS-CoV spike polypeptide. J Clin Microbiol 42: 5885–5888. pmid:15583332