1
|
Multisite Clinical Validation of Isothermal Amplification-Based SARS-CoV-2 Detection Assays Using Different Sampling Strategies. Microbiol Spectr 2021; 9:e0084621. [PMID: 34668736 PMCID: PMC8528118 DOI: 10.1128/spectrum.00846-21] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
Isothermal amplification-based tests have been introduced as rapid, low-cost, and simple alternatives to real-time reverse transcriptase PCR (RT-PCR) tests for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) detection. The clinical performance of two isothermal amplification-based tests (Atila Biosystems iAMP coronavirus disease of 2019 [COVID-19] detection test and OptiGene COVID-19 direct plus RT-loop-mediated isothermal amplification [LAMP] test) was compared with that of clinical RT-PCR assays using different sampling strategies. A total of 1,378 participants were tested across 4 study sites. Compared with standard of care RT-PCR testing, the overall sensitivity and specificity of the Atila iAMP test for detection of SARS-CoV-2 were 76.2% and 94.9%, respectively, and increased to 88.8% and 89.5%, respectively, after exclusion of an outlier study site. Sensitivity varied based on the anatomic site from which the sample was collected. Sensitivity for nasopharyngeal sampling was 65.4% (range across study sites, 52.8% to 79.8%), for midturbinate was 88.2%, for saliva was 55.1% (range across study sites, 42.9% to 77.8%), and for anterior nares was 66.7% (range across study sites, 63.6% to 76.5%). The specificity for these anatomic collection sites ranged from 96.7% to 100%. Sensitivity improved in symptomatic patients (overall, 82.7%) and those with a higher viral load (overall, 92.4% for cycle threshold [CT] of ≤25). Sensitivity and specificity of the OptiGene direct plus RT-LAMP test, which was conducted at a single study site, were 25.5% and 100%, respectively. The Atila iAMP COVID test with midturbinate sampling is a rapid, low-cost assay for detecting SARS-CoV-2, especially in symptomatic patients and those with a high viral load, and could be used to reduce the risk of SARS-CoV-2 transmission in clinical settings. Variation of performance between study sites highlights the need for site-specific clinical validation of these assays before clinical adoption. IMPORTANCE Numerous SARS-CoV-2 detection assays have been developed and introduced into the market under emergency use authorizations (EUAs). EUAs are granted primarily based on small studies of analytic sensitivity and specificity with limited clinical validations. A thorough clinical performance evaluation of SARS-CoV-2 assays is important to understand the strengths, limitations, and specific applications of these assays. In this first large-scale multicentric study, we evaluated the clinical performance and operational characteristics of two isothermal amplification-based SARS-CoV-2 tests, namely, (i) iAMP COVID-19 detection test (Atila BioSystems, USA) and (ii) COVID-19 direct plus RT-LAMP test (OptiGene Ltd., UK), compared with those of clinical RT-PCR tests using different sampling strategies (i.e., nasopharyngeal, self-sampled anterior nares, self-sampled midturbinate, and saliva). An important specific use for these isothermal amplification-based, rapid, low-cost, and easy-to-perform SARS-CoV-2 assays is to allow for a safer return to preventive clinical encounters, such as cancer screening, particularly in low- and middle-income countries that have low SARS-CoV-2 vaccination rates.
Collapse
|
2
|
Huang L. Computed tomography-positive, SARS-CoV-2 RNA-negative symptomatic contacts of COVID-19 patients: what are their nature and implications? Future Virol 2021; 16:10.2217/fvl-2021-0205. [PMID: 34650618 PMCID: PMC8500462 DOI: 10.2217/fvl-2021-0205] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 09/13/2021] [Indexed: 01/19/2023]
Affiliation(s)
- Lei Huang
- Department of Oncology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, 197 Ruijin Er Road, Shanghai, 200025, China
| |
Collapse
|
3
|
Huang L, Zhang X, Zhang L, Xu J, Wei Z, Xu Y, Zhang C, Xu A. Swab and Sputum SARS-CoV-2 RNA-Negative, CT-Positive, Symptomatic Contacts of COVID-19 Cases: A Hypothesis-Generating Prospective Population-Based Cohort Study of Eight Clusters. Front Med (Lausanne) 2021; 8:685544. [PMID: 34485329 PMCID: PMC8416039 DOI: 10.3389/fmed.2021.685544] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 07/20/2021] [Indexed: 01/19/2023] Open
Abstract
Background: While some contacts of COVID-19 cases become symptomatic and radiographically abnormal, their SARS-CoV-2 RNA tests remain negative throughout the disease course. This prospective population-based cohort study aimed to explore their characteristics and significances. Methods: From January 22, 2020, when the first COVID-19 case was identified in Hefei, China, until July 3, a total of 14,839 people in Feidong, Hefei, with a population of ~1,081,000 underwent SARS-CoV-2 RNA testing, where 36 cases (0.2%) with confirmed COVID-19 infection (Group 1) and 27 close contacts (0.2%) testing negative for SARS-CoV-2 RNA but having both positive COVID-19 exposure histories and CT findings (Group 2) from eight clusters were prospectively identified. Another 62 non-COVID-19 pneumonia cases without any exposure history (Group 3) were enrolled, and characteristics of the three groups were described and compared. We further described a cluster with an unusual transmission pattern. Results: Fever was more common in Group 2 than Groups 1 and 3. Frequency of diarrhea in Group 1 was higher than in Groups 2 and 3. Median leucocyte, neutrophil, monocyte, and eosinophil counts were all lower in Groups 1 and 2 than in Group 3. Median D-dimer level was lower in Group 1 than in Groups 2 and 3. Total protein and albumin levels were higher in Groups 1 and 2 than in Group 3. C-reactive protein level was lower and erythrocyte sedimentation rate slower in Groups 1 and 2 than in Group 3. Combination antibacterial therapy and levofloxacin were more often used in Group 3 than in Groups 1 and 2. Lopinavir/ritonavir was more often administered in Groups 1 and 2 than in Group 3. Group 1 received more often corticosteroids than Groups 2 and 3. Group 2 received less often oxygen therapy than Groups 1 and 3. Median duration from illness onset to discharge was longer in Group 1 (27 d) than Groups 2 and 3 (both 17 d). Among contacts of a confirmed COVID-19 patient, only one had a positive virus RNA test but remained asymptomatic and had negative CT findings, and three had negative virus RNA tests but had symptoms and positive CT findings, one of whom transmitted COVID-19 to another asymptomatic laboratory-confirmed patient who had no other exposures. Conclusions: Among close contacts of confirmed COVID-19 cases, some present with positive symptoms and CT findings but test negative for SARS-CoV-2 RNA using common respiratory (throat swab and sputum) specimens; they have features more similar to confirmed COVID-19 cases than non-COVID-19 pneumonia cases and might have transmitted SARS-CoV-2 to others. Such cases might add to the complexity and difficulty of COVID-19 control. Our hypothesis-generating study might suggest that SARS-CoV-2 RNA testing by rRT-PCR assays of common respiratory (throat swab and sputum) specimens alone, the widely accepted "golden standard" for diagnosing COVID-19, might be sometimes insufficient, and that further studies with some further procedures (e.g., testing via bronchoalveolar lavage or specific antibodies) would be warranted for Group 2-like patients, namely, the SARS-CoV-2 RNA-negative (tested using common respiratory specimens), radiographically positive, symptomatic contacts of COVID-19 cases, to further reveal their nature.
Collapse
Affiliation(s)
- Lei Huang
- Department of Oncology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Xiuwen Zhang
- Quarantine Ward for Respiratory Infectious Diseases, Feidong People's Hospital, East District of the First Affiliated Hospital of Anhui Medical University, Hefei, China
- Graduate School, Soochow University, Suzhou, China
| | - Lingli Zhang
- Quarantine Ward for Respiratory Infectious Diseases, Feidong People's Hospital, East District of the First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Jingjing Xu
- Quarantine Ward for Respiratory Infectious Diseases, Feidong People's Hospital, East District of the First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Zhijian Wei
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yuanhong Xu
- Department of Clinical Laboratory Medicine, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Chengyuan Zhang
- Department of Respiratory and Critical Care Medicine, Feidong People's Hospital, East District of the First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Aman Xu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
4
|
Brümmer LE, Katzenschlager S, Gaeddert M, Erdmann C, Schmitz S, Bota M, Grilli M, Larmann J, Weigand MA, Pollock NR, Macé A, Carmona S, Ongarello S, Sacks JA, Denkinger CM. Accuracy of novel antigen rapid diagnostics for SARS-CoV-2: A living systematic review and meta-analysis. PLoS Med 2021; 18:e1003735. [PMID: 34383750 PMCID: PMC8389849 DOI: 10.1371/journal.pmed.1003735] [Citation(s) in RCA: 159] [Impact Index Per Article: 53.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 08/26/2021] [Accepted: 07/14/2021] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND SARS-CoV-2 antigen rapid diagnostic tests (Ag-RDTs) are increasingly being integrated in testing strategies around the world. Studies of the Ag-RDTs have shown variable performance. In this systematic review and meta-analysis, we assessed the clinical accuracy (sensitivity and specificity) of commercially available Ag-RDTs. METHODS AND FINDINGS We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched multiple databases (PubMed, Web of Science Core Collection, medRvix, bioRvix, and FIND) for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 up until 30 April 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity in comparison to reverse transcription polymerase chain reaction (RT-PCR) testing. We assessed heterogeneity by subgroup analyses, and rated study quality and risk of bias using the QUADAS-2 assessment tool. From a total of 14,254 articles, we included 133 analytical and clinical studies resulting in 214 clinical accuracy datasets with 112,323 samples. Across all meta-analyzed samples, the pooled Ag-RDT sensitivity and specificity were 71.2% (95% CI 68.2% to 74.0%) and 98.9% (95% CI 98.6% to 99.1%), respectively. Sensitivity increased to 76.3% (95% CI 73.1% to 79.2%) if analysis was restricted to studies that followed the Ag-RDT manufacturers' instructions. LumiraDx showed the highest sensitivity, with 88.2% (95% CI 59.0% to 97.5%). Of instrument-free Ag-RDTs, Standard Q nasal performed best, with 80.2% sensitivity (95% CI 70.3% to 87.4%). Across all Ag-RDTs, sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values, i.e., <20 (96.5%, 95% CI 92.6% to 98.4%) and <25 (95.8%, 95% CI 92.3% to 97.8%), in comparison to those with Ct ≥ 25 (50.7%, 95% CI 35.6% to 65.8%) and ≥30 (20.9%, 95% CI 12.5% to 32.8%). Testing in the first week from symptom onset resulted in substantially higher sensitivity (83.8%, 95% CI 76.3% to 89.2%) compared to testing after 1 week (61.5%, 95% CI 52.2% to 70.0%). The best Ag-RDT sensitivity was found with anterior nasal sampling (75.5%, 95% CI 70.4% to 79.9%), in comparison to other sample types (e.g., nasopharyngeal, 71.6%, 95% CI 68.1% to 74.9%), although CIs were overlapping. Concerns of bias were raised across all datasets, and financial support from the manufacturer was reported in 24.1% of datasets. Our analysis was limited by the included studies' heterogeneity in design and reporting. CONCLUSIONS In this study we found that Ag-RDTs detect the vast majority of SARS-CoV-2-infected persons within the first week of symptom onset and those with high viral load. Thus, they can have high utility for diagnostic purposes in the early phase of disease, making them a valuable tool to fight the spread of SARS-CoV-2. Standardization in conduct and reporting of clinical accuracy studies would improve comparability and use of data.
Collapse
Affiliation(s)
- Lukas E. Brümmer
- Division of Tropical Medicine, Center for Infectious Diseases, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Mary Gaeddert
- Division of Tropical Medicine, Center for Infectious Diseases, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Stephani Schmitz
- Division of Tropical Medicine, Center for Infectious Diseases, Heidelberg University Hospital, Heidelberg, Germany
| | - Marc Bota
- Agaplesion Bethesda Hospital, Hamburg, Germany
| | - Maurizio Grilli
- Library, University Medical Center Mannheim, Mannheim, Germany
| | - Jan Larmann
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Markus A. Weigand
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Nira R. Pollock
- Department of Laboratory Medicine, Boston Children’s Hospital, Boston, Massachusetts, United States of America
| | | | | | | | | | - Claudia M. Denkinger
- Division of Tropical Medicine, Center for Infectious Diseases, Heidelberg University Hospital, Heidelberg, Germany
- Partner Site Heidelberg University Hospital, German Center for Infection Research (DZIF), Heidelberg, Germany
| |
Collapse
|
5
|
Desai KT, Alfaro K, Mendoza L, Faron M, Mesich B, Maza M, Dominguez R, Valenzuela A, Acosta CD, Martínez M, Felix JC, Masch R, Gabrilovich S, Plump M, Novetsky AP, Einstein MH, Douglas NC, Cremer M, Wentzensen N. Multi-site clinical validation of Isothermal Amplification based SARS-COV-2 detection assays using different sampling strategies. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2021:2021.07.01.21259879. [PMID: 34268516 PMCID: PMC8282105 DOI: 10.1101/2021.07.01.21259879] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND Isothermal amplification-based tests were developed as rapid, low-cost, and simple alternatives to real-time reverse transcriptase-polymerase chain reaction (RT-PCR) tests for SARS-COV-2 detection. METHODS Clinical performance of two isothermal amplification-based tests (Atila Biosystems iAMP COVID-19 detection test and OptiGene COVID-19 Direct Plus RT-LAMP test) was compared to clinical RT-PCR assays using different sampling strategies. A total of 1378 participants were tested across four study sites. RESULTS Compared to standard of care RT-PCR testing, the overall sensitivity and specificity of the Atila iAMP test for detection of SARS-CoV-2 were 76.2% and 94.9%, respectively, and increased to 88.8% and 89.5%, respectively, after exclusion of an outlier study site. Sensitivity varied based on the anatomic collected site. Sensitivity for nasopharyngeal was 65.4% (range across study sites:52.8%-79.8%), mid-turbinate 88.2%, saliva 55.1% (range across study sites:42.9%-77.8%) and anterior nares 66.7% (range across study sites:63.6%-76.5%). The specificity for these anatomic collection sites ranged from 96.7% to 100%. Sensitivity improved in symptomatic patients (overall 82.7%) and those with a higher viral load (overall 92.4% for ct≤25). Sensitivity and specificity of the OptiGene Direct Plus RT-LAMP test, conducted at a single study-site, were 25.5% and 100%, respectively. CONCLUSIONS The Atila iAMP COVID test with mid-turbinate sampling is a rapid, low-cost assay for detecting SARS-COV-2, especially in symptomatic patients and those with a high viral load, and could be used to reduce the risk of SARS-COV-2 transmission in clinical settings. Variation of performance between study sites highlights the need for site-specific clinical validation of these assays before clinical adoption.
Collapse
Affiliation(s)
- Kanan T. Desai
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, NIH, Rockville, USA
| | | | - Laura Mendoza
- Instituto de Investigaciones en Ciencias de la Salud, Universidad Nacional de Asunción, San Lorenzo, Paraguay
| | | | | | | | - Rhina Dominguez
- Research Unit, El Salvador National Institute of Health (INS), El Salvador
| | - Adriana Valenzuela
- Instituto de Investigaciones en Ciencias de la Salud, Universidad Nacional de Asunción, San Lorenzo, Paraguay
| | - Chyntia Díaz Acosta
- Instituto de Investigaciones en Ciencias de la Salud, Universidad Nacional de Asunción, San Lorenzo, Paraguay
| | - Magaly Martínez
- Instituto de Investigaciones en Ciencias de la Salud, Universidad Nacional de Asunción, San Lorenzo, Paraguay
| | | | - Rachel Masch
- Basic Health International, Pittsburgh, USA
- The Mount Sinai Hospital, New York, USA
| | | | | | - Akiva P. Novetsky
- Rutgers New Jersey Medical School, Newark, USA
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | - Mark H. Einstein
- Rutgers New Jersey Medical School, Newark, USA
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | | | - Miriam Cremer
- Basic Health International, Pittsburgh, USA
- Cleveland Clinic Lerner College of Medicine, Clevland, USA
| | - Nicolas Wentzensen
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, NIH, Rockville, USA
| |
Collapse
|