1
|
Manten K, Katzenschlager S, Brümmer LE, Schmitz S, Gaeddert M, Erdmann C, Grilli M, Pollock NR, Macé A, Erkosar B, Carmona S, Ongarello S, Johnson CC, Sacks JA, Faehling V, Bornemann L, Weigand MA, Denkinger CM, Yerlikaya S. Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests: a systematic review and meta-analysis. Virol J 2024; 21:99. [PMID: 38685117 PMCID: PMC11059670 DOI: 10.1186/s12985-024-02371-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 04/17/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests' clinical accuracy. METHODS We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern. RESULTS We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer's instructions and those conducted differently, or between point-of-care and lab-based testing. CONCLUSION Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.
Collapse
Affiliation(s)
- Katharina Manten
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Stephan Katzenschlager
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
| | - Lukas E Brümmer
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Stephani Schmitz
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
- Department of Developmental Biology, Erasmus Medical Center, Rotterdam, Netherlands
| | - Mary Gaeddert
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Maurizio Grilli
- Library, University Medical Center Mannheim, Mannheim, Germany
| | - Nira R Pollock
- Department of Laboratory Medicine, Boston Children's Hospital, Boston, MA, USA
| | | | | | | | | | - Cheryl C Johnson
- Global HIV, Hepatitis and STIs Programmes, World Health Organization, Geneva, Switzerland
| | - Jilian A Sacks
- Department of Epidemic and Pandemic Preparedness and Prevention, World Health Organization, Geneva, Switzerland
| | - Verena Faehling
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Linus Bornemann
- Institute of Virology, Faculty of Medicine, University Medical Centre, University of Freiburg, Freiburg, Germany
| | - Markus A Weigand
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
| | - Claudia M Denkinger
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
- German Center for Infection Research (DZIF), partner site Heidelberg University Hospital, Heidelberg, Germany
| | - Seda Yerlikaya
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany.
- German Center for Infection Research (DZIF), partner site Heidelberg University Hospital, Heidelberg, Germany.
| |
Collapse
|
2
|
Mohammadi A, Chiang S, Li F, Wei F, Lau CS, Aziz M, Ibarrondo FJ, Fulcher JA, Yang OO, Chia D, Kim Y, Wong DT. Direct Detection of 4-Dimensions of SARS-CoV-2: Infection (vRNA), Infectivity (Antigen), Binding Antibody, and Functional Neutralizing Antibody in Saliva. RESEARCH SQUARE 2023:rs.3.rs-3745787. [PMID: 38234820 PMCID: PMC10793499 DOI: 10.21203/rs.3.rs-3745787/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
We developed a 4-parameter clinical assay using Electric Field Induced Release and Measurement (EFIRM) technology to simultaneously assess SARS-CoV-2 RNA (vRNA), nucleocapsid antigen, host binding (BAb) and neutralizing antibody (NAb) levels from a drop of saliva with performance that equals or surpasses current EUA-approved tests. The vRNA and antigen assays achieved lower limit of detection (LOD) of 100 copies/reaction and 3.5 TCID₅₀/mL, respectively. The vRNA assay differentiated between acutely infected (n=10) and infection-naïve patients (n=33) with an AUC of 0.9818, sensitivity of 90%, and specificity of 100%. The antigen assay similarly differentiated these patient populations with an AUC of 1.000. The BAb assay detected BAbs with an LOD of 39 pg/mL and distinguished acutely infected (n=35), vaccinated with prior infection (n=13), and vaccinated infection-naïve patients (n=13) from control (n=81) with AUC of 0.9481, 1.000, and 0.9962, respectively. The NAb assay detected NAbs with an LOD of 31.6 Unit/mL and differentiated between COVID-19 recovered or vaccinated patients (n=31) and pre-pandemic controls (n=60) with an AUC 0.923, sensitivity of 87.10%, and specificity of 86.67%. Our multiparameter assay represents a significant technological advancement to simultaneously address SARS-CoV-2 infection and immunity, and it lays the foundation for tackling potential future pandemics.
Collapse
Affiliation(s)
- Aida Mohammadi
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - Samantha Chiang
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - Feng Li
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - Fang Wei
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | | | - Mohammad Aziz
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - Francisco J. Ibarrondo
- Division of Infectious Diseases, Department of Medicine, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Jennifer A. Fulcher
- Division of Infectious Diseases, Department of Medicine, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Otto O. Yang
- Division of Infectious Diseases, Department of Medicine, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - David Chia
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - Yong Kim
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| | - David T.W. Wong
- School of Dentistry, University of California Los Angeles, Los Angeles, CA, USA
| |
Collapse
|