Standardization and Comparison of Emergency Use Authorized COVID-19 Assays and Testing Laboratories

Motivation

The motivation for this work was the need to establish a predefined cutoff based on genome copies per ml (GE/ml) rather than Ct, which can vary depending on the laboratory and assay used. A GE/ml-based threshold was necessary to define what constituted 'low positives" for samples that were included in data sets submitted to the FDA for emergency use approval for SARS-CoV-2 antigen tests.

Summary

SARS-CoV-2, the causal agent of the global COVID-19 pandemic, made its appearance at the end of 2019 and is still circulating in the population. The pandemic led to an urgent need for fast, reliable, and widely available testing. After December 2020, the emergence of new variants of SARS-CoV-2 led to additional challenges since new and existing tests had to detect variants to the same extent as the original Wuhan strain. When an antigen-based test is submitted to the Food and Drug Administration (FDA) for Emergency Use Authorization (EUA) consideration it is benchmarked against PCR comparator assays, which yield cycle threshold (CT) data as an indirect indicator of viral load - the lower the CT, the higher the viral load of the sample and the higher the CT, the lower the viral load. The FDA mandates that 10-20% of clinical samples used to evaluate the antigen test have to be low positive. Low positive, as defined by the FDA, are clinical samples in which the CT of the SARS-CoV-2 target gene is within 3 CT of the mean CT value of the approved comparator test's Limit of Detection (LOD). While all comparator tests are PCR-based, the results from different PCR assays used are not uniform. Results vary depending on assay platform, target gene, LOD and laboratory methodology. The emergence and dominance of the Omicron variant further challenged this approach as the fraction of low positive clinical samples dramatically increased as compared to earlier SARS-CoV-2 variants. This led to 20-40% of clinical samples having high CT values and therefore assays vying for an EUA were failing to achieve the 80% Percent Positive Agreement (PPA) threshold required. Here we describe the methods and statistical analyses used to establish a predefined cutoff, based on genome copies per ml (GE/ml) to classify samples as low positive (less than the cutoff GE/ml) or high positive (greater than the cutoff GE/mL). CT 30 for the E gene target using Cobas® SARS-CoV-2-FluA/B platform performed at TriCore Reference Laboratories, and this low positive cutoff value was used for two EUA authorizations. Using droplet digital PCR and methods described here, a value 49,447.72 was determined as the GE/ml equivalent for the low positive cutoff. The CT cutoff corresponding to 49447.72 GE/ml was determined across other platforms and laboratories. The methodology and statistical analysis described here can now be used for standardization of all comparators used for FDA submissions with a goal towards establishing uniform criteria for EUA authorization.

Sensitivity of rapid antigen tests against SARS-CoV-2 Omicron and Delta variants

Rapid antigen tests (RATs) have become an invaluable tool for combating the COVID-19 pandemic. However, concerns have been raised regarding the ability of existing RATs to effectively detect emerging SARS-CoV-2 variants. We compared the performance of 10 commercially available, emergency use authorized RATs against the Delta and Omicron SARS-CoV-2 variants using both individual patient and serially diluted pooled clinical samples. The RATs exhibited lower sensitivity for Omicron samples when using PCR cycle threshold (CT) value (a rough proxy for RNA concentration) as the comparator. Interestingly, however, they exhibited similar sensitivity for Omicron and Delta samples when using quantitative antigen concentration as the comparator. We further found that the Omicron samples had lower ratios of antigen to RNA, which offers a potential explanation for the apparent lower sensitivity of RATs for that variant when using C T value as a reference. Our findings underscore the complexity in assessing RAT performance against emerging variants and highlight the need for ongoing evaluation in the face of changing population immunity and virus evolution.

Investigation of Blood Plasma Viral Nucleocapsid Antigen as a Marker of Active Severe Acute Respiratory Syndrome Coronavirus 2 Omicron Variant Infection

Background

Nasopharyngeal qualitative reverse-transcription polymerase chain reaction (RT-PCR) is the gold standard for diagnosis of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, but it is not practical or sufficient in every clinical scenario due to its inability to distinguish active from resolved infection. Alternative or adjunct testing may be needed to guide isolation precautions and treatment in patients admitted to the hospital.

Methods

We performed a single-center, retrospective analysis of residual clinical specimens and medical record data to examine blood plasma nucleocapsid antigen as a candidate biomarker of active SARS-CoV-2. Adult patients admitted to the hospital or presenting to the emergency department with SARS-CoV-2 ribonucleic acid (RNA) detected by RT-PCR from a nasopharyngeal swab specimen were included. Both nasopharyngeal swab and a paired whole blood sample were required to be available for analysis.

Results

Fifty-four patients were included. Eight patients had positive nasopharyngeal swab virus cultures, 7 of whom (87.5%) had concurrent antigenemia. Nineteen (79.2%) of 24 patients with detectable subgenomic RNA and 20 (80.0%) of 25 patients with N2 RT-PCR cycle threshold ≤ 33 had antigenemia.

Conclusions

Most individuals with active SARS-CoV-2 infection are likely to have concurrent antigenemia, but there may be some individuals with active infection in whom antigenemia is not detectable. The potential for high sensitivity and convenience of a blood test prompts interest in further investigation as a screening tool to reduce reliance on nasopharyngeal swab sampling and as an adjunct diagnostic test to aid in clinical decision making during the period after acute coronavirus disease 2019.

Sensitivity of Rapid Antigen Tests Against SARS-CoV-2 Omicron and Delta Variants

Rapid Antigen Tests (RAT) have become an invaluable tool for combating the COVID-19 pandemic. However, concerns have been raised regarding the ability of existing RATs to effectively detect emerging SARS-CoV-2 variants. We compared the performance of eight commercially available, emergency use authorized RATs against the Delta and Omicron SARS-CoV-2 variants using individual patient and serially diluted pooled clinical samples. The RATs exhibited lower sensitivity for Omicron samples when using PCR Cycle threshold (C T ) value (a proxy for RNA concentration) as the comparator. Interestingly, however, they exhibited similar sensitivity for Omicron and Delta samples when using quantitative antigen concentration as the comparator. We further found that the Omicron samples had lower ratios of antigen to RNA, which offers a potential explanation for the apparent lower sensitivity of RATs for that variant when using C T value as a reference. Our findings underscore the complexity in assessing RAT performance against emerging variants and highlight the need for ongoing evaluation in the face of changing population immunity and virus evolution.