Clinical validation of an open-access SARS-COV-2 antigen detection lateral flow assay, compared to commercially available assays

Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests: a systematic review and meta-analysis

BACKGROUND

During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests' clinical accuracy.

METHODS

We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern.

RESULTS

We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer's instructions and those conducted differently, or between point-of-care and lab-based testing.

CONCLUSION

Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.

Defining the impact of immune tolerance induction on clinically relevant outcomes in a US cohort of severe hemophilia A

ABSTRACT

Although the near-term benefit of immune tolerance induction (ITI) for the treatment of people with severe hemophilia A with inhibitor is apparent, the magnitude of the longer-term impact of ITI on clinical outcomes remains undefined. We examined the association between receiving ITI and the success of ITI on clinical outcomes including (1) clinical events, (2) health care use, (3) quality of life/function, (4) socioeconomic status, and (5) death, using the Community Counts (CC) registry of US Hemophilia Treatment Centers between 2013 and 2017. Multivariate logistic regression, negative binomial, and Poisson models were used. Included in this study were 3659 people with severe hemophilia A with median age of 21 years when entering the CC registry. Among 576 participants with inhibitors, 485 had received ITI (84%). ITI was successful in 299 (61.7%) and partially successful or failed in 95 (19.5%) or 91 (18.7%), respectively. Those that received ITI had fewer treated bleeds, less chronic pain, better function, and higher educational attainment than those not receiving ITI. Successful vs partially successful and failed ITI was associated with fewer treated bleeds, less health care use, less chronic pain, better function, and fewer missed days of school or work. Mortality was not associated with ITI, regardless of its success. Those with successful ITI had similar rates of treated bleeds, chronic pain, and health care use as those with no inhibitors. Undergoing ITI, particularly if successful, improved clinical outcomes but not mortality. These findings support decision making regarding initiation of ITI and inform future clinical trials.

Net-Shaped DNA Nanostructure-Based Lateral Flow Assays for Rapid and Sensitive SARS-CoV-2 Detection

Lateral flow assay (LFA)-based rapid antigen tests are experiencing extensive global uptake as an expeditious and highly effective modality for the screening of viral infections during the COVID-19 pandemic. While these devices have played a significant role in alleviating the burden on the public healthcare system, their specificity and sensitivity fall short compared with molecular tests. In this study, we endeavor to address both limitations through the utilization of DNA nanotechnology in LFA format, wherein we substitute the target-specific antibody with designer DNA nanostructure-based molecular probes for recognizing the SARS-CoV-2 virus via multivalent, pattern-matching interactions. We meticulously designed a Net-shaped DNA nanostructure and strategically arranged trimeric clusters of aptamers that specifically recognize the spike proteins of SARS-CoV-2. This approach has proven instrumental in bolstering virus-binding affinity on the LFAs. Our findings indicate high LFA sensitivity, enabling the detection of viral loads ranging from 103 to 108 viral copies/mL. This notable sensitivity is maintained across various SARS-CoV-2 viral strains, obviating the need for intricate sample preparation protocols. The significance of this heightened sensitivity lies in the crucial role played by the designer DNA nanostructure, which facilitates the detection of extremely low levels of viral loads. This not only enhances the overall reliability of self-testing but also reduces the likelihood of false-negative results, especially in cases of low viral load within patient samples.

Rapid Antigen and Antibody Microfluidic Immunofluorescence Assays Compared to Culture, PCR, and Laboratory Reference Tests: Performance in a Longitudinal Cohort

We evaluated the performance of rapid antigen (RAg) and antibody (RAb) microfluidic diagnostics with serial sampling of 71 participants at 6 visits over 2 months following severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. Rapid tests showed strong agreement with laboratory references (κAg = 81.0%; κAb = 87.8%). RAg showed substantial concordance to both virus growth in culture and PCR positivity 0-5 days since symptom onset (κAg-culture = 60.1% and κAg-PCR = 87.1%). PCR concordance to virus growth in culture was similar (κPCR-culture = 70.0%), although agreement between RAg and culture was better overall (κAg-culture = 45.5% vs κPCR-culture = 10.0%). Rapid antigen and antibody testing by microfluidic immunofluorescence platform are highly accurate for characterization of acute infection.

Update of ESCMID COVID-19 guidelines: diagnostic testing for SARS-CoV-2

SCOPE

Since the onset of coronavirus disease 2019 (COVID-19), several assays have been deployed for the diagnosis of SARS-CoV-2. The European Society of Clinical Microbiology and Infectious Diseases (ESCMID) published the first set of guidelines on SARS-CoV-2 in-vitro diagnosis in February 2022. Since the COVID-19 landscape is rapidly evolving, the relevant ESCMID guidelines panel releases an update of the previously published recommendations on diagnostic testing for SARS-CoV-2. This update aims to delineate the best diagnostic approach for SARS-CoV-2 in different populations based on current evidence.

METHODS

An ESCMID COVID-19 guidelines task force was established by the ESCMID Executive Committee. A small group was established, half appointed by the chair, and the remaining selected with an open call. The panel met virtually once a week. For all decisions, a simple majority vote was used. A list of clinical questions using the PICO (population, intervention, comparison, and outcome) format was developed at the beginning of the process. For each PICO, two panel members performed a literature search focusing on systematic reviews with a third panellist involved in case of inconsistent results. The panel reassessed the PICOs previously defined as priority in the first set of guidelines and decided to address 49 PICO questions, as 6 of them were discarded as outdated/non-clinically relevant. The "Grading of Recommendations Assessment, Development and Evaluation(GRADE)-adoption, adaptation, and de novo development of recommendations (ADOLOPMENT)" evidence-to-decision framework was utilized to produce the guidelines.

QUESTIONS ADDRESSED BY THE GUIDELINE AND RECOMMENDATIONS

After literature search, we updated 16 PICO questions; these PICOs address the use of antigen-based assays among symptomatic and asymptomatic patients with different ages, COVID-19 severity status or risk for severe COVID-19, time since onset of symptoms/contact with an infectious case, and finally, types of biomaterials used.

Duration of viral infectiousness and correlation with symptoms and diagnostic testing in non-hospitalized adults during acute SARS-CoV-2 infection: A longitudinal cohort study

BACKGROUND

Guidelines for SARS-CoV-2 have relied on limited data on duration of viral infectiousness and correlation with COVID-19 symptoms and diagnostic testing.

METHODS

We enrolled ambulatory adults with acute SARS-CoV-2 infection and performed serial measurements of COVID-19 symptoms, nasal swab viral RNA, nucleocapsid (N) and spike (S) antigens, and replication-competent SARS-CoV-2 by viral growth in culture. We determined average time from symptom onset to a first negative test result and estimated risk of infectiousness, as defined by positive viral growth in culture.

RESULTS

Among 95 adults, median [interquartile range] time from symptom onset to first negative test result was 9 [5] days, 13 [6] days, 11 [4] days, and >19 days for S antigen, N antigen, culture growth, and viral RNA by RT-PCR, respectively. Beyond two weeks, virus growth and N antigen titers were rarely positive, while viral RNA remained detectable among half (26/51) of participants tested 21-30 days after symptom onset. Between 6-10 days from symptom onset, N antigen was strongly associated with culture positivity (relative risk=7.61, 95% CI: 3.01-19.22), whereas neither viral RNA nor symptoms were associated with culture positivity. During the 14 days following symptom onset, the presence of N antigen remained strongly associated (adjusted relative risk=7.66, 95% CI: 3.96-14.82) with culture positivity, regardless of COVID-19 symptoms.

CONCLUSIONS

Most adults have replication-competent SARS-CoV-2 for 10-14 after symptom onset. N antigen testing is a strong predictor of viral infectiousness and may be a more suitable biomarker, rather than absence of symptoms or viral RNA, to discontinue isolation within two weeks from symptom onset.

Regulating the product quality of COVID-19 antigen testing reagents: A tripartite evolutionary game analysis under China's legal framework

Personal purchases of novel coronavirus antigen detection reagents (ADRs) for self-detection have contributed to the optimization of medical resources and containment of the COVID-19 pandemic. The recurring occurrence of false testing results in China has generated concerns regarding the quality of ADRs and the testing mechanism for medical devices. Academic viewpoints and remarks on the sensitivity, application possibilities, and product innovation of ADRs may be found in the extant scientific literature. However, the current research does not explore the microscopic product quality concerns that emerge throughout the production and marketing of ADRs. To explore strategic equilibrium circumstances and behavioral evolution processes, an evolutionary game model was developed to include ADR manufacturers, third-party medical device inspection agencies, and regulatory authorities. The results reveal that the quantity of illegal incentives, the cost of regulation, and the loss of government credibility have a major impact on the decisions of regulatory authorities and determine three potential systemic equilibrium states. To maximize social welfare, ADRs should be incorporated into China's medication price monitoring system in order to manage market prices. To cut regulatory expenses, the government should employ blockchain technology for traceable network regulation of ADR product quality. The government should also protect the people's right to free speech and encourage online reporting of adverse incidents caused by ADRs. The conclusions of this article can provide many developing nations with important insights for regulating the quality of ADR products.

A Genetically Engineered Biofilm Material for SARS-CoV-2 Capturing and Isolation

The novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is continuously infecting people all around the world since its outbreak in 2019. Studies for numerous infection detection strategies are continuing. The sensitivity of detection methods is crucial to separate people with mild infections from people who are asymptomatic. In this sense, a strategy that would help to capture and isolate the SARS-CoV-2 virus prior to tests can be effective and beneficial. To this extent, genetically engineered biomaterials grounding from the biofilm protein of Escherichia coli are beneficial due to their robustness and adaptability to various application areas. Through functionalizing the E. coli biofilm protein, diverse properties can be attained such as enzyme display, nanoparticle production, and medical implant structures. Here, E. coli species are employed to express major curli protein CsgA and Griffithsin (GRFT) as fusion proteins, through a complex formation using SpyTag and SpyCatcher domains. In this study, a complex system with a CsgA scaffold harboring the affinity of GRFT against Spike protein to capture and isolate SARS-CoV-2 virus is successfully developed. It is shown that the hybrid recombinant protein can dramatically increase the sensitivity of currently available lateral flow assays for Sars-CoV-2 diagnostics.

Development of Lateral Flow Immunochromatographic Test for Rapid Detection of SARS-CoV-2 Virus Antigens in Clinical Specimens

In the presented study, we developed a nanogold lateral glow immunoassay-based technique (LFI-COVID-19 antigen test) for the detection of SARS-CoV-2 nucleocapsid proteins; the developed LFI-COVID-19 Ag test has been tested for limit of detection (LOD), cross-reactivity and interfering substances, and performance. It was found that the performance of the developed LFI-COVID-19 antigen test when it was evaluated by RT-qPCR indicated 95, 98, and 97% for sensitivity, specificity and accuracy, respectively. This complies with the WHO guidelines. It was concluded that the developed LFI-COVID-19 antigen test is a point of care and an alternative approach to current laboratory methods, especially RT-qPCR. It provides an easy, rapid (within 20 min), and on-site diagnostic tool for COVID-19 infection, and it is a cheap test if it is manufactured on a large scale for commercial use.

Accuracy of rapid point-of-care antigen-based diagnostics for SARS-CoV-2: An updated systematic review and meta-analysis with meta-regression analyzing influencing factors

BACKGROUND

Comprehensive information about the accuracy of antigen rapid diagnostic tests (Ag-RDTs) for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) is essential to guide public health decision makers in choosing the best tests and testing policies. In August 2021, we published a systematic review and meta-analysis about the accuracy of Ag-RDTs. We now update this work and analyze the factors influencing test sensitivity in further detail.

METHODS AND FINDINGS

We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched preprint and peer-reviewed databases for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 until August 31, 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity with reverse transcription polymerase chain reaction (RT-PCR) testing as a reference. To evaluate factors influencing test sensitivity, we performed 3 different analyses using multivariable mixed-effects meta-regression models. We included 194 studies with 221,878 Ag-RDTs performed. Overall, the pooled estimates of Ag-RDT sensitivity and specificity were 72.0% (95% confidence interval [CI] 69.8 to 74.2) and 98.9% (95% CI 98.6 to 99.1). When manufacturer instructions were followed, sensitivity increased to 76.3% (95% CI 73.7 to 78.7). Sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values (97.9% [95% CI 96.9 to 98.9] and 90.6% [95% CI 88.3 to 93.0] for Ct-values <20 and <25, compared to 54.4% [95% CI 47.3 to 61.5] and 18.7% [95% CI 13.9 to 23.4] for Ct-values ≥25 and ≥30) and was estimated to increase by 2.9 percentage points (95% CI 1.7 to 4.0) for every unit decrease in mean Ct-value when adjusting for testing procedure and patients' symptom status. Concordantly, we found the mean Ct-value to be lower for true positive (22.2 [95% CI 21.5 to 22.8]) compared to false negative (30.4 [95% CI 29.7 to 31.1]) results. Testing in the first week from symptom onset resulted in substantially higher sensitivity (81.9% [95% CI 77.7 to 85.5]) compared to testing after 1 week (51.8%, 95% CI 41.5 to 61.9). Similarly, sensitivity was higher in symptomatic (76.2% [95% CI 73.3 to 78.9]) compared to asymptomatic (56.8% [95% CI 50.9 to 62.4]) persons. However, both effects were mainly driven by the Ct-value of the sample. With regards to sample type, highest sensitivity was found for nasopharyngeal (NP) and combined NP/oropharyngeal samples (70.8% [95% CI 68.3 to 73.2]), as well as in anterior nasal/mid-turbinate samples (77.3% [95% CI 73.0 to 81.0]). Our analysis was limited by the included studies' heterogeneity in viral load assessment and sample origination.

CONCLUSIONS

Ag-RDTs detect most of the individuals infected with SARS-CoV-2, and almost all (>90%) when high viral loads are present. With viral load, as estimated by Ct-value, being the most influential factor on their sensitivity, they are especially useful to detect persons with high viral load who are most likely to transmit the virus. To further quantify the effects of other factors influencing test sensitivity, standardization of clinical accuracy studies and access to patient level Ct-values and duration of symptoms are needed.

Nanotechnology meets immunology towards a rapid diagnosis solution: the COVID-19 outbreak challenge

The current COVID-19 pandemic presents one of the greatest challenges in human history. There is a consensus that the rapid and accurate diagnosis of COVID-19 directly affects procedures to avoid dissemination, promote treatments, and favor the prognosis of infected patients. This interdisciplinary study aims at designing new synthetic peptides inspired by the SARS-CoV-2 spike protein (SARS-CoV-2S) to produce rapid detection tests relying on nanomaterial-based colorimetric properties. Hence, in silico analyses of SARS-CoV-2S were performed using advanced bioinformatic simulation tools and algorithms. Five novel peptide sequences were proposed, and three were selected (P2, J4, and J5) based on their prospective reactivity against positive serum from naturally COVID-19-infected humans. Next, hyperimmune sera against the selected peptides were produced in rabbits. Concurrently, gold nanoparticles (AuNP) were synthesized using a green aqueous method under mild conditions through in situ reduction by trisodium citrate salt. They were extensively characterized by their morphological, physicochemical, and optical properties. The AuNPs demonstrated colloidal chemical stability in aqueous media, with an average size of approximately 29 nm (metallic core), and zeta potential before and after bioconjugation of −43 mV and −31 mV, respectively. Moreover, they presented an intense reddish-bluish color due to the surface plasmon resonance (SPR) effect, with maxima at λ = 525 nm and 536 nm, before and after bioconjugation, respectively, evidencing their applicability as colorimetric biomarkers for antigen–antibody immunoassay detection. To develop a rapid COVID-19 diagnosis test using lateral flow assay (LFA), semi-purified anti-SARS-CoV-2S sera against the three selected peptides were bioconjugated to the AuNPs as the highly optically sensitive agents using a considerably low antibody concentration (0.2 mg mL⁻¹). All tested peptide sequences (P2, J4, and J5) induced antibodies capable of identifying the presence of SARS-CoV-2 virus inactivate suspensions (1 : 10, 1 : 100, or 1 : 1000 dilutions). For LFA positive test control, an anti-rabbit antibody was used. In summary, this research comprises several contributions and advances to the broad and multidisciplinary field of nanomaterials-based immunodiagnosis tools, encompassing: (a) the novelty of designing and synthesizing new immunogenic peptides inspired by SARS-CoV-2 virus epitopes using in silico bioinformatics; (b) the peptides induced the immune response in rabbit animal model producing hyperimmune serum; (c) the semi-purified hyperimmune serum rendered effective antibodies to detect SARS-CoV-2 virus in cell suspension; (d) colloidal gold nanoparticles were produced and bioconjugated to the antibodies for qualitative colorimetric detection. As the overall result of this study, it was designed, developed, produced, and validated a new simple, rapid, and sensitive LFA diagnostic test for the SARS-CoV-2 virus using a nanotechnology-based qualitative colorimetric assay, which can be envisioned as promising nanoplatforms for detecting other diseases.

The current COVID-19 pandemic presents one of the greatest challenges in human history.

A SARS-CoV-2 coronavirus nucleocapsid protein antigen-detecting lateral flow assay

Inexpensive, simple, rapid diagnostics are necessary for efficient detection, treatment, and mitigation of COVID-19. Assays for SARS-CoV2 using reverse transcription polymerase chain reaction (RT-PCR) offer good sensitivity and excellent specificity, but are expensive, slowed by transport to centralized testing laboratories, and often unavailable. Antigen-based assays are inexpensive and can be rapidly mass-produced and deployed at point-of-care, with lateral flow assays (LFAs) being the most common format. While various manufacturers have produced commercially available SARS-Cov2 antigen LFAs, access to validated tests remains difficult or cost prohibitive in low-and middle-income countries. Herein, we present a visually read open-access LFA (OA-LFA) using commercially-available antibodies and materials for the detection of SARS-CoV-2. The LFA yielded a Limit of Detection (LOD) of 4 TCID50/swab of gamma irradiated SARS-CoV-2 virus, meeting the acceptable analytical sensitivity outlined by in World Health Organization target product profile. The open-source architecture presented in this manuscript provides a template for manufacturers around the globe to rapidly design a SARS-CoV2 antigen test.