Proficiency testing for SARS-CoV-2 in assuring the quality and overall performance in viral RNA detection in clinical and public health laboratories

External Quality Assessment (EQA) for SARS-CoV-2 RNA Point-of-Care Testing in Primary Healthcare Services: Analytical Performance over Seven EQA Cycles

In April 2020, the Aboriginal and Torres Strait Islander COVID-19 Point-of-Care (POC) Testing Program was initiated to improve access to rapid molecular-based SARS-CoV-2 detection in First Nations communities. At capacity, the program reached 105 health services across Australia. An external review estimated the program contributed to averting between 23,000 and 122,000 COVID-19 infections within 40 days of the first infection in a remote community, equating to cost savings of between AU$337 million and AU$1.8 billion. Essential to the quality management of this program, a customised External Quality Assessment (EQA) program was developed with the Royal College of Pathologists of Australasia Quality Assurance Programs (RCPAQAP). From July 2020 to May 2022, SARS-CoV-2 EQA participation ranged from 93 to 100%. Overall concordance of valid EQA results was high (98%), with improved performance following the first survey. These results are consistent with those reported by 12 Australian and 4 New Zealand laboratories for three SARS-CoV-2 RNA EQA surveys in March 2020, demonstrating that SARS-CoV-2 RNA POC testing in primary care settings can be performed to an equivalent laboratory analytical standard. More broadly, this study highlights the value of quality management practices in real-world testing environments and the benefits of ongoing EQA program participation.

External quality assessment for laboratories in pan-India ILI/SARI surveillance for simultaneous detection of influenza virus and SARS-CoV-2

Introduction

The Indian Council of Medical Research has set up a nationwide network of 28 laboratories for simultaneous surveillance of influenza virus and SARS-CoV-2 in ILI/SARI patients, using an in-house developed and validated multiplex real-time RTPCR assay. The aim of this study was to ensure the quality of testing by these laboratories by implementing an external quality assessment program (EQAP).

Methods

For this EQAP, a proficiency test (PT) panel comprising tissue-culture or egg-grown influenza virus and SARS-CoV-2 was developed. The PT panel was distributed to all the participant laboratories, which tested the panel and submitted the qualitative results online to the EQAP provider. The performance of the laboratories was evaluated on qualitative criteria but cycle threshold (Ct) values were also gathered for each sample.

Results

On a qualitative basis, all the laboratories achieved the criteria of 90% concordance with the results of the PT panel provider. Ct values of different samples across the laboratories were within ≤ ±3 cycles of the corresponding mean values of the respective sample. The results of this EQAP affirmed the quality and reliability of testing being done for simultaneous surveillance of influenza virus and SARS-CoV-2 in India.

Design of external quality assessment schemes and definition of the roles of their providers in future epidemics

During an epidemic, individual test results form the basis of epidemiological indicators such as case numbers or incidence. Therefore, the accuracy of measures derived from these indicators depends on the reliability of individual results. In the COVID-19 pandemic, monitoring and evaluating the performance of the unprecedented number of testing facilities in operation, and novel testing systems in use, was urgently needed. External quality assessment (EQA) schemes are unique sources of data reporting on testing performance, and their providers are recognised contacts and support for test facilities (for technical-analytical topics) and health authorities (for planning the monitoring of infection diagnostics). To identify information provided by SARS-CoV-2 genome detection EQA schemes that is relevant for public health microbiology, we reviewed the current literature published in PubMed between January, 2020, and July, 2022. We derived recommendations for EQA providers and their schemes for best practices to monitor pathogen-detection performance in future epidemics. We also showed laboratories, test facilities, and health authorities the information and benefits they can derive from EQA data, and from the non-EQA services of their providers.

Comparison of fifteen SARS-CoV-2 nucleic acid amplification test assays used during the Canadian Laboratory Response Network's National SARS-CoV-2 Proficiency Program, May 2020 to June 2021

Background

On March 11, 2020, the World Health Organization declared a pandemic caused by the recently emerged severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). This led to increased clinical testing and decentralizing of this testing from provincial health laboratories to regional and private facilities. Leveraging the results from the Canadian Laboratory Response Network's National SARS-CoV-2 Proficiency Test (PT) Program, this study compares multiple commercial and laboratory-developed nucleic acid amplification tests, assessing both sensitivity and specificity across multiple users.

Methods

Each panel consisted of six blinded, contrived-clinical samples. Panels were distributed to international, provincial and territorial laboratories and subsequently to partner facilities. Participating laboratories were asked to run these sample through their respective extraction/PCR workflows and submit results to the National Microbiology Laboratory, outlining the nucleic acid extraction platform and nucleic acid amplification test employed, as well as the viral gene target and Ct values or equivalent obtained. Data were compiled for each molecular platform and gene target used.

Results

The PT schemes were deployed in May 2020, November 2020 and June 2021, resulting in 683 data sets using 37 different nucleic acid amplification tests. Over the course of three PT schemes, the average score obtained was 99.3% by participants demonstrating consistent testing between laboratories and testing platforms.

Conclusion

This study confirmed the rapid and successful implementation of a Canadian PT Program and provided comparative analysis of the various emergency use authorized and laboratory developed tests employed for the detection of SARS-CoV-2 and demonstrated an overall 99.3% test concordance nationwide.