European follow-up of incorrect biomarker results for colorectal cancer demonstrates the importance of quality improvement projects

Longitudinal analysis of 20 Years of external quality assurance schemes for PCR/NAAT-based bacterial genome detection in diagnostic testing

Background

Quality control (QC), quality assurance, and standardization are crucial for modern diagnostic testing in the field of medical microbiology. The need for efficient QC to ensure accurate laboratory results, treatment, and infection prevention has led to significant efforts in standardizing assay reagents and workflows. External quality assessment (EQA) schemes, like those offered by INSTAND, play a vital role in evaluating in-house and commercial routine diagnostic assays, regarded as mandatory by national and global guidelines. The recent impact of polymerase chain reaction/nucleic acid amplification technology (PCR/NAAT) assays in medical microbiology requires that high-performing assays be distinguished from inadequately performing ones, especially those made by inexperienced suppliers.

Objectives

The study assesses the evolving diagnostic performance trends over 2 decades for the detection of EHEC/STEC, Borrelia (B.) burgdorferi, and MRSA/cMRSA. It explores the historical context of assay utilization, participant engagement, and rates of correct results in EQA schemes. The research seeks to identify patterns in assay preferences, participant proficiency, and the challenges encountered in detecting emerging variants or clinical strains.

Results

The study highlights the decline in in-house PCR assay usage, the emergence of new diagnostic challenges, and educational aspects within EQA schemes. Specific examples, such as the inclusion, in certain EQA surveys, of EHEC strains carrying stx-2f or B. miyamotoi, highlight the role of EQAs in increasing awareness and diagnostic capabilities. Advancements in MRSA detection, especially through the adoption of commercial assays, demonstrate the impact that technology evolution has had on diagnostic performance.

Conclusion

Achieving excellence in diagnostic molecular microbiology involves a multifaceted approach, including well-evaluated assays, careful instrumentation selection, and structured training programs. EQA schemes contribute significantly to this pursuit by providing insights into the evolving diagnostic landscape and identifying areas for improvement in the diagnostic workflow as well as in PCR/NAAT assay design.

The Significance of External Quality Assessment Schemes for Molecular Testing in Clinical Laboratories

Simple Summary

Patients and clinicians often rely on the outcome of laboratory tests, but can we really trust these test results? Good quality management is key for laboratories to guarantee reliable test results. This review focusses on external quality assessment (EQA) schemes which are a tool for laboratories to examine and improve the quality of their testing routines. In this review, an overview of the role and importance of EQA schemes for clinical laboratories is given, and different types of EQA schemes and EQA providers available on the market are discussed, as well as recent developments in the EQA landscape.

Abstract

External quality assessment (EQA) schemes are a tool for clinical laboratories to evaluate and manage the quality of laboratory practice with the support of an independent party (i.e., an EQA provider). Depending on the context, there are different types of EQA schemes available, as well as various EQA providers, each with its own field of expertise. In this review, an overview of the general requirements for EQA schemes and EQA providers based on international guidelines is provided. The clinical and scientific value of these kinds of schemes for clinical laboratories, clinicians and patients are highlighted, in addition to the support EQA can provide to other types of laboratories, e.g., laboratories affiliated to biotech companies. Finally, recent developments and challenges in laboratory medicine and quality management, for example, the introduction of artificial intelligence in the laboratory and the shift to a more individual-approach instead of a laboratory-focused approach, are discussed. EQA schemes should represent current laboratory practice as much as possible, which poses the need for EQA providers to introduce latest laboratory innovations in their schemes and to apply up-to-date guidelines. By incorporating these state-of-the-art techniques, EQA aims to contribute to continuous learning.

Cancer Biomarkers in the era of precision oncology: Addressing the needs of patients and health systems

Cancer Biomarkers are the key to unlocking the promise of precision oncology, selecting which patients will respond to a more personalised treatment while sparing non-responders the therapy-related toxicity. In this paper, we highlight the primacy of cancer biomarkers, but focus on their importance to patients and to health systems. We also highlight how cancer biomarkers represent value for money. We emphasise the need for cancer biomarkers infrastructure to be embedded into European health systems. We also highlight the need to deploy multiple biomarker testing to deliver the optimal benefit for patients and health systems and consider cancer biomarkers from the perspective of cost, value and regulation. Cancer biomarkers must also be situated in the context of the upcoming In Vitro Diagnostics Regulation, which may pose certain challenges (e.g. non-compliance of laboratory developed tests, leading to cancer biomarker shortages and increased costs) that need to be overcome. Cancer biomarkers must be embedded in the real world of oncology delivery and testing must be implemented across Europe, with the intended aim of narrowing, not widening the inequity gap for patients. Cancer patients must be placed firmly at the centre of a cancer biomarker informed precision oncology care agenda.

Frequency of Participation in External Quality Assessment Programs Focused on Rare Diseases: Belgian Guidelines for Human Genetics Centers

Background

Participation in quality controls, also called external quality assessment (EQA) schemes, is required for the ISO15189 accreditation of the Medical Centers of Human Genetics. However, directives on the minimal frequency of participation in genetic quality control schemes are lacking or too heterogeneous, with a possible impact on health care quality.

Objective

The aim of this project is to develop Belgian guidelines on the frequency of participation in quality controls for genetic testing in the context of rare diseases.

Methods

A group of experts analyzed 90 EQA schemes offered by accredited providers and focused on analyses used for the diagnosis of rare diseases. On that basis, the experts developed practical recommendations about the minimal frequencies of participation of the Medical Centers of Human Genetics in quality controls and how to deal with poor performances and change management. These guidelines were submitted to the Belgian Accreditation Body and then reviewed and approved by the Belgian College of Human Genetics and Rare Diseases and by the National Institute for Health and Disability Insurance.

Results

The guidelines offer a decisional algorithm for the minimal frequency of participation in human genetics EQA schemes. This algorithm has been developed taking into account the scopes of the EQA schemes, the levels of experience, and the annual volumes of the Centers of Human Genetics in the performance of the tests considered. They include three key principles: (1) the recommended annual assessment of all genetic techniques and technological platforms, if possible through EQAs covering the technique, genotyping, and clinical interpretation; (2) the triennial assessment of the genotyping and interpretation of specific germline mutations and pharmacogenomics analyses; and (3) the documentation of actions undertaken in the case of poor performances and the participation to quality control the following year. The use of a Bayesian statistical model has been proposed to help the Centers of Human Genetics to determine the theoretical number of tests that should be annually performed to achieve a certain threshold of performance (eg, a maximal error rate of 1%). Besides, the guidelines insist on the role and responsibility of the national public health authorities in the follow-up of the quality of analyses performed by the Medical Centers of Human Genetics and in demonstrating the cost-effectiveness and rationalization of participation frequency in these quality controls.

Conclusions

These guidelines have been developed based on the analysis of a large panel of EQA schemes and data collected from the Belgian Medical Centers of Human Genetics. They are applicable to other countries and will facilitate and improve the quality management and financing systems of the Medical Centers of Human Genetics.

Evaluation of a worldwide EQA scheme for complex clonality analysis of clinical lymphoproliferative cases demonstrates a learning effect

Clonality analysis of immunoglobulin (IG) or T-cell receptor (TR) gene rearrangements is routine practice to assist diagnosis of lymphoid malignancies. Participation in external quality assessment (EQA) aids laboratories in identifying systematic shortcomings. The aim of this study was to evaluate laboratories' improvement in IG/TR analysis and interpretation during five EQA rounds between 2014 and 2018. Each year, participants received a total of five cases for IG and five cases for TR testing. Paper-based cases were included for analysis of the final molecular conclusion that should be interpreted based on the integration of the individual PCR results. Wet cases were distributed for analysis of their routine protocol as well as evaluation of the final molecular conclusion. In total, 94.9% (506/533) of wet tests and 97.9% (829/847) of paper tests were correctly analyzed for IG, and 96.8% (507/524) wet tests and 93.2% (765/821) paper tests were correctly analyzed for TR. Analysis scores significantly improved when laboratories participated to more EQA rounds (p=0.001). Overall performance was significantly lower (p=0.008) for non-EuroClonality laboratories (95% for IG and 93% for TR) compared to EuroClonality laboratories (99% for IG and 97% for TR). The difference was not related to the EQA scheme year, anatomic origin of the sample, or final clinical diagnosis. This evaluation showed that repeated EQA participation helps to reduce performance differences between laboratories (EuroClonality versus non-EuroClonality) and between sample types (paper versus wet). The difficulties in interpreting oligoclonal cases highlighted the need for continued education by meetings and EQA schemes.

Biomarker testing and mutation prevalence in metastatic colorectal cancer patients in five European countries using a large oncology database

Background: The literature on biomarker testing for metastatic colorectal cancer (mCRC) in Europe is scarce. This study aimed to estimate the percentage of mCRC patients from five European countries tested for biomarkers over time. Materials & methods: An oncology database was retrospectively analyzed; evaluated biomarkers were RAS, BRAF and microsatellite instability (MSI). The patients were drug treated during 2018 and tested for relevant biomarkers in 2013-2018. Results: RAS testing was conducted in >90% of mCRC patients from 2014 onwards. BRAF testing increased from 31% of mCRC patients in 2013 to 67% in 2018. MSI testing increased from 10 to 41%. There was no notable trend over time for RAS and BRAF mutation or MSI-high prevalence. Conclusion: Biomarker testing among patients diagnosed with mCRC was increased over time. This study demonstrates the quick uptake of biomarker testing in clinical practice. These findings are significant as biomarker-based drugs are becoming more common.

Causes behind error rates for predictive biomarker testing: the utility of sending post-EQA surveys

External quality assessment (EQA) schemes assess the performance of predictive biomarker testing in lung and colorectal cancer and have previously demonstrated variable error rates. No information is currently available on the underlying causes of incorrect EQA results in the laboratories. Participants in EQA schemes by the European Society of Pathology between 2014 and 2018 for lung and colorectal cancer were contacted to complete a survey if they had at least one analysis error or test failure in the provided cases. Of the 791 surveys that were sent, 325 were completed including data from 185 unique laboratories on 514 incorrectly analyzed or failed cases. For the digital cases and immunohistochemistry, the majority of errors were interpretation-related. For fluorescence in situ hybridization, problems with the EQA materials were reported frequently. For variant analysis, the causes were mainly methodological for lung cancer but variable for colorectal cancer. Post-analytical (clerical and interpretation) errors were more likely detected after release of the EQA results compared to pre-analytical and analytical issues. Accredited laboratories encountered fewer reagent problems and more often responded to the survey. A recent change in test methodology resulted in method-related problems. Testing more samples annually introduced personnel errors and lead to a lower performance in future schemes. Participation to quality improvement projects is important to reduce deviating test results in laboratories, as the different error causes differently affect the test performance. EQA providers could benefit from requesting root cause analyses behind errors to offer even more tailored feedback, subschemes, and cases.

Managing Deviating EQA Results: A Survey to Assess the Corrective and Preventive Actions of Medical Laboratories Testing for Oncological Biomarkers

Laboratories testing predictive biomarkers in lung and colorectal cancer are advised to participate in external quality assessment (EQA) schemes. This study aimed to investigate which corrective actions were taken by laboratories if predetermined performance criteria were not met, to ultimately improve current test practices. EQA participants from the European Society of Pathology between 2014 and 2018 for lung and colorectal cancer were contacted, if they had at least one analysis error or test failure in the provided cases, to complete a survey. For 72.4% of 514 deviating EQA results, an appropriate action was performed, most often including staff training (15.2%) and protocol revisions (14.6%). Main assigned persons were the molecular biologist (40.0%) and pathologist (46.5%). A change in test method or the use of complex techniques, such as next-generation sequencing, required more training and the involvement of dedicated personnel to reduce future test failures. The majority of participants adhered to ISO 15189 and implemented suitable actions by designated staff, not limited to accredited laboratories. However, for 27.6% of cases (by 20 laboratories) no corrective action was taken, especially for pre-analytic problems and complex techniques. The surveys were feasible to request information on results follow-up and further recommendations were provided.

Potential of modern circulating cell-free DNA diagnostic tools for detection of specific tumour cells in clinical practice

Personalized medicine is a developing field of medicine that has gained in importance in recent decades. New diagnostic tests based on the analysis of circulating cell-free DNA (cfDNA) were developed as a tool of diagnosing different cancer types. By detecting the subpopulation of mutated DNA from cancer cells, it is possible to detect the presence of a specific tumour in early stages of the disease. Mutation analysis is performed by quantitative polymerase chain reaction (qPCR) or the next generation sequencing (NGS), however, cfDNA protocols need to be modified carefully in preanalytical, analytical, and postanalytical stages. To further improve treatment of cancer the Food and Drug Administration approved more than 20 companion diagnostic tests that combine cancer drugs with highly efficient genetic diagnostic tools. Tools detect mutations in the DNA originating from cancer cells directly through the subpopulation of cfDNA, the circular tumour DNA (ctDNA) analysis or with visualization of cells through intracellular DNA probes. A large number of ctDNA tests in clinical studies demonstrate the importance of new findings in the field of cancer diagnosis. We describe the innovations in personalized medicine: techniques for detecting ctDNA and genomic DNA (gDNA) mutations approved Food and Drug Administration companion genetic diagnostics, candidate genes for assembling the cancer NGS panels, and a brief mention of the multitude of cfDNA currently in clinical trials. Additionally, an overview of the development steps of the diagnostic tools will refresh and expand the knowledge of clinics and geneticists for research opportunities beyond the development phases.

Biomarker testing in oncology - Requirements for organizing external quality assessment programs to improve the performance of laboratory testing: revision of an expert opinion paper on behalf of IQNPath ABSL

In personalized medicine, predictive biomarker testing is the basis for an appropriate choice of therapy for patients with cancer. An important tool for laboratories to ensure accurate results is participation in external quality assurance (EQA) programs. Several providers offer predictive EQA programs for different cancer types, test methods, and sample types. In 2013, a guideline was published on the requirements for organizing high-quality EQA programs in molecular pathology. Now, after six years, steps were taken to further harmonize these EQA programs as an initiative by IQNPath ABSL, an umbrella organization founded by various EQA providers. This revision is based on current knowledge, adds recommendations for programs developed for predictive biomarkers by in situ methodologies (immunohistochemistry and in situ hybridization), and emphasized transparency and an evidence-based approach. In addition, this updated version also has the aim to give an overview of current practices from various EQA providers.