Special issue on External Quality Assessment in Laboratory Medicine - current challenges and future trends

Longitudinal analysis of 20 Years of external quality assurance schemes for PCR/NAAT-based bacterial genome detection in diagnostic testing

Background

Quality control (QC), quality assurance, and standardization are crucial for modern diagnostic testing in the field of medical microbiology. The need for efficient QC to ensure accurate laboratory results, treatment, and infection prevention has led to significant efforts in standardizing assay reagents and workflows. External quality assessment (EQA) schemes, like those offered by INSTAND, play a vital role in evaluating in-house and commercial routine diagnostic assays, regarded as mandatory by national and global guidelines. The recent impact of polymerase chain reaction/nucleic acid amplification technology (PCR/NAAT) assays in medical microbiology requires that high-performing assays be distinguished from inadequately performing ones, especially those made by inexperienced suppliers.

Objectives

The study assesses the evolving diagnostic performance trends over 2 decades for the detection of EHEC/STEC, Borrelia (B.) burgdorferi, and MRSA/cMRSA. It explores the historical context of assay utilization, participant engagement, and rates of correct results in EQA schemes. The research seeks to identify patterns in assay preferences, participant proficiency, and the challenges encountered in detecting emerging variants or clinical strains.

Results

The study highlights the decline in in-house PCR assay usage, the emergence of new diagnostic challenges, and educational aspects within EQA schemes. Specific examples, such as the inclusion, in certain EQA surveys, of EHEC strains carrying stx-2f or B. miyamotoi, highlight the role of EQAs in increasing awareness and diagnostic capabilities. Advancements in MRSA detection, especially through the adoption of commercial assays, demonstrate the impact that technology evolution has had on diagnostic performance.

Conclusion

Achieving excellence in diagnostic molecular microbiology involves a multifaceted approach, including well-evaluated assays, careful instrumentation selection, and structured training programs. EQA schemes contribute significantly to this pursuit by providing insights into the evolving diagnostic landscape and identifying areas for improvement in the diagnostic workflow as well as in PCR/NAAT assay design.

Control externo de la calidad en medicina del laboratorio. Avances y futuro

Objectivos

Un programa de control externo distribuye las mismas muestras control entre varios laboratorios y evalúa los resultados obtenidos con un criterio común. El objetivo de este trabajo es resumir la evolución de los programas externos, poner de manifiesto los progresos conseguidos y deducir consecuencias prácticas para el laboratorio participante.

Métodos

El material es una breve revisión de los diferentes tipos de programas externos utilizados a lo largo de cuarenta años. El método es el análisis crítico de las ventajas e inconvenientes de cada modelo, a la luz de nuestra experiencia.

Resultados

A mitad del siglo XX se iniciaron los programas EQA, detectándose gran discrepancia entre resultados emitidos por distintos laboratorios. Se desarrollaron EQA en muchos países y se propusieron mecanismos para armonizarlos, como: establecer especificaciones derivadas de la variación biológica, promover el uso de métodos analíticos homogéneos, usar el EQA como herramienta educacional. A partir del 2000 se hacen importantes avances: asegurar el adecuado uso clínico de las pruebas del laboratorio, utilizar material control conmutable con el espécimen humano, armonizar los distintos modelos de EQA, promover una organización de cooperación entre organizadores de programas EQA.

Conclusiones

Participar en un EQA con controles conmutables y valores asignados por método de referencia certificado permite conocer la inexactitud real de los resultados y el impacto en las muestras de pacientes. Si se participa en programas con controles no conmutables solo se conoce si la prestación del laboratorio es similar a la de otros usuarios del mismo método analítico.

External quality control in laboratory medicine. Progresses and future

Objectives

An external quality control program distributes same control samples to various laboratories and evaluates results obtained with a common criterion. The aim of this work is to summarize the evolution of various types of external programs, to point out the progresses ant to preclude practical consequences of the participant laboratories.

Content

The material consists on a brief revision of the different types of external programs that have been used for the last forty years. The method is the critical analysis of the strong and weak points of each program model, from the light of our experience. External quality assessment (EQA) programs were initiated at half the XX century, evidencing big discrepancies among laboratory results. EQA were developed in various countries and some mechanisms to harmonize them were proposed: to establish common performance specifications derived from biological variation, to use EQS as educational tool. Since the 2000 important advances were seen: to focus EQA to assure the adequate clinical use of laboratory tests, to use commutable controls, to harmonize the different EQA models, to promote a forum for co-operation and exchange of knowledge on quality-related matters for EQA organizers.

Summary and Outlook

To participate in an EQA with commutable-reference method assigned values controls allows to know the real inaccuracy of results and their impact on patient' samples. To participate in a EQA with non commutable controls allows to know whether the individual laboratory performance agrees with that from other laboratories using same analytical method.

Survey on reporting of epithelial cells in urine sediment as part of external quality assessment programs in Brazilian laboratories

Introduction

Epithelial cells (ECs) are structures regularly observed during urine microscopy analysis. The correct identification of EC subtypes can be useful since renal tubular epithelial cells (RTECs) are clinically relevant. We investigate the urinary ECs report and the judgement of its clinical importance by Brazilian laboratories.

Materials and methods

A survey with four questions was made available to participants of the Urinalysis External Quality Assessment Program (EQAP) from Controllab. Laboratories composed 3 groups: (1) differentiating ECs subtypes: “squamous”, “transitional” and “RTECs”; (2) differentiating ECs subtypes: “squamous” or “non-squamous” cells; (3) without ECs subtype identification. Participants did not necessarily answer to all questions and the answers were evaluated both within the same laboratory’s category and within different categories of laboratories.

Results

A total of 1336 (94%) laboratories answered the survey; Group 1, 119/140 (85%) reported that ECs differentiation is important to the physician and 62% want to be evaluated by EQAP, while in Group 3, 455/1110 (41%) reported it is useful to them, however only 25% want be evaluated by EQAP. Group 2 laboratories 37/51 (73%) reported that the information is important, but only 13/52 (25%) are interested in an EQAP with differentiation of the 3 ECs subtypes.

Conclusion

Most of the laboratories do not differentiate ECs in the three subtypes, despite the clinical importance of RTECs. Education of laboratory staff about the clinical significance of urinary particles should be considered a key priority.

Analytical performance of Raman spectroscopy in assaying biochemical components in human serum

Chronic non-infectious diseases are important to research as they are the main causes of death in Brazil and worldwide. One very important chronic non-infectious disease is cardiovascular disease, whose risk factors (diabetes, dyslipidemia, and renal failure) can be detected through assessments of serum biochemical components. The objective of this study was to evaluate the analytical performance of Raman spectroscopy for analysis of lipid profile (total cholesterol, triglycerides, and HDL cholesterol), non-protein nitrogenous compounds (urea and creatinine), and glucose in 242 human serum samples. Models to discriminate and quantify the samples were developed using the predicted concentration by quantitative regression model based on partial least squares (PLS). The analytical error for the "leave-one-out" cross-validation based on the predicted PLS concentration was 10.5 mg/dL for total cholesterol, 21.4 mg/dL for triglyceride, 13.0 mg/dL for HDL cholesterol, 4.9 mg/dL for urea, 0.21 mg/dL for creatinine, and 15.4 mg/dL for glucose. The Kappa coefficient indicate very good agreement for cholesterol (0.83), good for triglyceride (0.77), urea (0.70) and creatinine (0.66), and fair for HDL cholesterol (0.38) and glucose (0.30). The results of the analytical performance demonstrated that Raman spectroscopy can be considered an important methodology to screen the population, especially for serum triglycerides and cholesterol.

A Z-score based method for comparing the relative sensitivity of behavioral and physiological metrics including cognitive performance, mood, and hormone levels

A method for assessing the relative sensitivity of research metrics is proposed and illustrated by comparing 18 outcome measures from a published study of the cognitive, mood, and hormonal effects of four different levels of stress induced by intense military training. Research on the human response to stress often assesses multiple disparate dependent measures. Selecting the most sensitive is difficult as formal methods to compare varied dependent measures have not been developed. The method first converts the outcome measures into standard scores (z-scores) and then compares them using analysis of variance to determine whether there are differences in how they assess the impact of graded levels of exposure to stress. The analysis detected various significant interactions in several measures and suggests self-report mood questionnaires were more sensitive to the stressors present in the study than the cognitive or hormonal measures which were used. These findings support the effectiveness of the z-score based method as a useful procedure for objectively evaluating the differential sensitivity of various metrics. This method could be useful for research on other independent variables when use of multiple assessment strategies is appropriate. It could be used for evaluating studies yielding conflicting results, such as those detecting effects on one parameter but not others. In such instances, cross-metric inconsistencies may be due to differential sensitivity of measurement strategies rather than actual differences in the effects of the independent-variable on the domains under investigation.

Quality assurance of genetic laboratories and the EBTNA practice certification, a simple standardization assurance system for a laboratory network

Analytical laboratory results greatly influence medical diagnosis, about 70% of medical decisions are based on laboratory results. Quality assurance and quality control are designed to detect and correct errors in a laboratory’s analytical process to ensure both the reliability and accuracy of test results. Unreliable performance can result in misdiagnosis and delayed treatment. Furthermore, improved quality guarantees increased productivity at a lower cost. Quality assurance programmes include internal quality control, external quality assessment, proficiency surveillance and standardization. It is necessary to try to ensure compliance with the requirements of the standards at all levels of the process. The sources of these standards are the International Standards Organization (ISO), national standards bodies, guidelines from professional organisations, accreditation bodies and governmental regulations. Laboratory networks increase the performance of laboratories in support of diagnostic screening programme. It is essential that genetic laboratories of a network have procedures underpinned by a robust quality assurance system to minimize errors and to reassure the clinicians and the patients that international standards are being met. This article provides an overview of the bases of quality assurance and its importance in genetic tests and it reports the EBTNA quality assurance system which is a clear and simple system available for access to adequate standardization of a genetic laboratory’s network.