Systematic monitoring of standardization and harmonization status with commutable EQA-samples--five year experience from the Netherlands

External quality assurance in the era of standardization

Metrology in clinical chemistry aims to ensure the equivalence of measurement results from different in-vitro diagnostic measurement devices (IVD MD) for use in healthcare. The metrological traceability of measurement results to higher-order references is the cornerstone to achieving equivalent results. However, other fundamentals are also needed, including the commutability of reference materials and external quality assessment (EQA) materials for monitoring the equivalence of measurement results at the end-user level. This manuscript summarizes the findings and opinions expressed at the Joint Community for Traceability in Laboratory Medicine (JCTLM) workshop held on December 4-5, 2023. The workshop explored the relationship between EQA/proficiency testing and metrological traceability to higher-order references. EQA monitors the equivalence of measurement results from end-user IVD MDs. The workshop discussed the role and challenges of using EQA to improve and maintain the equivalence of measurement results. It also elucidated current developments in establishing the clinical suitability of laboratory results expressed as analytical performance specifications (APS).

Model of implementing proficiency testing in Vietnam, a developing country

Backgrounds and aims

The aim of this study is to provide a good approach for a quantitative EQA scheme assigned value with limited resources.

Materials and methods

Twelve lyophilized EQA items were distributed to participants in 2021 from North to Southeast Vietnam to measure the concentration of nine parameters, including glucose, urea, creatinine, cholesterol, triglyceride, uric acid, AST, ALT, and GGT. The consensus value of the expert group and all participants were calculated and statistically compared to choose the most appropriate consensus value.

Results

Fifty-nine laboratories attended the EQA scheme, including an expert group using automatic biochemistry analyzers (AAs) and all participants with auto and semi-auto biochemistry (SAA) analyzers. Consensus values of six per nine parameters were different between the two groups for at least two EQA items, including glucose, creatinine, cholesterol, uric acid, AST, and ALT. The coefficients of variation of glucose, urea, creatinine, triglycerides, uric acid, and GGT in the expert group were significantly lower than those in all the participants.

Conclusion

Using the consensus values of expert groups as the assigned values of the EQA program is a relevant strategy to increase testing quality in developing countries with limited resources, such as Vietnam.

Application of serum pools in insulin harmonization: Commutability and stability

BACKGROUND

Recalibration using serum pools assigned by higher-order reference methods had been demonstrated to be effective in improving the agreement among insulin immunoassays. To promote the application of serum pools in insulin harmonization, this study analyzed serum pools' commutability between insulin immunoassays, and their short- and long-term stability at different temperatures. The agreement between commonly used immunoassays was also evaluated.

METHODS

Insulin in 69 individual serum samples, 10 serum pools, and three EQA samples (lyophilized powder of serum pools) were detected by six widely used immunoassays. The commutability of serum pools and EQA samples was evaluated according to the IFCC-recommended approach. Serum pools' stability at different temperatures was investigated by placing them at various temperatures for varying lengths of time. Individual serum samples' results were analyzed using the Bland-Altman and Passing and Bablok regression analyses.

RESULTS

Serum pools were commutable among most assays, the EQA samples-lyophilized serum pools-were non-commutable among most assays. Serum pools can be stably stored at -20°C and -80°C for at least one year, but can only be stably stored at room temperature for twenty-four hours. Significant relative differences were observed among assays. Recalibration using serum pools can only improve the assays' agreement at middle and high insulin levels, but not at low levels.

CONCLUSIONS

Serum pools were commutable and stable for insulin measurement and can be used in insulin harmonization. The existing EQA materials were non-commutable between most assays, and other EQA materials, such as serum pools, should be studied.

Commutability Assessment of Processed Human Plasma Samples for Normetanephrine and Metanephrine Measurements Based on the Candidate Reference Measurement Procedure

Background

To identify candidate external quality assessment (EQA) materials for normetanephrine and metanephrine measurements, we assessed the commutability of eight processed human plasma samples. The agreement between routine assays and the candidate reference measurement procedure (cRMP) was also evaluated.

Methods

Fifty-three clinical samples and eight processed plasma samples were prepared. The processed samples included pooled and individual plasma samples spiked with pure normetanephrine and metanephrine and non-spiked pooled and individual plasma samples. The clinical and processed samples were subjected to four routine isotope dilution tandem mass spectrometry assays and cRMP. Commutability was assessed based on two approaches recommended by the CLSI and International Federation of Clinical Chemistry (IFCC). Passing–Bablok regression and Bland–Altman analysis were used to evaluate the agreement between the routine assays and cRMP.

Results

The commutability results of the CLSI approach were better than those of the IFCC approach. For the CLSI approach, spiked individual plasma samples and spiked high-concentration pooled plasma samples were commutable for all routine assays for both analytes. The non-spiked pooled plasma sample was commutable for two out of four routine assays for metanephrine and three out of four routine assays for normetanephrine. The agreement between the routine assays and the cRMP was satisfactory, except for one routine assay showing significant bias.

Conclusions

High-concentration spiked pooled plasma samples and spiked individual plasma samples are candidate EQA materials for normetanephrine and metanephrine measurements.

Long-Term Tubular Dysfunction in Childhood Cancer Survivors; DCCSS-LATER 2 Renal Study

The aim of this nationwide cross-sectional cohort study was to determine the prevalence of and risk factors for tubular dysfunction in childhood cancer survivors (CCS). In the DCCSS-LATER 2 Renal study, 1024 CCS (≥5 years after diagnosis), aged ≥ 18 years at study, treated between 1963 and 2001 with potentially nephrotoxic therapy (i.e., nephrectomy, abdominal radiotherapy, total body irradiation, cisplatin, carboplatin, ifosfamide, high-dose cyclophosphamide, or hematopoietic stem cell transplantation) participated, and 500 age- and sex-matched participants from Lifelines acted as controls. Tubular electrolyte loss was defined as low serum levels (magnesium < 0.7 mmol/L, phosphate < 0.7 mmol/L and potassium < 3.6 mmol/L) with increased renal excretion or supplementation. A α1-microglobulin:creatinine ratio > 1.7 mg/mmol was considered as low-molecular weight proteinuria (LMWP). Multivariable risk analyses were performed. After median 25.5 years follow-up, overall prevalence of electrolyte losses in CCS (magnesium 5.6%, potassium 4.5%, phosphate 5.5%) was not higher compared to controls. LMWP was more prevalent (CCS 20.1% versus controls 0.4%). LMWP and magnesium loss were associated with glomerular dysfunction. Ifosfamide was associated with potassium loss, phosphate loss (with cumulative dose > 42 g/m2) and LMWP. Cisplatin was associated with magnesium loss and a cumulative dose > 500 mg/m2 with potassium and phosphate loss. Carboplatin cumulative dose > 2800 mg/m2 was associated with potassium loss. In conclusion, long-term tubular dysfunction is infrequent. Yet, ifosfamide, cisplatin and carboplatin are risk factors.

The Time Has Come for Quantitative Protein Mass Spectrometry Tests That Target Unmet Clinical Needs

Protein mass spectrometry (MS) is an enabling technology that is ideally suited for precision diagnostics. In contrast to immunoassays with indirect readouts, MS quantifications are multiplexed and include identification of proteoforms in a direct manner. Although widely used for routine measurements of drugs and metabolites, the number of clinical MS-based protein applications is limited. In this paper, we share our experience and aim to take away the concerns that have kept laboratory medicine from implementing quantitative protein MS. To ensure added value of new medical tests and guarantee accurate test results, five key elements of test evaluation have been established by a working group within the European Federation for Clinical Chemistry and Laboratory Medicine. Moreover, it is emphasized to identify clinical gaps in the contemporary clinical pathways before test development is started. We demonstrate that quantitative protein MS tests that provide an additional layer of clinical information have robust performance and meet long-term desirable analytical performance specifications as exemplified by our own experience. Yet, the adoption of quantitative protein MS tests into medical laboratories is seriously hampered due to its complexity, lack of robotization and high initial investment costs. Successful and widespread implementation in medical laboratories requires uptake and automation of this next generation protein technology by the In-Vitro Diagnostics industry. Also, training curricula of lab workers and lab specialists should include education on enabling technologies for transitioning to precision medicine by quantitative protein MS tests.

Big data and reference intervals: rationale, current practices, harmonization and standardization prerequisites and future perspectives of indirect determination of reference intervals using routine data

Reference intervals are commonly used as a decision-making tool. In this review, we provide an overview on "big data" and reference intervals, describing the rationale, current practices including statistical methods, essential prerequisites concerning data quality, including harmonization and standardization, and future perspectives of the indirect determination of reference intervals using routine laboratory data.

Fast 0/1-h algorithm for detection of NSTEMI: are current high-sensitivity cardiac troponin assays fit for purpose? An EQA-based evaluation

Background High-sensitivity cardiac troponin T/I (hs-cTnT/I) assays have improved analytical sensitivity for the detection of myocardial infarction (MI). To gain clinical specificity and sensitivity, interpretation of changes in cTn concentrations over time is crucial. The 2015 ESC NSTEMI guideline defines absolute delta values as additional rule-in and rule-out criteria for MI. A critical assumption for application of this rule is that total analytical imprecision within the delta period, including inter-instrument bias, is comparable to analytical imprecision in the validation studies. Methods Data from the Dutch External Quality Assessment Scheme (EQAS) were used to calculate inter-instrument bias and estimate imprecision for the measuring range where the proposed delta values are relevant: for Roche Elecsys hs-cTnT, 5-52 and 5-12 ng/L; for Abbott Architect hs-cTnI, 2-52 and 2-5 ng/L for rule-in and rule-out, respectively. Results For Elecsys, the median inter-instrument bias is 0.3 ng/L (n = 33 laboratories), resulting in reference change values (RCVs) of 3.0 and 1.7 ng/L, respectively, for rule-in and rule-out with imprecision as claimed by the manufacturer. With RCVs smaller than the guideline's delta thresholds, 100% of the laboratories have adequate specifications. RCVs for rule-in/rule-out increased to 4.6 ng/L/2.5 ng/L, respectively, with individual imprecisions as estimated from EQA data, resulting in 64% and 82% of laboratories with adequate specifications. For Architect, 40% of instruments (n = 10) might falsely qualify the result as clinically relevant; hence, inter-instrument bias could not be determined. Conclusions We advise laboratories that use the fast 0/1-h algorithm to introduce stringent internal quality procedures at the relevant/low concentration level, especially when multiple analyzers are randomly used.

Commutability Assessment of Candidate External Quality Assessment Materials for Aminotransferase Activity Measurements Based on Different Approaches in China

Background

Using commutable external quality assessment (EQA) materials is important for monitoring successful harmonization efforts. We assessed the commutability of four human serum pool (HSP) preparations to identify candidate EQA materials for alanine aminotransferase (ALT) and aspartate aminotransferase (AST) activity measurement.

Methods

One set each of 85 clinical samples (CSs) was collected for ALT and AST activity measurement. The 15 candidate EQA materials included four types of HSP preparations (A to D): materials A, C, and D contained human original recombinant (HOR) aminotransferases; materials B was mixed leftover samples. The CSs and 15 candidate EQA materials were analyzed using seven routine assays, and the ln-transformed results were analyzed in 21 assay pairs. Commutability was assessed using Deming regression, with a 95% prediction interval (CLSI approach) and the difference in bias with an error component model (International Federation of Clinical Chemistry and Laboratory Medicine [IFCC] approach).

Results

For ALT, all materials were commutable for 14–21 assay pairs according to the CLSI and IFCC approaches. For AST, B01–03 showed commutability for 14–21 assay pairs, and C01–03 and D01–03 showed commutability for no less than 10 assay pairs according to the two approaches. A01–06 were commutable for 9–16 assay pairs according to the CLSI approach, but for 6–9 assay pairs according to the IFCC approach.

Conclusions

Mixed leftover samples showed desirable commutability characteristics as candidate EQA materials for routine aminotransferase activity measurements. Human serum bases supplemented with HOR were commutable for most routine ALT activity measurements.

Evaluation of serum electrolytes measurement through the 6-year trueness verification program in China

Objectives

The National Center for Clinical Laboratories (NCCL) in China initiated a serum electrolyte trueness verification (ETV) program in 2014 for measurement standardization.

Methods

Every year, two levels of fresh frozen commutable serum samples determined by inductively coupled plasma mass spectrometry (ICP-MS) reference methods were transported to participating clinical laboratories for the measurement of sodium, potassium, calcium and magnesium. Both samples were measured 15 times in 3 days, and the mean values and coefficient variations (CVs) were calculated from the results. The tolerance limits of trueness (bias), precision (CV) and accuracy (TE) based on the biological variation database were used as the evaluation criteria. The overall trend of the ETV program over 6 years was surveyed by calculating the pass rates of the participating laboratories. The mean bias, inter-laboratory CV, and TE of all laboratory results were analysed. Furthermore, homogeneous and heterogeneous systems were compared, and the bias and CV results of mainstream analysis systems were analysed.

Results

Pass rates of the three quality specifications increased, and the overall mean bias and inter-laboratory CVs decreased. The homogeneous system was superior to the heterogeneous system for calcium and magnesium measurements. For sodium, potassium, calcium and magnesium, the minimum bias corresponded to Hitachi, Siemens, Beckman AU and Roche, respectively. For inter-laboratory robust CVs, no obvious differences were observed between each peer group.

Conclusions

The commutable ETV materials assigned via reference methods can evaluate the accuracy and reproducibility of an individual laboratory and the calibration traceability and uniformity between laboratories for measurements.

Harmonization of External Quality Assessment Schemes and their role - clinical chemistry and beyond

The article tries to reply to the following three questions: Are External Quality Assessment Schemes (EQAS) really fit for purpose? Are all schemes equivalent and sufficiently harmonized? Is the role of EQAS similar and necessary in all branches of laboratory medicine? Although the reply to the first two questions is, unfortunately, negative for several reasons (lack of commutable material with reference method values, EQAS with different scopes, etc.), the reply to the third one is positive: EQAS are a necessary source of information on trueness and accuracy and must be fully developed for all the branches of the clinical laboratory.

Standardization in laboratory medicine: Two years' experience from category 1 EQA programs in Spain

Introduction

Standardization is the ability to obtain interchangeable results leading to same medical interpretation. External quality assessment (EQA) is the main support of the on-going harmonization initiatives. Aim of study was to evaluate results obtained from two years category 1 EQA program experience in Spain and determine the impact of applying this type of EQA program on the analytical standardization.

Materials and methods

According to the analytical method, traceability and instrument different groups were established which results were evaluated by calculating mean, coefficient of variation and percent of deviation to the reference value. Analytical performance specifications used to the results' evaluation were derived from biological variation for bias and from the inter-laboratory coefficients of variation found in a previous pilot study.

Results

Only creatinine measured by enzymatic methods gave excellent results, although few laboratories used this method. Creatine kinase and GGT gave good precision and bias in all, but one instrument studied. For the remaining analytes (ALT, ALP, AST, bilirubin, calcium, chloride, glucose, magnesium, potassium, sodium, total protein and urate) some improvement is still necessary to achieve satisfactory standardization in our setting.

Conclusions

The two years of category 1 EQA program experience in Spain have manifested a lack of standardization of 17 most frequent biochemistry tests used in our laboratories. The impact of the information obtained on the lack of standardization is to recommend abandoning methods such as ALT, AST without exogenous pyridoxal phosphate, Jaffe method for creatinine, and do not use non-commutable calibrators, such as aqueous solutions for calcium and sodium.

NUMBER: standardized reference intervals in the Netherlands using a ‘big data’ approach

Background

External quality assessment (EQA) programs for general chemistry tests have evolved from between laboratory comparison programs to trueness verification surveys. In the Netherlands, the implementation of such programs has reduced inter-laboratory variation for electrolytes, substrates and enzymes. This allows for national and metrological traceable reference intervals, but these are still lacking. We have initiated a national endeavor named NUMBER (Nederlandse UniforMe Beslisgrenzen En Referentie-intervallen) to set up a sustainable system for the determination of standardized reference intervals in the Netherlands.

Methods

We used an evidence-based ‘big-data’ approach to deduce reference intervals using millions of test results from patients visiting general practitioners from clinical laboratory databases. We selected 21 medical tests which are either traceable to SI or have Joint Committee for Traceability in Laboratory Medicine (JCTLM)-listed reference materials and/or reference methods. Per laboratory, per test, outliers were excluded, data were transformed to a normal distribution (if necessary), and means and standard deviations (SDs) were calculated. Then, average means and SDs per test were calculated to generate pooled (mean±2 SD) reference intervals. Results were discussed in expert meetings.

Results

Sixteen carefully selected clinical laboratories across the country provided anonymous test results (n=7,574,327). During three expert meetings, participants found consensus about calculated reference intervals for 18 tests and necessary partitioning in subcategories, based on sex, age, matrix and/or method. For two tests further evaluation of the reference interval and the study population were considered necessary. For glucose, the working group advised to adopt the clinical decision limit.

Conclusions

Using a ‘big-data’ approach we were able to determine traceable reference intervals for 18 general chemistry tests. Nationwide implementation of these established reference intervals has the potential to improve unequivocal interpretation of test results, thereby reducing patient harm.

External quality assessment programs in the context of ISO 15189 accreditation

Effective management of clinical laboratories participating in external quality assessment schemes (EQAS) is of fundamental importance in ensuring reliable analytical results. The International Standard ISO 15189:2012 requires participation in interlaboratory comparison [e.g. external quality assessment (EQA)] for all tests provided by an individual laboratory. If EQAS is not commercially available, alternative approaches should be identified, although clinical laboratories may find it challenging to choose the EQAS that comply with the international standards and approved guidelines. Great competence is therefore required, as well as knowledge of the characteristics and key elements affecting the reliability of an EQAS, and the analytical quality specifications stated in approved documents. Another skill of fundamental importance is the ability to identify an alternative approach when the available EQAS are inadequate or missing. Yet the choice of the right EQA program alone does not guarantee its effectiveness. In fact, the fundamental steps of analysis of the information provided in EQA reports and the ability to identify improvement actions to be undertaken call for the involvement of all laboratory staff playing a role in the specific activity. The aim of this paper was to describe the critical aspects that EQA providers and laboratory professionals should control in order to guarantee effective EQAS management and compliance with ISO 15189 accreditation requirements.

The quest for equivalence of test results: the pilgrimage of the Dutch Calibration 2.000 program for metrological traceability

Calibration 2.000 was initiated 20 years ago for standardization and harmonization of medical tests. The program also intended to evaluate adequate implementation of the In Vitro Diagnostics (IVD) 98/79/EC directive, in order to ensure that medical tests are fit-for-clinical purpose. The Calibration 2.000 initiative led to ongoing verification of test standardization and harmonization in the Netherlands using commutable external quality assessment (EQA)-tools and a type 1 EQA-design, where feasible. National support was guaranteed by involving all laboratory professionals as well as laboratory technicians responsible for EQA and quality officers. A category 1 EQA-system for general chemistry analytes, harmonizers for specific analytes like hGH and IGF-1, and commutable materials for other EQA-sections have been developed and structurally introduced in the EQA-schemes. The type 1 EQA-design facilitates the dialogue between individual specialists in laboratory medicine and the IVD-industry to reduce lot-to-lot variation and to improve standardization. In such a way, Calibration 2.000 sheds light on the metrological traceability challenges that we are facing and helps the laboratory community to get the issues on the table and resolved. The need for commutable trueness verifiers and/or harmonizers for other medical tests is now seen as paramount. Much knowledge is present in the Netherlands and for general chemistry, humoral immunology and protein chemistry, a few endocrinology tests, and various therapeutic drug monitoring (TDM) tests, commutable materials are available. Also the multi sample evaluation scoring system (MUSE) and the category 1 EQA-design offer many possibilities for permanent education of laboratory professionals to further improve the between and within laboratory variation and the test equivalence.

External Quality Assessment in Croatia: problems, challenges, and specific circumstances

In Croatian medical laboratories (ML), external quality assessment (EQA) has a long tradition of almost half of a century. At national level, EQA is provided by Croatian Centre for Quality Assessment in Laboratory Medicine (CROQALM) which is a part of Croatian Society of Medical Biochemistry and Laboratory Medicine.
This case study aimed to summarize the main challenges, which are set to CROQALM and their possible solutions.
CROQALM has 10 schemes, covering majority of analysis for which medical biochemistry laboratories in Croatia are authorized for, including pre-analytical and post-analytical phase of laboratory work. Assessment scheme has three exercises per year. One sample per scheme and exercise is distributed to participants depending on their application. All data transfer and evaluation of the results are done using web interface and statistical software for evaluation of quality in laboratory medicine.
Since CROQALM has relatively small number of participating laboratories (N = 197) with lot of different manufacturers of instruments used for analysis in all schemes, constant challenges are present in the evaluation of the results (commutability problems, statistical analysis etc.). Further, number of participating medical laboratories is even lower for highly specific parameters, which are in the scope of clinical laboratories only.
Despite the obstacles we are faced to, EQA at national level is useful tool regarding standardization and harmonization aspects in total testing process within the country. Furthermore, it gives participating laboratories recognition and proof for meeting expected quality criteria in the community they serve.

Expressing analytical performance from multi-sample evaluation in laboratory EQA

BACKGROUND

To provide its participants with an external quality assessment system (EQAS) that can be used to check trueness, the Dutch EQAS organizer, Organization for Quality Assessment of Laboratory Diagnostics (SKML), has innovated its general chemistry scheme over the last decade by introducing fresh frozen commutable samples whose values were assigned by Joint Committee for Traceability in Laboratory Medicine (JCTLM)-listed reference laboratories using reference methods where possible. Here we present some important innovations in our feedback reports that allow participants to judge whether their trueness and imprecision meet predefined analytical performance specifications.

METHODS

Sigma metrics are used to calculate performance indicators named 'sigma values'. Tolerance intervals are based on both Total Error allowable (TEa) according to biological variation data and state of the art (SA) in line with the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Milan consensus.

RESULTS

The existing SKML feedback reports that express trueness as the agreement between the regression line through the results of the last 12 months and the values obtained from reference laboratories and calculate imprecision from the residuals of the regression line are now enriched with sigma values calculated from the degree to which the combination of trueness and imprecision are within tolerance limits. The information and its conclusion to a simple two-point scoring system are also graphically represented in addition to the existing difference plot.

CONCLUSIONS

By adding sigma metrics-based performance evaluation in relation to both TEa and SA tolerance intervals to its EQAS schemes, SKML provides its participants with a powerful and actionable check on accuracy.

Analytical performance of 17 general chemistry analytes across countries and across manufacturers in the INPUtS project of EQA organizers in Italy, the Netherlands, Portugal, United Kingdom and Spain

Background:

Optimum patient care in relation to laboratory medicine is achieved when results of laboratory tests are equivalent, irrespective of the analytical platform used or the country where the laboratory is located. Standardization and harmonization minimize differences and the success of efforts to achieve this can be monitored with international category 1 external quality assessment (EQA) programs.

Methods:

An EQA project with commutable samples, targeted with reference measurement procedures (RMPs) was organized by EQA institutes in Italy, the Netherlands, Portugal, UK, and Spain. Results of 17 general chemistry analytes were evaluated across countries and across manufacturers according to performance specifications derived from biological variation (BV).

Results:

For K, uric acid, glucose, cholesterol and high-density density (HDL) cholesterol, the minimum performance specification was met in all countries and by all manufacturers. For Na, Cl, and Ca, the minimum performance specifications were met by none of the countries and manufacturers. For enzymes, the situation was complicated, as standardization of results of enzymes toward RMPs was still not achieved in 20% of the laboratories and questionable in the remaining 80%.

Conclusions:

The overall performance of the measurement of 17 general chemistry analytes in European medical laboratories met the minimum performance specifications. In this general picture, there were no significant differences per country and no significant differences per manufacturer. There were major differences between the analytes. There were six analytes for which the minimum quality specifications were not met and manufacturers should improve their performance for these analytes. Standardization of results of enzymes requires ongoing efforts.

Progress and impact of enzyme measurement standardization

International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) has established reference measurement procedures (RMPs) for the most popular enzymes. Manufacturers should assign values to commercial calibrators traceable to these RMPs to achieve equivalent results in clinical samples, independent of reagent kits, instruments, and laboratory where the measurement is carried out. The situation is, however, far from acceptable. Some manufacturers continue to market assays giving results that are not traceable to internationally accepted RMPs. Meanwhile, end-users often do not abandon assays with demonstrated insufficient quality. Of the enzyme measurements, creatine kinase (CK) is satisfactorily standardized and a substantial improvement in performance of marketed γ-glutamyltranspeptidase (GGT) assays has been demonstrated. Conversely, aminotransferase measurements often exceed the desirable analytical performance because of the lack of pyridoxal-5-phosphate addition in the commercial reagents. Measurements of lactate dehydrogenase (LDH), alkaline phosphatase (ALP), and α-amylase (AMY) still show major disagreement, suggesting the need for improvement in implementing traceability to higher-order references. This is mainly the result of using assays with different analytical selectivities for these enzymes. The definition by laboratory professionals of the clinically acceptable measurement uncertainty for each enzyme together with the adoption by EQAS of commutable materials and use of an evaluation approach based on trueness represent the way forward for reaching standardization in clinical enzymology.

Effect of Participating in a Quality Improvement System over Time for Point-of-Care C-Reactive Protein, Glucose, and Hemoglobin Testing

BACKGROUND

Users of point-of-care testing (POCT) in Norway participate in a quality improvement system that includes education and guidance in safe laboratory management along with participation in external quality assurance schemes (EQAS).

The aim of this study was to identify the effect on the analytical performance of POCT C-reactive protein (CRP), glucose, and hemoglobin (Hb) with the use of a quality improvement system over time and to identify which factors are associated with good performance.

METHODS

Participants' results from 19 EQAS for CRP, glucose, and Hb from 2006 to 2015 along with information on the instruments used and different practice characteristics were analyzed. Logistic regression analysis was used to evaluate the factors associated with good laboratory performance. An instrument evaluation and comparison for CRP determination was performed by using commutable EQA material.

RESULTS

The mean number of participants in each EQAS was 2134, 2357, and 2271 for CRP, glucose, and Hb, respectively. The percentage of good participant performances increased gradually whereas that of poor performances decreased with participation in a quality improvement system over 9 years for all 3 analytes. Independent factors associated with good performance were type of instrument, the number of times performing EQA, performing internal QC weekly, performing 10 or more tests weekly, and having laboratory-qualified personnel perform the tests. Considering CRP instrument performance, Afinion and QuikRead exhibited the lowest systematic deviation.

CONCLUSIONS

The analytical quality of CRP, glucose, and Hb testing is improved by systematic participation in a quality improvement system over time.

Performance of electrolyte measurements assessed by a trueness verification program

In this study, we analyzed frozen sera with known commutabilities for standardization of serum electrolyte measurements in China.

Fresh frozen sera were sent to 187 clinical laboratories in China for measurement of four electrolytes (sodium, potassium, calcium, and magnesium). Target values were assigned by two reference laboratories. Precision (CV), trueness (bias), and accuracy [total error (TE

About half of the laboratories used a homogeneous system (same manufacturer for instrument, reagent and calibrator) for calcium and magnesium measurement, and more than 80% of laboratories used a homogeneous system for sodium and potassium measurement. More laboratories met the tolerance limit of imprecision (coefficient of variation [CV

The use of commutable proficiency testing/external quality assessment (PT/EQA) samples with values assigned by reference methods can monitor performance and provide reliable data for improving the performance of laboratory electrolyte measurement. The homogeneous systems were superior to the non homogeneous systems, whereas accuracy of assigned values of calibrators and assay stability remained challenges.

Sigma metric analysis for performance of creatinine with fresh frozen serum

BACKGROUND

Six sigma provides an objective and quantitative methodology to describe the laboratory testing performance. In this study, we conducted a national trueness verification scheme with fresh frozen serum (FFS) for serum creatinine to evaluate its performance in China.

METHODS

Two different concentration levels of FFS, targeted with reference method, were sent to 98 laboratories in China. Imprecision and bias of the measurement procedure were calculated for each participant to further evaluate the sigma value. Quality goal index (QGI) analysis was used to investigate the reason of unacceptable performance for laboratories with σ < 3.

RESULTS

Our study indicated that the sample with high concentration of creatinine had preferable sigma values. For the enzymatic method, 7.0% (5/71) to 45.1% (32/71) of the laboratories need to improve their measurement procedures (σ < 3). And for the Jaffe method, the percentages were from 11.5% (3/26) to 73.1% (19/26). QGI analysis suggested that most of the laboratories (62.5% for the enzymatic method and 68.4% for the Jaffe method) should make an effort to improve the trueness (QGI > 1.2). Only 3.1-5.3% of the laboratories should improve both of the precision and trueness.

CONCLUSIONS

Sigma metric analysis of the serum creatinine assays is disappointing, which was mainly due to the unacceptable analytical bias according to the QGI analysis. Further effort is needed to enhance the trueness of the creatinine measurement.

Measurements for 8 common analytes in native sera identify inadequate standardization among 6 routine laboratory assays

BACKGROUND

External quality assessment (EQA) with commutable samples is essential for assessing the quality of assays performed by laboratories, particularly when the emphasis is on their standardization status and interchangeability of results.

METHODS

We used a panel of 20 fresh-frozen single-donation serum samples to assess assays for the measurement of creatinine, glucose, phosphate, uric acid, total cholesterol, HDL cholesterol, LDL cholesterol, and triglycerides. The commercial random access platforms included: Abbott Architect, Beckman Coulter AU, Ortho Vitros, Roche Cobas, Siemens Advia, and Thermo Scientific Konelab. The assessment was done at the peer group level and by comparison against the all-method trimmed mean or reference method values, where available. The considered quality indicators were intraassay imprecision, combined imprecision (including sample-matrix interference), bias, and total error. Fail/pass decisions were based on limits reflecting state-of-the-art performance, but also limits related to biological variation.

RESULTS

Most assays showed excellent peer performance attributes, except for HDL- and LDL cholesterol. Cases in which individual assays had biases exceeding the used limits were the Siemens Advia creatinine (-4.2%), Ortho Vitros phosphate (8.9%), Beckman Coulter AU triglycerides (5.4%), and Thermo Scientific Konelab uric acid (6.4%), which lead to considerable interassay discrepancies. Additionally, large laboratory effects were observed that caused interlaboratory differences of >30%.

CONCLUSIONS

The design of the EQA study was well suited for monitoring different quality attributes of assays performed in daily laboratory practice. There is a need for improvement, even for simple clinical chemistry analytes. In particular, the interchangeability of results remains jeopardized both by assay standardization issues and individual laboratory effects.