Diagnosis of von Willebrand disease: An assessment of the quality of testing in North American laboratories

BACKGROUND

Laboratory diagnosis of von Willebrand Disease (VWD) is complex. Reliance on laboratory testing can be problematic as different VWD screening panels, assays and methodologies can produce analytic variability in test results.

OBJECTIVES

To compare the degree of imprecision among the VWD assays and within the platelet binding activity (PBA) assays, to determine the consensus among the VWD assays for correct classification of sample results, and to determine consensus among laboratories' von Willebrand factor (VWF) multimer interpretations and final interpretations of the VWD panels.

PATIENTS/METHODS

Proficiency testing results from the North American Specialized Coagulation Laboratory Association (NASCOLA) submitted by laboratories from 2010 to 2019 for all normal, type (T) 1 VWD and T2 VWD samples were analysed.

RESULTS AND CONCLUSIONS

Imprecision was lowest for VWF antigen and highest for collagen binding activity (CBA) with median coefficient of variation (CV) of 12% (interquartile range (IQR) 7%) and 23% (IQR 21%) respectively. Within the VWF PBA assays, the gain-of-function mutant GP1b binding (VWF: GP1bM) methods had the least imprecision (CV 9%, IQR 10%). All assays, including the various PBA methods had excellent consensus. The majority of laboratories agreed that normal (median consensus-82%, IQR 16%) and T1 VWD (median consensus-100%, IQR 9%) samples had normal multimer distribution. Consensus among laboratories for final interpretations was excellent for normal samples (median 81%, IQR 8%), good for T1 VWD samples (median 59%, IQR 9%), and fair for T2 VWD samples (median 44%, IQR 21%). Consensus on final interpretation decreased as sample complexity increased.

Audit of sweat chloride testing reveals analytical errors

OBJECTIVES

Sweat chloride testing (SCT) is the mainstay for the diagnosis of cystic fibrosis (CF) and biomarker in the evaluation of CFTR-modifying drugs. To be a reliable and valid tool, analytical variance (CVA) must be minimized. However, external quality assessments have revealed significant deviations in routine clinical practice. Our goal was to identify and quantify technical errors through proficiency testing and simulations.

METHODS

Chloride concentrations of three blinded samples (each as triplicates) were measured in 9 CF centers using a chloridometer in a routine setting. Technical errors were simulated and quantified in a series of measurements. We compared imprecision and bias before and after a counseling session by evaluating coefficients of variation (CV), adherence to tolerance limits, and inter-rater variability coefficients.

RESULTS

Pipetting errors resulting in changes in sample volume were identified as the main source of error with deviations up to 41%. After the counseling session, the overall CVA decreased from 7.6 to 5.2%, the pass rate increased from 67 to 92%, and the inter-rater variability diminished. Significant deviations continued to be observed in individual centers.

CONCLUSIONS

Prevention of technical errors in SCT decreases imprecision and bias. Quality assurance programs must be established in all CF centers, including staff training, standard operating procedures, and proficiency testing.

Top-down and bottom-up approaches for the estimation of measurement uncertainty in coagulation assays

Background

The assessment of measurement uncertainty (MU) in clinical laboratories is essential to the reliable interpretation of results in clinical laboratories. However, despite the introduction of various methods for the expression of uncertainty in measurement, the MUs of coagulation tests have not been extensively studied. The aim of this study was to quantify the MU of various coagulation assays according to international guidelines and to report an expected confidence in the quality of coagulation assays.

Methods

We selected activated partial thromboplastin time, international normalized ratio (INR), protein C/S, antithrombin, fibrinogen, and Factor V/VIII/X to quantify the MUs of two coagulation testing systems: ACL TOP 750 CTS (Instrumentation Laboratory, Bedford, MA, USA) and STA Compact (Diagnostica Stago, Asnières-sur-Seine, France). We used international standards and interlaboratory comparison results in accordance with international guidelines in a top-down approach to the assessment of MU. For INR, MU was estimated in a bottom-up approach using reference thromboplastin and certified plasmas.

Results

Top-down approaches resulted in MUs between 3.3% and 21.3% for each measurand. In the bottom-up approach, MUs of INR values ranged from 10.9% to 26.4% and showed an upward trend as INR increased.

Conclusions

In this study, we were successful in quantifying MU of coagulation assays using practical methods. Our results demonstrated that top-down and bottom-up approaches were adequate for coagulation assays. However, some assays showed significant biases against international standards; therefore, standardization would be necessary to ensure more reliable patient results.

First inter-laboratory comparison of Echinococcus granulosus sensu lato diagnosis in Latin America

OBJECTIVE

To compare the performance of polymerase chain reaction (PCR) and enzyme-linked immunosorbent assay (ELISA) tests for diagnosing Echinococcus granulosus in dog feces among national reference laboratories in Argentina, Chile, Peru, and Uruguay.

METHODS

National laboratories affiliated with the Ministry of Health/Agriculture of each country exchanged panels of 10 positive/negative samples obtained from their regular national surveillance programs in November 2015 - November 2016. All laboratories applied PCR; two also applied ELISA techniques. Sensitivity and specificity were determined for each laboratory and concordance of results among the laboratories was evaluated by Cohen Kappa coefficient.

RESULTS

Poor concordance (3 of 10 paired comparisons had values of Kappa > 0.4), low sensitivity and specificity across all laboratories, and poor performance of both techniques in detecting E. granulosus in canine feces was demonstrated in this study. An ex-post comparison of the laboratories' test protocols showed substantial heterogeneity that could partially explain poor concordance of results.

CONCLUSION

The results underscore the heterogeneity of canine echinococcosis diagnosis across the region and indicate possible sources of variability. Efforts to standardize canine echinococcosis testing must be included in the plan of action for the Regional Initiative for the Control of Cystic Echinococcosis. Future comparisons with fecal samples of known parasite load are needed.

An international external quality assessment for laboratory diagnosis of heparin-induced thrombocytopenia

Essentials A pilot study for External Quality Assessment for testing of HIT is described. The qualitative accordance for the PF4/heparin IgG test was 97.6%. The qualitative accordance for functional HIT tests was considerably lower. External Quality Assessment for functional HIT tests is required. SUMMARY: Objective Heparin-induced thrombocytopenia (HIT) is a potentially life-threatening complication of heparin exposure. Diagnosis is most reliable using a combination of an enzyme immunoassay (EIA) that detects antibodies against platelet factor 4 (PF4)/heparin complexes ("antigen" assay) and a "functional" assay that detects platelet-activating properties of the pathogenic HIT antibodies. No External Quality Assessment (EQA) is available for a combination of the tests. Here we report on the results of the first international EQA. Methods The pilot EQA was organized by the Department of Transfusion Medicine, Universitätsmedizin Greifswald, Germany. Six serum samples of patients, which were referred to Greifswald for HIT diagnosis, and one negative control sample were distributed to seven participants in Germany, Canada, and Singapore. Participants were asked to report the optical density (OD) values of their local EIA test for IgG-specific antibodies against the PF4/heparin complexes and the results for a functional assay (HIPA or SRA). Consensus was defined as a minimum 70% agreement, i.e., agreement among at least five of the seven participating laboratories. Results and conclusion Six out of seven participants reported results for EIA, with a high quantitative accordance (97.6%). For the functional assay, consensus was reached for all samples except the negative control, for which some participants reported nonspecific reactivity. All HIT-negative samples were correctly diagnosed by all participants; for HIT-positive samples, consensus of 70% was reached. Although the limited availability of sample material is an obstacle to overcome, an EQA combining both EIA and functional testing is feasible.

Canine factor VII deficiency: lessons learned in applying methods-based laboratory proficiency testing

Canine inherited factor VII deficiency is a mild-to-moderate, inherited coagulopathy that affects several breeds of dog. We identified 2 polymorphisms near the disease-causing F7 gene mutation, one of which interfered with testing in several Beagles by causing allele dropout of the normal, wild-type allele. In the absence of an external proficiency program among veterinary genetic testing laboratories, implementation of an internal proficiency program, which requires 2 independent methods for genotyping dogs at any given locus, was further enhanced by ensuring minimally non-overlapping primer pairs between the 2 assays. After redesign of our clinical tests, all dogs were re-examined, and the correct genotypes were identified. These changes ensure higher accuracy in future testing of the F7 mutation.

Validation of Digital Microscopy Compared With Light Microscopy for the Diagnosis of Canine Cutaneous Tumors

Integration of new technologies, such as digital microscopy, into a highly standardized laboratory routine requires the validation of its performance in terms of reliability, specificity, and sensitivity. However, a validation study of digital microscopy is currently lacking in veterinary pathology. The aim of the current study was to validate the usability of digital microscopy in terms of diagnostic accuracy, speed, and confidence for diagnosing and differentiating common canine cutaneous tumor types and to compare it to classical light microscopy. Therefore, 80 histologic sections including 17 different skin tumor types were examined twice as glass slides and twice as digital whole-slide images by 6 pathologists with different levels of experience at 4 time points. Comparison of both methods found digital microscopy to be noninferior for differentiating individual tumor types within the category epithelial and mesenchymal tumors, but diagnostic concordance was slightly lower for differentiating individual round cell tumor types by digital microscopy. In addition, digital microscopy was associated with significantly shorter diagnostic time, but diagnostic confidence was lower and technical quality was considered inferior for whole-slide images compared with glass slides. Of note, diagnostic performance for whole-slide images scanned at 200× magnification was noninferior in diagnostic performance for slides scanned at 400×. In conclusion, digital microscopy differs only minimally from light microscopy in few aspects of diagnostic performance and overall appears adequate for the diagnosis of individual canine cutaneous tumors with minor limitations for differentiating individual round cell tumor types and grading of mast cell tumors.

Essential aspects of external quality assurance for point-of-care testing

External quality assurance (EQA) or proficiency testing for point-of-care (POC) testing is in principle similar to EQA for larger hospital laboratories, but the participants are different. The participants are usually health care personnel with little or no knowledge of laboratory medicine. The implication of this is that the EQA provider has to a) convince the participants that participation in EQA schemes are important, b) be able to circulate materials with reasonable time intervals, c) produce feedback reports that are understandable, and d) offer help and guidance to the participants when needed. It is also important that EQA for POC testing e) address the pre-examination, the examination and the post-examination processes, and f) that schemes for measurement procedures using interval or ordinal scale are offered. The aim of the present paper is to highlight important issues of these essential aspects of EQA for POC testing.

Survey material choices in haematology EQA: a confounding factor in automated counting performance assessment

The complete blood count (CBC) is one of the most frequently requested tests in laboratory medicine, performed in a range of healthcare situations. The provision of an ideal assay material for external quality assessment is confounded by the fragility of the cellular components of blood, the lack of commutability of stabilised whole blood material and the lack of certified reference materials and methods to which CBC results can be traced. The choice of assay material between fresh blood, extended life assay material and fully stabilised, commercially prepared, whole blood material depends upon the scope and objectives of the EQA scheme. The introduction of new technologies in blood counting and the wider clinical application of parameters from the extended CBC will bring additional challenges for the EQA provider.

An overview of the European Organization for External Quality Assurance Providers in Laboratory Medicine (EQALM)

The European Organisation for External Quality Assurance Providers in Laboratory Medicine (EQALM) was founded in 1996 and currently has members from 29 European countries and 6 countries from outside Europe. EQALM provides a forum for co-operation and exchange of knowledge on quality-related matters in laboratory medicine, especially with regard to external quality assessment (EQA) programs in Europe. In addition, EQALM represent the EQA providers in laboratory medicine at European level vis-ŕ-vis political, professional, scientific and other bodies, including patients’ organisations. To this end EQALM promotes activities such as organizing meetings with scientific and practical themes for members and other interested parties, issuing scientific publications, developing EQA projects and representing laboratory medicine EQA activities within other organisations and networks. EQALM is active in scientific and educational activity in different fields such as survey frequency, haematology, haemostasis, microbiology, nomenclature, virtual microscopy, traceability, accreditation, and quality assurance of the total testing process. The aim of this paper is to give an overview of the EQALM organisation.

Evaluation of staff performance and interpretation of the screening program for prevention of thalassemia

Introduction

Thalassemia screening program has been implemented for years in Southeast Asia, but no external quality assessment program has been established. We have developed and initiated the proficiency testing (PT) program for the first time in Thailand with the aim to assess the screening performance of laboratory staff and their competency in interpretation of the screening results.

Materials and methods

Three PT cycles per year were organized. From the first to the third cycle of the PT scheme, a total number of participant laboratories increased from 59 to 67. In each cycle, 2 PT items (assigned as blood samples of the couple) were provided. Performance evaluation was based on the accuracy of screening results, i.e. mean corpuscular volume (MCV), mean corpuscular haemoglobin (MCH) and the dichlorophenolindophenol (DCIP) test for haemoglobin E, including the competency in interpretation of screening results and assessment of foetal risk. Performance was assessed by comparing the participants’ result against the assigned value.

Results

Of all 3 cycles, most laboratories reported acceptable MCV and MCH values. From the first to the third cycle, incorrect DCIP test and misinterpretation rates were decreased while incorrect risk assessment varied by cycle to cycle. Combining the accuracy of thalassemia screening and the competency in interpretation and risk assessment, approximately half of participants showed excellent performance.

Conclusion

Improved performance observed in many laboratories reflects the achievement and benefit of the PT program which should be regularly provided.

Quality assuring HIV point of care testing using whole blood samples

The Royal College of Pathologists Australasia Quality Assurance Programs (RCPAQAP), have offered dedicated external quality assurance (EQA) for HIV point of care testing (PoCT) since 2011. Prior to this, EQA for these tests was available within the comprehensive human immunodeficiency virus (HIV) module. EQA testing for HIV has typically involved the supply of serum or plasma, while in the clinic or community based settings HIV PoCT is generally performed using whole blood obtained by capillary finger-stick collection. RCPAQAP has offered EQA for HIV PoCT using stabilised whole blood since 2014. A total of eight surveys have been undertaken over a period of 2 years from 2014 to 2015. Of the 962 responses received, the overall consensus rate was found to be 98% (941/962). A total of 21 errors were detected. The majority of errors were attributable to false reactive HIV p24 antigen results (9/21, 43%), followed by false reactive HIV antibody results (8/21, 38%). There were 4/21 (19%) false negative HIV antibody results and no false negative HIV p24 antigen results reported. Overall performance was observed to vary minimally between surveys, from a low of 94% up to 99% concordant. Encouraging levels of testing proficiency for HIV PoCT are indicated by these data, but they also confirm the need for HIV PoCT sites to participate in external quality assurance programs to ensure the ongoing provision of high quality patient care.

Larger differences in utilization of rarely requested tests in primary care in Spain

INTRODUCTION

The study was performed to compare and analyze the inter-departmental variability in the request of rarely requested laboratory tests in primary care, as opposed to other more common and highly requested tests.

MATERIALS AND METHODS

Data from production statistics for the year 2012 from 76 Spanish laboratories was used. The number of antinuclear antibodies, antistreptolysin O, creatinine, cyclic citrullinated peptide antibodies, deaminated peptide gliadine IgA antibodies, glucose, protein electrophoresis, rheumatoid factor, transglutaminase IgA antibodies, urinalysis and uric acid tests requested was collected. The number of test requests per 1000 inhabitants was calculated. In order to explore the variability the coefficient of quartile dispersion was calculated.

RESULTS

The smallest variation was seen for creatinine, glucose, uric acid and urinalysis; the most requested tests. The tests that were least requested showed the greatest variability.

CONCLUSION

Our study shows through a very simplified approach, in a population close to twenty million inhabitants, how in primary care, the variability in the request of laboratory tests is inversely proportional to the request rate.

A pilot external quality assurance study of transfusion screening for HIV, HCV and HBsAG in 12 African countries

BACKGROUND AND OBJECTIVES

Serologic screening for the major transfusion transmissible viruses (TTV) is critical to blood safety and has been widely implemented. However, actual performance as measured by proficiency testing has not been well studied in sub-Saharan Africa. Therefore, we conducted an external quality assessment of laboratories engaged in transfusion screening in the region.

MATERIALS AND METHODS

Blinded test panels, each comprising 25 serum samples that were pedigreed for HIV, HBsAg, HCV and negative status, were sent to participating laboratories. The panels were tested using the laboratories' routine donor screening methods and conditions. Sensitivity and specificity were calculated, and multivariable analysis was used to compare performance against mode of testing, country and infrastructure.

RESULTS

A total of 12 African countries and 44 laboratories participated in the study. The mean (range) sensitivities for HIV, HBsAg and HCV were 91·9% (14·3-100), 86·7% (42·9-100) and 90·1% (50-100), respectively. Mean specificities for HIV, HBsAg and HCV were 97·7%, 97% and 99·5%, respectively. After adjusting for country and infrastructure, rapid tests had significantly lower sensitivity than enzyme immunoassays for both HBsAg (P < 0·0001) and HCV (P < 0·05). Sensitivity also varied by country and selected infrastructure variables.

CONCLUSION

While specificity was high, sensitivity was more variable and deficient in a substantial number of testing laboratories. These findings underscore the importance of proficiency testing and quality control, particularly in Africa where TTV prevalence is high.

Analysis of Accelerants in Fire Debris - Data Interpretation

Analysis of accelerants in fire debris involves the isolation of residual volatiles from the matrix and the analysis of these volatiles, usually by gas chromatography (GC). The resulting chromatograms are interpreted by comparing to a library of accelerant chromatograms obtained under similar conditions. This review first mentions ASTM's system in classifying fire accelerants into light petroleum distillates, gasoline, medium petroleum distillates, kerosene, heavy petroleum distillates, and unclassified compounds. Chromatograms with well-resolved n-alkane homolog patterns are most recognizable. Chromatograms that are inadequately resolved can be improved by columns having higher efficiency or selectivity, while those with too much interference can be improved by physical removal or reduction of these interfering compounds or selective detection. Using a mass spectrometer (MS) as the detector in GC/MS applications allows the display of common ions shared by compounds with similar structural features, thus greatly facilitating pattern recognition practices. Computer algorithms are now available for automated recognition of patterns possessed by various categories of accelerants. The state-of-the-art in forensic laboratories' analysis of accelerants in fire debris is presented as an appendix to this review. Data generated in annual proficiency tests over an 8-year period (1987-1995) revealed increased use of GC/MS instrumentation and some persisting problems, which include false positives and difficulties associated with component discrimination in the sample preparation process and recognition of partially evaporated distillates.