Validation conform ISO-15189 of assays in the field of autoimmunity: Joint efforts in The Netherlands

Cutting edge confusion about cut-off settings in autoimmune diagnostics

In autoimmune diagnostics results are interpreted in relation to a single or multiple cut-off value(s) in order to decide if the test is negative, weak positive, positive, or even strong positive. The way a cut-off is established appears to be very heterogeneous and this hampers harmonization of test results obtained in assays, either established in-house or obtained from different companies. In this context it is surprising that in diagnostic and classification criteria for distinct autoimmune diseases referral is made to cut-off values with the intention of harmonization. In this review article distinct ways to establish cut-off values will be described and discussed in relation to some disease criteria in order to increase the awareness of the confusion matrix of cut-off values and, as a consequence, the implications for test result interpretation.

Detection of antinuclear antibodies: recommendations from EFLM, EASI and ICAP

OBJECTIVES

Antinuclear antibodies (ANA) are important for the diagnosis of various autoimmune diseases. ANA are usually detected by indirect immunofluorescence assay (IFA) using HEp-2 cells (HEp-2 IFA). There are many variables influencing HEp-2 IFA results, such as subjective visual reading, serum screening dilution, substrate manufacturing, microscope components and conjugate. Newer developments on ANA testing that offer novel features adopted by some clinical laboratories include automated computer-assisted diagnosis (CAD) systems and solid phase assays (SPA).

METHODS

A group of experts reviewed current literature and established recommendations on methodological aspects of ANA testing. This process was supported by a two round Delphi exercise. International expert groups that participated in this initiative included (i) the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group "Autoimmunity Testing"; (ii) the European Autoimmune Standardization Initiative (EASI); and (iii) the International Consensus on ANA Patterns (ICAP).

RESULTS

In total, 35 recommendations/statements related to (i) ANA testing and reporting by HEp-2 IFA; (ii) HEp-2 IFA methodological aspects including substrate/conjugate selection and the application of CAD systems; (iii) quality assurance; (iv) HEp-2 IFA validation/verification approaches and (v) SPA were formulated. Globally, 95% of all submitted scores in the final Delphi round were above 6 (moderately agree, agree or strongly agree) and 85% above 7 (agree and strongly agree), indicating strong international support for the proposed recommendations.

CONCLUSIONS

These recommendations are an important step to achieve high quality ANA testing.

Repository of intra- and inter-run variations of quantitative autoantibody assays: a European multicenter study

OBJECTIVES

No reference data are available on repositories to measure precision of autoantibody assays. The scope of this study was to document inter- and intra-run variations of quantitative autoantibody assays based on a real-world large international data set.

METHODS

Members of the European Autoimmunity Standardisation Initiative (EASI) group collected the data of intra- and inter-run variability obtained with assays quantifying 15 different autoantibodies in voluntary participating laboratories from their country. We analyzed the impact on the assay performances of the type of immunoassay, the number of measurements used to calculate the coefficient of variation (CVs), the nature and the autoantibody level of the internal quality control (IQC).

RESULTS

Data were obtained from 64 laboratories from 15 European countries between February and October 2021. We analyzed 686 and 1,331 values of intra- and inter-run CVs, respectively. Both CVs were significantly dependent on: the method of immunoassay, the level of IQC with higher imprecision observed when the antibody levels were lower than 2-fold the threshold for positivity, and the nature of the IQC with commercial IQCs having lower CVs than patients-derived IQCs. Our analyses also show that the type of autoantibody has low impact on the assay' performances and that 15 measurements are sufficient to establish reliable intra- and inter-run variations.

CONCLUSIONS

This study provides for the first time an international repository yielding values of intra- and inter-run variation for quantitative autoantibody assays. These data could be useful for ISO 15189 accreditation requirements and will allow clinical diagnostic laboratories to assure quality of patient results.

Rational development and application of biomarkers in the field of autoimmunity: A conceptual framework guiding clinicians and researchers

Clear guidance is needed in the development and implementation of laboratory biomarkers in medicine. So far, no standardized phased approach is established that would pilot researchers and clinicians in this process. This leads to often incompletely validated biomarkers, which can bear the consequence of wrong applications, misinterpretation and inadequate management in the clinical context.

In this conceptual article, we describe a stepwise approach to develop and comprehensively validate laboratory biomarkers. We will delineate basic steps including technical performance, pre-analytical issues, and biological variation, as well as advanced aspects of biomarker utility comprising interpretability, diagnostic and prognostic accuracy, and health-care outcomes. These aspects will be illustrated by using well-known examples from the field of immunology.

The application of this conceptual framework will guide researchers in conducting meaningful projects to develop and evaluate biomarkers for the use in clinical practice. Furthermore, clinicians will be able to adequately interpret pre-clinical and clinical diagnostic literature and rationally apply biomarkers in clinical practice. Improvement in the implementation and application of biomarkers might relevantly change the management and outcomes of our patients for the better.

The Role of Autoantibodies in the Diagnosis of Autoimmune Liver Disease: Lessons Learned from Clinical Practice

BACKGROUND

Primary biliary cholangitis (PBC), autoimmune hepatitis (AIH) and primary sclerosing cholangitis (PSC) are autoimmune liver diseases associated with distinct autoantibodies. Diagnosis is based upon clinical, serological, and histopathology findings. The role of autoantibodies in the diagnosis of these autoimmune liver diseases, with the focus on PBC and AIH, will be discussed.

CONTENT

When AIH or PBC is suspected, testing for multiple autoantibodies can be requested. In this mini-review, the different ways in which autoantibodies can be tested (indirect immunofluorescence and antigen-specific tests) in the context of PBC and AIH are discussed, as well as the pitfalls in interpreting the test results.

SUMMARY

For appropriate interpretation of test results, an important prerequisite is that the doctor knows which test is used in the laboratory of choice and that the laboratory specialist is aware of what the doctor wants to test for. Good communication between clinician and laboratory specialist can, therefore, aid in the diagnosis of autoimmune liver diseases.

ANCA Testing in Clinical Practice: From Implementation to Quality Control and Harmonization

Analyses for the presence of anti-neutrophil cytoplasmic antibodies (ANCA) are important in the diagnostic work-up of patients with small vessel vasculitis. Since current immuno-assays are predominantly designed for diagnosis of patients with ANCA-associated vasculitis (AAV), implementation in routine clinical practice, internal and external quality control, and harmonization are focused on this particular use. However, ANCA testing may also be relevant for monitoring therapy efficacy and for predicting a clinical relapse in AAV patients, and even for diagnostic purposes in other clinical situations. In the current review, the topics of implementation, quality control, and standardization vs. harmonization are discussed while taking into account the different applications of the ANCA assays in the context of AAV.

Comparison of different immunoassays for the detection of antibodies against Intrinsic Factor and Parietal Cells

OBJECTIVES

In the diagnostic work up of autoimmune gastritis several immunological methods are available for the detection of antibodies against Intrinsic Factor (IF) and Parietal Cells (PC). However, there are no recent reports directly comparing all the available assays and methods. The objective of this study was to compare the performance of several commercially available anti-IF and anti-PC antibody assays from different manufacturers in a multi-center multi-cohort setting.

METHODS

Sera were used from 5 different cohorts consisting of samples from 25 healthy elderly, 20 HCV or HIV positive patients and 150 patients positive for anti-IF or anti-PC antibodies or in whom these antibodies were requested. These cohorts were tested for anti-IF antibodies with 6 different assays (IIF, ELISA, DIA and EliA) and for anti-PC antibodies with 7 different assays (IIF, ELISA, DIA and EliA). Performance was evaluated by calculating the concordance and relative sensitivity and specificity.

RESULTS

Good concordance was found between the assays for both antibody specificities, ranging from 81 to 100% and 91-100% for anti-IF and anti-PC antibodies, respectively. Highest relative sensitivity was found with the (automated) ELISA based methods. However, all assays had a relative sensitivity between 85 and 100% for anti-IF antibodies and between 95 and 100% for anti-PC antibodies. The relative specificity ranged between 76 and 100% for anti-IF antibodies and between 96 and 100% for anti-PC antibodies.

CONCLUSIONS

We conclude that most assays perform well and are concordant to each other, despite the methodological differences and the different sources of antigen used. However, the method used affects the sensitivity and specificity. The (automated) ELISA based assays have the highest relative sensitivity and relative specificity. Care should be taken in the interpretation of positive results by IIF and negative results by the Blue Diver when testing for anti-IF antibodies.

Quality and best practice in medical laboratories: specific requests for autoimmunity testing

Special conditions associated with laboratory autoimmune testing are not well compatible with recent developments in regulatory frameworks such as EN/ISO 15189 accreditation or in vitro diagnostic medical device regulation (IVD-R). In addition, international recommendations, guidelines and disease criteria are poorly defined with respect to requirements on autoantibody testing. Laboratory specialists from Austria, Belgium, Croatia, Estonia, Finland, France, Germany, Greece, Hungary, Italy, Norway, Poland, Portugal, South Africa, Spain, Sweden, Switzerland, and The Netherlands collected information, reported national experience, and identified quality issues in relation to autoantibody testing that require consensus on interpretation of the regulatory frameworks and guidelines. This process has been organized by the European Autoimmunity Standardisation Initiative (EASI). By identifying the critical items and looking for a consensus, our objective was to define a framework for, in particular, EN/ISO accreditation purposes. Here, we present a review of current publications and guidelines in this field to unify national guidelines and deliver in this way a European handout on quality control and accreditation for laboratories involved in autoantibody testing. We focus on quality items that can be checked during accreditation visits. Despite various local varieties, we encountered an overwhelming dedication to quality assurance in all contributing countries.

Precision of autoantibody assays in clinical diagnostic laboratories: What is the reality?

BACKGROUND

ISO 15189 accreditation remains a challenge for specialized laboratories. In the field of autoimmunity, beside the crucial problem of absence of standardization, laboratories have to manage the analytical performances of the large panel of assays in terms of sensitivity and specificity, but also on their measurement precision for which no reference values are available on biorepositories.

METHODS

As an initiative of the French EASI (European Autoimmunity Standardization Initiative) group, French clinical diagnostic laboratories were requested to participate in a survey aiming to analyze the coefficients of variation (CVs) of intra-run and inter-run variability obtained with assays quantifying 14 different autoantibodies. Two performance goals corresponding to the 90th percentile and the 50th percentile (lowest CV values reached by 90% and 50% of laboratories respectively) defined for three levels of concentration were calculated. The impact on the assay performances of the number of measurements, of the nature of the internal quality control (IQC) and the type of immunoassay, was also analyzed.

RESULTS

414 and 616 values of intra-run and inter-run CVs were collected, respectively. The 50th percentile performance goals were comprised between 1.0% and 8.9% for the intra-run CVs, and between 1.8% and 14.6% for the inter-run CVs. At 90th percentile, the performance goals were comprised between 3.2% and 13.5% for the intra-run CVs, and between 7.3% and 30.8% for the inter-run CVs. CVs calculated from 10 values were similar to those obtained from more values. Higher imprecision was observed when the antibody levels of the IQC was lower than 2 fold the positive threshold. Commercial IQCs gave lower CVs than IQCs derived from patient samples.

CONCLUSION

Our results allow proposing some acceptability limits for the precision performances of the autoantibody assays, compatible with the reality of life in diagnostic laboratories and clinical care.