Presentation and formatting of laboratory results: a narrative review on behalf of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group "postanalytical phase" (WG-POST)

Harmonizing the post-analytical phase: focus on the laboratory report

The final, post-analytical, phase of laboratory testing is increasingly recognized as a fundamental step in maximizing quality and effectiveness of laboratory information. There is a need to close the loop of the total testing cycle by improving upon the laboratory report, and its notification to users. The harmonization of the post-analytical phase is somewhat complicated, mainly because it calls for communication that involves parties speaking different languages, including laboratorians, physicians, information technology specialists, and patients. Recently, increasing interest has been expressed in integrated diagnostics, defined as convergence of imaging, pathology, and laboratory tests with advanced information technology (IT). In particular, a common laboratory, radiology and pathology diagnostic reporting system that integrates text, sentinel images and molecular diagnostic data to an integrated, coherent interpretation enhances management decisions and improves quality of care.

The BioRef Infrastructure, a Framework for Real-Time, Federated, Privacy-Preserving, and Personalized Reference Intervals: Design, Development, and Application

BACKGROUND

Reference intervals (RIs) for patient test results are in standard use across many medical disciplines, allowing physicians to identify measurements indicating potentially pathological states with relative ease. The process of inferring cohort-specific RIs is, however, often ignored because of the high costs and cumbersome efforts associated with it. Sophisticated analysis tools are required to automatically infer relevant and locally specific RIs directly from routine laboratory data. These tools would effectively connect clinical laboratory databases to physicians and provide personalized target ranges for the respective cohort population.

OBJECTIVE

This study aims to describe the BioRef infrastructure, a multicentric governance and IT framework for the estimation and assessment of patient group-specific RIs from routine clinical laboratory data using an innovative decentralized data-sharing approach and a sophisticated, clinically oriented graphical user interface for data analysis.

METHODS

A common governance agreement and interoperability standards have been established, allowing the harmonization of multidimensional laboratory measurements from multiple clinical databases into a unified "big data" resource. International coding systems, such as the International Classification of Diseases, Tenth Revision (ICD-10); unique identifiers for medical devices from the Global Unique Device Identification Database; type identifiers from the Global Medical Device Nomenclature; and a universal transfer logic, such as the Resource Description Framework (RDF), are used to align the routine laboratory data of each data provider for use within the BioRef framework. With a decentralized data-sharing approach, the BioRef data can be evaluated by end users from each cohort site following a strict "no copy, no move" principle, that is, only data aggregates for the intercohort analysis of target ranges are exchanged.

RESULTS

The TI4Health distributed and secure analytics system was used to implement the proposed federated and privacy-preserving approach and comply with the limitations applied to sensitive patient data. Under the BioRef interoperability consensus, clinical partners enable the computation of RIs via the TI4Health graphical user interface for query without exposing the underlying raw data. The interface was developed for use by physicians and clinical laboratory specialists and allows intuitive and interactive data stratification by patient factors (age, sex, and personal medical history) as well as laboratory analysis determinants (device, analyzer, and test kit identifier). This consolidated effort enables the creation of extremely detailed and patient group-specific queries, allowing the generation of individualized, covariate-adjusted RIs on the fly.

CONCLUSIONS

With the BioRef-TI4Health infrastructure, a framework for clinical physicians and researchers to define precise RIs immediately in a convenient, privacy-preserving, and reproducible manner has been implemented, promoting a vital part of practicing precision medicine while streamlining compliance and avoiding transfers of raw patient data. This new approach can provide a crucial update on RIs and improve patient care for personalized medicine.

Potentials and pitfalls of ChatGPT and natural-language artificial intelligence models for the understanding of laboratory medicine test results. An assessment by the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group on Artificial Intelligence (WG-AI)

OBJECTIVES

ChatGPT, a tool based on natural language processing (NLP), is on everyone's mind, and several potential applications in healthcare have been already proposed. However, since the ability of this tool to interpret laboratory test results has not yet been tested, the EFLM Working group on Artificial Intelligence (WG-AI) has set itself the task of closing this gap with a systematic approach.

METHODS

WG-AI members generated 10 simulated laboratory reports of common parameters, which were then passed to ChatGPT for interpretation, according to reference intervals (RI) and units, using an optimized prompt. The results were subsequently evaluated independently by all WG-AI members with respect to relevance, correctness, helpfulness and safety.

RESULTS

ChatGPT recognized all laboratory tests, it could detect if they deviated from the RI and gave a test-by-test as well as an overall interpretation. The interpretations were rather superficial, not always correct, and, only in some cases, judged coherently. The magnitude of the deviation from the RI seldom plays a role in the interpretation of laboratory tests, and artificial intelligence (AI) did not make any meaningful suggestion regarding follow-up diagnostics or further procedures in general.

CONCLUSIONS

ChatGPT in its current form, being not specifically trained on medical data or laboratory data in particular, may only be considered a tool capable of interpreting a laboratory report on a test-by-test basis at best, but not on the interpretation of an overall diagnostic picture. Future generations of similar AIs with medical ground truth training data might surely revolutionize current processes in healthcare, despite this implementation is not ready yet.

A zlog-based algorithm and tool for plausibility checks of reference intervals

OBJECTIVES

Laboratory information systems typically contain hundreds or even thousands of reference limits stratified by sex and age. Since under these conditions a manual plausibility check is hardly feasible, we have developed a simple algorithm that facilitates this check. An open-source R tool is available as a Shiny application at github.com/SandraKla/Zlog_AdRI.

METHODS

Based on the zlog standardization, we can possibly detect critical jumps at the transitions between age groups, regardless of the analytical method or the measuring unit. Its advantage compared to the standard z-value is that means and standard deviations are calculated from the reference limits rather than from the underlying data itself. The purpose of the tool is illustrated by the example of reference intervals of children and adolescents from the Canadian Laboratory Initiative on Pediatric Reference Intervals (CALIPER).

RESULTS

The Shiny application identifies the zlog values, lists them in a colored table format and plots them additionally with the specified reference intervals. The algorithm detected several strong and rapid changes in reference intervals from the neonatal period to puberty. Remarkable jumps with absolute zlog values of more than five were seen for 29 out of 192 reference limits (15.1%). This might be attenuated by introducing shorter time periods or mathematical functions of reference limits over age.

CONCLUSIONS

Age-partitioned reference intervals will remain the standard in laboratory routine for the foreseeable future, and as such, algorithmic approaches like our zlog approach in the presented Shiny application will remain valuable tools for testing their plausibility on a wide scale.

Diagnostic Workup of Microcytic Anemia: An Evaluation of Underuse or Misuse of Laboratory Testing in a Hospital Setting Using the AlinIQ System

CONTEXT.—

Underuse of laboratory testing has been previously investigated in preselected populations, such as documented malpractice claims. However, these numbers might not reflect real-life situations.

OBJECTIVE.—

To evaluate the underuse and misuse of laboratory follow-up testing in a real-life hospital patient population with microcytic anemia, using laboratory results ordered during routine patient care.

DESIGN.—

From all patients in whom a microcytic anemia was detected during routine diagnostics in 2018, all available laboratory data were collected and screened for appropriateness of diagnostic workup of iron deficiency and thalassemia. Subgroup analysis was performed for patient groups with mean corpuscular volume values 75 to 79 μm3 (group 1), 65 to 74 μm3 (group 2), and <65 μm3 (group 3).

RESULTS.—

A total of 2244 patients with microcytic anemia were identified. Follow-up testing for iron deficiency was not performed in 761 cases (34%). For inconclusive ferritin levels due to elevated C-reactive protein results (n = 336), reticulocyte hemoglobin content or soluble transferrin receptor levels were missing in 86 cases (26%). In patients with suspected thalassemia (n = 127), follow-up testing for hemoglobin variants was not performed in 70 cases (55%). Subgroup analysis showed that the frequency of underuse of iron status as well as thalassemia/hemoglobinopathy testing decreased from group 1 to group 3. When considering relevant preexisting anemia diagnoses, laboratory tests were underused in 904 cases (40.3%).

CONCLUSIONS.—

Because 40% (n = 904) of the patients with microcytic anemia were potentially not followed up correctly, laboratory specialists are advised to act by implementing demand management strategies in collaboration with clinicians to overcome underuse of laboratory tests and to improve patient safety.

Big Data in Laboratory Medicine—FAIR Quality for AI?

Laboratory medicine is a digital science. Every large hospital produces a wealth of data each day—from simple numerical results from, e.g., sodium measurements to highly complex output of “-omics” analyses, as well as quality control results and metadata. Processing, connecting, storing, and ordering extensive parts of these individual data requires Big Data techniques. Whereas novel technologies such as artificial intelligence and machine learning have exciting application for the augmentation of laboratory medicine, the Big Data concept remains fundamental for any sophisticated data analysis in large databases. To make laboratory medicine data optimally usable for clinical and research purposes, they need to be FAIR: findable, accessible, interoperable, and reusable. This can be achieved, for example, by automated recording, connection of devices, efficient ETL (Extract, Transform, Load) processes, careful data governance, and modern data security solutions. Enriched with clinical data, laboratory medicine data allow a gain in pathophysiological insights, can improve patient care, or can be used to develop reference intervals for diagnostic purposes. Nevertheless, Big Data in laboratory medicine do not come without challenges: the growing number of analyses and data derived from them is a demanding task to be taken care of. Laboratory medicine experts are and will be needed to drive this development, take an active role in the ongoing digitalization, and provide guidance for their clinical colleagues engaging with the laboratory data in research.

Efficiency, efficacy and subjective user satisfaction of alternative laboratory report formats. An investigation on behalf of the Working Group for Postanalytical Phase (WG-POST), of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM)

OBJECTIVES

Although laboratory result presentation may lead to information overload and subsequent missed or delayed diagnosis, little has been done in the past to improve this post-analytical issue. We aimed to investigate the efficiency, efficacy and user satisfaction of alternative report formats.

METHODS

We redesigned cumulative (sparkline format) and single reports (improved tabular and z-log format) and tested these on 46 physicians, nurses and medical students in comparison to the classical tabular formats, by asking standardized questions on general items on the reports as well as on suspected diagnosis and follow-up treatment or diagnostics.

RESULTS

Efficacy remained at a very high level both in the new formats as well as in the classical formats. We found no significant difference in any of the groups. Efficiency improved in all groups when using the sparkline cumulative format and marginally when showing the improved tabular format. When asking medical questions, efficiency and efficacy remained similar between report formats and groups. All alternative reports were subjectively more attractive to the majority of participants.

CONCLUSIONS

Showing cumulative reports as a graphical display led to faster detection of general information on the report with the same level of correctness. Considering the familiarity bias of the classical single report formats, the borderline-significant improvement of the alternative tabular format and the non-inferiority of the z-log format, suggests that single reports might benefit from some improvements derived from basic information design.

Rise of the Machines: The Inevitable Evolution of Medicine and Medical Laboratories Intertwining with Artificial Intelligence-A Narrative Review

Laboratory medicine has evolved from a mainly manual profession, providing few selected test results to a highly automated and standardized medical discipline, generating millions of test results per year. As the next inevitable evolutional step, artificial intelligence (AI) algorithms will need to assist us in structuring and making sense of the masses of diagnostic data collected today. Such systems will be able to connect clinical and diagnostic data and to provide valuable suggestions in diagnosis, prognosis or therapeutic options. They will merge the often so separated worlds of the laboratory and the clinics. When used correctly, it will be a tool, capable of freeing the physicians time so that he/she can refocus on the patient. In this narrative review I therefore aim to provide an overview of what AI is, what applications currently are available in healthcare and in laboratory medicine in particular. I will discuss the challenges and pitfalls of applying AI algorithms and I will elaborate on the question if healthcare workers will be replaced by such systems in the near future.