A Machine Learning Approach to the Classification of Acute Leukemias and Distinction From Nonneoplastic Cytopenias Using Flow Cytometry Data

Machine learning-based clinical decision support using laboratory data

Artificial intelligence (AI) and machine learning (ML) are becoming vital in laboratory medicine and the broader context of healthcare. In this review article, we summarized the development of ML models and how they contribute to clinical laboratory workflow and improve patient outcomes. The process of ML model development involves data collection, data cleansing, feature engineering, model development, and optimization. These models, once finalized, are subjected to thorough performance assessments and validations. Recently, due to the complexity inherent in model development, automated ML tools were also introduced to streamline the process, enabling non-experts to create models. Clinical Decision Support Systems (CDSS) use ML techniques on large datasets to aid healthcare professionals in test result interpretation. They are revolutionizing laboratory medicine, enabling labs to work more efficiently with less human supervision across pre-analytical, analytical, and post-analytical phases. Despite contributions of the ML tools at all analytical phases, their integration presents challenges like potential model uncertainties, black-box algorithms, and deskilling of professionals. Additionally, acquiring diverse datasets is hard, and models' complexity can limit clinical use. In conclusion, ML-based CDSS in healthcare can greatly enhance clinical decision-making. However, successful adoption demands collaboration among professionals and stakeholders, utilizing hybrid intelligence, external validation, and performance assessments.

Critical test result management at Danish hospital laboratories: a national survey

Critical test results in clinical laboratories are crucial for timely patient care, serving as indicators of potentially life-threatening conditions. Despite their importance, a notable heterogeneity in management practices exists globally. This study investigates the current practices of managing critical results at Danish clinical biochemistry laboratories and identifies areas prone for improvement. A comprehensive online survey was distributed to all 21 Danish clinical biochemistry laboratories regarding their critical result management, including documentation practices, critical limit selection, and quality assurance measures. A total of 17 laboratories (81%) responded. The answers revealed a generally uniform approach to managing critical results, with all laboratories having 24-h reporting, local instructions and using the telephone as communication channel. However, variations were noted in documentation practices and critical limit selection. Notably, 23.5% of the laboratories reported that one out of every ten critical results was not reported, indicating a significant risk of delayed critical results. This is further complicated by the limited use of predefined timeframes for reporting and also, only few laboratories actively monitored response times. The findings emphasize the need for more standardized documentation and evaluation practices to align with international standards and to enhance patient safety. While the laboratories showed a commitment to standardized procedures, the study emphasizes the necessity of a National or Nordic guideline to supplement the ISO 15189:2022. This study is a step towards optimizing critical result management, not only in Danish clinical biochemistry laboratories but also across various laboratory specialties, thereby improving overall laboratory quality, efficiency, and patient safety.

Deep learning assists in acute leukemia detection and cell classification via flow cytometry using the acute leukemia orientation tube

This study aimed to evaluate the sensitivity of AI in screening acute leukemia and its capability to classify either physiological or pathological cells. Utilizing an acute leukemia orientation tube (ALOT), one of the protocols of Euroflow, flow cytometry efficiently identifies various forms of acute leukemia. However, the analysis of flow cytometry can be time-consuming work. This retrospective study included 241 patients who underwent flow cytometry examination using ALOT between 2017 and 2022. The collected flow cytometry data were used to train an artificial intelligence using deep learning. The trained AI demonstrated a 94.6% sensitivity in detecting acute myeloid leukemia (AML) patients and a 98.2% sensitivity for B-lymphoblastic leukemia (B-ALL) patients. The sensitivities of physiological cells were at least 80%, with variable performance for pathological cells. In conclusion, the AI, trained with ResNet-50 and EverFlow, shows promising results in identifying patients with AML and B-ALL, as well as classifying physiological cells.

Validation of Artificial Intelligence (AI)-Assisted Flow Cytometry Analysis for Immunological Disorders

Flow cytometry is a vital diagnostic tool for hematologic and immunologic disorders, but manual analysis is prone to variation and time-consuming. Over the last decade, artificial intelligence (AI) has advanced significantly. In this study, we developed and validated an AI-assisted flow cytometry workflow using 379 clinical cases from 2021, employing a 3-tube, 10-color flow panel with 21 antibodies for primary immunodeficiency diseases and related immunological disorders. The AI software (DeepFlow™, version 2.1.1) is fully automated, reducing analysis time to under 5 min per case. It interacts with hematopatholoists for manual gating adjustments when necessary. Using proprietary multidimensional density-phenotype coupling algorithm, the AI model accurately classifies and enumerates T, B, and NK cells, along with important immune cell subsets, including CD4+ helper T cells, CD8+ cytotoxic T cells, CD3+/CD4-/CD8- double-negative T cells, and class-switched or non-switched B cells. Compared to manual analysis with hematopathologist-determined lymphocyte subset percentages as the gold standard, the AI model exhibited a strong correlation (r > 0.9) across lymphocyte subsets. This study highlights the accuracy and efficiency of AI-assisted flow cytometry in diagnosing immunological disorders in a clinical setting, providing a transformative approach within a concise timeframe.

Using Artificial Intelligence to Interpret Clinical Flow Cytometry Datasets for Automated Disease Diagnosis and/or Monitoring

Flow cytometry (FC) is routinely used for hematological disease diagnosis and monitoring. Advancement in this technology allows us to measure an increasing number of markers simultaneously, generating complex high-dimensional datasets. However, current analytic software and methods rely on experienced analysts to perform labor-intensive manual inspection and interpretation on a series of 2-dimensional plots via a complex, sequential gating process. With an aggravating shortage of professionals and growing demands, it is very challenging to provide the FC analysis results in a fast, accurate, and reproducible way. Artificial intelligence has been widely used in many sectors to develop automated detection or classification tools. Here we describe a type of machine learning method for developing automated disease classification and residual disease monitoring on clinical flow datasets.

Machine learning applications and challenges in graft-versus-host disease: a scoping review

PURPOSE OF REVIEW

This review delves into the potential of artificial intelligence (AI), particularly machine learning (ML), in enhancing graft-versus-host disease (GVHD) risk assessment, diagnosis, and personalized treatment.

RECENT FINDINGS

Recent studies have demonstrated the superiority of ML algorithms over traditional multivariate statistical models in donor selection for allogeneic hematopoietic stem cell transplantation. ML has recently enabled dynamic risk assessment by modeling time-series data, an upgrade from the static, "snapshot" assessment of patients that conventional statistical models and older ML algorithms offer. Regarding diagnosis, a deep learning model, a subset of ML, can accurately identify skin segments affected with chronic GVHD with satisfactory results. ML methods such as Q-learning and deep reinforcement learning have been utilized to develop adaptive treatment strategies (ATS) for the personalized prevention and treatment of acute and chronic GVHD.

SUMMARY

To capitalize on these promising advancements, there is a need for large-scale, multicenter collaborations to develop generalizable ML models. Furthermore, addressing pertinent issues such as the implementation of stringent ethical guidelines is crucial before the widespread introduction of AI into GVHD care.

A cell-level discriminative neural network model for diagnosis of blood cancers

MOTIVATION

Precise identification of cancer cells in patient samples is essential for accurate diagnosis and clinical monitoring but has been a significant challenge in machine learning approaches for cancer precision medicine. In most scenarios, training data are only available with disease annotation at the subject or sample level. Traditional approaches separate the classification process into multiple steps that are optimized independently. Recent methods either focus on predicting sample-level diagnosis without identifying individual pathologic cells or are less effective for identifying heterogeneous cancer cell phenotypes.

RESULTS

We developed a generalized end-to-end differentiable model, the Cell Scoring Neural Network (CSNN), which takes sample-level training data and predicts the diagnosis of the testing samples and the identity of the diagnostic cells in the sample, simultaneously. The cell-level density differences between samples are linked to the sample diagnosis, which allows the probabilities of individual cells being diagnostic to be calculated using backpropagation. We applied CSNN to two independent clinical flow cytometry datasets for leukemia diagnosis. In both qualitative and quantitative assessments, CSNN outperformed preexisting neural network modeling approaches for both cancer diagnosis and cell-level classification. Post hoc decision trees and 2D dot plots were generated for interpretation of the identified cancer cells, showing that the identified cell phenotypes match the cancer endotypes observed clinically in patient cohorts. Independent data clustering analysis confirmed the identified cancer cell populations.

AVAILABILITY AND IMPLEMENTATION

The source code of CSNN and datasets used in the experiments are publicly available on GitHub (http://github.com/erobl/csnn). Raw FCS files can be downloaded from FlowRepository (ID: FR-FCM-Z6YK).

Artificial Intelligence for Clinical Flow Cytometry

In this review, the authors discuss the fundamental principles of machine learning. They explore recent studies and approaches in implementing machine learning into flow cytometry workflows. These applications are promising but not without their shortcomings. Explainability may be the biggest barrier to adoption, as they contain "black boxes" in which a complex network of mathematical processes learns features of data that are not translatable into real language. The authors discuss the current limitations of machine learning models and the possibility that, without a multiinstitutional development process, these applications could have poor generalizability. They also discuss widespread deployment of augmented decision-making.

A cell-level discriminative neural network model for diagnosis of blood cancers

Motivation

Precise identification of cancer cells in patient samples is essential for accurate diagnosis and clinical monitoring but has been a significant challenge in machine learning approaches for cancer precision medicine. In most scenarios, training data are only available with disease annotation at the subject or sample level. Traditional approaches separate the classification process into multiple steps that are optimized independently. Recent methods either focus on predicting sample-level diagnosis without identifying individual pathologic cells or are less effective for identifying heterogeneous cancer cell phenotypes.

Results

We developed a generalized end-to-end differentiable model, the Cell Scoring Neural Network (CSNN), which takes the available sample-level training data and predicts both the diagnosis of the testing samples and the identity of the diagnostic cells in the sample, simultaneously. The cell-level density differences between samples are linked to the sample diagnosis, which allows the probabilities of individual cells being diagnostic to be calculated using backpropagation. We applied CSNN to two independent clinical flow cytometry datasets for leukemia diagnosis. In both qualitative and quantitative assessments, CSNN outperformed preexisting neural network modeling approaches for both cancer diagnosis and cell-level classification. Post hoc decision trees and 2D dot plots were generated for interpretation of the identified cancer cells, showing that the identified cell phenotypes match the cancer endotypes observed clinically in patient cohorts. Independent data clustering analysis confirmed the identified cancer cell populations.

Availability

The source code of CSNN and datasets used in the experiments are publicly available on GitHub and FlowRepository.

Contact

Edgar E. Robles: roblesee@uci.edu and Yu Qian: mqian@jcvi.org.

Supplementary information

Supplementary data are available on GitHub and at Bioinformatics online.

Hematology and Machine Learning

BACKGROUND

Substantial improvements in computational power and machine learning (ML) algorithm development have vastly increased the limits of what autonomous machines are capable of. Since its beginnings in the 19th century, laboratory hematology has absorbed waves of progress yielding improvements in both of accuracy and efficiency. The next wave of change in laboratory hematology will be the result of the ML revolution that has already touched many corners of healthcare and society at large.

CONTENT

This review will describe the manifestations of ML and artificial intelligence (AI) already utilized in the clinical hematology laboratory. This will be followed by a topical summary of the innovative and investigational applications of this technology in each of the major subdomains within laboratory hematology.

SUMMARY

Application of this technology to laboratory hematology will increase standardization and efficiency by reducing laboratory staff involvement in automatable activities. This will unleash time and resources for focus on more meaningful activities such as the complexities of patient care, research and development, and process improvement.

Artificial intelligence applications in pediatric oncology diagnosis

Artificial intelligence (AI) algorithms have been applied in abundant medical tasks with high accuracy and efficiency. Physicians can improve their diagnostic efficiency with the assistance of AI techniques for improving the subsequent personalized treatment and surveillance. AI algorithms fundamentally capture data, identify underlying patterns, achieve preset endpoints, and provide decisions and predictions about real-world events with working principles of machine learning and deep learning. AI algorithms with sufficient graphic processing unit power have been demonstrated to provide timely diagnostic references based on preliminary training of large amounts of clinical and imaging data. The sample size issue is an inevitable challenge for pediatric oncology considering its low morbidity and individual heterogeneity. However, this problem may be solved in the near future considering the exponential advancements of AI algorithms technically to decrease the dependence of AI operation on the amount of data sets and the efficiency of computing power. For instance, it could be a feasible solution by shifting convolutional neural networks (CNNs) from adults and sharing CNN algorithms across multiple institutions besides original data. The present review provides important insights into emerging AI applications for the diagnosis of pediatric oncology by systematically overviewing of up-to-date literature.

A Chunking-for-Pooling Strategy for Cytometric Representation Learning for Automatic Hematologic Malignancy Classification

Differentiating types of hematologic malignancies is vital to determine therapeutic strategies for the newly diagnosed patients. Flow cytometry (FC) can be used as diagnostic indicator by measuring the multi-parameter fluorescent markers on thousands of antibody-bound cells, but the manual interpretation of large scale flow cytometry data has long been a time-consuming and complicated task for hematologists and laboratory professionals. Past studies have led to the development of representation learning algorithms to perform sample-level automatic classification. In this work, we propose a chunking-for-pooling strategy to include large-scale FC data into a supervised deep representation learning procedure for automatic hematologic malignancy classification. The use of discriminatively-trained representation learning strategy and the fixed-size chunking and pooling design are key components of this framework. It improves the discriminative power of the FC sample-level embedding and simultaneously addresses the robustness issue due to an inevitable use of down-sampling in conventional distribution based approaches for deriving FC representation. We evaluated our framework on two datasets. Our framework outperformed other baseline methods and achieved 92.3% unweighted average recall (UAR) for four-class recognition on the UPMC dataset and 85.0% UAR for five-class recognition on the hema.to dataset. We further compared the robustness of our proposed framework with that of the traditional downsampling approach. Analysis of the effects of the chunk size and the error cases revealed further insights about different hematologic malignancy characteristics in the FC data.