1
|
Baxter JSH, Eagleson R. Exploring the values underlying machine learning research in medical image analysis. Med Image Anal 2025; 102:103494. [PMID: 40020419 DOI: 10.1016/j.media.2025.103494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 01/26/2025] [Accepted: 02/01/2025] [Indexed: 03/03/2025]
Abstract
Machine learning has emerged as a crucial tool for medical image analysis, largely due to recent developments in deep artificial neural networks addressing numerous, diverse clinical problems. As with any conceptual tool, the effective use of machine learning should be predicated on an understanding of its underlying motivations just as much as algorithms or theory - and to do so, we need to explore its philosophical foundations. One of these foundations is the understanding of how values, despite being non-empirical, nevertheless affect scientific research. This article has three goals: to introduce the reader to values in a way that is specific to medical image analysis; to characterise a particular set of technical decisions (what we call the end-to-end vs. separable learning spectrum) that are fundamental to machine learning for medical image analysis; and to create a simple and structured method to show how these values can be rigorously connected to these technical decisions. This better understanding of how the philosophy of science can clarify fundamental elements of how medical image analysis research is performed and can be improved.
Collapse
Affiliation(s)
- John S H Baxter
- Laboratoire Traitement du Signal et de l'Image (LTSI, INSERM UMR 1099), Université de Rennes, Rennes, France.
| | - Roy Eagleson
- Biomedical Engineering Graduate Program, Western University, London, Canada
| |
Collapse
|
2
|
Meeus M, Beirnaert C, Mahieu L, Laukens K, Meysman P, Mulder A, Van Laere D. Clinical Decision Support for Improved Neonatal Care: The Development of a Machine Learning Model for the Prediction of Late-onset Sepsis and Necrotizing Enterocolitis. J Pediatr 2024; 266:113869. [PMID: 38065281 DOI: 10.1016/j.jpeds.2023.113869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 11/24/2023] [Accepted: 12/04/2023] [Indexed: 01/08/2024]
Abstract
OBJECTIVE To develop an artificial intelligence-based software system for predicting late-onset sepsis (LOS) and necrotizing enterocolitis (NEC) in infants admitted to the neonatal intensive care unit (NICU). STUDY DESIGN Single-center, retrospective cohort study, conducted in the NICU of the Antwerp University Hospital. Continuous monitoring data of 865 preterm infants born at <32 weeks gestational age, admitted to the NICU in the first week of life, were used to train an XGBoost machine learning (ML) algorithm for LOS and NEC prediction in a cross-validated setup. Afterward, the model's performance was assessed on an independent test set of 148 patients (internal validation). RESULTS The ML model delivered hourly risk predictions with an overall sensitivity of 69% (142/206) for all LOS/NEC episodes and 81% (67/83) for severe LOS/NEC episodes. The model showed a median time gain of ≤10 hours (IQR, 3.1-21.0 hours), compared with historical clinical diagnosis. On the complete retrospective dataset, the ML model made 721 069 predictions, of which 9805 (1.3%) depicted a LOS/NEC probability of ≥0.15, resulting in a total alarm rate of <1 patient alarm-day per week. The model reached a similar performance on the internal validation set. CONCLUSIONS Artificial intelligence technology can assist clinicians in the early detection of LOS and NEC in the NICU, which potentially can result in clinical and socioeconomic benefits. Additional studies are required to quantify further the effect of combining artificial and human intelligence on patient outcomes in the NICU.
Collapse
Affiliation(s)
- Marisse Meeus
- Department of Neonatal Intensive Care, Antwerp University Hospital, Edegem, Belgium; Laboratory of Experimental Medicine and Pediatrics, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerpen, Belgium.
| | - Charlie Beirnaert
- Department of Neonatal Intensive Care, Antwerp University Hospital, Edegem, Belgium; Innocens BV, Antwerpen, Belgium; Department of Computer Science, University of Antwerp, Antwerpen, Belgium
| | - Ludo Mahieu
- Department of Neonatal Intensive Care, Antwerp University Hospital, Edegem, Belgium; Laboratory of Experimental Medicine and Pediatrics, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerpen, Belgium
| | - Kris Laukens
- Department of Computer Science, University of Antwerp, Antwerpen, Belgium
| | - Pieter Meysman
- Department of Computer Science, University of Antwerp, Antwerpen, Belgium
| | - Antonius Mulder
- Department of Neonatal Intensive Care, Antwerp University Hospital, Edegem, Belgium; Laboratory of Experimental Medicine and Pediatrics, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerpen, Belgium
| | - David Van Laere
- Department of Neonatal Intensive Care, Antwerp University Hospital, Edegem, Belgium; Laboratory of Experimental Medicine and Pediatrics, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerpen, Belgium; Innocens BV, Antwerpen, Belgium
| |
Collapse
|
3
|
Rajendran S, Pan W, Sabuncu MR, Chen Y, Zhou J, Wang F. Learning across diverse biomedical data modalities and cohorts: Challenges and opportunities for innovation. PATTERNS (NEW YORK, N.Y.) 2024; 5:100913. [PMID: 38370129 PMCID: PMC10873158 DOI: 10.1016/j.patter.2023.100913] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
In healthcare, machine learning (ML) shows significant potential to augment patient care, improve population health, and streamline healthcare workflows. Realizing its full potential is, however, often hampered by concerns about data privacy, diversity in data sources, and suboptimal utilization of different data modalities. This review studies the utility of cross-cohort cross-category (C4) integration in such contexts: the process of combining information from diverse datasets distributed across distinct, secure sites. We argue that C4 approaches could pave the way for ML models that are both holistic and widely applicable. This paper provides a comprehensive overview of C4 in health care, including its present stage, potential opportunities, and associated challenges.
Collapse
Affiliation(s)
- Suraj Rajendran
- Tri-Institutional Computational Biology & Medicine Program, Cornell University, Ithaca, NY, USA
| | - Weishen Pan
- Division of Health Informatics, Department of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA
| | - Mert R. Sabuncu
- School of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
- Cornell Tech, Cornell University, New York, NY, USA
- Department of Radiology, Weill Cornell Medical School, New York, NY, USA
| | - Yong Chen
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, PA, USA
| | - Jiayu Zhou
- Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USA
| | - Fei Wang
- Division of Health Informatics, Department of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA
| |
Collapse
|
4
|
Keim-Malpass J, Kausch SL. Data Science and Precision Oncology Nursing: Creating an Analytic Ecosystem to Support Personalized Supportive Care across the Trajectory of Illness. Semin Oncol Nurs 2023; 39:151432. [PMID: 37149440 PMCID: PMC10330746 DOI: 10.1016/j.soncn.2023.151432] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 03/27/2023] [Indexed: 05/08/2023]
Abstract
OBJECTIVES The authors' objective is to present an overarching framework of an analytic ecosystem using diverse data domains and data science approaches that can be used and implemented across the cancer continuum. Analytic ecosystems can improve quality practices and offer enhanced anticipatory guidance in the era of precision oncology nursing. DATA SOURCES Published scientific articles supporting the development of a novel framework with a case exemplar to provide applied examples of current barriers in data integration and use. CONCLUSION The combination of diverse data sets and data science analytic approaches has the potential to extend precision oncology nursing research and practice. Integration of this framework can be implemented within a learning health system where models can update as new data become available across the continuum of the cancer care trajectory. To date, data science approaches have been underused in extending personalized toxicity assessments, precision supportive care, and enhancing end-of-life care practices. IMPLICATIONS FOR NURSING PRACTICE Nurses and nurse scientists have a unique role in the convergence of data science applications to support precision oncology across the trajectory of illness. Nurses also have specific expertise in supportive care needs that have been dramatically underrepresented in existing data science approaches thus far. They also have a role in centering the patient and family perspectives and needs as these frameworks and analytic capabilities evolve.
Collapse
Affiliation(s)
- Jessica Keim-Malpass
- Associate Professor, Department of Pediatrics, University of Virginia School of Medicine, Charlottesville, Virginia, USA; Member, Center for Advanced Medical Analytics, University of Virginia, Charlottesville, Virginia, USA.
| | - Sherry L Kausch
- Member, Center for Advanced Medical Analytics, University of Virginia, Charlottesville, Virginia, USA; Data scientist, Department of Pediatrics, University of Virginia, Charlottesville, Virginia, USA
| |
Collapse
|
5
|
Niraula D, Sun W, Jin J, Dinov ID, Cuneo K, Jamaluddin J, Matuszak MM, Luo Y, Lawrence TS, Jolly S, Ten Haken RK, El Naqa I. A clinical decision support system for AI-assisted decision-making in response-adaptive radiotherapy (ARCliDS). Sci Rep 2023; 13:5279. [PMID: 37002296 PMCID: PMC10066294 DOI: 10.1038/s41598-023-32032-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 03/21/2023] [Indexed: 04/03/2023] Open
Abstract
Involvement of many variables, uncertainty in treatment response, and inter-patient heterogeneity challenge objective decision-making in dynamic treatment regime (DTR) in oncology. Advanced machine learning analytics in conjunction with information-rich dense multi-omics data have the ability to overcome such challenges. We have developed a comprehensive artificial intelligence (AI)-based optimal decision-making framework for assisting oncologists in DTR. In this work, we demonstrate the proposed framework to Knowledge Based Response-Adaptive Radiotherapy (KBR-ART) applications by developing an interactive software tool entitled Adaptive Radiotherapy Clinical Decision Support (ARCliDS). ARCliDS is composed of two main components: Artifcial RT Environment (ARTE) and Optimal Decision Maker (ODM). ARTE is designed as a Markov decision process and modeled via supervised learning. Given a patient's pre- and during-treatment information, ARTE can estimate treatment outcomes for a selected daily dosage value (radiation fraction size). ODM is formulated using reinforcement learning and is trained on ARTE. ODM can recommend optimal daily dosage adjustments to maximize the tumor local control probability and minimize the side effects. Graph Neural Networks (GNN) are applied to exploit the inter-feature relationships for improved modeling performance and a novel double GNN architecture is designed to avoid nonphysical treatment response. Datasets of size 117 and 292 were available from two clinical trials on adaptive RT in non-small cell lung cancer (NSCLC) patients and adaptive stereotactic body RT (SBRT) in hepatocellular carcinoma (HCC) patients, respectively. For training and validation, dense data with 297 features were available for 67 NSCLC patients and 110 features for 71 HCC patients. To increase the sample size for ODM training, we applied Generative Adversarial Networks to generate 10,000 synthetic patients. The ODM was trained on the synthetic patients and validated on the original dataset. We found that, Double GNN architecture was able to correct the nonphysical dose-response trend and improve ARCliDS recommendation. The average root mean squared difference (RMSD) between ARCliDS recommendation and reported clinical decisions using double GNNs were 0.61 [0.03] Gy/frac (mean [sem]) for adaptive RT in NSCLC patients and 2.96 [0.42] Gy/frac for adaptive SBRT HCC compared to the single GNN's RMSDs of 0.97 [0.12] Gy/frac and 4.75 [0.16] Gy/frac, respectively. Overall, For NSCLC and HCC, ARCliDS with double GNNs was able to reproduce 36% and 50% of the good clinical decisions (local control and no side effects) and improve 74% and 30% of the bad clinical decisions, respectively. In conclusion, ARCliDS is the first web-based software dedicated to assist KBR-ART with multi-omics data. ARCliDS can learn from the reported clinical decisions and facilitate AI-assisted clinical decision-making for improving the outcomes in DTR.
Collapse
Affiliation(s)
- Dipesh Niraula
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA.
| | - Wenbo Sun
- University of Michigan Transport Research Institute, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Jionghua Jin
- Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Ivo D Dinov
- Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Kyle Cuneo
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Jamalina Jamaluddin
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Martha M Matuszak
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
- Department of Nuclear Engineering and Radiological Sciences, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Yi Luo
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Theodore S Lawrence
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Shruti Jolly
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Randall K Ten Haken
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, 48109, USA
| | - Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| |
Collapse
|
6
|
Jin W, Li X, Fatehi M, Hamarneh G. Guidelines and evaluation of clinical explainable AI in medical image analysis. Med Image Anal 2023; 84:102684. [PMID: 36516555 DOI: 10.1016/j.media.2022.102684] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 10/20/2022] [Accepted: 11/03/2022] [Indexed: 11/18/2022]
Abstract
Explainable artificial intelligence (XAI) is essential for enabling clinical users to get informed decision support from AI and comply with evidence-based medical practice. Applying XAI in clinical settings requires proper evaluation criteria to ensure the explanation technique is both technically sound and clinically useful, but specific support is lacking to achieve this goal. To bridge the research gap, we propose the Clinical XAI Guidelines that consist of five criteria a clinical XAI needs to be optimized for. The guidelines recommend choosing an explanation form based on Guideline 1 (G1) Understandability and G2 Clinical relevance. For the chosen explanation form, its specific XAI technique should be optimized for G3 Truthfulness, G4 Informative plausibility, and G5 Computational efficiency. Following the guidelines, we conducted a systematic evaluation on a novel problem of multi-modal medical image explanation with two clinical tasks, and proposed new evaluation metrics accordingly. Sixteen commonly-used heatmap XAI techniques were evaluated and found to be insufficient for clinical use due to their failure in G3 and G4. Our evaluation demonstrated the use of Clinical XAI Guidelines to support the design and evaluation of clinically viable XAI.
Collapse
Affiliation(s)
- Weina Jin
- School of Computing Science, Simon Fraser University, Burnaby, BC, V5A 1S6, Canada.
| | - Xiaoxiao Li
- Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, V6T 1Z4, Canada.
| | - Mostafa Fatehi
- Division of Neurosurgery, The University of British Columbia, Vancouver, BC, V5Z 1M9, Canada.
| | - Ghassan Hamarneh
- School of Computing Science, Simon Fraser University, Burnaby, BC, V5A 1S6, Canada.
| |
Collapse
|
7
|
Niraula D, Cui S, Pakela J, Wei L, Luo Y, Ten Haken RK, El Naqa I. Current status and future developments in predicting outcomes in radiation oncology. Br J Radiol 2022; 95:20220239. [PMID: 35867841 PMCID: PMC9793488 DOI: 10.1259/bjr.20220239] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023] Open
Abstract
Advancements in data-driven technologies and the inclusion of information-rich multiomics features have significantly improved the performance of outcomes modeling in radiation oncology. For this current trend to be sustainable, challenges related to robust data modeling such as small sample size, low size to feature ratio, noisy data, as well as issues related to algorithmic modeling such as complexity, uncertainty, and interpretability, need to be mitigated if not resolved. Emerging computational technologies and new paradigms such as federated learning, human-in-the-loop, quantum computing, and novel interpretability methods show great potential in overcoming these challenges and bridging the gap towards precision outcome modeling in radiotherapy. Examples of these promising technologies will be presented and their potential role in improving outcome modeling will be discussed.
Collapse
Affiliation(s)
- Dipesh Niraula
- Department of Machine Learning, H Lee Moffitt Cancer Center and Research Institute, Tampa, USA
| | - Sunan Cui
- Department of Radiation Oncology, Stanford Medicine, Stanford University, Stanford, USA
| | - Julia Pakela
- Department of Radiation Oncology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, USA
| | - Lise Wei
- Department of Radiation Oncology, University of Michigan, Ann Arbor, USA
| | - Yi Luo
- Department of Machine Learning, H Lee Moffitt Cancer Center and Research Institute, Tampa, USA
| | | | - Issam El Naqa
- Department of Machine Learning, H Lee Moffitt Cancer Center and Research Institute, Tampa, USA
| |
Collapse
|
8
|
Mang JM, Seuchter SA, Gulden C, Schild S, Kraska D, Prokosch HU, Kapsner LA. DQAgui: a graphical user interface for the MIRACUM data quality assessment tool. BMC Med Inform Decis Mak 2022; 22:213. [PMID: 35953813 PMCID: PMC9367129 DOI: 10.1186/s12911-022-01961-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 08/03/2022] [Indexed: 11/11/2022] Open
Abstract
Background With the growing impact of observational research studies, there is also a growing focus on data quality (DQ). As opposed to experimental study designs, observational research studies are performed using data mostly collected in a non-research context (secondary use). Depending on the number of data elements to be analyzed, DQ reports of data stored within research networks can grow very large. They might be cumbersome to read and important information could be overseen quickly. To address this issue, a DQ assessment (DQA) tool with a graphical user interface (GUI) was developed and provided as a web application. Methods The aim was to provide an easy-to-use interface for users without prior programming knowledge to carry out DQ checks and to present the results in a clearly structured way. This interface serves as a starting point for a more detailed investigation of possible DQ irregularities. A user-centered development process ensured the practical feasibility of the interactive GUI. The interface was implemented in the R programming language and aligned to Kahn et al.’s DQ categories conformance, completeness and plausibility. Results With DQAgui, an R package with a web-app frontend for DQ assessment was developed. The GUI allows users to perform DQ analyses of tabular data sets and to systematically evaluate the results. During the development of the GUI, additional features were implemented, such as analyzing a subset of the data by defining time periods and restricting the analyses to certain data elements. Conclusions As part of the MIRACUM project, DQAgui is now being used at ten German university hospitals for DQ assessment and to provide a central overview of the availability of important data elements in a datamap over 2 years. Future development efforts should focus on design optimization and include a usability evaluation. Supplementary Information The online version contains supplementary material available at 10.1186/s12911-022-01961-z.
Collapse
Affiliation(s)
- Jonathan M Mang
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany.
| | - Susanne A Seuchter
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Christian Gulden
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Stefanie Schild
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany.,Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Detlef Kraska
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany.,Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Lorenz A Kapsner
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany.,Institute of Radiology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|