1
|
Kong Q, Li K. Predicting early recurrence of hepatocellular carcinoma after thermal ablation based on longitudinal MRI with a deep learning approach. Oncologist 2025; 30:oyaf013. [PMID: 40110765 PMCID: PMC11923588 DOI: 10.1093/oncolo/oyaf013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Accepted: 01/13/2025] [Indexed: 03/22/2025] Open
Abstract
BACKGROUND Accurate prediction of early recurrence (ER) is essential to improve the prognosis of patients with hepatocellular carcinoma (HCC) underwent thermal ablation (TA). Therefore, a deep learning model system using longitudinal magnetic resonance imaging (MRI) was developed to predict ER of patients with HCC. METHODS From 2014, April to 2017, May, a total of 289 eligible patients with HCC underwent TA were retrospectively enrolled from 3 hospitals and assigned into one training cohort (n = 254) and one external testing cohort (n = 35). Two deep learning models (Pre and PrePost) were developed using the pre-operative MRI and longitudinal MRI (pre- and post-operative) to predict ER for the patients with HCC after TA, respectively. Then, an integrated model (DL_Clinical) incorporating PrePost model signature and clinical variables was built for post-ablation ER risk stratification for the patients with HCC. RESULTS In the external testing cohort, the area under the receiver operating characteristic curve (AUC) of the DL_Clinical model was better than that of the Clinical (0.740 vs 0.571), Pre (0.740 vs 0.648), and PrePost model (0.740 vs 0.689). Additionally, there was a significant difference in RFS between the high- and low-risk groups which were divided by the DL_Clinical model (P = .04). CONCLUSIONS The PrePost model developed using longitudinal MRI showed outstanding performance for predicting post-ablation ER of HCC. The DL_Clinical model could stratify the patients into high- and low-risk groups, which may help physicians in treatment and surveillance strategy selection in clinical practice.
Collapse
Affiliation(s)
- Qingyang Kong
- Department of Ultrasound, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, People’s Republic of China
| | - Kai Li
- Department of Ultrasound, The Third Affiliated Hospital of Sun Yat-Sen University, Guangzhou, People’s Republic of China
| |
Collapse
|
2
|
Obeagu EI, Ezeanya CU, Ogenyi FC, Ifu DD. Big data analytics and machine learning in hematology: Transformative insights, applications and challenges. Medicine (Baltimore) 2025; 104:e41766. [PMID: 40068020 PMCID: PMC11902945 DOI: 10.1097/md.0000000000041766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/14/2024] [Accepted: 02/17/2025] [Indexed: 03/14/2025] Open
Abstract
The integration of big data analytics and machine learning (ML) into hematology has ushered in a new era of precision medicine, offering transformative insights into disease management. By leveraging vast and diverse datasets, including genomic profiles, clinical laboratory results, and imaging data, these technologies enhance diagnostic accuracy, enable robust prognostic modeling, and support personalized therapeutic interventions. Advanced ML algorithms, such as neural networks and ensemble learning, facilitate the discovery of novel biomarkers and refine risk stratification for hematological disorders, including leukemias, lymphomas, and coagulopathies. Despite these advancements, significant challenges persist, particularly in the realms of data integration, algorithm validation, and ethical concerns. The heterogeneity of hematological datasets and the lack of standardized frameworks complicate their application, while the "black-box" nature of ML models raises issues of reliability and clinical trust. Moreover, safeguarding patient privacy in an era of data-driven medicine remains paramount, necessitating the development of secure and ethical analytical practices. Addressing these challenges is critical to ensuring equitable and effective implementation of these technologies. Collaborative efforts between hematologists, data scientists, and bioinformaticians are pivotal in translating these innovations into real-world clinical practice. Emphasis on developing explainable artificial intelligence models, integrating real-time analytics, and adopting federated learning approaches will further enhance the utility and adoption of these technologies. As big data analytics and ML continue to evolve, their potential to revolutionize hematology and improve patient outcomes remains immense.
Collapse
Affiliation(s)
| | | | - Fabian Chukwudi Ogenyi
- Department of Electrical, Telecommunication and Computer Engineering, Kampala International University, Kampala, Uganda
| | - Deborah Domini Ifu
- Department of Biomedical and Laboratory Science, Africa University, Mutare, Zimbabwe
| |
Collapse
|
3
|
Akbari A, Adabi M, Masoodi M, Namazi A, Mansouri F, Tabaeian SP, Shokati Eshkiki Z. Artificial intelligence: clinical applications and future advancement in gastrointestinal cancers. Front Artif Intell 2024; 7:1446693. [PMID: 39764458 PMCID: PMC11701808 DOI: 10.3389/frai.2024.1446693] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Accepted: 12/02/2024] [Indexed: 04/01/2025] Open
Abstract
One of the foremost causes of global healthcare burden is cancer of the gastrointestinal tract. The medical records, lab results, radiographs, endoscopic images, tissue samples, and medical histories of patients with gastrointestinal malignancies provide an enormous amount of medical data. There are encouraging signs that the advent of artificial intelligence could enhance the treatment of gastrointestinal issues with this data. Deep learning algorithms can swiftly and effectively analyze unstructured, high-dimensional data, including texts, images, and waveforms, while advanced machine learning approaches could reveal new insights into disease risk factors and phenotypes. In summary, artificial intelligence has the potential to revolutionize various features of gastrointestinal cancer care, such as early detection, diagnosis, therapy, and prognosis. This paper highlights some of the many potential applications of artificial intelligence in this domain. Additionally, we discuss the present state of the discipline and its potential future developments.
Collapse
Affiliation(s)
- Abolfazl Akbari
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Maryam Adabi
- Infectious Ophthalmologic Research Center, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Mohsen Masoodi
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Abolfazl Namazi
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
- Department of Internal Medicine, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Fatemeh Mansouri
- Department of Microbiology, Faculty of Sciences, Qom Branch, Islamic Azad University, Qom, Iran
| | - Seidamir Pasha Tabaeian
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
- Department of Internal Medicine, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Zahra Shokati Eshkiki
- Alimentary Tract Research Center, Clinical Sciences Research Institute, Imam Khomeini Hospital, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| |
Collapse
|
4
|
Vadlamudi S, Kumar V, Ghosh D, Abraham A. Artificial intelligence-powered precision: Unveiling the landscape of liver disease diagnosis—A comprehensive review. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE 2024; 138:109452. [DOI: 10.1016/j.engappai.2024.109452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2025]
|
5
|
Loper MR, Makary MS. Evolving and Novel Applications of Artificial Intelligence in Abdominal Imaging. Tomography 2024; 10:1814-1831. [PMID: 39590942 PMCID: PMC11598375 DOI: 10.3390/tomography10110133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2024] [Revised: 11/11/2024] [Accepted: 11/15/2024] [Indexed: 11/28/2024] Open
Abstract
Advancements in artificial intelligence (AI) have significantly transformed the field of abdominal radiology, leading to an improvement in diagnostic and disease management capabilities. This narrative review seeks to evaluate the current standing of AI in abdominal imaging, with a focus on recent literature contributions. This work explores the diagnosis and characterization of hepatobiliary, pancreatic, gastric, colonic, and other pathologies. In addition, the role of AI has been observed to help differentiate renal, adrenal, and splenic disorders. Furthermore, workflow optimization strategies and quantitative imaging techniques used for the measurement and characterization of tissue properties, including radiomics and deep learning, are highlighted. An assessment of how these advancements enable more precise diagnosis, tumor description, and body composition evaluation is presented, which ultimately advances the clinical effectiveness and productivity of radiology. Despite the advancements of AI in abdominal imaging, technical, ethical, and legal challenges persist, and these challenges, as well as opportunities for future development, are highlighted.
Collapse
Affiliation(s)
| | - Mina S. Makary
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA;
| |
Collapse
|
6
|
Gravell R, Frood R, Littlejohns A, Casanova N, Goody R, Podesta C, Albazaz R, Scarsbrook A. Can Patient Characteristics and Pre-Treatment MRI Features Predict Survival After Stereotactic Ablative Radiotherapy (SABR) Treatment in Hepatocellular Carcinoma (HCC): Preliminary Assessment. Curr Oncol 2024; 31:6384-6394. [PMID: 39451778 PMCID: PMC11506294 DOI: 10.3390/curroncol31100474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2024] [Revised: 10/07/2024] [Accepted: 10/08/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND The study purpose was to develop a machine learning (ML)-based predictive model for event-free survival (EFS) in patients with hepatocellular carcinoma (HCC) undergoing stereotactic ablative radiotherapy (SABR). METHODS Patients receiving SABR for HCC at a single institution, between 2017 and 2020, were included in the study. They were split into training and test (85%:15%) cohorts. Events of interest were HCC recurrence or death. Three ML models were trained, the features were selected, and the hyperparameters were tuned. The performance was measured using Harrell's C index with the best-performing model being tested on the unseen cohort. RESULTS Overall, 41 patients were included (training = 34, test = 7) and 64 lesions were analysed (training = 50, test = 14), resulting in 30 events (60% rate) in the training set (death = 6, recurrence = 24) and 8 events (57% rate) in the test set (death = 5, recurrence = 3). A Cox regression model, using age at treatment, albumin, and intra-lesional fat identified through MRI as variables, had the best performance with a mean training score of 0.78 (standard deviation (SD) 0.02), a mean validation of 0.78 (SD 0.18), and a test score of 0.94. CONCLUSIONS Predicting the outcomes in patients with HCC, following SABR, using a novel model is feasible and warrants further evaluation.
Collapse
Affiliation(s)
- Rachel Gravell
- Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Russell Frood
- Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
- Leeds Institute of Medical Research, Faculty of Medicine and Health, University of Leeds, Leeds LS2 9JT, UK
| | - Anna Littlejohns
- Department of Oncology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Nathalie Casanova
- Department of Oncology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Rebecca Goody
- Department of Oncology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Christine Podesta
- Department of Oncology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Raneem Albazaz
- Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
| | - Andrew Scarsbrook
- Department of Radiology, Leeds Teaching Hospitals NHS Trust, Leeds LS9 7TF, UK
- Leeds Institute of Medical Research, Faculty of Medicine and Health, University of Leeds, Leeds LS2 9JT, UK
| |
Collapse
|
7
|
Sobhani N, D'Angelo A, Pittacolo M, Mondani G, Generali D. Future AI Will Most Likely Predict Antibody-Drug Conjugate Response in Oncology: A Review and Expert Opinion. Cancers (Basel) 2024; 16:3089. [PMID: 39272947 PMCID: PMC11394064 DOI: 10.3390/cancers16173089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Revised: 08/31/2024] [Accepted: 09/03/2024] [Indexed: 09/15/2024] Open
Abstract
The medical research field has been tremendously galvanized to improve the prediction of therapy efficacy by the revolution in artificial intelligence (AI). An earnest desire to find better ways to predict the effectiveness of therapy with the use of AI has propelled the evolution of new models in which it can become more applicable in clinical settings such as breast cancer detection. However, in some instances, the U.S. Food and Drug Administration was obliged to back some previously approved inaccurate models for AI-based prognostic models because they eventually produce inaccurate prognoses for specific patients who might be at risk of heart failure. In light of instances in which the medical research community has often evolved some unrealistic expectations regarding the advances in AI and its potential use for medical purposes, implementing standard procedures for AI-based cancer models is critical. Specifically, models would have to meet some general parameters for standardization, transparency of their logistic modules, and avoidance of algorithm biases. In this review, we summarize the current knowledge about AI-based prognostic methods and describe how they may be used in the future for predicting antibody-drug conjugate efficacy in cancer patients. We also summarize the findings of recent late-phase clinical trials using these conjugates for cancer therapy.
Collapse
Affiliation(s)
- Navid Sobhani
- Department of Cancer Biology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Alberto D'Angelo
- Department of Medicine, Northern General Hospital, Sheffield S5 7AT, UK
| | - Matteo Pittacolo
- Department of Surgery, Oncology and Gastroenterology, University of Padova, 35122 Padova, Italy
| | - Giuseppina Mondani
- Royal Infirmary Hospital, Foresterhill Health Campus, Aberdeen AB25 2ZN, UK
| | - Daniele Generali
- Department of Medicine, Surgery and Health Sciences, University of Trieste, 34100 Trieste, Italy
| |
Collapse
|
8
|
Gao Y, Yang X, Li H, Ding DW. A knowledge-enhanced interpretable network for early recurrence prediction of hepatocellular carcinoma via multi-phase CT imaging. Int J Med Inform 2024; 189:105509. [PMID: 38851131 DOI: 10.1016/j.ijmedinf.2024.105509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Revised: 05/20/2024] [Accepted: 05/28/2024] [Indexed: 06/10/2024]
Abstract
BACKGROUND Predicting early recurrence (ER) of hepatocellular carcinoma (HCC) accurately can guide treatment decisions and further enhance survival. Computed tomography (CT) imaging, analyzed by deep learning (DL) models combining domain knowledge, has been employed for the prediction. However, these DL models utilized late fusion, restricting the interaction between domain knowledge and images during feature extraction, thereby limiting the prediction performance and compromising decision-making interpretability. METHODS We propose a novel Vision Transformer (ViT)-based DL network, referred to as Dual-Style ViT (DSViT), to augment the interaction between domain knowledge and images and the effective fusion among multi-phase CT images for improving both predictive performance and interpretability. We apply the DSViT to develop pre-/post-operative models for predicting ER. Within DSViT, to balance the utilization between domain knowledge and images within DSViT, we propose an adaptive self-attention mechanism. Moreover, we present an attention-guided supervised learning module for balancing the contributions of multi-phase CT images to prediction and a domain knowledge self-supervision module for enhancing the fusion between domain knowledge and images, thereby further improving predictive performance. Finally, we provide the interpretability of the DSViT decision-making. RESULTS Experiments on our multi-phase data demonstrate that DSViTs surpass the existing models across multiple performance metrics and provide the decision-making interpretability. Additional validation on a publicly available dataset underscores the generalizability of DSViT. CONCLUSIONS The proposed DSViT can significantly improve the performance and interpretability of ER prediction, thereby fortifying the trustworthiness of artificial intelligence tool for HCC ER prediction in clinical settings.
Collapse
Affiliation(s)
- Yu Gao
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China; Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, Beijing 100083, China
| | - Xue Yang
- First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan 450052, China; Department of Radiology, Beijing Youan Hospital, Capital Medical University, Beijing 100069, China
| | - Hongjun Li
- Department of Radiology, Beijing Youan Hospital, Capital Medical University, Beijing 100069, China.
| | - Da-Wei Ding
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China; Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education, Beijing 100083, China.
| |
Collapse
|
9
|
Haghshomar M, Rodrigues D, Kalyan A, Velichko Y, Borhani A. Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies. Front Oncol 2024; 14:1362737. [PMID: 38779098 PMCID: PMC11109422 DOI: 10.3389/fonc.2024.1362737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 04/12/2024] [Indexed: 05/25/2024] Open
Abstract
Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.
Collapse
Affiliation(s)
| | | | | | | | - Amir Borhani
- Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
| |
Collapse
|
10
|
Bo Z, Song J, He Q, Chen B, Chen Z, Xie X, Shu D, Chen K, Wang Y, Chen G. Application of artificial intelligence radiomics in the diagnosis, treatment, and prognosis of hepatocellular carcinoma. Comput Biol Med 2024; 173:108337. [PMID: 38547656 DOI: 10.1016/j.compbiomed.2024.108337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 03/04/2024] [Accepted: 03/17/2024] [Indexed: 04/17/2024]
Abstract
Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer, with an increasing incidence and poor prognosis. In the past decade, artificial intelligence (AI) technology has undergone rapid development in the field of clinical medicine, bringing the advantages of efficient data processing and accurate model construction. Promisingly, AI-based radiomics has played an increasingly important role in the clinical decision-making of HCC patients, providing new technical guarantees for prediction, diagnosis, and prognostication. In this review, we evaluated the current landscape of AI radiomics in the management of HCC, including its diagnosis, individual treatment, and survival prognosis. Furthermore, we discussed remaining challenges and future perspectives regarding the application of AI radiomics in HCC.
Collapse
Affiliation(s)
- Zhiyuan Bo
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Jiatao Song
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Qikuan He
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Bo Chen
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Ziyan Chen
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Xiaozai Xie
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Danyang Shu
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
| | - Kaiyu Chen
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China.
| | - Yi Wang
- Department of Epidemiology and Biostatistics, School of Public Health and Management, Wenzhou Medical University, Wenzhou, China.
| | - Gang Chen
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, China; Zhejiang-Germany Interdisciplinary Joint Laboratory of Hepatobiliary-Pancreatic Tumor and Bioengineering, the First Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China.
| |
Collapse
|
11
|
Gaddum O, Chapiro J. An Interventional Radiologist's Primer of Critical Appraisal of Artificial Intelligence Research. J Vasc Interv Radiol 2024; 35:7-14. [PMID: 37769940 DOI: 10.1016/j.jvir.2023.09.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 07/17/2023] [Accepted: 09/18/2023] [Indexed: 10/03/2023] Open
Abstract
Recent advances in artificial intelligence (AI) are expected to cause a significant paradigm shift in all digital data-driven aspects of information gain, processing, and decision making in both clinical healthcare and medical research. The field of interventional radiology (IR) will be enmeshed in this innovation, yet the collective IR expertise in the field of AI remains rudimentary because of lack of training. This primer provides the clinical interventional radiologist with a simple guide for critically appraising AI research and products by identifying 12 fundamental items that should be considered: (a) need for AI technology to address the clinical problem, (b) type of applied Al algorithm, (c) data quality and degree of annotation, (d) reporting of accuracy, (e) applicability of standardized reporting, (f) reproducibility of methodology and data transparency, (g) algorithm validation, (h) interpretability, (i) concrete impact on IR, (j) pathway toward translation to clinical practice, (k) clinical benefit and cost-effectiveness, and (l) regulatory framework.
Collapse
Affiliation(s)
- Olivia Gaddum
- Division of Interventional Radiology, Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Connecticut
| | - Julius Chapiro
- Division of Interventional Radiology, Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Connecticut.
| |
Collapse
|
12
|
Grudza M, Salinel B, Zeien S, Murphy M, Adkins J, Jensen CT, Bay C, Kodibagkar V, Koo P, Dragovich T, Choti MA, Kundranda M, Syeda-Mahmood T, Wang HZ, Chang J. Methods for improving colorectal cancer annotation efficiency for artificial intelligence-observer training. World J Radiol 2023; 15:359-369. [PMID: 38179201 PMCID: PMC10762523 DOI: 10.4329/wjr.v15.i12.359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 11/13/2023] [Accepted: 12/05/2023] [Indexed: 12/26/2023] Open
Abstract
BACKGROUND Missing occult cancer lesions accounts for the most diagnostic errors in retrospective radiology reviews as early cancer can be small or subtle, making the lesions difficult to detect. Second-observer is the most effective technique for reducing these events and can be economically implemented with the advent of artificial intelligence (AI). AIM To achieve appropriate AI model training, a large annotated dataset is necessary to train the AI models. Our goal in this research is to compare two methods for decreasing the annotation time to establish ground truth: Skip-slice annotation and AI-initiated annotation. METHODS We developed a 2D U-Net as an AI second observer for detecting colorectal cancer (CRC) and an ensemble of 5 differently initiated 2D U-Net for ensemble technique. Each model was trained with 51 cases of annotated CRC computed tomography of the abdomen and pelvis, tested with 7 cases, and validated with 20 cases from The Cancer Imaging Archive cases. The sensitivity, false positives per case, and estimated Dice coefficient were obtained for each method of training. We compared the two methods of annotations and the time reduction associated with the technique. The time differences were tested using Friedman's two-way analysis of variance. RESULTS Sparse annotation significantly reduces the time for annotation particularly skipping 2 slices at a time (P < 0.001). Reduction of up to 2/3 of the annotation does not reduce AI model sensitivity or false positives per case. Although initializing human annotation with AI reduces the annotation time, the reduction is minimal, even when using an ensemble AI to decrease false positives. CONCLUSION Our data support the sparse annotation technique as an efficient technique for reducing the time needed to establish the ground truth.
Collapse
Affiliation(s)
- Matthew Grudza
- School of Biological Health and Systems Engineering, Arizona State University, Tempe, AZ 85287, United States
| | - Brandon Salinel
- Department of Radiology, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| | - Sarah Zeien
- School of Osteopathic Medicine, A.T. Still University, Mesa, AZ 85206, United States
| | - Matthew Murphy
- School of Osteopathic Medicine, A.T. Still University, Mesa, AZ 85206, United States
| | - Jake Adkins
- Department of Abdominal Imaging, MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Corey T Jensen
- Department of Abdominal Imaging, University Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Curtis Bay
- Department of Interdisciplinary Sciences, A.T. Still University, Mesa, AZ 85206, United States
| | - Vikram Kodibagkar
- School of Biological and Health Systems Engineering, Arizona State University, Tempe, AZ 85287, United States
| | - Phillip Koo
- Department of Radiology, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| | - Tomislav Dragovich
- Division of Cancer Medicine, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| | - Michael A Choti
- Department of Surgical Oncology, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| | - Madappa Kundranda
- Division of Cancer Medicine, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| | | | - Hong-Zhi Wang
- IBM Almaden Research Center, IBM, San Jose, CA 95120, United States
| | - John Chang
- Department of Radiology, Banner MD Anderson Cancer Center, Gilbert, AZ 85234, United States
| |
Collapse
|
13
|
Hsieh C, Laguna A, Ikeda I, Maxwell AWP, Chapiro J, Nadolski G, Jiao Z, Bai HX. Using Machine Learning to Predict Response to Image-guided Therapies for Hepatocellular Carcinoma. Radiology 2023; 309:e222891. [PMID: 37934098 DOI: 10.1148/radiol.222891] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2023]
Abstract
Interventional oncology is a rapidly growing field with advances in minimally invasive image-guided local-regional treatments for hepatocellular carcinoma (HCC), including transarterial chemoembolization, transarterial radioembolization, and thermal ablation. However, current standardized clinical staging systems for HCC are limited in their ability to optimize patient selection for treatment as they rely primarily on serum markers and radiologist-defined imaging features. Given the variation in treatment responses, an updated scoring system that includes multidimensional aspects of the disease, including quantitative imaging features, serum markers, and functional biomarkers, is needed to optimally triage patients. With the vast amounts of numerical medical record data and imaging features, researchers have turned to image-based methods, such as radiomics and artificial intelligence (AI), to automatically extract and process multidimensional data from images. The synthesis of these data can provide clinically relevant results to guide personalized treatment plans and optimize resource utilization. Machine learning (ML) is a branch of AI in which a model learns from training data and makes effective predictions by teaching itself. This review article outlines the basics of ML and provides a comprehensive overview of its potential value in the prediction of treatment response in patients with HCC after minimally invasive image-guided therapy.
Collapse
Affiliation(s)
- Celina Hsieh
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Amanda Laguna
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Ian Ikeda
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Aaron W P Maxwell
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Julius Chapiro
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Gregory Nadolski
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Zhicheng Jiao
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| | - Harrison X Bai
- From the Department of Diagnostic Imaging (C.H., A.W.P.M., Z.J.) and Warren Alpert Medical School (A.L.), Brown University, Providence, RI; Department of Radiology and Biomedical Imaging, Yale University School of Medicine, New Haven, Conn (I.I., J.C.); Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pa (G.N.); and Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 N Caroline St, Baltimore, MD 21205 (H.X.B.)
| |
Collapse
|
14
|
Mansur A, Vrionis A, Charles JP, Hancel K, Panagides JC, Moloudi F, Iqbal S, Daye D. The Role of Artificial Intelligence in the Detection and Implementation of Biomarkers for Hepatocellular Carcinoma: Outlook and Opportunities. Cancers (Basel) 2023; 15:2928. [PMID: 37296890 PMCID: PMC10251861 DOI: 10.3390/cancers15112928] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 05/23/2023] [Accepted: 05/24/2023] [Indexed: 06/12/2023] Open
Abstract
Liver cancer is a leading cause of cancer-related death worldwide, and its early detection and treatment are crucial for improving morbidity and mortality. Biomarkers have the potential to facilitate the early diagnosis and management of liver cancer, but identifying and implementing effective biomarkers remains a major challenge. In recent years, artificial intelligence has emerged as a promising tool in the cancer sphere, and recent literature suggests that it is very promising in facilitating biomarker use in liver cancer. This review provides an overview of the status of AI-based biomarker research in liver cancer, with a focus on the detection and implementation of biomarkers for risk prediction, diagnosis, staging, prognostication, prediction of treatment response, and recurrence of liver cancers.
Collapse
Affiliation(s)
- Arian Mansur
- Harvard Medical School, Boston, MA 02115, USA; (A.M.); (J.C.P.)
| | - Andrea Vrionis
- Morsani College of Medicine, University of South Florida Health, Tampa, FL 33602, USA; (A.V.); (J.P.C.)
| | - Jonathan P. Charles
- Morsani College of Medicine, University of South Florida Health, Tampa, FL 33602, USA; (A.V.); (J.P.C.)
| | - Kayesha Hancel
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA; (K.H.); (F.M.); (S.I.)
| | | | - Farzad Moloudi
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA; (K.H.); (F.M.); (S.I.)
| | - Shams Iqbal
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA; (K.H.); (F.M.); (S.I.)
| | - Dania Daye
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA; (K.H.); (F.M.); (S.I.)
| |
Collapse
|
15
|
Paudyal R, Shah AD, Akin O, Do RKG, Konar AS, Hatzoglou V, Mahmood U, Lee N, Wong RJ, Banerjee S, Shin J, Veeraraghavan H, Shukla-Dave A. Artificial Intelligence in CT and MR Imaging for Oncological Applications. Cancers (Basel) 2023; 15:cancers15092573. [PMID: 37174039 PMCID: PMC10177423 DOI: 10.3390/cancers15092573] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 04/13/2023] [Accepted: 04/17/2023] [Indexed: 05/15/2023] Open
Abstract
Cancer care increasingly relies on imaging for patient management. The two most common cross-sectional imaging modalities in oncology are computed tomography (CT) and magnetic resonance imaging (MRI), which provide high-resolution anatomic and physiological imaging. Herewith is a summary of recent applications of rapidly advancing artificial intelligence (AI) in CT and MRI oncological imaging that addresses the benefits and challenges of the resultant opportunities with examples. Major challenges remain, such as how best to integrate AI developments into clinical radiology practice, the vigorous assessment of quantitative CT and MR imaging data accuracy, and reliability for clinical utility and research integrity in oncology. Such challenges necessitate an evaluation of the robustness of imaging biomarkers to be included in AI developments, a culture of data sharing, and the cooperation of knowledgeable academics with vendor scientists and companies operating in radiology and oncology fields. Herein, we will illustrate a few challenges and solutions of these efforts using novel methods for synthesizing different contrast modality images, auto-segmentation, and image reconstruction with examples from lung CT as well as abdome, pelvis, and head and neck MRI. The imaging community must embrace the need for quantitative CT and MRI metrics beyond lesion size measurement. AI methods for the extraction and longitudinal tracking of imaging metrics from registered lesions and understanding the tumor environment will be invaluable for interpreting disease status and treatment efficacy. This is an exciting time to work together to move the imaging field forward with narrow AI-specific tasks. New AI developments using CT and MRI datasets will be used to improve the personalized management of cancer patients.
Collapse
Affiliation(s)
- Ramesh Paudyal
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Akash D Shah
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Oguz Akin
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Richard K G Do
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Amaresha Shridhar Konar
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Vaios Hatzoglou
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Usman Mahmood
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Nancy Lee
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Richard J Wong
- Head and Neck Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | | | | | - Harini Veeraraghavan
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Amita Shukla-Dave
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| |
Collapse
|
16
|
Tabari A, D’Amore B, Cox M, Brito S, Gee MS, Wehrenberg-Klee E, Uppot RN, Daye D. Machine-Learning-Based Radiomic Features on Pre-Ablation MRI as Predictors of Pathologic Response in Patients with Hepatocellular Carcinoma Who Underwent Hepatic Transplant. Cancers (Basel) 2023; 15:cancers15072058. [PMID: 37046718 PMCID: PMC10092969 DOI: 10.3390/cancers15072058] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/29/2023] [Accepted: 03/29/2023] [Indexed: 03/31/2023] Open
Abstract
Background: The aim was to investigate the role of pre-ablation tumor radiomics in predicting pathologic treatment response in patients with early-stage hepatocellular carcinoma (HCC) who underwent liver transplant. Methods: Using data collected from 2005–2015, we included adult patients who (1) had a contrast-enhanced MRI within 3 months prior to ablation therapy and (2) underwent liver transplantation. Demographics were obtained for each patient. The treated hepatic tumor volume was manually segmented on the arterial phase T1 MRI images. A vector with 112 radiomic features (shape, first-order, and texture) was extracted from each tumor. Feature selection was employed through minimum redundancy and maximum relevance using a training set. A random forest model was developed based on top radiomic and demographic features. Model performance was evaluated by ROC analysis. SHAP plots were constructed in order to visualize feature importance in model predictions. Results: Ninety-seven patients (117 tumors, 31 (32%) microwave ablation, 66 (68%) radiofrequency ablation) were included. The mean model for end-stage liver disease (MELD) score was 10.5 ± 3. The mean follow-up time was 336.2 ± 179 days. Complete response on pathology review was achieved in 62% of patients at the time of transplant. Incomplete pathologic response was associated with four features: two first-order and two GLRM features using univariate logistic regression analysis (p < 0.05). The random forest model included two radiomic features (diagnostics maximum and first-order maximum) and four clinical features (pre-procedure creatinine, pre-procedure albumin, age, and gender) achieving an AUC of 0.83, a sensitivity of 82%, a specificity of 67%, a PPV of 69%, and an NPV of 80%. Conclusions: Pre-ablation MRI radiomics could act as a valuable imaging biomarker for the prediction of tumor pathologic response in patients with HCC.
Collapse
|
17
|
Yang YQ, Wen ZY, Liu XY, Ma ZH, Liu YE, Cao XY, Hou L, Xie H. Current status and prospect of treatments for recurrent hepatocellular carcinoma. World J Hepatol 2023; 15:129-150. [PMID: 36926237 PMCID: PMC10011906 DOI: 10.4254/wjh.v15.i2.129] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Revised: 11/13/2022] [Accepted: 01/23/2023] [Indexed: 02/24/2023] Open
Abstract
Owing to its heterogeneous and highly aggressive nature, hepatocellular carcinoma (HCC) has a high recurrence rate, which is a non-negligible problem despite the increasing number of available treatment options. Recent clinical trials have attempted to reduce the recurrence and develop innovative treatment options for patients with recurrent HCC. In the event of liver remnant recurrence, the currently available treatment options include repeat hepatectomy, salvage liver transplantation, tumor ablation, transcatheter arterial chemoembolization, stereotactic body radiotherapy, systemic therapies, and combination therapy. In this review, we summarize the strategies to reduce the recurrence of high-risk tumors and aggressive therapies for recurrent HCC. Additionally, we discuss methods to prevent HCC recurrence and prognostic models constructed based on predictors of recurrence to develop an appropriate surveillance program.
Collapse
Affiliation(s)
- Yu-Qing Yang
- Department of Epidemiology and Biostatistics, Jilin University, Changchun 130021, Jilin Province, China
| | - Zhen-Yu Wen
- Department of Occupational and Environmental Health, Jilin University, Changchun 130021, Jilin Province, China
| | - Xiao-Yan Liu
- Senior Department of Hepatology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| | - Zhen-Hu Ma
- Senior Department of Oncology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| | - Yan-E Liu
- Department of Epidemiology and Biostatistics, Jilin University, Changchun 130021, Jilin Province, China
| | - Xue-Ying Cao
- Senior Department of Oncology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| | - Li Hou
- Senior Department of Oncology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| | - Hui Xie
- Senior Department of Oncology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing 100039, China
| |
Collapse
|
18
|
Editor's Notebook: February 2023. AJR Am J Roentgenol 2023; 220:158-159. [PMID: 36661431 DOI: 10.2214/ajr.22.28715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|