1
|
Wu C, Wang S, Wang Y, Wang C, Zhou H, Zhang Y, Wang Q. A Novel Multi-Modal Population-Graph Based Framework for Patients of Esophageal Squamous Cell Cancer Prognostic Risk Prediction. IEEE J Biomed Health Inform 2025; 29:3206-3219. [PMID: 38843065 DOI: 10.1109/jbhi.2024.3410543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/11/2024]
Abstract
Prognostic risk prediction is pivotal for clinicians to appraise the patient's esophageal squamous cell cancer (ESCC) progression status precisely and tailor individualized therapy treatment plans. Currently, CT-based multi-modal prognostic risk prediction methods have gradually attracted the attention of researchers for their universality, which is also able to be applied in scenarios of preoperative prognostic risk assessment in the early stages of cancer. However, much of the current work focuses only on CT images of the primary tumor, ignoring the important role that CT images of lymph nodes play in prognostic risk prediction. Additionally, it is important to consider and explore the inter-patient feature similarity in prognosis when developing models. To solve these problems, we proposed a novel multi-modal population-graph based framework leveraging CT images including primary tumor and lymph nodes combined with clinical, hematology, and radiomics data for ESCC prognostic risk prediction. A patient population graph was constructed to excavate the homogeneity and heterogeneity of inter-patient feature embedding. Moreover, a novel node-level multi-task joint loss was proposed for graph model optimization through a supervised-based task and an unsupervised-based task. Sufficient experimental results show that our model achieved state-of-the-art performance compared with other baseline models as well as the gold standard on discriminative ability, risk stratification, and clinical utility.
Collapse
|
2
|
Liu C, Shi C, Wang S, Qi R, Gu W, Yu F, Zhang G, Qiu F. Bridging the gap: how patient-derived lung cancer organoids are transforming personalized medicine. Front Cell Dev Biol 2025; 13:1554268. [PMID: 40302940 PMCID: PMC12037501 DOI: 10.3389/fcell.2025.1554268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2025] [Accepted: 03/25/2025] [Indexed: 05/02/2025] Open
Abstract
Lung cancer is a major malignancy that poses a significant threat to human health, with its complex pathogenesis and molecular characteristics presenting substantial challenges for treatment. Traditional two-dimensional cell cultures and animal models are limited in their ability to accurately replicate the characteristics of different lung cancer patients, thereby hindering research on disease mechanisms and treatment strategies. The development of organoid technology has enabled the growth of patient-derived tumor cells in three-dimensional cultures, which can stably preserve the tumor's tissue morphology, genomic features, and drug response. There have been significant advancements in the field of patient-derived lung cancer organoids (PDLCOs), challenges remain in the reproducibility and standardization of PDLCOs models due to variations in specimen sources, subsequent processing techniques, culture medium formulations, and Matrigel batches. This review summarizes the cultivation and validation processes of PDLCOs and explores their clinical applications in personalized treatment, drug screening after resistance, PDLCOs biobanks construction, and drug development. Additionally, the integration of PDLCOs with cutting-edge technologies in various fields, such as tumor assembloid techniques, artificial intelligence, organoid-on-a-chip, 3D bioprinting, gene editing, and single-cell RNA sequencing, has greatly expanded their clinical potential. This review, incorporating the latest research developments in PDLCOs, provides an overview of their cultivation, clinical applications, and interdisciplinary integration, while also addressing the prospects and challenges of PDLCOs in precision medicine for lung cancer.
Collapse
Affiliation(s)
- Chaoxing Liu
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Chao Shi
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Siya Wang
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Rong Qi
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Weiguo Gu
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Feng Yu
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Guohua Zhang
- Nanchang Key Laboratory of Tumor Gene Diagnosis and Innovative Treatment Research, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Feng Qiu
- Department of Oncology, Gaoxin Branch of the First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Department of Oncology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| |
Collapse
|
3
|
Kai C, Tamori H, Ohtsuka T, Nara M, Yoshida A, Sato I, Futamura H, Kodama N, Kasai S. Classifying the molecular subtype of breast cancer using vision transformer and convolutional neural network features. Breast Cancer Res Treat 2025; 210:771-782. [PMID: 39841349 DOI: 10.1007/s10549-025-07614-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Accepted: 01/10/2025] [Indexed: 01/23/2025]
Abstract
PURPOSE Identification of the molecular subtypes in breast cancer allows to optimize treatment strategies, but usually requires invasive needle biopsy. Recently, non-invasive imaging has emerged as promising means to classify them. Magnetic resonance imaging is often used for this purpose because it is three-dimensional and highly informative. Instead, only a few reports have documented the use of mammograms. Given that mammography is the first choice for breast cancer screening, using it to classify molecular subtypes would allow for early intervention on a much wider scale. Here, we aimed to evaluate the effectiveness of combining global and local mammographic features by using Vision Transformer (ViT) and Convolutional Neural Network (CNN) to classify molecular subtypes in breast cancer. METHODS The feature values for binary classification were calculated using the ViT and EfficientnetV2 feature extractors, followed by dimensional compression via principal component analysis. LightGBM was used to perform binary classification of each molecular subtype: triple-negative, HER2-enriched, luminal A, and luminal B. RESULTS The combination of ViT and CNN achieved higher accuracy than ViT or CNN alone. The sensitivity for triple-negative subtypes was very high (0.900, with F-value = 0.818); whereas F-value and sensitivity were 0.720 and 0.750 for HER2-enriched, 0.765 and 0.867 for luminal A, and 0.614 and 0.711 for luminal B subtypes, respectively. CONCLUSION Features obtained from mammograms by combining ViT and CNN allow the classification of molecular subtypes with high accuracy. This approach could streamline early treatment workflows and triage, especially for poor prognosis subtypes such as triple-negative breast cancer.
Collapse
Affiliation(s)
- Chiharu Kai
- Department of Radiological Technology, Faculty of Medical Technology, Niigata University of Health and Welfare, 1398 Shimamichou, Kita-Ku, Niigata, Japan
- Major in Health and Welfare, Graduate School of Niigata, University of Health and Welfare, Niigata, Japan
| | | | | | | | - Akifumi Yoshida
- Department of Radiological Technology, Faculty of Medical Technology, Niigata University of Health and Welfare, 1398 Shimamichou, Kita-Ku, Niigata, Japan
| | - Ikumi Sato
- Major in Health and Welfare, Graduate School of Niigata, University of Health and Welfare, Niigata, Japan
- Department of Nursing, Faculty of Nursing, Niigata University of Health and Welfare, Niigata City, Niigata, Japan
| | | | - Naoki Kodama
- Department of Radiological Technology, Faculty of Medical Technology, Niigata University of Health and Welfare, 1398 Shimamichou, Kita-Ku, Niigata, Japan
| | - Satoshi Kasai
- Department of Radiological Technology, Faculty of Medical Technology, Niigata University of Health and Welfare, 1398 Shimamichou, Kita-Ku, Niigata, Japan.
| |
Collapse
|
4
|
Mehri-Kakavand G, Mdletshe S, Wang A. A Comprehensive Review on the Application of Artificial Intelligence for Predicting Postsurgical Recurrence Risk in Early-Stage Non-Small Cell Lung Cancer Using Computed Tomography, Positron Emission Tomography, and Clinical Data. J Med Radiat Sci 2025. [PMID: 39844750 DOI: 10.1002/jmrs.860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Revised: 01/08/2025] [Accepted: 01/11/2025] [Indexed: 01/24/2025] Open
Abstract
INTRODUCTION Non-small cell lung cancer (NSCLC) is the leading cause of cancer-related mortality worldwide. Despite advancements in early detection and treatment, postsurgical recurrence remains a significant challenge, occurring in 30%-55% of patients within 5 years after surgery. This review analysed existing studies on the utilisation of artificial intelligence (AI), incorporating CT, PET, and clinical data, for predicting recurrence risk in early-stage NSCLCs. METHODS A literature search was conducted across multiple databases, focusing on studies published between 2018 and 2024 that employed radiomics, machine learning, and deep learning based on preoperative positron emission tomography (PET), computed tomography (CT), and PET/CT, with or without clinical data integration. Sixteen studies met the inclusion criteria and were assessed for methodological quality using the METhodological RadiomICs Score (METRICS). RESULTS The reviewed studies demonstrated the potential of radiomics and AI models in predicting postoperative recurrence risk. Various approaches showed promising results, including handcrafted radiomics features, deep learning models, and multimodal models combining different imaging modalities with clinical data. However, several challenges and limitations were identified, such as small sample sizes, lack of external validation, interpretability issues, and the need for effective multimodal imaging techniques. CONCLUSIONS Future research should focus on conducting larger, prospective, multicentre studies, improving data integration and interpretability, enhancing the fusion of imaging modalities, assessing clinical utility, standardising methodologies, and fostering collaboration among researchers and institutions. Addressing these aspects will advance the development of robust and generalizable AI models for predicting postsurgical recurrence risk in early-stage NSCLC, ultimately improving patient care and outcomes.
Collapse
Affiliation(s)
- Ghazal Mehri-Kakavand
- Department of Anatomy and Medical Imaging, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
| | - Sibusiso Mdletshe
- Department of Anatomy and Medical Imaging, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
| | - Alan Wang
- Department of Anatomy and Medical Imaging, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
- Centre for Brain Research, The University of Auckland, Auckland, New Zealand
- Matai Medical Research Institute, Gisborne, New Zealand
- Medical Imaging Research Centre, The University of Auckland, Auckland, New Zealand
- Centre for Co-Created Ageing Research, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
5
|
Wang L, Zhang C, Li J. A Hybrid CNN-Transformer Model for Predicting N Staging and Survival in Non-Small Cell Lung Cancer Patients Based on CT-Scan. Tomography 2024; 10:1676-1693. [PMID: 39453040 PMCID: PMC11510788 DOI: 10.3390/tomography10100123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/03/2024] [Accepted: 10/09/2024] [Indexed: 10/26/2024] Open
Abstract
Accurate assessment of N staging in patients with non-small cell lung cancer (NSCLC) is critical for the development of effective treatment plans, the optimization of therapeutic strategies, and the enhancement of patient survival rates. This study proposes a hybrid model based on 3D convolutional neural networks (CNNs) and transformers for predicting the N-staging and survival rates of NSCLC patients within the NSCLC radiogenomics and Nsclc-radiomics datasets. The model achieved accuracies of 0.805, 0.828, and 0.819 for the training, validation, and testing sets, respectively. By leveraging the strengths of CNNs in local feature extraction and the superior performance of transformers in global information modeling, the model significantly enhances predictive accuracy and efficacy. A comparative analysis with traditional CNN and transformer architectures demonstrates that the CNN-transformer hybrid model outperforms N-staging predictions. Furthermore, this study extracts the one-year survival rate as a feature and employs the Lasso-Cox model for survival predictions at various time intervals (1, 3, 5, and 7 years), with all survival prediction p-values being less than 0.05, illustrating the time-dependent nature of survival analysis. The application of time-dependent ROC curves further validates the model's accuracy and reliability for survival predictions. Overall, this research provides innovative methodologies and new insights for the early diagnosis and prognostic evaluation of NSCLC.
Collapse
Affiliation(s)
| | | | - Jin Li
- College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin 150001, China; (L.W.); (C.Z.)
| |
Collapse
|
6
|
Zhang R, Zhu H, Chen M, Sang W, Lu K, Li Z, Wang C, Zhang L, Yin FF, Yang Z. A dual-radiomics model for overall survival prediction in early-stage NSCLC patient using pre-treatment CT images. Front Oncol 2024; 14:1419621. [PMID: 39206157 PMCID: PMC11349529 DOI: 10.3389/fonc.2024.1419621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 07/26/2024] [Indexed: 09/04/2024] Open
Abstract
Introduction Radiation therapy (RT) is one of the primary treatment options for early-stage non-small cell lung cancer (ES-NSCLC). Therefore, accurately predicting the overall survival (OS) rate following radiotherapy is crucial for implementing personalized treatment strategies. This work aims to develop a dual-radiomics (DR) model to (1) predict 3-year OS in ES-NSCLC patients receiving RT using pre-treatment CT images, and (2) provide explanations between feature importanceand model prediction performance. Methods The publicly available TCIA Lung1 dataset with 132 ES-NSCLC patients received RT were studied: 89/43 patients in the under/over 3-year OS group. For each patient, two types of radiomic features were examined: 56 handcrafted radiomic features (HRFs) extracted within gross tumor volume, and 512 image deep features (IDFs) extracted using a pre-trained U-Net encoder. They were combined as inputs to an explainable boosting machine (EBM) model for OS prediction. The EBM's mean absolute scores for HRFs and IDFs were used as feature importance explanations. To evaluate identified feature importance, the DR model was compared with EBM using either (1) key or (2) non-key feature type only. Comparison studies with other models, including supporting vector machine (SVM) and random forest (RF), were also included. The performance was evaluated by the area under the receiver operating characteristic curve (AUCROC), accuracy, sensitivity, and specificity with a 100-fold Monte Carlo cross-validation. Results The DR model showed highestperformance in predicting 3-year OS (AUCROC=0.81 ± 0.04), and EBM scores suggested that IDFs showed significantly greater importance (normalized mean score=0.0019) than HRFs (score=0.0008). The comparison studies showed that EBM with key feature type (IDFs-only demonstrated comparable AUCROC results (0.81 ± 0.04), while EBM with non-key feature type (HRFs-only) showed limited AUCROC (0.64 ± 0.10). The results suggested that feature importance score identified by EBM is highly correlated with OS prediction performance. Both SVM and RF models were unable to explain key feature type while showing limited overall AUCROC=0.66 ± 0.07 and 0.77 ± 0.06, respectively. Accuracy, sensitivity, and specificity showed a similar trend. Discussion In conclusion, a DR model was successfully developed to predict ES-NSCLC OS based on pre-treatment CT images. The results suggested that the feature importance from DR model is highly correlated to the model prediction power.
Collapse
Affiliation(s)
- Rihui Zhang
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Haiming Zhu
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Minbin Chen
- Department of Radiotherapy & Oncology, The First People’s Hospital of Kunshan, Kunshan, Jiangsu, China
| | - Weiwei Sang
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Ke Lu
- Deparment of Radiation Oncology, Duke University, Durham, NC, United States
| | - Zhen Li
- Radiation Oncology Department, Shanghai Sixth People’s Hospital, Shanghai, China
| | - Chunhao Wang
- Deparment of Radiation Oncology, Duke University, Durham, NC, United States
| | - Lei Zhang
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Fang-Fang Yin
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Zhenyu Yang
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| |
Collapse
|
7
|
Waqas A, Tripathi A, Ramachandran RP, Stewart PA, Rasool G. Multimodal data integration for oncology in the era of deep neural networks: a review. Front Artif Intell 2024; 7:1408843. [PMID: 39118787 PMCID: PMC11308435 DOI: 10.3389/frai.2024.1408843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Accepted: 07/09/2024] [Indexed: 08/10/2024] Open
Abstract
Cancer research encompasses data across various scales, modalities, and resolutions, from screening and diagnostic imaging to digitized histopathology slides to various types of molecular data and clinical records. The integration of these diverse data types for personalized cancer care and predictive modeling holds the promise of enhancing the accuracy and reliability of cancer screening, diagnosis, and treatment. Traditional analytical methods, which often focus on isolated or unimodal information, fall short of capturing the complex and heterogeneous nature of cancer data. The advent of deep neural networks has spurred the development of sophisticated multimodal data fusion techniques capable of extracting and synthesizing information from disparate sources. Among these, Graph Neural Networks (GNNs) and Transformers have emerged as powerful tools for multimodal learning, demonstrating significant success. This review presents the foundational principles of multimodal learning including oncology data modalities, taxonomy of multimodal learning, and fusion strategies. We delve into the recent advancements in GNNs and Transformers for the fusion of multimodal data in oncology, spotlighting key studies and their pivotal findings. We discuss the unique challenges of multimodal learning, such as data heterogeneity and integration complexities, alongside the opportunities it presents for a more nuanced and comprehensive understanding of cancer. Finally, we present some of the latest comprehensive multimodal pan-cancer data sources. By surveying the landscape of multimodal data integration in oncology, our goal is to underline the transformative potential of multimodal GNNs and Transformers. Through technological advancements and the methodological innovations presented in this review, we aim to chart a course for future research in this promising field. This review may be the first that highlights the current state of multimodal modeling applications in cancer using GNNs and transformers, presents comprehensive multimodal oncology data sources, and sets the stage for multimodal evolution, encouraging further exploration and development in personalized cancer care.
Collapse
Affiliation(s)
- Asim Waqas
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, United States
- Department of Cancer Epidemiology, Moffitt Cancer Center, Tampa, FL, United States
| | - Aakash Tripathi
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, United States
| | - Ravi P. Ramachandran
- Department of Electrical and Computer Engineering, Rowan University, Glassboro, NJ, United States
| | - Paul A. Stewart
- Department of Biostatistics and Bioinformatics, Moffitt Cancer Center, Tampa, FL, United States
| | - Ghulam Rasool
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, United States
| |
Collapse
|
8
|
Mi H, Sivagnanam S, Ho WJ, Zhang S, Bergman D, Deshpande A, Baras AS, Jaffee EM, Coussens LM, Fertig EJ, Popel AS. Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology. Brief Bioinform 2024; 25:bbae421. [PMID: 39179248 PMCID: PMC11343572 DOI: 10.1093/bib/bbae421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 07/11/2024] [Accepted: 08/09/2024] [Indexed: 08/26/2024] Open
Abstract
Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.
Collapse
Affiliation(s)
- Haoyang Mi
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Shamilene Sivagnanam
- The Knight Cancer Institute, Oregon Health and Science University, Portland, OR 97201, United States
- Department of Cell, Development and Cancer Biology, Oregon Health and Science University, Portland, OR 97201, United States
| | - Won Jin Ho
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
| | - Shuming Zhang
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Daniel Bergman
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
| | - Atul Deshpande
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Alexander S Baras
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Pathology, Johns Hopkins University School of Medicine, MD 21205, United States
- The Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Elizabeth M Jaffee
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Lisa M Coussens
- The Knight Cancer Institute, Oregon Health and Science University, Portland, OR 97201, United States
- Department of Cell, Development and Cancer Biology, Oregon Health and Science University, Portland, OR 97201, United States
- Brenden-Colson Center for Pancreatic Care, Oregon Health and Science University, Portland, OR 97201, United States
| | - Elana J Fertig
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Applied Mathematics and Statistics, Johns Hopkins University Whiting School of Engineering, Baltimore, MD 21218, United States
| | - Aleksander S Popel
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
| |
Collapse
|
9
|
Shen Y, Yang X, Liu H, Li Z. Advancing mortality rate prediction in European population clusters: integrating deep learning and multiscale analysis. Sci Rep 2024; 14:6255. [PMID: 38491097 PMCID: PMC10942990 DOI: 10.1038/s41598-024-56390-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 03/06/2024] [Indexed: 03/18/2024] Open
Abstract
Accurately predicting population mortality rates is crucial for effective retirement insurance and economic policy formulation. Recent advancements in deep learning time series forecasting (DLTSF) have led to improved mortality rate predictions compared to traditional models like Lee-Carter (LC). This study focuses on mortality rate prediction in large clusters across Europe. By utilizing PCA dimensionality reduction and statistical clustering techniques, we integrate age features from high-dimensional mortality data of multiple countries, analyzing their similarities and differences. To capture the heterogeneous characteristics, an adaptive adjustment matrix is generated, incorporating sequential variation and spatial geographical information. Additionally, a combination of graph neural networks and a transformer network with an adaptive adjustment matrix is employed to capture the spatiotemporal features between different clusters. Extensive numerical experiments using data from the Human Mortality Database validate the superiority of the proposed GT-A model over traditional LC models and other classic neural networks in terms of prediction accuracy. Consequently, the GT-A model serves as a powerful forecasting tool for global population studies and the international life insurance field.
Collapse
Affiliation(s)
- Yuewen Shen
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215000, China
| | - Xinhao Yang
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215000, China.
| | - Hao Liu
- School of Mechanical and Electrical Engineering, Soochow University, Suzhou, 215000, China
| | - Ze Li
- School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou, 215000, China
| |
Collapse
|
10
|
Cellina M, De Padova G, Caldarelli N, Libri D, Cè M, Martinenghi C, Alì M, Papa S, Carrafiello G. Artificial Intelligence in Lung Cancer Imaging: From Data to Therapy. Crit Rev Oncog 2024; 29:1-13. [PMID: 38505877 DOI: 10.1615/critrevoncog.2023050439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
Lung cancer remains a global health challenge, leading to substantial morbidity and mortality. While prevention and early detection strategies have improved, the need for precise diagnosis, prognosis, and treatment remains crucial. In this comprehensive review article, we explore the role of artificial intelligence (AI) in reshaping the management of lung cancer. AI may have different potential applications in lung cancer characterization and outcome prediction. Manual segmentation is a time-consuming task, with high inter-observer variability, that can be replaced by AI-based approaches, including deep learning models such as U-Net, BCDU-Net, and others, to quantify lung nodules and cancers objectively and to extract radiomics features for the characterization of the tissue. AI models have also demonstrated their ability to predict treatment responses, such as immunotherapy and targeted therapy, by integrating radiomic features with clinical data. Additionally, AI-based prognostic models have been developed to identify patients at higher risk and personalize treatment strategies. In conclusion, this review article provides a comprehensive overview of the current state of AI applications in lung cancer management, spanning from segmentation and virtual biopsy to outcome prediction. The evolving role of AI in improving the precision and effectiveness of lung cancer diagnosis and treatment underscores its potential to significantly impact clinical practice and patient outcomes.
Collapse
Affiliation(s)
- Michaela Cellina
- Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Milano, Piazza Principessa Clotilde 3, 20121, Milan, Italy
| | - Giuseppe De Padova
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Nazarena Caldarelli
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Dario Libri
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Maurizio Cè
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy
| | - Carlo Martinenghi
- Radiology Department, Ospedale San Raffaele, Via Olgettina, 60 - 20132 Milan, Italy
| | - Marco Alì
- Radiology Unit, CDI, Centro Diagnostico Italiano, Via Simone Saint Bon, 20, 20147 Milan, Italy
| | - Sergio Papa
- Radiology Unit, CDI, Centro Diagnostico Italiano, Via Simone Saint Bon, 20, 20147 Milan, Italy
| | - Gianpaolo Carrafiello
- Postgraduation School in Radiodiagnostics, Università degli Studi di Milano, Via Festa del Perdono, 7, 20122 Milan, Italy; Radiology Department, Fondazione IRCCS Cà Granda, Policlinico di Milano Ospedale Maggiore, Università di Milano, 20122 Milan, Italy
| |
Collapse
|
11
|
Gogoshin G, Rodin AS. Graph Neural Networks in Cancer and Oncology Research: Emerging and Future Trends. Cancers (Basel) 2023; 15:5858. [PMID: 38136405 PMCID: PMC10742144 DOI: 10.3390/cancers15245858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/09/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023] Open
Abstract
Next-generation cancer and oncology research needs to take full advantage of the multimodal structured, or graph, information, with the graph data types ranging from molecular structures to spatially resolved imaging and digital pathology, biological networks, and knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on large multimodal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. We then identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise guidelines for cancer and oncology researchers or physician-scientists, asking the question of whether they should adopt the GNN methodology in their research pipelines.
Collapse
Affiliation(s)
- Grigoriy Gogoshin
- Department of Computational and Quantitative Medicine, Beckman Research Institute, and Diabetes and Metabolism Research Institute, City of Hope National Medical Center, 1500 East Duarte Road, Duarte, CA 91010, USA
| | - Andrei S. Rodin
- Department of Computational and Quantitative Medicine, Beckman Research Institute, and Diabetes and Metabolism Research Institute, City of Hope National Medical Center, 1500 East Duarte Road, Duarte, CA 91010, USA
| |
Collapse
|
12
|
Fanizzi A, Fadda F, Comes MC, Bove S, Catino A, Di Benedetto E, Milella A, Montrone M, Nardone A, Soranno C, Rizzo A, Guven DC, Galetta D, Massafra R. Comparison between vision transformers and convolutional neural networks to predict non-small lung cancer recurrence. Sci Rep 2023; 13:20605. [PMID: 37996651 PMCID: PMC10667245 DOI: 10.1038/s41598-023-48004-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 11/21/2023] [Indexed: 11/25/2023] Open
Abstract
Non-Small cell lung cancer (NSCLC) is one of the most dangerous cancers, with 85% of all new lung cancer diagnoses and a 30-55% of recurrence rate after surgery. Thus, an accurate prediction of recurrence risk in NSCLC patients during diagnosis could be essential to drive targeted therapies preventing either overtreatment or undertreatment of cancer patients. The radiomic analysis of CT images has already shown great potential in solving this task; specifically, Convolutional Neural Networks (CNNs) have already been proposed providing good performances. Recently, Vision Transformers (ViTs) have been introduced, reaching comparable and even better performances than traditional CNNs in image classification. The aim of the proposed paper was to compare the performances of different state-of-the-art deep learning algorithms to predict cancer recurrence in NSCLC patients. In this work, using a public database of 144 patients, we implemented a transfer learning approach, involving different Transformers architectures like pre-trained ViTs, pre-trained Pyramid Vision Transformers, and pre-trained Swin Transformers to predict the recurrence of NSCLC patients from CT images, comparing their performances with state-of-the-art CNNs. Although, the best performances in this study are reached via CNNs with AUC, Accuracy, Sensitivity, Specificity, and Precision equal to 0.91, 0.89, 0.85, 0.90, and 0.78, respectively, Transformer architectures reach comparable ones with AUC, Accuracy, Sensitivity, Specificity, and Precision equal to 0.90, 0.86, 0.81, 0.89, and 0.75, respectively. Based on our preliminary experimental results, it appears that Transformers architectures do not add improvements in terms of predictive performance to the addressed problem.
Collapse
Affiliation(s)
- Annarita Fanizzi
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Federico Fadda
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Maria Colomba Comes
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy.
| | - Samantha Bove
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy.
| | - Annamaria Catino
- Unità Operativa Complessa di Oncologia Toracica, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Erika Di Benedetto
- Unità Operativa Complessa di Oncologia Medica, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Angelo Milella
- Dipartimento di ElettronicaInformazione e Bioingegneria, Politecnico di Milano, Via Giuseppe Ponzio, 34, 20133, Milan, Italy
| | - Michele Montrone
- Unità Operativa Complessa di Oncologia Toracica, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Annalisa Nardone
- Unità Operativa Complessa di Radioterapia, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Clara Soranno
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Alessandro Rizzo
- Unità Operativa Complessa di Oncologia Medica 'Don Tonino Bello', I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Deniz Can Guven
- Department of Medical Oncology, Hacettepe University Cancer Institute, 06100, Sihhiye, Ankara, Turkey
| | - Domenico Galetta
- Unità Operativa Complessa di Oncologia Toracica, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| | - Raffaella Massafra
- Struttura Semplice Dipartimentale Fisica Sanitaria, I.R.C.C.S. Istituto Tumori 'Giovanni Paolo II', Viale Orazio Flacco 65, 70124, Bari, Italy
| |
Collapse
|
13
|
Prosper AE, Kammer MN, Maldonado F, Aberle DR, Hsu W. Expanding Role of Advanced Image Analysis in CT-detected Indeterminate Pulmonary Nodules and Early Lung Cancer Characterization. Radiology 2023; 309:e222904. [PMID: 37815447 PMCID: PMC10623199 DOI: 10.1148/radiol.222904] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 03/23/2023] [Accepted: 03/30/2023] [Indexed: 10/11/2023]
Abstract
The implementation of low-dose chest CT for lung screening presents a crucial opportunity to advance lung cancer care through early detection and interception. In addition, millions of pulmonary nodules are incidentally detected annually in the United States, increasing the opportunity for early lung cancer diagnosis. Yet, realization of the full potential of these opportunities is dependent on the ability to accurately analyze image data for purposes of nodule classification and early lung cancer characterization. This review presents an overview of traditional image analysis approaches in chest CT using semantic characterization as well as more recent advances in the technology and application of machine learning models using CT-derived radiomic features and deep learning architectures to characterize lung nodules and early cancers. Methodological challenges currently faced in translating these decision aids to clinical practice, as well as the technical obstacles of heterogeneous imaging parameters, optimal feature selection, choice of model, and the need for well-annotated image data sets for the purposes of training and validation, will be reviewed, with a view toward the ultimate incorporation of these potentially powerful decision aids into routine clinical practice.
Collapse
Affiliation(s)
- Ashley Elizabeth Prosper
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Michael N. Kammer
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Fabien Maldonado
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Denise R. Aberle
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - William Hsu
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| |
Collapse
|
14
|
Ali H, Mohsen F, Shah Z. Improving diagnosis and prognosis of lung cancer using vision transformers: a scoping review. BMC Med Imaging 2023; 23:129. [PMID: 37715137 PMCID: PMC10503208 DOI: 10.1186/s12880-023-01098-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 09/05/2023] [Indexed: 09/17/2023] Open
Abstract
BACKGROUND Vision transformer-based methods are advancing the field of medical artificial intelligence and cancer imaging, including lung cancer applications. Recently, many researchers have developed vision transformer-based AI methods for lung cancer diagnosis and prognosis. OBJECTIVE This scoping review aims to identify the recent developments on vision transformer-based AI methods for lung cancer imaging applications. It provides key insights into how vision transformers complemented the performance of AI and deep learning methods for lung cancer. Furthermore, the review also identifies the datasets that contributed to advancing the field. METHODS In this review, we searched Pubmed, Scopus, IEEEXplore, and Google Scholar online databases. The search terms included intervention terms (vision transformers) and the task (i.e., lung cancer, adenocarcinoma, etc.). Two reviewers independently screened the title and abstract to select relevant studies and performed the data extraction. A third reviewer was consulted to validate the inclusion and exclusion. Finally, the narrative approach was used to synthesize the data. RESULTS Of the 314 retrieved studies, this review included 34 studies published from 2020 to 2022. The most commonly addressed task in these studies was the classification of lung cancer types, such as lung squamous cell carcinoma versus lung adenocarcinoma, and identifying benign versus malignant pulmonary nodules. Other applications included survival prediction of lung cancer patients and segmentation of lungs. The studies lacked clear strategies for clinical transformation. SWIN transformer was a popular choice of the researchers; however, many other architectures were also reported where vision transformer was combined with convolutional neural networks or UNet model. Researchers have used the publicly available lung cancer datasets of the lung imaging database consortium and the cancer genome atlas. One study used a cluster of 48 GPUs, while other studies used one, two, or four GPUs. CONCLUSION It can be concluded that vision transformer-based models are increasingly in popularity for developing AI methods for lung cancer applications. However, their computational complexity and clinical relevance are important factors to be considered for future research work. This review provides valuable insights for researchers in the field of AI and healthcare to advance the state-of-the-art in lung cancer diagnosis and prognosis. We provide an interactive dashboard on lung-cancer.onrender.com/ .
Collapse
Affiliation(s)
- Hazrat Ali
- College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar.
| | - Farida Mohsen
- College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Zubair Shah
- College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar.
| |
Collapse
|
15
|
Yang Z, Wang C, Wang Y, Lafata KJ, Zhang H, Ackerson BG, Kelsey C, Tong B, Yin FF. Development of a multi-feature-combined model: proof-of-concept with application to local failure prediction of post-SBRT or surgery early-stage NSCLC patients. Front Oncol 2023; 13:1185771. [PMID: 37781201 PMCID: PMC10534017 DOI: 10.3389/fonc.2023.1185771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 08/21/2023] [Indexed: 10/03/2023] Open
Abstract
Objective To develop a Multi-Feature-Combined (MFC) model for proof-of-concept in predicting local failure (LR) in NSCLC patients after surgery or SBRT using pre-treatment CT images. This MFC model combines handcrafted radiomic features, deep radiomic features, and patient demographic information in an integrated machine learning workflow. Methods The MFC model comprised three key steps. (1) Extraction of 92 handcrafted radiomic features from the GTV segmented on pre-treatment CT images. (2) Extraction of 512 deep radiomic features from pre-trained U-Net encoder. (3) The extracted handcrafted radiomic features, deep radiomic features, along with 4 patient demographic information (i.e., gender, age, tumor volume, and Charlson comorbidity index), were concatenated as a multi-dimensional input to the classifiers for LR prediction. Two NSCLC patient cohorts from our institution were investigated: (1) the surgery cohort includes 83 patients with segmentectomy or wedge resection (7 LR), and (2) the SBRT cohort includes 84 patients with lung SBRT (9 LR). The MFC model was developed and evaluated independently for both cohorts, and was subsequently compared against the prediction models based on only handcrafted radiomic features (R models), patient demographic information (PI models), and deep learning modeling (DL models). ROC with AUC was adopted to evaluate model performance with leave-one-out cross-validation (LOOCV) and 100-fold Monte Carlo random validation (MCRV). The t-test was performed to identify the statistically significant differences. Results In LOOCV, the AUC range (surgery/SBRT) of the MFC model was 0.858-0.895/0.868-0.913, which was higher than the three other models: 0.356-0.480/0.322-0.650 for PI models, 0.559-0.618/0.639-0.682 for R models, and 0.809/0.843 for DL models. In 100-fold MCRV, the MFC model again showed the highest AUC results (surgery/SBRT): 0.742-0.825/0.888-0.920, which were significantly higher than PI models: 0.464-0.564/0.538-0.628, R models: 0.557-0.652/0.551-0.732, and DL models: 0.702/0.791. Conclusion We successfully developed an MFC model that combines feature information from multiple sources for proof-of-concept prediction of LR in patients with surgical and SBRT early-stage NSCLC. Initial results suggested that incorporating pre-treatment patient information from multiple sources improves the ability to predict the risk of local failure.
Collapse
Affiliation(s)
- Zhenyu Yang
- Department of Radiation Oncology, Duke University, Durham, NC, United States
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
- Medical Physics Graduate Program, Duke University, Durham, NC, United States
| | - Chunhao Wang
- Department of Radiation Oncology, Duke University, Durham, NC, United States
| | - Yuqi Wang
- Medical Physics Graduate Program, Duke University, Durham, NC, United States
| | - Kyle J. Lafata
- Department of Radiation Oncology, Duke University, Durham, NC, United States
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, United States
- Department of Radiology, Duke University, Durham, NC, United States
| | - Haozhao Zhang
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| | - Bradley G. Ackerson
- Department of Radiation Oncology, Duke University, Durham, NC, United States
| | - Christopher Kelsey
- Department of Radiation Oncology, Duke University, Durham, NC, United States
| | - Betty Tong
- Department of Surgery, Duke University, Durham, NC, United States
| | - Fang-Fang Yin
- Department of Radiation Oncology, Duke University, Durham, NC, United States
- Medical Physics Graduate Program, Duke Kunshan University, Kunshan, Jiangsu, China
| |
Collapse
|
16
|
Yang W, Wu W, Wang L, Zhang S, Zhao J, Qiang Y. PMSG-Net: A priori-guided multilevel graph transformer fusion network for immunotherapy efficacy prediction. Comput Biol Med 2023; 164:107371. [PMID: 37586204 DOI: 10.1016/j.compbiomed.2023.107371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 07/24/2023] [Accepted: 08/12/2023] [Indexed: 08/18/2023]
Abstract
In the case of specific immunotherapy regimens and access to pre-treatment CT scans, developing reliable, interpretable intelligent image biomarkers to predict efficacy is essential for physician decision-making and patient treatment selection. However, varying levels of prognosis show a similar appearance on CT scans. It becomes challenging to stratify patients by a single pre-treatment CT scan when presenting subtle differences in images for experienced experts and existing prognostic classification methods. In addition, the pattern of peri-tumoural radiological structures also determines the patient's response to ICIs. Therefore, it is essential to develop a method that focuses on the clinical priori features of the tumour edges but also makes full use of the rich information within the 3D tumour. This paper proposes a priori-guided multilevel graph transformer fusion network (PMSG-Net). Specifically, a graph convolutional network is first used to obtain a feature representation of the tumour edge, and complementary information from that detailed representation is used to enhance the global representation. In the tumour global representation branch (MSGNet), we designed the cascaded scale-enhanced swin transformer to obtain attributes of graph nodes, and efficiently learn and model spatial dependencies and semantic connections at different scales through multi-hop context-aware attention (MCA), yielding a richer global semantic representation. To our knowledge, this is the first attempt to use graph neural networks to predict the efficacy of immunotherapy, and the experimental results show that this method outperforms the current mainstream methods.
Collapse
Affiliation(s)
- Wanting Yang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Wei Wu
- Department of Clinical Laboratory, Affiliated People's Hospital of Shanxi Medical University, Shanxi Provincial People's Hospital, Taiyuan, Shanxi, China
| | - Long Wang
- Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| | - Shuming Zhang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Juanjuan Zhao
- College of Software, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Yan Qiang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| |
Collapse
|
17
|
Restrepo JC, Dueñas D, Corredor Z, Liscano Y. Advances in Genomic Data and Biomarkers: Revolutionizing NSCLC Diagnosis and Treatment. Cancers (Basel) 2023; 15:3474. [PMID: 37444584 DOI: 10.3390/cancers15133474] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 06/23/2023] [Accepted: 06/27/2023] [Indexed: 07/15/2023] Open
Abstract
Non-small cell lung cancer (NSCLC) is a significant public health concern with high mortality rates. Recent advancements in genomic data, bioinformatics tools, and the utilization of biomarkers have improved the possibilities for early diagnosis, effective treatment, and follow-up in NSCLC. Biomarkers play a crucial role in precision medicine by providing measurable indicators of disease characteristics, enabling tailored treatment strategies. The integration of big data and artificial intelligence (AI) further enhances the potential for personalized medicine through advanced biomarker analysis. However, challenges remain in the impact of new biomarkers on mortality and treatment efficacy due to limited evidence. Data analysis, interpretation, and the adoption of precision medicine approaches in clinical practice pose additional challenges and emphasize the integration of biomarkers with advanced technologies such as genomic data analysis and artificial intelligence (AI), which enhance the potential of precision medicine in NSCLC. Despite these obstacles, the integration of biomarkers into precision medicine has shown promising results in NSCLC, improving patient outcomes and enabling targeted therapies. Continued research and advancements in biomarker discovery, utilization, and evidence generation are necessary to overcome these challenges and further enhance the efficacy of precision medicine. Addressing these obstacles will contribute to the continued improvement of patient outcomes in non-small cell lung cancer.
Collapse
Affiliation(s)
- Juan Carlos Restrepo
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 760035, Colombia
| | - Diana Dueñas
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 760035, Colombia
| | - Zuray Corredor
- Grupo de Investigaciones en Odontología (GIOD), Facultad de Odontología, Universidad Cooperativa de Colombia, Pasto 520002, Colombia
- Facultad de Salud, Departamento de Ciencias Básicas, Universidad Libre, Cali 760026, Colombia
| | - Yamil Liscano
- Grupo de Investigación en Salud Integral (GISI), Departamento Facultad de Salud, Universidad Santiago de Cali, Cali 760035, Colombia
| |
Collapse
|
18
|
Hochhegger B, Pasini R, Roncally Carvalho A, Rodrigues R, Altmayer S, Kayat Bittencourt L, Marchiori E, Forghani R. Artificial Intelligence for Cardiothoracic Imaging: Overview of Current and Emerging Applications. Semin Roentgenol 2023; 58:184-195. [PMID: 37087139 DOI: 10.1053/j.ro.2023.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 02/02/2023] [Indexed: 03/07/2023]
Abstract
Artificial intelligence algorithms can learn by assimilating information from large datasets in order to decipher complex associations, identify previously undiscovered pathophysiological states, and construct prediction models. There has been tremendous interest and increased incorporation of artificial intelligence into various industries, including healthcare. As a result, there has been an exponential rise in the number of research articles and industry participants producing models intended for a variety of applications in medical imaging, which can be challenging to navigate for radiologists. In thoracic imaging, multiple applications are being evaluated for chest radiography and computed tomography and include applications for lung nodule evaluation and cancer imaging, quantifying diffuse lung disorders, and cardiac imaging, to name a few. This review aims to provide an overview of current clinical AI models, focusing on the most common clinical applications of AI in cardiothoracic imaging.
Collapse
|
19
|
Zhang H, Xi Q, Zhang F, Li Q, Jiao Z, Ni X. Application of Deep Learning in Cancer Prognosis Prediction Model. Technol Cancer Res Treat 2023; 22:15330338231199287. [PMID: 37709267 PMCID: PMC10503281 DOI: 10.1177/15330338231199287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/16/2023] Open
Abstract
As an important branch of artificial intelligence and machine learning, deep learning (DL) has been widely used in various aspects of cancer auxiliary diagnosis, among which cancer prognosis is the most important part. High-accuracy cancer prognosis is beneficial to the clinical management of patients with cancer. Compared with other methods, DL models can significantly improve the accuracy of prediction. Therefore, this article is a systematic review of the latest research on DL in cancer prognosis prediction. First, the data type, construction process, and performance evaluation index of the DL model are introduced in detail. Then, the current mainstream baseline DL cancer prognosis prediction models, namely, deep neural networks, convolutional neural networks, deep belief networks, deep residual networks, and vision transformers, including network architectures, the latest application in cancer prognosis, and their respective characteristics, are discussed. Next, some key factors that affect the predictive performance of the model and common performance enhancement techniques are listed. Finally, the limitations of the DL cancer prognosis prediction model in clinical practice are summarized, and the future research direction is prospected. This article could provide relevant researchers with a comprehensive understanding of DL cancer prognostic models and is expected to promote the research progress of cancer prognosis prediction.
Collapse
Affiliation(s)
- Heng Zhang
- Department of Radiotherapy Oncology, Changzhou No.2 People's Hospital, Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Medical Physics Research Center, Nanjing Medical University, Changzhou, China
- Key Laboratory of Medical Physics in Changzhou, Changzhou, China
| | - Qianyi Xi
- Department of Radiotherapy Oncology, Changzhou No.2 People's Hospital, Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Medical Physics Research Center, Nanjing Medical University, Changzhou, China
- Key Laboratory of Medical Physics in Changzhou, Changzhou, China
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
| | - Fan Zhang
- Department of Radiotherapy Oncology, Changzhou No.2 People's Hospital, Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Medical Physics Research Center, Nanjing Medical University, Changzhou, China
- Key Laboratory of Medical Physics in Changzhou, Changzhou, China
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
| | - Qixuan Li
- Department of Radiotherapy Oncology, Changzhou No.2 People's Hospital, Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Medical Physics Research Center, Nanjing Medical University, Changzhou, China
- Key Laboratory of Medical Physics in Changzhou, Changzhou, China
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
| | - Zhuqing Jiao
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
| | - Xinye Ni
- Department of Radiotherapy Oncology, Changzhou No.2 People's Hospital, Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Medical Physics Research Center, Nanjing Medical University, Changzhou, China
- Key Laboratory of Medical Physics in Changzhou, Changzhou, China
| |
Collapse
|
20
|
Artificial Intelligence in Lung Cancer Imaging: Unfolding the Future. Diagnostics (Basel) 2022; 12:diagnostics12112644. [PMID: 36359485 PMCID: PMC9689810 DOI: 10.3390/diagnostics12112644] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 10/26/2022] [Accepted: 10/29/2022] [Indexed: 11/30/2022] Open
Abstract
Lung cancer is one of the malignancies with higher morbidity and mortality. Imaging plays an essential role in each phase of lung cancer management, from detection to assessment of response to treatment. The development of imaging-based artificial intelligence (AI) models has the potential to play a key role in early detection and customized treatment planning. Computer-aided detection of lung nodules in screening programs has revolutionized the early detection of the disease. Moreover, the possibility to use AI approaches to identify patients at risk of developing lung cancer during their life can help a more targeted screening program. The combination of imaging features and clinical and laboratory data through AI models is giving promising results in the prediction of patients’ outcomes, response to specific therapies, and risk for toxic reaction development. In this review, we provide an overview of the main imaging AI-based tools in lung cancer imaging, including automated lesion detection, characterization, segmentation, prediction of outcome, and treatment response to provide radiologists and clinicians with the foundation for these applications in a clinical scenario.
Collapse
|