1
|
Chen Z, Chen Y, Su Y, Jiang N, Wanggou S, Li X. Machine learning decision support model construction for craniotomy approach of pineal region tumors based on MRI images. BMC Med Imaging 2025; 25:194. [PMID: 40426149 DOI: 10.1186/s12880-025-01712-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2025] [Accepted: 05/06/2025] [Indexed: 05/29/2025] Open
Abstract
BACKGROUND Pineal region tumors (PRTs) are rare but deep-seated brain tumors, and complete surgical resection is crucial for effective tumor treatment. The choice of surgical approach is often challenging due to the low incidence and deep location. This study aims to combine machine learning and deep learning algorithms with pre-operative MRI images to build a model for PRTs surgical approaches recommendation, striving to model clinical experience for practical reference and education. METHODS This study was a retrospective study which enrolled a total of 173 patients diagnosed with PRTs radiologically from our hospital. Three traditional surgical approaches of were recorded for prediction label. Clinical and VASARI related radiological information were selected for machine learning prediction model construction. And MRI images from axial, sagittal and coronal views of orientation were also used for deep learning craniotomy approach prediction model establishment and evaluation. RESULTS 5 machine learning methods were applied to construct the predictive classifiers with the clinical and VASARI features and all methods could achieve area under the ROC (Receiver operating characteristic) curve (AUC) values over than 0.7. And also, 3 deep learning algorithms (ResNet-50, EfficientNetV2-m and ViT) were applied based on MRI images from different orientations. EfficientNetV2-m achieved the highest AUC value of 0.89, demonstrating a significant high performance of prediction. And class activation mapping was used to reveal that the tumor itself and its surrounding relations are crucial areas for model decision-making. CONCLUSION In our study, we used machine learning and deep learning to construct surgical approach recommendation models. Deep learning could achieve high performance of prediction and provide efficient and personalized decision support tools for PRTs surgical approach. CLINICAL TRIAL NUMBER Not applicable.
Collapse
Affiliation(s)
- Ziyan Chen
- Department of Neurosurgery, Xiangya Hospital, Central South University, No.87 Xiangya Road, Changsha, Hunan, P. R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan, P. R. China
- Xiangya Hospital, Hunan International Scientific and Technological Cooperation Base of Brain Tumor Research, Central South University, Changsha, Hunan, P. R. China
| | - Yinhua Chen
- Department of Neurosurgery, Xiangya Hospital, Central South University, No.87 Xiangya Road, Changsha, Hunan, P. R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan, P. R. China
- Xiangya Hospital, Hunan International Scientific and Technological Cooperation Base of Brain Tumor Research, Central South University, Changsha, Hunan, P. R. China
| | - Yandong Su
- Department of Neurosurgery, Changhai Hospital, Naval Medical University, Shanghai, P. R. China
| | - Nian Jiang
- Department of Neurosurgery, Xiangya Hospital, Central South University, No.87 Xiangya Road, Changsha, Hunan, P. R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan, P. R. China
- Xiangya Hospital, Hunan International Scientific and Technological Cooperation Base of Brain Tumor Research, Central South University, Changsha, Hunan, P. R. China
| | - Siyi Wanggou
- Department of Neurosurgery, Xiangya Hospital, Central South University, No.87 Xiangya Road, Changsha, Hunan, P. R. China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan, P. R. China
- Xiangya Hospital, Hunan International Scientific and Technological Cooperation Base of Brain Tumor Research, Central South University, Changsha, Hunan, P. R. China
| | - Xuejun Li
- Department of Neurosurgery, Xiangya Hospital, Central South University, No.87 Xiangya Road, Changsha, Hunan, P. R. China.
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan, P. R. China.
- Xiangya Hospital, Hunan International Scientific and Technological Cooperation Base of Brain Tumor Research, Central South University, Changsha, Hunan, P. R. China.
- Xiangya School of Medicine, Central South University, Changsha, Hunan, P. R. China.
| |
Collapse
|
2
|
Jiang L, Zhu G, Wang Y, Hong J, Fu J, Hu J, Xiao S, Chu J, Hu S, Xiao W. Development and validation of a multi-omics hemorrhagic transformation model based on hyperattenuated imaging markers following mechanical thrombectomy. Sci Rep 2025; 15:17990. [PMID: 40410254 PMCID: PMC12102234 DOI: 10.1038/s41598-025-02056-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2025] [Accepted: 05/12/2025] [Indexed: 05/25/2025] Open
Abstract
This study aimed to develop a predictive model integrating clinical, radiomics, and deep learning (DL) features of hyperattenuated imaging markers (HIM) from computed tomography scans immediately following mechanical thrombectomy (MT) to predict hemorrhagic transformation (HT). A total of 239 patients with HIM who underwent MT were enrolled, with 191 patients (80%) in the training cohort and 48 patients (20%) in the validation cohort. Additionally, the model was tested on an internal prospective cohort of 49 patients. A total of 1834 radiomics features and 2048 DL features were extracted from HIM images. Statistical methods, such as analysis of variance, Pearson's correlation coefficient, principal component analysis, and least absolute shrinkage and selection operator, were used to select the most significant features. A K-Nearest Neighbor classifier was employed to develop a combined model integrating clinical, radiomics, and DL features for HT prediction. Model performance was evaluated using metrics such as accuracy, sensitivity, specificity, receiver operating characteristic curves, and area under curve (AUC). In the training, validation, and test cohorts, the combined model achieved AUCs of 0.926, 0.923, and 0.887, respectively, outperforming other models, including clinical, radiomics, and DL models, as well as hybrid models combining subsets of features (Clinical + Radiomics, DL + Radiomics, and Clinical + DL) in predicting HT. The combined model, which integrates clinical, radiomics, and DL features derived from HIM, demonstrated efficacy in noninvasively predicting HT. These findings suggest its potential utility in guiding clinical decision-making for patients with MT.
Collapse
Affiliation(s)
- Lina Jiang
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Guoping Zhu
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Yue Wang
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Jiayi Hong
- Department of Neurology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Jingjing Fu
- Department of Neurology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Jibo Hu
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Shengxiang Xiao
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Jiayi Chu
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China
| | - Sheng Hu
- Department of Radiology, the Fourth Affiliated Hospital of School of Medicine, and International School of Medicine, International Institutes of Medicine, Zhejiang University, Yiwu, 322000, China.
| | - Wenbo Xiao
- Department of Radiology, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, 310000, China.
| |
Collapse
|
3
|
Huang Z, Qiu Z, Chen S, Zhang Y, Wang K, Zeng Q, Huang Y, Zhang Y, Bu J. Optimizing Deep Learning Models for Luminal and Nonluminal Breast Cancer Classification Using Multidimensional ROI in DCE-MRI-A Multicenter Study. Cancer Med 2025; 14:e70931. [PMID: 40347080 PMCID: PMC12065080 DOI: 10.1002/cam4.70931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2024] [Revised: 04/14/2025] [Accepted: 04/25/2025] [Indexed: 05/12/2025] Open
Abstract
OBJECTIVES Previous deep learning studies have not explored the synergistic effects of ROI dimensions (2D/2.5D/3D), peritumoral expansion levels (0-8 mm), and segmentation scenarios (ROI only vs. ROI original). Our study aims to evaluate the performance of multidimensional deep transfer learning models in distinguishing molecular subtypes of breast cancer (luminal vs. nonluminal) using DCE-MRI. Under two segmentation scenarios, we systematically compare the effects of ROI dimensions and peritumoral expansion levels to optimize multidimensional deep learning models via transfer learning for distinguishing luminal from nonluminal breast cancers in DCE-MRI-based analysis. MATERIALS AND METHODS From October 2020 to October 2023, data from 426 patients with primary invasive breast cancer were retrospectively collected. Patients were divided into three cohorts: (1) training cohort, n = 108, from SYSU Hospital (Zhuhai, China); (2) validation cohort 1, n = 165, from HZ Hospital (Huizhou, China); and (3) validation cohort 2, n = 153, from LY Hospital (Linyi, China). ROIs were delineated, and expansions of 2, 4, 6, and 8 mm beyond the lesion boundary were performed. We assessed the performance of various deep transfer learning models, considering precise segmentation (ROI only and ROI original) and varying peritumoral regions, using ROC curves and decision curve analysis. RESULTS The 2.5D1-based deep learning model (ROI original, 4 mm expansion) demonstrated optimal performance, achieving an AUC of 0.808 (95% CI 0.715-0.901) in the training cohort, 0.766 (95% CI 0.682-0.850) in validation cohort 1, and 0.799 (95% CI 0.725-0.874) in validation cohort 2. CONCLUSION The study highlights that the 2.5D1-based deep learning model utilizing the three principal slices of the minimum bounding box (ROI original) with a 4 mm peritumoral region is effective in distinguishing between luminal and nonluminal breast cancer tumors, serving as a potential diagnostic tool.
Collapse
Affiliation(s)
- Zhenfeng Huang
- Department of Thyroid & Breast SurgeryThe Fifth Affiliated Hospital, Sun Yat‐sen UniversityZhuhaiChina
- Guangdong Provincial Engineering Research Center of Molecular Imaging, the Fifth Affiliated HospitalSun Yat‐sen UniversityZhuhaiChina
| | - Zhikun Qiu
- Department of Breast SurgeryHuizhou Central People's HospitalHuizhouChina
| | | | - Yideng Zhang
- Department of Thyroid & Breast SurgeryThe Fifth Affiliated Hospital, Sun Yat‐sen UniversityZhuhaiChina
| | - Kunyi Wang
- Department of Thyroid & Breast SurgeryThe Fifth Affiliated Hospital, Sun Yat‐sen UniversityZhuhaiChina
| | - Qingan Zeng
- Department of Thyroid & Breast SurgeryThe Fifth Affiliated Hospital, Sun Yat‐sen UniversityZhuhaiChina
| | - Yukang Huang
- Department of Breast SurgeryHuizhou Central People's HospitalHuizhouChina
| | | | - Juyuan Bu
- Department of Gastrointestinal Surgery, the Fifth Affiliated HospitalSun Yat‐Sen UniversityZhuhaiChina
| |
Collapse
|
4
|
Niu W, Yan J, Hao M, Zhang Y, Li T, Liu C, Li Q, Liu Z, Su Y, Peng B, Tan Y, Wang X, Wang L, Zhang H, Yang G. MRI transformer deep learning and radiomics for predicting IDH wild type TERT promoter mutant gliomas. NPJ Precis Oncol 2025; 9:89. [PMID: 40148588 PMCID: PMC11950645 DOI: 10.1038/s41698-025-00884-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2024] [Accepted: 03/17/2025] [Indexed: 03/29/2025] Open
Abstract
This study aims to predict IDH wt with TERTp-mut gliomas using multiparametric MRI sequences through a novel fusion model, while matching model classification metrics with patient risk stratification aids in crafting personalized diagnostic and prognosis evaluations.Preoperative T1CE and T2FLAIR sequences from 1185 glioma patients were analyzed. A MultiChannel_2.5D_DL model and a 2D DL model, both based on the cross-scale attention vision transformer (CrossFormer) neural network, along with a Radiomics model, were developed. These were integrated via ensemble learning into a stacking model. The MultiChannel_2.5D_DL model outperformed the 2D_DL and Radiomics models, with AUCs of 0.806-0.870. The stacking model achieved the highest AUC (0.855-0.904) across validation sets. Patients were stratified into high-risk and low-risk groups based on stacking model scores, with significant survival differences observed via Kaplan-Meier analysis and log-rank tests. The stacking model effectively identifies IDH wt TERTp-mutant gliomas and stratifies patient risk, aiding personalized prognosis.
Collapse
Affiliation(s)
- Wenju Niu
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Junyu Yan
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China
- Academy of Medical Sciences, Shanxi Medical University, Taiyuan, 030001, China
- Department of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, 030001, China
| | - Min Hao
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Yibo Zhang
- Faculty of Robotics Science and Engineering, Northeastern University, Shenyang, 110000, China
| | - Tianshi Li
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100050, China
| | - Chen Liu
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Qijian Li
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Zihao Liu
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Yincheng Su
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Bo Peng
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China
| | - Yan Tan
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China
| | - Xiaochun Wang
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China
| | - Lei Wang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100050, China.
| | - Hui Zhang
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China.
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China.
- Shanxi Key Laboratory of Intelligent Imaging and Nanomedicine, First Hospital of Shanxi Medical University, Taiyuan, 030001, China.
- Intelligent Imaging Big Data and Functional Nano-imaging Engineering Research Center of Shanxi Province, First Hospital of Shanxi Medical University, Taiyuan, 030001, China.
| | - Guoqiang Yang
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, 030001, China.
- College of Medical Imaging, Shanxi Medical University, Taiyuan, 030001, China.
- Shanxi Key Laboratory of Intelligent Imaging and Nanomedicine, First Hospital of Shanxi Medical University, Taiyuan, 030001, China.
| |
Collapse
|
5
|
Song S, Zhang G, Yao Z, Chen R, Liu K, Zhang T, Zeng G, Wang Z, Liu R. Deep learning based on intratumoral heterogeneity predicts histopathologic grade of hepatocellular carcinoma. BMC Cancer 2025; 25:497. [PMID: 40102774 PMCID: PMC11917083 DOI: 10.1186/s12885-025-13781-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Accepted: 02/20/2025] [Indexed: 03/20/2025] Open
Abstract
OBJECTIVES The potential of medical imaging to non-invasively assess intratumoral heterogeneity (ITH) is increasingly being recognized. This study aimed to investigate the value of the ITH-based deep learning model for preoperative prediction of histopathologic grade in hepatocellular carcinoma (HCC). MATERIALS AND METHODS A total of 858 patients from primary cohort and two external cohorts were included. 3.0T or 1.5T axial portal venous phase MRI images were collected. We conducted radiomics feature-driven K-means clustering for automatic partition to reveal ITH. 2.5D and 3D deep learning models based on ResNet architecture were trained to extract deep learning hidden features of each subregion. The selected features were used to train Random Forest classifier, which constructed the feature-fusion model. RESULTS The extracted voxel-level radiomics features were unsupervised clustered by K-means to generate three subregions. In the 2.5D deep learning, the feature-fusion model based on ITH had superior predictive efficacy than the whole-tumor model (AUC: 0.82 vs. 0.72; p = 0.004). Even in the validation and external test sets, this model maintained a high AUC of 0.78-0.83, and net reclassification indices indicated that it could improve prediction by 25-28%. Regarding the prognostic value, overall survival (OS) and recurrence-free survival (RFS) could be significantly stratified by the 2.5D feature-fusion model, and multivariable Cox regressions indicated its signature was identified as a risk predictor for OS and RFS (p < 0.05). CONCLUSION The ITH-based feature-fusion model provided a non-invasive method for classifying tumor differentiation in HCC, which may serve as a promising strategy for stratification management.
Collapse
Affiliation(s)
- Shaoming Song
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, 730000, China
| | - Gong Zhang
- Faculty of Hepatopancreatobiliary Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, 100853, China
- Key Laboratory of Digital Hepatobiliary Surgery, Chinese PLA General Hospital, Beijing, 100853, China
| | - Zhiyuan Yao
- Faculty of Hepatopancreatobiliary Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, 100853, China
- Department of Hepatobiliary Surgery, The Sixth Medical Center of Chinese PLA General Hospital, Beijing, 100048, China
| | - Ruiqiu Chen
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, 730000, China
| | - Kai Liu
- Faculty of Hepatopancreatobiliary Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, 100853, China
| | - Tianchen Zhang
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, 730000, China
| | - Guineng Zeng
- Faculty of Hepatopancreatobiliary Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, 100853, China
- Nankai University School of Medicine, Nankai University, Tianjin, 300071, China
| | - Zizheng Wang
- Department of Hepatobiliary Surgery, Senior Department of Hepatology, The Fifth Medical Center of Chinese PLA General Hospital, Beijing, 100039, China.
| | - Rong Liu
- The First School of Clinical Medicine, Lanzhou University, Lanzhou, 730000, China.
- Faculty of Hepatopancreatobiliary Surgery, The First Medical Center of Chinese PLA General Hospital, Beijing, 100853, China.
| |
Collapse
|
6
|
He J, Li H, Zhang B, Liang G, Zhang L, Zhao W, Zhao W, Zhang YJ, Wang ZX, Li JF. Convolutional neural network-assisted Raman spectroscopy for high-precision diagnosis of glioblastoma. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2025; 329:125615. [PMID: 39721487 DOI: 10.1016/j.saa.2024.125615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2024] [Revised: 12/10/2024] [Accepted: 12/16/2024] [Indexed: 12/28/2024]
Abstract
Glioblastoma multiforme (GBM) is the most lethal intracranial tumor with a median survival of approximately 15 months. Due to its highly invasive properties, it is particularly difficult to accurately identify the tumor margins intraoperatively. The current gold standard for diagnosing GBM during surgery is pathology, but it is time-consuming. Under these circumstances, we developed a method combining Raman spectroscopy (RS) with convolutional neural networks (CNN) to distinguish GBM. Analysis of the spectra of normal brain samples (478 spectra) and GBM samples (462 spectra) from 29 in situ intracranial tumor-bearing mice showed that this method identified GBM tissue with 96.8 % accuracy. Subsequently, spectral analysis of 23 normal human brain tissues (223 spectra) versus 21 tissues from patients with pathologically diagnosed GBM (267 spectra) revealed that the accuracy of this method was 93.9 %. Most importantly, for the difference peaks in the spectra of GBM and normal brain tissue, the common difference peaks in the mouse and human spectra were at 750 cm-1, 1440 cm-1, and 1586 cm-1, which emphasized the differences in cytochrome C and lipids between GBM samples and normal brain samples in both mice and human. The preliminary results showed that CNN-assisted RS is simple to operate and can rapidly and accurately identify whether it is GBM tissue or normal brain tissue.
Collapse
Affiliation(s)
- Jiawei He
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Hongmei Li
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Bingchang Zhang
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Gehao Liang
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Liang Zhang
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Wentao Zhao
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Wenpeng Zhao
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China
| | - Yue-Jiao Zhang
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China.
| | - Zhan-Xiang Wang
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China.
| | - Jian-Feng Li
- Department of Neurosurgery and Department of Neuroscience, The First Affiliated Hospital of Xiamen University, School of Medicine, College of Chemistry and Chemical Engineering, College of Energy, Institute of Artificial Intelligence, State Key Laboratory for Physical Chemistry of Solid Surfaces, Xiamen University, Xiamen 361102, China; Scientific Research Foundation of State Key Laboratory of Vaccines for Infectious Diseases, Xiang An Biomedicine Laboratory, Xiamen 361005, China.
| |
Collapse
|
7
|
Byeon Y, Park YW, Lee S, Park D, Shin H, Han K, Chang JH, Kim SH, Lee SK, Ahn SS, Hwang D. Interpretable multimodal transformer for prediction of molecular subtypes and grades in adult-type diffuse gliomas. NPJ Digit Med 2025; 8:140. [PMID: 40044878 PMCID: PMC11883078 DOI: 10.1038/s41746-025-01530-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2024] [Accepted: 02/19/2025] [Indexed: 03/09/2025] Open
Abstract
Molecular subtyping and grading of adult-type diffuse gliomas are essential for treatment decisions and patient prognosis. We introduce GlioMT, an interpretable multimodal transformer that integrates imaging and clinical data to predict the molecular subtype and grade of adult-type diffuse gliomas according to the 2021 WHO classification. GlioMT is trained on multiparametric MRI data from an institutional set of 1053 patients with adult-type diffuse gliomas to predict the IDH mutation status, 1p/19q codeletion status, and tumor grade. External validation on the TCGA (200 patients) and UCSF (477 patients) shows that GlioMT outperforms conventional CNNs and visual transformers, achieving AUCs of 0.915 (TCGA) and 0.981 (UCSF) for IDH mutation, 0.854 (TCGA) and 0.806 (UCSF) for 1p/19q codeletion, and 0.862 (TCGA) and 0.960 (UCSF) for grade prediction. GlioMT enhances the reliability of clinical decision-making by offering interpretability through attention maps and contributions of imaging and clinical data.
Collapse
Affiliation(s)
- Yunsu Byeon
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Yae Won Park
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Soohyun Lee
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Doohyun Park
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - HyungSeob Shin
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jong Hee Chang
- Department of Neurosurgery, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Se Hoon Kim
- Department of Pathology, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Seung-Koo Lee
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Sung Soo Ahn
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea.
| | - Dosik Hwang
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea.
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea.
- Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea.
- Department of Oral and Maxillofacial Radiology, Yonsei University College of Dentistry, Seoul, Republic of Korea.
| |
Collapse
|
8
|
Wang X, Bi Q, Deng C, Wang Y, Miao Y, Kong R, Chen J, Li C, Liu X, Gong X, Zhang Y, Bi G. Multiparametric MRI-based radiomics combined with 3D deep transfer learning to predict cervical stromal invasion in patients with endometrial carcinoma. Abdom Radiol (NY) 2025; 50:1414-1425. [PMID: 39276192 DOI: 10.1007/s00261-024-04577-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 09/06/2024] [Accepted: 09/09/2024] [Indexed: 09/16/2024]
Abstract
OBJECTIVE To develop and compare various preoperative cervical stromal invasion (CSI) prediction models, including radiomics, three-dimensional (3D) deep transfer learning (DTL), and integrated models, using single-sequence and multiparametric MRI. METHODS Data from 466 early-stage endometrial carcinoma (EC) patients from three centers were collected. Radiomics models were constructed based on T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI), apparent diffusion coefficient (ADC) mapping, contrast-enhanced T1-weighted imaging (CE-T1WI), and four combined sequences as well as 3D DTL models. Two integrated models were created using ensemble and stacking algorithms based on optimal radiomics and DTL models. Model performance and clinical benefits were assessed using area under the curve (AUC), decision curve analysis (DCA), net reclassification index (NRI), integrated discrimination index (IDI), and the Delong test for model comparisons. RESULTS Multiparametric MRI models were superior to single-sequence models for radiomics or DTL models. Ensemble and stacking integrated models displayed excellent performance. The stacking model had the highest average AUC (0.908) and accuracy (0.883) in external validation groups 1 and 2 (AUC = 0.965 and 0.851, respectively) and emerged as the best predictive model for CSI. All models significantly outperformed the radiologist (P < 0.05). In terms of net benefits, all models demonstrated favorable outcomes in DCA, NRI, and IDI, with the stacking model yielding the highest net benefit. CONCLUSION Multiparametric MRI-based radiomics combined with 3D DTL can be used to noninvasively predict CSI in EC patients with greater diagnostic accuracy than the radiologist. Stacking integrated models showed significant potential utility in predicting CSI. Which helps to provide new treatment strategy for clinicians to treat early-stage EC patients.
Collapse
Affiliation(s)
- Xianhong Wang
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Qiu Bi
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Cheng Deng
- Department of Radiology, the Second Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Yaoxin Wang
- Department of Radiology, Shenzhen Traditional Chinese Medicine Hospital, the Fourth Clinical Medical College of Guangzhou University of Chinese Medicine, Shenzhen, China
| | - Yunbo Miao
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of Geriatrie Medicine, the First People's Hospital of Yunnan Province, Kunming, China
| | - Ruize Kong
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of Vascular Surgery, the First People's Hospital of Yunnan Province, Kunming, China
| | - Jie Chen
- Department of Radiology, the Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Chenrong Li
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Xiulan Liu
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Xiarong Gong
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China
| | - Ya Zhang
- Department of Radiology, the Third Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Guoli Bi
- The Affiliated Hospital of Kunming University of Science and Technology, Kunming, China.
- Department of MRI, the First People's Hospital of Yunnan Province, Kunming, China.
| |
Collapse
|
9
|
Wang Z, Wang L, Wang Y. Radiomics in glioma: emerging trends and challenges. Ann Clin Transl Neurol 2025; 12:460-477. [PMID: 39901654 PMCID: PMC11920724 DOI: 10.1002/acn3.52306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2024] [Revised: 12/11/2024] [Accepted: 12/31/2024] [Indexed: 02/05/2025] Open
Abstract
Radiomics is a promising neuroimaging technique for extracting and analyzing quantitative glioma features. This review discusses the application, emerging trends, and challenges associated with using radiomics in glioma. Integrating deep learning algorithms enhances various radiomics components, including image normalization, region of interest segmentation, feature extraction, feature selection, and model construction and can potentially improve model accuracy and performance. Moreover, investigating specific tumor habitats of glioblastomas aids in a better understanding of glioblastoma aggressiveness and the development of effective treatment strategies. Additionally, advanced imaging techniques, such as diffusion-weighted imaging, perfusion-weighted imaging, magnetic resonance spectroscopy, magnetic resonance fingerprinting, functional MRI, and positron emission tomography, can provide supplementary information for tumor characterization and classification. Furthermore, radiomics analysis helps understand the glioma immune microenvironment by predicting immune-related biomarkers and characterizing immune responses within tumors. Integrating multi-omics data, such as genomics, transcriptomics, proteomics, and pathomics, with radiomics, aids the understanding of the biological significance of the underlying radiomics features and improves the prediction of genetic mutations, prognosis, and treatment response in patients with glioma. Addressing challenges, such as model reproducibility, model generalizability, model interpretability, and multi-omics data integration, is crucial for the clinical translation of radiomics in glioma.
Collapse
Affiliation(s)
- Zihan Wang
- Department of Neurosurgery, Beijing Tiantan HospitalCapital Medical UniversityBeijingChina
| | - Lei Wang
- Department of NeurosurgeryGuiqian International General HospitalGuiyangGuizhouChina
| | - Yinyan Wang
- Department of Neurosurgery, Beijing Tiantan HospitalCapital Medical UniversityBeijingChina
| |
Collapse
|
10
|
Yang X, Tian N, Zhang Y, Gao C, Hao D, Li J, Zhou C, Cui J. Deep learning radiomics model based on contrast-enhanced MRI for distinguishing between tuberculous spondylitis and pyogenic spondylitis. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2025:10.1007/s00586-025-08696-1. [PMID: 39920318 DOI: 10.1007/s00586-025-08696-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 11/23/2024] [Accepted: 01/26/2025] [Indexed: 02/09/2025]
Abstract
PURPOSE This study aimed to develop and validate a deep learning radiomics nomogram (DLRN) to differentiate between tuberculous spondylitis (TS) and pyogenic spondylitis (PS) using contrast-enhanced MRI (CE-MRI). METHODS A retrospective approach was employed, enrolling patients diagnosed with TS or PS based on pathological examination at two centers. Clinical features were evaluated to establish a clinical model. Radiomics and deep learning (DL) features were extracted from contrast-enhanced T1-weighted images and subsequently fused. Following feature selection, radiomics, DL, combined DL-radiomics (DLR), and a deep learning radiomics nomogram (DLRN) were developed to differentiate TS from PS. Performance was assessed using metrics including the area under the curve (AUC), calibration curves, and decision curve analysis (DCA). RESULTS A total of 147 patients met the study criteria. Center 1 comprised the training cohort with 102 patients (52 TS and 50 PS), while Center 2 served as the external test cohort with 45 patients (17 TS and 28 PS). The DLRN model exhibited the highest diagnostic accuracy, achieving an AUC of 0.994 (95% CI: 0.983-1.000) in the training cohort and 0.859 (95% CI: 0.744-0.975) in the external test cohort. Calibration curves indicated good agreement for DLRN, and decision curve analysis (DCA) demonstrated it provided the greatest clinical benefit. CONCLUSION The CE-MRI-based DLRN showed robust diagnostic capability for distinguishing between TS and PS in clinical practice.
Collapse
Affiliation(s)
- Xiaonan Yang
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Na Tian
- Department of Endocrinology and Metabolism, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Yuzhu Zhang
- Department of Abdominal Ultrasound, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Chuanping Gao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Dapeng Hao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Jie Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China
| | - Chuanli Zhou
- Minimally Invasive Spinal Surgery Center, The Affiliated Hospital of Qingdao University, Qingdao, 266000, Shandong, China
| | - Jiufa Cui
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, 266000, China.
| |
Collapse
|
11
|
Leone A, Di Napoli V, Fochi NP, Di Perna G, Spetzger U, Filimonova E, Angileri F, Carbone F, Colamaria A. Virtual Biopsy for the Prediction of MGMT Promoter Methylation in Gliomas: A Comprehensive Review of Radiomics and Deep Learning Approaches Applied to MRI. Diagnostics (Basel) 2025; 15:251. [PMID: 39941181 PMCID: PMC11816478 DOI: 10.3390/diagnostics15030251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2024] [Revised: 01/18/2025] [Accepted: 01/20/2025] [Indexed: 02/16/2025] Open
Abstract
Background/Objectives: The methylation status of the O6-methylguanine-DNA methyltransferase (MGMT) promoter in gliomas has emerged as a critical biomarker for prognosis and treatment response. Conventional methods for assessing MGMT promoter methylation, such as methylation-specific PCR, are invasive and require tissue sampling. Methods: A comprehensive literature search was performed in compliance with the updated PRISMA 2020 guidelines within electronic databases MEDLINE/PubMed, Scopus, and IEEE Xplore. Search terms, including "MGMT", "methylation", "glioma", "glioblastoma", "machine learning", "deep learning", and "radiomics", were adopted in various MeSH combinations. Original studies in the English, Italian, German, and French languages were considered for inclusion. Results: This review analyzed 34 studies conducted in the last six years, focusing on assessing MGMT methylation status using radiomics (RD), deep learning (DL), or combined approaches. These studies utilized radiological data from the public (e.g., BraTS, TCGA) and private institutional datasets. Sixteen studies focused exclusively on glioblastoma (GBM), while others included low- and high-grade gliomas. Twenty-seven studies reported diagnostic accuracy, with fourteen achieving values above 80%. The combined use of DL and RD generally resulted in higher accuracy, sensitivity, and specificity, although some studies reported lower minimum accuracy compared to studies using a single model. Conclusions: The integration of RD and DL offers a powerful, non-invasive tool for precisely recognizing MGMT promoter methylation status in gliomas, paving the way for enhanced personalized medicine in neuro-oncology. The heterogeneity of study populations, data sources, and methodologies reflected the complexity of the pipeline and machine learning algorithms, which may require general standardization to be implemented in clinical practice.
Collapse
Affiliation(s)
- Augusto Leone
- Department of Neurosurgery, Karlsruher Neurozentrum, Städtisches Klinikum Karlsruhe, 76133 Karlsruhe, Germany; (A.L.); (U.S.); (F.C.)
- Faculty of Human Medicine, Charité Universitätsmedizin, 10117 Berlin, Germany
| | - Veronica Di Napoli
- Department of Neurosurgery, University of Turin, 10124 Turin, Italy; (V.D.N.); (N.P.F.)
| | - Nicola Pio Fochi
- Department of Neurosurgery, University of Turin, 10124 Turin, Italy; (V.D.N.); (N.P.F.)
| | - Giuseppe Di Perna
- Division of Neurosurgery, “Policlinico Riuniti”, 71122 Foggia, Italy;
| | - Uwe Spetzger
- Department of Neurosurgery, Karlsruher Neurozentrum, Städtisches Klinikum Karlsruhe, 76133 Karlsruhe, Germany; (A.L.); (U.S.); (F.C.)
| | - Elena Filimonova
- Department of Neuroradiology, Federal Neurosurgical Center, 630048 Novosibirsk, Russia;
| | - Flavio Angileri
- Department of Neurosurgery, University of Messina, 98122 Messina, Italy;
| | - Francesco Carbone
- Department of Neurosurgery, Karlsruher Neurozentrum, Städtisches Klinikum Karlsruhe, 76133 Karlsruhe, Germany; (A.L.); (U.S.); (F.C.)
- Division of Neurosurgery, “Policlinico Riuniti”, 71122 Foggia, Italy;
| | - Antonio Colamaria
- Division of Neurosurgery, “Policlinico Riuniti”, 71122 Foggia, Italy;
| |
Collapse
|
12
|
Zhou J, Yang D, Tang H. Magnetic resonance imaging radiomics based on artificial intelligence is helpful to evaluate the prognosis of single hepatocellular carcinoma. Heliyon 2025; 11:e41735. [PMID: 39866463 PMCID: PMC11761343 DOI: 10.1016/j.heliyon.2025.e41735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 01/04/2025] [Accepted: 01/05/2025] [Indexed: 01/28/2025] Open
Abstract
Background Previous studies mostly use single-type features to establish a prediction model. We aim to develop a comprehensive prediction model that effectively identify patients with poor prognosis for single hepatocellular carcinoma (HCC) based on artificial intelligence (AI). Patients and methods: 236 single HCC patients were studied to establish a comprehensive prediction model. We collected the basic information of patients and used AI to extract the features of magnetic resonance (MR) images. Results The clinical model based on linear regression (LR) algorithm (AUC: 0.658, 95%CI: 0.5021-0.8137), the radiomics model and deep transfer learning (DTL) model based on light gradient-boosting machine (Light GBM) algorithm (AUC: 0.761, 95%CI: 0.6326-0.8886 and AUC: 0.784, 95%CI: 0.6587-0.9087, respectively) were the optimal prediction models. A comparison revealed that the integrated nomogram had the largest area under the receiver operating characteristic curve (AUC) (all P < 0.05). In the training cohort, the integrated nomogram was predictive of recurrence-free survival (RFS) as well as overall survival (OS) (C-index: 0.735 and 0.712, P < 0.001). In the test cohort, the integrated nomogram also can predict RFS and OS (C-index: 0.718 and 0.740, P < 0.001) in patients. Conclusion The integrated nomogram composed of signatures in the prediction models can not only predict the postoperative recurrence of single HCC patients but also stratify the risk of OS after the operation.
Collapse
Affiliation(s)
- Jing Zhou
- Department of Infectious Diseases, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Daofeng Yang
- Department of Infectious Diseases, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Hao Tang
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
13
|
Wang FA, Li Y, Zeng T. Deep Learning of radiology-genomics integration for computational oncology: A mini review. Comput Struct Biotechnol J 2024; 23:2708-2716. [PMID: 39035833 PMCID: PMC11260400 DOI: 10.1016/j.csbj.2024.06.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 06/18/2024] [Accepted: 06/18/2024] [Indexed: 07/23/2024] Open
Abstract
In the field of computational oncology, patient status is often assessed using radiology-genomics, which includes two key technologies and data, such as radiology and genomics. Recent advances in deep learning have facilitated the integration of radiology-genomics data, and even new omics data, significantly improving the robustness and accuracy of clinical predictions. These factors are driving artificial intelligence (AI) closer to practical clinical applications. In particular, deep learning models are crucial in identifying new radiology-genomics biomarkers and therapeutic targets, supported by explainable AI (xAI) methods. This review focuses on recent developments in deep learning for radiology-genomics integration, highlights current challenges, and outlines some research directions for multimodal integration and biomarker discovery of radiology-genomics or radiology-omics that are urgently needed in computational oncology.
Collapse
Affiliation(s)
- Feng-ao Wang
- Key Laboratory of Systems Health Science of Zhejiang Province, School of Life Science, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China
| | - Yixue Li
- Key Laboratory of Systems Health Science of Zhejiang Province, School of Life Science, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China
- Guangzhou National Laboratory, Guangzhou, China
- GMU-GIBH Joint School of Life Sciences, The Guangdong-Hong Kong-Macau Joint Laboratory for Cell Fate Regulation and Diseases, Guangzhou Laboratory, Guangzhou Medical University, Guangzhou, China
| | - Tao Zeng
- Guangzhou National Laboratory, Guangzhou, China
- GMU-GIBH Joint School of Life Sciences, The Guangdong-Hong Kong-Macau Joint Laboratory for Cell Fate Regulation and Diseases, Guangzhou Laboratory, Guangzhou Medical University, Guangzhou, China
| |
Collapse
|
14
|
Sun X, Li S, Ma C, Fang W, Jing X, Yang C, Li H, Zhang X, Ge C, Liu B, Li Z. Glioma subtype prediction based on radiomics of tumor and peritumoral edema under automatic segmentation. Sci Rep 2024; 14:27471. [PMID: 39523433 PMCID: PMC11551193 DOI: 10.1038/s41598-024-79344-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Accepted: 11/08/2024] [Indexed: 11/16/2024] Open
Abstract
Comprehensive and non-invasive preoperative molecular diagnosis is important for prognostic and therapy decision-making in adult-type diffuse gliomas. We employed a deep learning method for automatic segmentation of brain gliomas directly from conventional magnetic resonance imaging (MRI) scans of the tumor core and peritumoral edema regions based on available glioma MRI data provided in the BraTS2021. Three-dimensional volumes of interest were segmented from 424 cases of glioma imaging data retrospectively obtained from two medical centers using the segmentation method and radiomic features were extracted. We developed a subtype prediction model based on extracted radiomic features and analyzed significance and correlations between glioma morphological characteristics and pathological features using data from patients with adult-type diffuse glioma. The automated segmentation achieved mean Dice scores of 0.884 and 0.889 for the tumor core and whole tumor, respectively. The area under the receiver operating characteristic curve for the prediction of adult-type diffuse gliomas subtypes was 0.945. "Glioblastoma, IDH-wildtype", "Astrocytoma, IDH-mutant", and "Oligodendroglioma, IDH-mutant, 1p/19q-coded" showed AUCs of 0.96, 0.914, and 0.961, respectively, for subtype prediction. Glioma morphological characteristics, molecular and pathological levels, and clinical data showed significant differences and correlations. An automatic segmentation model for gliomas based on 3D U-Nets was developed, and the prediction model for gliomas built using the parameters obtained from the automatic segmentation model showed high overall performance.
Collapse
Affiliation(s)
- Xiangyu Sun
- Department of Neurosurgery, Zhongnan Hospital of Wuhan University, No.125 Donghu Road, WuChang, Wuhan, 430062, China
| | - Sirui Li
- Department of Radiology, Zhongnan Hospital of Wuhan University, Wuchang District, Wuhan, China
| | - Chao Ma
- Department of Neurosurgery, Zhongnan Hospital of Wuhan University, No.125 Donghu Road, WuChang, Wuhan, 430062, China
| | - Wei Fang
- Wuhan Zhongke Industrial Research Institute of Medical Science Co., Ltd., Wuhan, China
| | - Xin Jing
- Wuhan United Imaging Healthcare Surgical Technology Co., Ltd., Wuhan, China
| | - Chao Yang
- Department of Neurosurgery, Zhongnan Hospital of Wuhan University, No.125 Donghu Road, WuChang, Wuhan, 430062, China
| | - Huan Li
- Department of Radiology, Zhongnan Hospital of Wuhan University, Wuchang District, Wuhan, China
| | - Xu Zhang
- Wuhan United Imaging Healthcare Surgical Technology Co., Ltd., Wuhan, China
| | - Chuanbin Ge
- Wuhan United Imaging Healthcare Surgical Technology Co., Ltd., Wuhan, China
| | - Bo Liu
- Wuhan United Imaging Healthcare Surgical Technology Co., Ltd., Wuhan, China
| | - Zhiqiang Li
- Department of Neurosurgery, Zhongnan Hospital of Wuhan University, No.125 Donghu Road, WuChang, Wuhan, 430062, China.
| |
Collapse
|
15
|
Yang Y, Cheng J, Chen L, Cui C, Liu S, Zuo M. Application of machine learning for the differentiation of thymomas and thymic cysts using deep transfer learning: A multi-center comparison of diagnostic performance based on different dimensional models. Thorac Cancer 2024; 15:2235-2247. [PMID: 39305057 PMCID: PMC11543273 DOI: 10.1111/1759-7714.15454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Revised: 09/02/2024] [Accepted: 09/04/2024] [Indexed: 11/09/2024] Open
Abstract
OBJECTIVE This study aimed to evaluate the feasibility and performance of deep transfer learning (DTL) networks with different types and dimensions in differentiating thymomas from thymic cysts in a retrospective cohort. MATERIALS AND METHODS Based on chest-enhanced computed tomography (CT), the region of interest was delineated, and the maximum cross section of the lesion was selected as the input image. Five convolutional neural networks (CNNs) and Vision Transformer (ViT) were used to construct a 2D DTL model. The 2D model constructed by the maximum section (n) and the upper and lower layers (n - 1, n + 1) of the lesion was used for feature extraction, and the features were selected. The remaining features were pre-fused to construct a 2.5D model. The whole lesion image was selected for input and constructing a 3D model. RESULTS In the 2D model, the area under curve (AUC) of Resnet50 was 0.950 in the training cohort and 0.907 in the internal validation cohort. In the 2.5D model, the AUCs of Vgg11 in the internal validation cohort and external validation cohort 1 were 0.937 and 0.965, respectively. The AUCs of Inception_v3 in the training cohort and external validation cohort 2 were 0.981 and 0.950, respectively. The AUC values of 3D_Resnet50 in the four cohorts were 0.987, 0.937, 0.938, and 0.905. CONCLUSIONS The DTL model based on multiple different dimensions can be used as a highly sensitive and specific tool for the non-invasive differential diagnosis of thymomas and thymic cysts to assist clinicians in decision-making.
Collapse
Affiliation(s)
- Yuhua Yang
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| | - Jia Cheng
- Department of RadiologyThe First Affiliated Hospital of Gannan Medical UniversityGanzhouChina
| | - Liang Chen
- Department of RadiologyAffiliated Hospital of Jiujiang UniversityJiujiangChina
| | - Can Cui
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| | - Shaoqiang Liu
- Department of RadiologyThe First Affiliated Hospital of Gannan Medical UniversityGanzhouChina
| | - Minjing Zuo
- Department of Radiology, The Second Affiliated Hospital, Jiangxi Medical CollegeNanchang UniversityNanchangChina
- Intelligent Medical Imaging of Jiangxi Key LaboratoryNanchangChina
| |
Collapse
|
16
|
Huo X, Li H, Xing Y, Liu W, Chen P, Du F, Song L, Yu Z, Cao X, Tian J. Two decades of progress in glioma methylation research: the rise of temozolomide resistance and immunotherapy insights. Front Neurosci 2024; 18:1440756. [PMID: 39286478 PMCID: PMC11402815 DOI: 10.3389/fnins.2024.1440756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 08/12/2024] [Indexed: 09/19/2024] Open
Abstract
Aims This study aims to systematically analyze the global trends in glioma methylation research using bibliometric methodologies. We focus on identifying the scholarly trajectory and key research interests, and we utilize these insights to predict future research directions within the epigenetic context of glioma. Methods We performed a comprehensive literature search of the Web of Science Core Collection (WoSCC) to identify articles related to glioma methylation published from January 1, 2004, to December 31, 2023. The analysis included full-text publications in the English language and excluded non-research publications. Analysis and visualization were performed using GraphPad Prism, CiteSpace, and VOSviewer software. Results The search identified 3,744 publications within the WoSCC database, including 3,124 original research articles and 620 review articles. The research output gradually increased from 2004 to 2007, followed by a significant increase after 2008, which peaked in 2022. A minor decline in publication output was noted during 2020-2021, potentially linked to the coronavirus disease 2019 pandemic. The United States and China were the leading contributors, collectively accounting for 57.85% of the total research output. The Helmholtz Association of Germany, the German Cancer Research Center (DKFZ), and the Ruprecht Karls University of Heidelberg were the most productive institutions. The Journal of Neuro-Oncology led in terms of publication volume, while Neuro-Oncology had the highest Impact Factor. The analysis of publishing authors revealed Michael Weller as the most prolific contributor. The co-citation network analysis identified David N. Louis's article as the most frequently cited. The keyword analysis revealed "temozolomide," "expression," "survival," and "DNA methylation" as the most prominent keywords, while "heterogeneity," "overall survival," and "tumor microenvironment" showed the strongest citation bursts. Conclusions The findings of this study illustrate the increasing scholarly interest in glioma methylation, with a notable increase in research output over the past two decades. This study provides a comprehensive overview of the research landscape, highlighting the importance of temozolomide, DNA methylation, and the tumor microenvironment in glioma research. Despite its limitations, this study offers valuable insights into the current research trends and potential future directions, particularly in the realm of immunotherapy and epigenetic editing techniques.
Collapse
Affiliation(s)
- Xianhao Huo
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
| | - Haoyuan Li
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
- Ningxia Key Laboratory of Cerebrocranial Disease, Ningxia Medical University, Yinchuan, China
- Clinical Medical College, Ningxia Medical University, Yinchuan, China
| | - Yixiang Xing
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
- Clinical Medical College, Ningxia Medical University, Yinchuan, China
| | - Wenqing Liu
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
| | - Pengfei Chen
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
| | - Fang Du
- School of Information Engineering, Ningxia University, Yinchuan, China
- Collaborative Innovation Center for Ningxia Big Data and Artificial Intelligence Co-founded by Ningxia Municipality and Ministry of Education, Ningxia University, Yinchuan, China
| | - Lijuan Song
- School of Information Engineering, Ningxia University, Yinchuan, China
| | - Zhenhua Yu
- School of Information Engineering, Ningxia University, Yinchuan, China
| | - Xiangmei Cao
- Basic Medical School, Ningxia Medical University, Yinchuan, China
| | - Jihui Tian
- Department of Neurosurgery, General Hospital of Ningxia Medical University, Yinchuan, China
| |
Collapse
|
17
|
He W, Huang W, Zhang L, Wu X, Zhang S, Zhang B. Radiogenomics: bridging the gap between imaging and genomics for precision oncology. MedComm (Beijing) 2024; 5:e722. [PMID: 39252824 PMCID: PMC11381657 DOI: 10.1002/mco2.722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 08/06/2024] [Accepted: 08/18/2024] [Indexed: 09/11/2024] Open
Abstract
Genomics allows the tracing of origin and evolution of cancer at molecular scale and underpin modern cancer diagnosis and treatment systems. Yet, molecular biomarker-guided clinical decision-making encounters major challenges in the realm of individualized medicine, consisting of the invasiveness of procedures and the sampling errors due to high tumor heterogeneity. By contrast, medical imaging enables noninvasive and global characterization of tumors at a low cost. In recent years, radiomics has overcomes the limitations of human visual evaluation by high-throughput quantitative analysis, enabling the comprehensive utilization of the vast amount of information underlying radiological images. The cross-scale integration of radiomics and genomics (hereafter radiogenomics) has the enormous potential to enhance cancer decoding and act as a catalyst for digital precision medicine. Herein, we provide a comprehensive overview of the current framework and potential clinical applications of radiogenomics in patient care. We also highlight recent research advances to illustrate how radiogenomics can address common clinical problems in solid tumors such as breast cancer, lung cancer, and glioma. Finally, we analyze existing literature to outline challenges and propose solutions, while also identifying future research pathways. We believe that the perspectives shared in this survey will provide a valuable guide for researchers in the realm of radiogenomics aiming to advance precision oncology.
Collapse
Affiliation(s)
- Wenle He
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| | - Wenhui Huang
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| | - Lu Zhang
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| | - Xuewei Wu
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| | - Shuixing Zhang
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| | - Bin Zhang
- Department of Radiology The First Affiliated Hospital of Jinan University Guangzhou Guangdong China
| |
Collapse
|
18
|
Liang X, Tang K, Ke X, Jiang J, Li S, Xue C, Deng J, Liu X, Yan C, Gao M, Zhou J, Zhao L. Development of an MRI-Based Comprehensive Model Fusing Clinical, Radiomics and Deep Learning Models for Preoperative Histological Stratification in Intracranial Solitary Fibrous Tumor. J Magn Reson Imaging 2024; 60:523-533. [PMID: 37897302 DOI: 10.1002/jmri.29098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 10/09/2023] [Accepted: 10/10/2023] [Indexed: 10/30/2023] Open
Abstract
BACKGROUND Accurate preoperative histological stratification (HS) of intracranial solitary fibrous tumors (ISFTs) can help predict patient outcomes and develop personalized treatment plans. However, the role of a comprehensive model based on clinical, radiomics and deep learning (CRDL) features in preoperative HS of ISFT remains unclear. PURPOSE To investigate the feasibility of a CRDL model based on magnetic resonance imaging (MRI) in preoperative HS in ISFT. STUDY TYPE Retrospective. POPULATION Three hundred and ninety-eight patients from Beijing Tiantan Hospital, Capital Medical University (primary training cohort) and 49 patients from Lanzhou University Second Hospital (external validation cohort) with ISFT based on histopathological findings (237 World Health Organization [WHO] tumor grade 1 or 2, and 210 WHO tumor grade 3). FIELD STRENGTH/SEQUENCE 3.0 T/T1-weighted imaging (T1) by using spin echo sequence, T2-weighted imaging (T2) by using fast spin echo sequence, and T1-weighted contrast-enhanced imaging (T1C) by using two-dimensional fast spin echo sequence. ASSESSMENT Area under the receiver operating characteristic curve (AUC) was used to assess the performance of the CRDL model and a clinical model (CM) in preoperative HS in the external validation cohort. The decision curve analysis (DCA) was used to evaluate the clinical net benefit provided by the CRDL model. STATISTICAL TESTS Cohen's kappa, intra-/inter-class correlation coefficients (ICCs), Chi-square test, Fisher's exact test, Student's t-test, AUC, DCA, calibration curves, DeLong test. A P value <0.05 was considered statistically significant. RESULTS The CRDL model had significantly better discrimination ability than the CM (AUC [95% confidence interval, CI]: 0.895 [0.807-0.912] vs. 0.810 [0.745-0.874], respectively) in the external validation cohort. The CRDL model can provide a clinical net benefit for preoperative HS at a threshold probability >20%. DATA CONCLUSION The proposed CRDL model holds promise for preoperative HS in ISFT, which is important for predicting patient outcomes and developing personalized treatment plans. LEVEL OF EVIDENCE 3 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Xiaohong Liang
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Kaiqiang Tang
- Department of Orthopedics, The Third Affiliated Hospital of Beijing University of Chinese Medicine, Beijing, China
| | - Xiaoai Ke
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Jian Jiang
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Shenglin Li
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Caiqiang Xue
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Juan Deng
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Xianwang Liu
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Cheng Yan
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Mingzi Gao
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Junlin Zhou
- Department of Radiology, Lanzhou University Second Hospital, Lanzhou, China
| | - Liqin Zhao
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
19
|
Wang S, Liu X, Jiang C, Kang W, Pan Y, Tang X, Luo Y, Gong J. CT-Based Super-Resolution Deep Learning Models with Attention Mechanisms for Predicting Spread Through Air Spaces of Solid or Part-Solid Lung Adenocarcinoma. Acad Radiol 2024; 31:2601-2609. [PMID: 38184418 DOI: 10.1016/j.acra.2023.12.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 12/20/2023] [Accepted: 12/20/2023] [Indexed: 01/08/2024]
Abstract
RATIONALE AND OBJECTIVES Spread through air space (STAS) is a novel invasive pattern of lung adenocarcinoma (LUAD), and preoperative knowledge of STAS status is helpful in choosing an appropriate surgical approach. MATERIALS AND METHODS This retrospective study collected and analyzed 602 patients diagnosed with LUAD from two medical centers: center 1 was randomly partitioned into training (n = 358) and validation cohorts (n = 154) at a 7:3 ratio; and center 2 was the external test cohort (n = 90). Super resolution was performed on all images to acquire high-resolution images, which were used to train the SE-ResNet50 model, before creating an equivalent parameter ResNet50 model. Disparities were compared between the two models using receiver operating characteristic curves, area under the curve, accuracy, precision, sensitivity, and specificity. RESULTS In this study, 512 and 90 patients with LUAD were enrolled from centers 1 and 2, respectively. The curve values of the SE-ResNet50 and ResNet50 models were compared for training, validation, and test cohorts, resulting in values of 0.933 vs 0.909, 0.783 vs 0.728, and 0.806 vs 0.695, respectively. In the external test cohort, the accuracy of the SE-ResNet50 model demonstrated a 10% improvement over the ResNet50 model (82.2% vs 72.2%). CONCLUSION The SE-ResNet50 model based on computed tomography super-resolution has great potential for predicting STAS status in patients with solid or partially solid LUAD, with superior predictive performance compared to traditional deep learning models.
Collapse
Affiliation(s)
- Shuxing Wang
- The Second Clinical Medical College, Jinan University, Shenzhen, Guangdong, China (S.W., X.L., Y.P., J.G.)
| | - Xiaowen Liu
- The Second Clinical Medical College, Jinan University, Shenzhen, Guangdong, China (S.W., X.L., Y.P., J.G.)
| | - Changsi Jiang
- Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College of Jinan University, The First Affiliated Hospital of Southern University of Science and Technology), Floor 1 Bldg 4, Dongbeilu 1017, Shenzhen 518020, Guangdong, China (C.J., X.T., Y.L., J.G.)
| | - Wenyan Kang
- Department of Radiology, Cancer Hospital Chinese Academy of Medical Sciences, Shenzhen Center, Shenzhen, China (W.K.)
| | - Yudie Pan
- The Second Clinical Medical College, Jinan University, Shenzhen, Guangdong, China (S.W., X.L., Y.P., J.G.)
| | - Xue Tang
- Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College of Jinan University, The First Affiliated Hospital of Southern University of Science and Technology), Floor 1 Bldg 4, Dongbeilu 1017, Shenzhen 518020, Guangdong, China (C.J., X.T., Y.L., J.G.)
| | - Yan Luo
- Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College of Jinan University, The First Affiliated Hospital of Southern University of Science and Technology), Floor 1 Bldg 4, Dongbeilu 1017, Shenzhen 518020, Guangdong, China (C.J., X.T., Y.L., J.G.)
| | - Jingshan Gong
- The Second Clinical Medical College, Jinan University, Shenzhen, Guangdong, China (S.W., X.L., Y.P., J.G.); Department of Radiology, Shenzhen People's Hospital (The Second Clinical Medical College of Jinan University, The First Affiliated Hospital of Southern University of Science and Technology), Floor 1 Bldg 4, Dongbeilu 1017, Shenzhen 518020, Guangdong, China (C.J., X.T., Y.L., J.G.).
| |
Collapse
|
20
|
Tan R, Sui C, Wang C, Zhu T. MRI-based intratumoral and peritumoral radiomics for preoperative prediction of glioma grade: a multicenter study. Front Oncol 2024; 14:1401977. [PMID: 38803534 PMCID: PMC11128562 DOI: 10.3389/fonc.2024.1401977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Accepted: 04/29/2024] [Indexed: 05/29/2024] Open
Abstract
Background Accurate preoperative prediction of glioma is crucial for developing individualized treatment decisions and assessing prognosis. In this study, we aimed to establish and evaluate the value of integrated models by incorporating the intratumoral and peritumoral features from conventional MRI and clinical characteristics in the prediction of glioma grade. Methods A total of 213 glioma patients from two centers were included in the retrospective analysis, among which, 132 patients were classified as the training cohort and internal validation set, and the remaining 81 patients were zoned as the independent external testing cohort. A total of 7728 features were extracted from MRI sequences and various volumes of interest (VOIs). After feature selection, 30 radiomic models depended on five sets of machine learning classifiers, different MRI sequences, and four different combinations of predictive feature sources, including features from the intratumoral region only, features from the peritumoral edema region only, features from the fusion area including intratumoral and peritumoral edema region (VOI-fusion), and features from the intratumoral region with the addition of features from peritumoral edema region (feature-fusion), were established to select the optimal model. A nomogram based on the clinical parameter and optimal radiomic model was constructed for predicting glioma grade in clinical practice. Results The intratumoral radiomic models based on contrast-enhanced T1-weighted and T2-flair sequences outperformed those based on a single MRI sequence. Moreover, the internal validation and independent external test underscored that the XGBoost machine learning classifier, incorporating features extracted from VOI-fusion, showed superior predictive efficiency in differentiating between low-grade gliomas (LGG) and high-grade gliomas (HGG), with an AUC of 0.805 in the external test. The radiomic models of VOI-fusion yielded higher prediction efficiency than those of feature-fusion. Additionally, the developed nomogram presented an optimal predictive efficacy with an AUC of 0.825 in the testing cohort. Conclusion This study systematically investigated the effect of intratumoral and peritumoral radiomics to predict glioma grading with conventional MRI. The optimal model was the XGBoost classifier coupled radiomic model based on VOI-fusion. The radiomic models that depended on VOI-fusion outperformed those that depended on feature-fusion, suggesting that peritumoral features should be rationally utilized in radiomic studies.
Collapse
Affiliation(s)
- Rui Tan
- Department of Neurosurgery, Tianjin Medical University General Hospital, Tianjin, China
| | - Chunxiao Sui
- Department of Molecular Imaging and Nuclear Medicine, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin, China
| | - Chao Wang
- Department of Neurosurgery, Qilu Hospital of Shandong University Dezhou Hospital (Dezhou People’s Hospital), Shandong, China
| | - Tao Zhu
- Department of Neurosurgery, Tianjin Medical University General Hospital, Tianjin, China
| |
Collapse
|
21
|
Gao J, Liu Z, Pan H, Cao X, Kan Y, Wen Z, Chen S, Wen M, Zhang L. Preoperative Discrimination of CDKN2A/B Homozygous Deletion Status in Isocitrate Dehydrogenase-Mutant Astrocytoma: A Deep Learning-Based Radiomics Model Using MRI. J Magn Reson Imaging 2024; 59:1655-1664. [PMID: 37555723 DOI: 10.1002/jmri.28945] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 07/26/2023] [Accepted: 07/26/2023] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Cyclin-dependent kinase inhibitor 2A/B (CDKN2A/B) homozygous deletion has been verified as an independent and critical biomarker of negative prognosis and short survival in isocitrate dehydrogenase (IDH)-mutant astrocytoma. Therefore, noninvasive and accurate discrimination of CDKN2A/B homozygous deletion status is essential for the clinical management of IDH-mutant astrocytoma patients. PURPOSE To develop a noninvasive, robust preoperative model based on MR image features for discriminating CDKN2A/B homozygous deletion status of IDH-mutant astrocytoma. STUDY TYPE Retrospective. POPULATION Two hundred fifty-one patients: 107 patients with CDKN2A/B homozygous deletion and 144 patients without CDKN2A/B homozygous deletion. FIELD STRENGTH/SEQUENCE 3.0 T/1.5 T: Contrast-enhanced T1-weighted spin-echo inversion recovery sequence (CE-T1WI) and T2-weighted fluid-attenuation spin-echo inversion recovery sequence (T2FLAIR). ASSESSMENT A total of 1106 radiomics and 1000 deep learning features extracted from CE-T1WI and T2FLAIR were used to develop models to discriminate the CDKN2A/B homozygous deletion status. Radiomics models, deep learning-based radiomics (DLR) models and the final integrated model combining radiomics features with deep learning features were developed and compared their preoperative discrimination performance. STATISTICAL TESTING Pearson chi-square test and Mann Whitney U test were used for assessing the statistical differences in patients' clinical characteristics. The Delong test compared the statistical differences of receiver operating characteristic (ROC) curves and area under the curve (AUC) of different models. The significance threshold is P < 0.05. RESULTS The final combined model (training AUC = 0.966; validation AUC = 0.935; test group: AUC = 0.943) outperformed the optimal models based on only radiomics or DLR features (training: AUC = 0.916 and 0.952; validation: AUC = 0.886 and 0.912; test group: AUC = 0.862 and 0.902). DATA CONCLUSION Whether based on a single sequence or a combination of two sequences, radiomics and DLR models have achieved promising performance in assessing CDKN2A/B homozygous deletion status. However, the final model combining both deep learning and radiomics features from CE-T1WI and T2FLAIR outperformed the optimal radiomics or DLR model. EVIDENCE LEVEL 4 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Jueni Gao
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Zhi Liu
- Department of Nuclear Medicine, Chongqing Hospital of Traditional Chinese Medicine, Chongqing, China
| | - Hongyu Pan
- College of Computer and Information Science, Southwest University, Chongqing, China
| | - Xu Cao
- School of Medical and Life Sciences, Chengdu University of Traditional Chinese Medicine, Chengdu, China
| | - Yubo Kan
- School of Medical and Life Sciences, Chengdu University of Traditional Chinese Medicine, Chengdu, China
| | - Zhipeng Wen
- Department of Radiology, Sichuan Cancer Hospital, Chengdu, China
| | - Shanxiong Chen
- College of Computer and Information Science, Southwest University, Chongqing, China
| | - Ming Wen
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Liqiang Zhang
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| |
Collapse
|
22
|
Tang C, He X, Jia L, Zhang X. Circular RNAs in glioma: Molecular functions and pathological implications. Noncoding RNA Res 2024; 9:105-115. [PMID: 38075205 PMCID: PMC10700123 DOI: 10.1016/j.ncrna.2023.10.007] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/01/2023] [Accepted: 10/15/2023] [Indexed: 01/23/2025] Open
Abstract
Circular RNAs (circRNAs) are a special class of non-coding RNAs with the ring structure. They are stable, abundant and conservative across mammals. The biogenesis and molecular properties of circRNAs are being elucidated, which exert regulatory functions not only through miRNA and protein sponge, but also via translation and exosomal interaction. Accumulating studies have demonstrated that circRNAs are aberrantly expressed in various diseases, especially in cancer. Glioma is one of the most common malignant cerebral neoplasms with poor prognosis. The accurate diagnosis and effective therapies of glioma have always been challenged, there is an urgent need for developing promising therapeutic intervention. Therefore, exploring novel biomarkers is crucial for diagnosis, treatment and prognosis of the glioma which can provide better assistance in guiding treatment. Recent findings found that circRNAs are systematically altered in glioma and may play critical roles in glioma tumorigenesis, proliferation, invasion and metastasis. Due to their distinct functional properties, they are considered as the potential therapeutic targets, diagnostic and prognostic biomarkers. This review elaborates on current advances towards the biogenesis, translation and interaction of circRNAs in many diseases and focused on the role of their involvement in glioma progression, highlighting the potential value of circRNAs in glioma.
Collapse
Affiliation(s)
- Cheng Tang
- Department of Biochemistry and Molecular Biology, Fourth Military Medical University, Xi'an, 710032, China
| | | | - Lintao Jia
- Department of Biochemistry and Molecular Biology, Fourth Military Medical University, Xi'an, 710032, China
| | - Xiao Zhang
- Department of Biochemistry and Molecular Biology, Fourth Military Medical University, Xi'an, 710032, China
| |
Collapse
|
23
|
Demircioğlu A. The effect of data resampling methods in radiomics. Sci Rep 2024; 14:2858. [PMID: 38310165 PMCID: PMC10838284 DOI: 10.1038/s41598-024-53491-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 02/01/2024] [Indexed: 02/05/2024] Open
Abstract
Radiomic datasets can be class-imbalanced, for instance, when the prevalence of diseases varies notably, meaning that the number of positive samples is much smaller than that of negative samples. In these cases, the majority class may dominate the model's training and thus negatively affect the model's predictive performance, leading to bias. Therefore, resampling methods are often utilized to class-balance the data. However, several resampling methods exist, and neither their relative predictive performance nor their impact on feature selection has been systematically analyzed. In this study, we aimed to measure the impact of nine resampling methods on radiomic models utilizing a set of fifteen publicly available datasets regarding their predictive performance. Furthermore, we evaluated the agreement and similarity of the set of selected features. Our results show that applying resampling methods did not improve the predictive performance on average. On specific datasets, slight improvements in predictive performance (+ 0.015 in AUC) could be seen. A considerable disagreement on the set of selected features was seen (only 28.7% of features agreed), which strongly impedes feature interpretability. However, selected features are similar when considering their correlation (82.9% of features correlated on average).
Collapse
Affiliation(s)
- Aydin Demircioğlu
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Hufelandstraße 55, 45147, Essen, Germany.
| |
Collapse
|
24
|
Tong X, Wang S, Zhang J, Fan Y, Liu Y, Wei W. Automatic Osteoporosis Screening System Using Radiomics and Deep Learning from Low-Dose Chest CT Images. Bioengineering (Basel) 2024; 11:50. [PMID: 38247927 PMCID: PMC10813496 DOI: 10.3390/bioengineering11010050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 12/21/2023] [Accepted: 12/29/2023] [Indexed: 01/23/2024] Open
Abstract
OBJECTIVE Develop two fully automatic osteoporosis screening systems using deep learning (DL) and radiomics (Rad) techniques based on low-dose chest CT (LDCT) images and evaluate their diagnostic effectiveness. METHODS In total, 434 patients who underwent LDCT and bone mineral density (BMD) examination were retrospectively enrolled and divided into the development set (n = 333) and temporal validation set (n = 101). An automatic thoracic vertebra cancellous bone (TVCB) segmentation model was developed. The Dice similarity coefficient (DSC) was used to evaluate the segmentation performance. Furthermore, the three-class Rad and DL models were developed to distinguish osteoporosis, osteopenia, and normal bone mass. The diagnostic performance of these models was evaluated using the receiver operating characteristic (ROC) curve and decision curve analysis (DCA). RESULTS The automatic segmentation model achieved excellent segmentation performance, with a mean DSC of 0.96 ± 0.02 in the temporal validation set. The Rad model was used to identify osteoporosis, osteopenia, and normal BMD in the temporal validation set, with respective area under the receiver operating characteristic curve (AUC) values of 0.943, 0.801, and 0.932. The DL model achieved higher AUC values of 0.983, 0.906, and 0.969 for the same categories in the same validation set. The Delong test affirmed that both models performed similarly in BMD assessment. However, the accuracy of the DL model is 81.2%, which is better than the 73.3% accuracy of the Rad model in the temporal validation set. Additionally, DCA indicated that the DL model provided a greater net benefit compared to the Rad model across the majority of the reasonable threshold probabilities Conclusions: The automated segmentation framework we developed can accurately segment cancellous bone on low-dose chest CT images. These predictive models, which are based on deep learning and radiomics, provided comparable diagnostic performance in automatic BMD assessment. Nevertheless, it is important to highlight that the DL model demonstrates higher accuracy and precision than the Rad model.
Collapse
Affiliation(s)
| | | | | | | | | | - Wei Wei
- Department of Radiology, First Affiliated Hospital of Dalian Medical University, Dalian 116014, China (S.W.); (Y.F.)
| |
Collapse
|
25
|
Lu T, Ma J, Zou J, Jiang C, Li Y, Han J. CT-based intratumoral and peritumoral deep transfer learning features prediction of lymph node metastasis in non-small cell lung cancer. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2024; 32:597-609. [PMID: 38578874 DOI: 10.3233/xst-230326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/07/2024]
Abstract
BACKGROUND The main metastatic route for lung cancer is lymph node metastasis, and studies have shown that non-small cell lung cancer (NSCLC) has a high risk of lymph node infiltration. OBJECTIVE This study aimed to compare the performance of handcrafted radiomics (HR) features and deep transfer learning (DTL) features in Computed Tomography (CT) of intratumoral and peritumoral regions in predicting the metastatic status of NSCLC lymph nodes in different machine learning classifier models. METHODS We retrospectively collected data of 199 patients with pathologically confirmed NSCLC. All patients were divided into training (n = 159) and validation (n = 40) cohorts, respectively. The best HR and DTL features in the intratumoral and peritumoral regions were extracted and selected, respectively. Support Vector Machine (SVM), k-Nearest Neighbors (KNN), Light Gradient Boosting Machine (Light GBM), Multilayer Perceptron (MLP), and Logistic Regression (LR) models were constructed, and the performance of the models was evaluated. RESULTS Among the five models in the training and validation cohorts, the LR classifier model performed best in terms of HR and DTL features. The AUCs of the training cohort were 0.841 (95% CI: 0.776-0.907) and 0.955 (95% CI: 0.926-0.983), and the AUCs of the validation cohort were 0.812 (95% CI: 0.677-0.948) and 0.893 (95% CI: 0.795-0.991), respectively. The DTL signature was superior to the handcrafted radiomics signature. CONCLUSIONS Compared with the radiomics signature, the DTL signature constructed based on intratumoral and peritumoral areas in CT can better predict NSCLC lymph node metastasis.
Collapse
Affiliation(s)
- Tianyu Lu
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Jianbing Ma
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Jiajun Zou
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Chenxu Jiang
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Yangyang Li
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Jun Han
- Department of Radiology, The First Hospital of Jiaxing or The Affiliated Hospital of Jiaxing University, Jiaxing, China
| |
Collapse
|
26
|
Ghayda RA, Cannarella R, Calogero AE, Shah R, Rambhatla A, Zohdy W, Kavoussi P, Avidor-Reiss T, Boitrelle F, Mostafa T, Saleh R, Toprak T, Birowo P, Salvio G, Calik G, Kuroda S, Kaiyal RS, Ziouziou I, Crafa A, Phuoc NHV, Russo GI, Durairajanayagam D, Al-Hashimi M, Hamoda TAAAM, Pinggera GM, Adriansjah R, Maldonado Rosas I, Arafa M, Chung E, Atmoko W, Rocco L, Lin H, Huyghe E, Kothari P, Solorzano Vazquez JF, Dimitriadis F, Garrido N, Homa S, Falcone M, Sabbaghian M, Kandil H, Ko E, Martinez M, Nguyen Q, Harraz AM, Serefoglu EC, Karthikeyan VS, Tien DMB, Jindal S, Micic S, Bellavia M, Alali H, Gherabi N, Lewis S, Park HJ, Simopoulou M, Sallam H, Ramirez L, Colpi G, Agarwal A, Global Andrology Forum. Artificial Intelligence in Andrology: From Semen Analysis to Image Diagnostics. World J Mens Health 2024; 42:39-61. [PMID: 37382282 PMCID: PMC10782130 DOI: 10.5534/wjmh.230050] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/10/2023] [Accepted: 03/17/2023] [Indexed: 06/30/2023] Open
Abstract
Artificial intelligence (AI) in medicine has gained a lot of momentum in the last decades and has been applied to various fields of medicine. Advances in computer science, medical informatics, robotics, and the need for personalized medicine have facilitated the role of AI in modern healthcare. Similarly, as in other fields, AI applications, such as machine learning, artificial neural networks, and deep learning, have shown great potential in andrology and reproductive medicine. AI-based tools are poised to become valuable assets with abilities to support and aid in diagnosing and treating male infertility, and in improving the accuracy of patient care. These automated, AI-based predictions may offer consistency and efficiency in terms of time and cost in infertility research and clinical management. In andrology and reproductive medicine, AI has been used for objective sperm, oocyte, and embryo selection, prediction of surgical outcomes, cost-effective assessment, development of robotic surgery, and clinical decision-making systems. In the future, better integration and implementation of AI into medicine will undoubtedly lead to pioneering evidence-based breakthroughs and the reshaping of andrology and reproductive medicine.
Collapse
Affiliation(s)
- Ramy Abou Ghayda
- Urology Institute, University Hospitals, Case Western Reserve University, Cleveland, OH, USA
| | - Rossella Cannarella
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Aldo E. Calogero
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
| | - Rupin Shah
- Department of Urology, Lilavati Hospital and Research Centre, Mumbai, India
| | - Amarnath Rambhatla
- Department of Urology, Henry Ford Health System, Vattikuti Urology Institute, Detroit, MI, USA
| | - Wael Zohdy
- Andrology and STDs, Cairo University, Cairo, Egypt
| | - Parviz Kavoussi
- Department of Urology, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Tomer Avidor-Reiss
- Department of Biological Sciences, University of Toledo, Toledo, OH, USA
- Department of Urology, College of Medicine and Life Sciences, University of Toledo, Toledo, OH, USA
| | - Florence Boitrelle
- Reproductive Biology, Fertility Preservation, Andrology, CECOS, Poissy Hospital, Poissy, France
- Department of Biology, Reproduction, Epigenetics, Environment, and Development, Paris Saclay University, UVSQ, INRAE, BREED, Paris, France
| | - Taymour Mostafa
- Andrology, Sexology & STIs Department, Faculty of Medicine, Cairo University, Cairo, Egypt
| | - Ramadan Saleh
- Department of Dermatology, Venereology and Andrology, Faculty of Medicine, Sohag University, Sohag, Egypt
| | - Tuncay Toprak
- Department of Urology, Fatih Sultan Mehmet Training and Research Hospital, University of Health Sciences, Istanbul, Turkey
| | - Ponco Birowo
- Department of Urology, Dr. Cipto Mangunkusumo Hospital, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia
| | - Gianmaria Salvio
- Department of Endocrinology, Polytechnic University of Marche, Ancona, Italy
| | - Gokhan Calik
- Department of Urology, Istanbul Medipol University, Istanbul, Turkey
| | - Shinnosuke Kuroda
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
- Department of Urology, Reproduction Center, Yokohama City University Medical Center, Yokohama, Japan
| | - Raneen Sawaid Kaiyal
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Imad Ziouziou
- Department of Urology, College of Medicine and Pharmacy, Ibn Zohr University, Agadir, Morocco
| | - Andrea Crafa
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
| | - Nguyen Ho Vinh Phuoc
- Department of Andrology, Binh Dan Hospital, Ho Chi Minh City, Vietnam
- Department of Urology and Andrology, Pham Ngoc Thach University of Medicine, Ho Chi Minh City, Vietnam
| | | | - Damayanthi Durairajanayagam
- Department of Physiology, Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh Campus, Selangor, Malaysia
| | - Manaf Al-Hashimi
- Department of Urology, Burjeel Hospital, Abu Dhabi, United Arab Emirates (UAE)
- Khalifa University, College of Medicine and Health Science, Abu Dhabi, United Arab Emirates (UAE)
| | - Taha Abo-Almagd Abdel-Meguid Hamoda
- Department of Urology, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Urology, Faculty of Medicine, Minia University, El-Minia, Egypt
| | | | - Ricky Adriansjah
- Department of Urology, Hasan Sadikin General Hospital, Universitas Padjadjaran, Banding, Indonesia
| | | | - Mohamed Arafa
- Department of Urology, Hamad Medical Corporation, Doha, Qatar
- Department of Urology, Weill Cornell Medical-Qatar, Doha, Qatar
| | - Eric Chung
- Department of Urology, Princess Alexandra Hospital, University of Queensland, Brisbane QLD, Australia
| | - Widi Atmoko
- Department of Urology, Dr. Cipto Mangunkusumo Hospital, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia
| | - Lucia Rocco
- Department of Environmental, Biological and Pharmaceutical Sciences and Technologies, University of Campania “Luigi Vanvitelli”, Caserta, Italy
| | - Haocheng Lin
- Department of Urology, Peking University Third Hospital, Peking University, Beijing, China
| | - Eric Huyghe
- Department of Urology and Andrology, University Hospital of Toulouse, Toulouse, France
| | - Priyank Kothari
- Department of Urology, B.Y.L. Nair Charitable Hospital, Topiwala National Medical College, Mumbai, India
| | | | - Fotios Dimitriadis
- Department of Urology, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Nicolas Garrido
- IVIRMA Global Research Alliance, IVI Foundation, Instituto de Investigación Sanitaria La Fe (IIS La Fe), Valencia, Spain
| | - Sheryl Homa
- Department of Biosciences, University of Kent, Canterbury, United Kingdom
| | - Marco Falcone
- Department of Urology, Molinette Hospital, A.O.U. Città della Salute e della Scienza, University of Turin, Torino, Italy
| | - Marjan Sabbaghian
- Department of Andrology, Reproductive Biomedicine Research Center, Royan Institute for Reproductive Biomedicine, ACECR, Tehran, Iran
| | | | - Edmund Ko
- Department of Urology, Loma Linda University Health, Loma Linda, CA, USA
| | - Marlon Martinez
- Section of Urology, Department of Surgery, University of Santo Tomas Hospital, Manila, Philippines
| | - Quang Nguyen
- Section of Urology, Department of Surgery, University of Santo Tomas Hospital, Manila, Philippines
- Center for Andrology and Sexual Medicine, Viet Duc University Hospital, Hanoi, Vietnam
- Department of Urology, Andrology and Sexual Medicine, University of Medicine and Pharmacy, Vietnam National University, Hanoi, Vietnam
| | - Ahmed M. Harraz
- Urology and Nephrology Center, Mansoura University, Mansoura, Egypt
- Department of Surgery, Urology Unit, Farwaniya Hospital, Farwaniya, Kuwait
- Department of Urology, Sabah Al Ahmad Urology Center, Kuwait City, Kuwait
| | - Ege Can Serefoglu
- Department of Urology, Biruni University School of Medicine, Istanbul, Turkey
| | | | - Dung Mai Ba Tien
- Department of Andrology, Binh Dan Hospital, Ho Chi Minh City, Vietnam
| | - Sunil Jindal
- Department of Andrology and Reproductive Medicine, Jindal Hospital, Meerut, India
| | - Sava Micic
- Department of Andrology, Uromedica Polyclinic, Belgrade, Serbia
| | - Marina Bellavia
- Andrology and IVF Center, Next Fertility Procrea, Lugano, Switzerland
| | - Hamed Alali
- King Fahad Specialist Hospital, Dammam, Saudi Arabia
| | - Nazim Gherabi
- Andrology Committee of the Algerian Association of Urology, Algiers, Algeria
| | - Sheena Lewis
- Examen Lab Ltd., Northern Ireland, United Kingdom
| | - Hyun Jun Park
- Department of Urology, Pusan National University School of Medicine, Busan, Korea
- Medical Research Institute of Pusan National University Hospital, Busan, Korea
| | - Mara Simopoulou
- Department of Experimental Physiology, School of Health Sciences, Faculty of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Hassan Sallam
- Alexandria University Faculty of Medicine, Alexandria, Egypt
| | - Liliana Ramirez
- IVF Laboratory, CITMER Reproductive Medicine, Mexico City, Mexico
| | - Giovanni Colpi
- Andrology and IVF Center, Next Fertility Procrea, Lugano, Switzerland
| | - Ashok Agarwal
- Global Andrology Forum, Moreland Hills, OH, USA
- Cleveland Clinic, Cleveland, OH, USA
| | | |
Collapse
|
27
|
Lu J, Xu W, Chen X, Wang T, Li H. Noninvasive prediction of IDH mutation status in gliomas using preoperative multiparametric MRI radiomics nomogram: A mutlicenter study. Magn Reson Imaging 2023; 104:72-79. [PMID: 37778708 DOI: 10.1016/j.mri.2023.09.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2022] [Revised: 08/21/2023] [Accepted: 09/17/2023] [Indexed: 10/03/2023]
Abstract
PURPOSE To establish and validate a radiomics nomogram for preoperative prediction of isocitrate dehydrogenase (IDH) mutation status of gliomas in a multicenter setting. METHODS 414 gliomas patients were collected (306 from local institution and 108 from TCGA). 851 radiomics features were extracted from contrast-enhanced T1-weighted (CE-T1W) and fluid attenuated inversion recovery (FLAIR) sequence, respectively. The features were refined using least absolute shrinkage and selection operator (LASSO) regression combing 10-fold cross-validation. The optimal radiomics features with age and sex were processed by multivariate logistic regression analysis to construct a prediction model, which was developed in the training dataset and assessed in the test and validation dataset. Receiver operating characteristic (ROC) curve, calibration curve and decision curve analysis were applied in the test and external validation datasets to evaluate the performance of the prediction model. RESULTS Ten robust radiomics features were selected from the 1702 features (four CE-T1W features and six FLAIR features). A nomogram was plotted to represent the prediction model. The accuracy and AUC of the radiomics nomogram achieved 86.96% and 0.891(0.809-0.947) in the test dataset and 84.26% and 0.881(0.805-0.936) in the external validation dataset (all p < 0.05). The positive predictive value (PPV) and negative predictive value (NPV) were 83.72% and 87.75% in the test dataset and 87.81% and 82.09% in the external validation dataset. CONCLUSION IDH genotypes of gliomas can be identified by preoperative multiparametric MRI radiomics nomogram and might be clinically meaningful for treatment strategy and prognosis stratification of gliomas.
Collapse
Affiliation(s)
- Jun Lu
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, No. 95 Yongan Road, Beijing 100050, China; Department of Radiology, the Affiliated Cancer Hospital of Zhengzhou University & Henan Cancer Hospital, No. 127 Dongming Road, Zhengzhou, Henan 450008, China
| | - Wenjuan Xu
- Department of Radiology, the Affiliated Cancer Hospital of Zhengzhou University & Henan Cancer Hospital, No. 127 Dongming Road, Zhengzhou, Henan 450008, China
| | - Xiaocao Chen
- Department of Radiology, the Affiliated Cancer Hospital of Zhengzhou University & Henan Cancer Hospital, No. 127 Dongming Road, Zhengzhou, Henan 450008, China
| | - Tan Wang
- Department of Ophthalmology, Chinese Academy of Medical Sciences and Peking Union Medical College, No.1 Dongdan North Street, Beijing 100005, China
| | - Hailiang Li
- Department of Minimally Invasive Intervention, the Affiliated Cancer Hospital of Zhengzhou University & Henan Cancer Hospital, No. 127 Dongming Road, Zhengzhou, Henan 450008, China.
| |
Collapse
|
28
|
Liu X, Zhang Q, Li J, Xu Q, Zhuo Z, Li J, Zhou X, Lu M, Zhou Q, Pan H, Wu N, Zhou Q, Shi F, Lu G, Liu Y, Zhang Z. Coordinatized lesion location analysis empowering ROI-based radiomics diagnosis on brain gliomas. Eur Radiol 2023; 33:8776-8787. [PMID: 37382614 DOI: 10.1007/s00330-023-09871-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 05/09/2023] [Accepted: 05/16/2023] [Indexed: 06/30/2023]
Abstract
OBJECTIVES To assess the value of coordinatized lesion location analysis (CLLA), in empowering ROI-based imaging diagnosis of gliomas by improving accuracy and generalization performances. METHODS In this retrospective study, pre-operative contrasted T1-weighted and T2-weighted MR images were obtained from patients with gliomas from three centers: Jinling Hospital, Tiantan Hospital, and the Cancer Genome Atlas Program. Based on CLLA and ROI-based radiomic analyses, a fusion location-radiomics model was constructed to predict tumor grades, isocitrate dehydrogenase (IDH) status, and overall survival (OS). An inter-site cross-validation strategy was used for assessing the performances of the fusion model on accuracy and generalization with the value of area under the curve (AUC) and delta accuracy (ACC) (ACCtesting-ACCtraining). Comparisons of diagnostic performances were performed between the fusion model and the other two models constructed with location and radiomics analysis using DeLong's test and Wilcoxon signed ranks test. RESULTS A total of 679 patients (mean age, 50 years ± 14 [standard deviation]; 388 men) were enrolled. Based on tumor location probabilistic maps, fusion location-radiomics models (averaged AUC values of grade/IDH/OS: 0.756/0.748/0.768) showed the highest accuracy in contrast to radiomics models (0.731/0.686/0.716) and location models (0.706/0.712/0.740). Notably, fusion models ([median Delta ACC: - 0.125, interquartile range: 0.130]) demonstrated improved generalization than that of radiomics model ([- 0.200, 0.195], p = 0.018). CONCLUSIONS CLLA could empower ROI-based radiomics diagnosis of gliomas by improving the accuracy and generalization of the models. CLINICAL RELEVANCE STATEMENT This study proposed a coordinatized lesion location analysis for glioma diagnosis, which could improve the performances of the conventional ROI-based radiomics model in accuracy and generalization. KEY POINTS • Using coordinatized lesion location analysis, we mapped anatomic distribution patterns of gliomas with specific pathological and clinical features and constructed glioma prediction models. • We integrated coordinatized lesion location analysis into ROI-based analysis of radiomics to propose new fusion location-radiomics models. • Fusion location-radiomics models, with the advantages of being less influenced by variabilities, improved accuracy, and generalization performances of ROI-based radiomics models on predicting the diagnosis of gliomas.
Collapse
Affiliation(s)
- Xiaoxue Liu
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
| | - Qirui Zhang
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
| | - Jianrui Li
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
| | - Qiang Xu
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
| | - Zhizheng Zhuo
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| | - Junjie Li
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| | - Xian Zhou
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
| | - Mengjie Lu
- School of Public Health, Shanghai JiaoTong University School of Medicine, Shanghai, 200240, China
| | - Qingqing Zhou
- Department of Radiology, The Affiliated Jiangning Hospital of Nanjing Medical University, Nanjing, 211100, China
| | - Hao Pan
- Department of Neurosurgery, Affiliated Jinling Hospital, Medical School of Nanjing University, Nanjing, 210002, China
| | - Nan Wu
- Department of Pathology, Affiliated Jinling Hospital, Medical School of Nanjing University, Nanjing, 210002, China
| | - Qing Zhou
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, 200232, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, 200232, China
| | - Guangming Lu
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China
- State Key Laboratory of Analytical Chemistry for Life Science, Nanjing University, Nanjing, 210093, China
| | - Yaou Liu
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, 100070, China
| | - Zhiqiang Zhang
- Department of Diagnostic Radiology, Affiliated Jinling Hospital, Medical School of Nanjing University, 305#, Eastern Zhongshan Rd, Nanjing, 210002, China.
- State Key Laboratory of Analytical Chemistry for Life Science, Nanjing University, Nanjing, 210093, China.
| |
Collapse
|
29
|
Gao R, Luo G, Ding R, Yang B, Sun H. A Lightweight Deep Learning Framework for Automatic MRI Data Sorting and Artifacts Detection. J Med Syst 2023; 47:124. [PMID: 37999807 DOI: 10.1007/s10916-023-02017-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 11/05/2023] [Indexed: 11/25/2023]
Abstract
The purpose of this study is to develop a lightweight and easily deployable deep learning system for fully automated content-based brain MRI sorting and artifacts detection. 22092 MRI volumes from 4076 patients between 2017 and 2021 were involved in this retrospective study. The dataset mainly contains 4 common contrast (T1-weighted (T1w), contrast-enhanced T1-weighted (T1c), T2-weighted (T2w), fluid-attenuated inversion recovery (FLAIR)) in three perspectives (axial, coronal, and sagittal), and magnetic resonance angiography (MRA), as well as three typical artifacts (motion, aliasing, and metal artifacts). In the proposed architecture, a pre-trained EfficientNetB0 with the fully connected layers removed was used as the feature extractor and a multilayer perceptron (MLP) module with four hidden layers was used as the classifier. Precision, recall, F1_Score, accuracy, the number of trainable parameters, and float-point of operations (FLOPs) were calculated to evaluate the performance of the proposed model. The proposed model was also compared with four other existing CNN-based models in terms of classification performance and model size. The overall precision, recall, F1_Score, and accuracy of the proposed model were 0.983, 0.926, 0.950, and 0.991, respectively. The performance of the proposed model was outperformed the other four CNN-based models. The number of trainable parameters and FLOPs were the smallest among the investigated models. Our proposed model can accurately sort head MRI scans and identify artifacts with minimum computational resources and can be used as a tool to support big medical imaging data research and facilitate large-scale database management.
Collapse
Affiliation(s)
- Ronghui Gao
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Guoting Luo
- Department of Radiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Renxin Ding
- IT Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Bo Yang
- IT Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Huaiqiang Sun
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, Sichuan, China.
- Huaxi MR Research Center, West China Hospital of Sichuan University, Chengdu, Sichuan, China.
- Huaxi MR Research Center, Department of Radiology, West China Hospital of Sichuan University, Chengdu, 610041, Sichuan, China.
| |
Collapse
|
30
|
Liu W, Wang W, Zhang H, Guo M, Xu Y, Liu X. Development and Validation of Multi-Omics Thymoma Risk Classification Model Based on Transfer Learning. J Digit Imaging 2023; 36:2015-2024. [PMID: 37268842 PMCID: PMC10501978 DOI: 10.1007/s10278-023-00855-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 05/17/2023] [Accepted: 05/19/2023] [Indexed: 06/04/2023] Open
Abstract
The paper aims to develop prediction model that integrates clinical, radiomics, and deep features using transfer learning to stratifying between high and low risk of thymoma. Our study enrolled 150 patients with thymoma (76 low-risk and 74 high-risk) who underwent surgical resection and pathologically confirmed in Shengjing Hospital of China Medical University from January 2018 to December 2020. The training cohort consisted of 120 patients (80%) and the test cohort consisted of 30 patients (20%). The 2590 radiomics and 192 deep features from non-enhanced, arterial, and venous phase CT images were extracted and ANOVA, Pearson correlation coefficient, PCA, and LASSO were used to select the most significant features. A fusion model that integrated clinical, radiomics, and deep features was developed with SVM classifiers to predict the risk level of thymoma, and accuracy, sensitivity, specificity, ROC curves, and AUC were applied to evaluate the classification model. In both the training and test cohorts, the fusion model demonstrated better performance in stratifying high and low risk of thymoma. It had AUCs of 0.99 and 0.95, and an accuracy of 0.93 and 0.83, respectively. This was compared to the clinical model (AUCs of 0.70 and 0.51, accuracy of 0.68 and 0.47), the radiomics model (AUCs of 0.97 and 0.82, accuracy of 0.93 and 0.80), and the deep model (AUCs of 0.94 and 0.85, accuracy of 0.88 and 0.80). The fusion model integrating clinical, radiomics and deep features based on transfer learning was efficient for noninvasively stratifying high risk and low risk of thymoma. The models could help to determine surgery strategy for thymoma cancer.
Collapse
Affiliation(s)
- Wei Liu
- School of Health Management, China Medical University, Shenyang, China
| | - Wei Wang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, China
| | - Hanyi Zhang
- Department of Radiology, Liaoning Cancer Hospital and Institute, Shenyang, China
| | - Miaoran Guo
- Department of Radiology, The First Affiliated Hospital of China Medical University, Shenyang, China
| | - Yingxin Xu
- School of Health Management, China Medical University, Shenyang, China
| | - Xiaoqi Liu
- School of Health Management, China Medical University, Shenyang, China
| |
Collapse
|
31
|
Guo Y, Ma Z, Pei D, Duan W, Guo Y, Liu Z, Guan F, Wang Z, Xing A, Guo Z, Luo L, Wang W, Yu B, Zhou J, Ji Y, Yan D, Cheng J, Liu X, Yan J, Zhang Z. Improving Noninvasive Classification of Molecular Subtypes of Adult Gliomas With Diffusion-Weighted MR Imaging: An Externally Validated Machine Learning Algorithm. J Magn Reson Imaging 2023; 58:1234-1242. [PMID: 36727433 DOI: 10.1002/jmri.28630] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 01/20/2023] [Accepted: 01/20/2023] [Indexed: 02/03/2023] Open
Abstract
BACKGROUND Genetic testing for molecular markers of gliomas sometimes is unavailable because of time-consuming and expensive, even limited tumor specimens or nonsurgery cases. PURPOSE To train a three-class radiomic model classifying three molecular subtypes including isocitrate dehydrogenase (IDH) mutations and 1p/19q-noncodeleted (IDHmut-noncodel), IDH wild-type (IDHwt), IDH-mutant and 1p/19q-codeleted (IDHmut-codel) of adult gliomas and investigate whether radiomic features from diffusion-weighted imaging (DWI) could bring additive value. STUDY TYPE Retrospective. POPULATION A total of 755 patients including 111 IDHmut-noncodel, 571 IDHwt, and 73 IDHmut-codel cases were divided into training (n = 480) and internal validation set (n = 275); 139 patients including 21 IDHmut-noncodel, 104 IDHwt, and 14 IDHmut-codel cases were utilized as external validation set. FIELD STRENGTH/SEQUENCE A 1.5 T or 3.0 T/multiparametric MRI, including T1-weighted (T1), T1-weighted gadolinium contrast-enhanced (T1c), T2-weighted (T2), fluid attenuated inversion recovery (FLAIR), and DWI. ASSESSMENT The performance of multiparametric radiomic model (random-forest model) using 22 selected features from T1, T2, FLAIR, T1c images and apparent diffusion coefficient (ADC) maps, and conventional radiomic model using 20 selected features from T1, T2, FLAIR, and T1c images was assessed in internal and external validation sets by comparing probability values and actual incidence. STATISTICAL TESTS Mann-Whitney U test, Chi-Squared test, Wilcoxon test, receiver operating curve (ROC), and area under the curve (AUC); DeLong analysis. P < 0.05 was statistically significant. RESULTS The multiparametric radiomic model achieved AUC values for IDHmut-noncodel, IDHwt, and IDHmut-codel of 0.8181, 0.8524, and 0.8502 in internal validation set and 0.7571, 0.7779, and 0.7491 in external validation set, respectively. Multiparametric radiomic model showed significantly better diagnostic performance after DeLong analysis, especially in classifying IDHwt and IDHmut-noncodel subtypes. DATA CONCLUSION Radiomic features from DWI could bring additive value and improve the performance of conventional MRI-based radiomic model for classifying the molecular subtypes especially IDHmut-noncodel and IDHwt of adult gliomas. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY Stage 2.
Collapse
Affiliation(s)
- Yang Guo
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
- Department of Neurosurgery, The Henan Provincial People's Hospital, Zhengzhou, Henan, China
| | - Zeyu Ma
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Dongling Pei
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Wenchao Duan
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yu Guo
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zhongyi Liu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Fangzhan Guan
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zilong Wang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Aoqi Xing
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zhixuan Guo
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Lin Luo
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Weiwei Wang
- Department of Pathology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Bin Yu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Jinqiao Zhou
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yuchen Ji
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Dongming Yan
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Jingliang Cheng
- Department of MRI, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Xianzhi Liu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Jing Yan
- Department of MRI, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zhenyu Zhang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| |
Collapse
|
32
|
Lost J, Verma T, Jekel L, von Reppert M, Tillmanns N, Merkaj S, Petersen GC, Bahar R, Gordem A, Haider MA, Subramanian H, Brim W, Ikuta I, Omuro A, Conte GM, Marquez-Nostra BV, Avesta A, Bousabarah K, Nabavizadeh A, Kazerooni AF, Aneja S, Bakas S, Lin M, Sabel M, Aboian M. Systematic Literature Review of Machine Learning Algorithms Using Pretherapy Radiologic Imaging for Glioma Molecular Subtype Prediction. AJNR Am J Neuroradiol 2023; 44:1126-1134. [PMID: 37770204 PMCID: PMC10549943 DOI: 10.3174/ajnr.a8000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 08/01/2023] [Indexed: 10/03/2023]
Abstract
BACKGROUND The molecular profile of gliomas is a prognostic indicator for survival, driving clinical decision-making for treatment. Pathology-based molecular diagnosis is challenging because of the invasiveness of the procedure, exclusion from neoadjuvant therapy options, and the heterogeneous nature of the tumor. PURPOSE We performed a systematic review of algorithms that predict molecular subtypes of gliomas from MR Imaging. DATA SOURCES Data sources were Ovid Embase, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, Web of Science. STUDY SELECTION Per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, 12,318 abstracts were screened and 1323 underwent full-text review, with 85 articles meeting the inclusion criteria. DATA ANALYSIS We compared prediction results from different machine learning approaches for predicting molecular subtypes of gliomas. Bias analysis was conducted for each study, following the Prediction model Risk Of Bias Assessment Tool (PROBAST) guidelines. DATA SYNTHESIS Isocitrate dehydrogenase mutation status was reported with an area under the curve and accuracy of 0.88 and 85% in internal validation and 0.86 and 87% in limited external validation data sets, respectively. For the prediction of O6-methylguanine-DNA methyltransferase promoter methylation, the area under the curve and accuracy in internal validation data sets were 0.79 and 77%, and in limited external validation, 0.89 and 83%, respectively. PROBAST scoring demonstrated high bias in all articles. LIMITATIONS The low number of external validation and studies with incomplete data resulted in unequal data analysis. Comparing the best prediction pipelines of each study may introduce bias. CONCLUSIONS While the high area under the curve and accuracy for the prediction of molecular subtypes of gliomas are reported in internal and external validation data sets, limited use of external validation and the increased risk of bias in all articles may present obstacles for clinical translation of these techniques.
Collapse
Affiliation(s)
- Jan Lost
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
- Department of Neurosurgery (J.L., M.S.), Heinrich-Heine-University, Duesseldorf, Germany
| | - Tej Verma
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Leon Jekel
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Marc von Reppert
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Niklas Tillmanns
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Sara Merkaj
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Gabriel Cassinelli Petersen
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Ryan Bahar
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Ayyüce Gordem
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Muhammad A Haider
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Harry Subramanian
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Waverly Brim
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Ichiro Ikuta
- Department of Radiology (I.I.), Mayo Clinic Arizona, Phoenix, Arizona
| | - Antonio Omuro
- Department of Neurology and Yale Cancer Center (A.O.), Yale School of Medicine, New Haven, Connecticut
| | - Gian Marco Conte
- Department of Radiology (G.M.C.), Mayo Clinic, Rochester, Minesotta
| | - Bernadette V Marquez-Nostra
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | - Arman Avesta
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| | | | - Ali Nabavizadeh
- Department of Radiology (A.N.), Perelman School of Medicine, Hospital of University of Pennsylvania, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Anahita Fathi Kazerooni
- Department of Neurosurgery (A.F.K.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
- Division of Neurosurgery (A.F.K.), Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
- Center for Data-Driven Discovery (A.F.K.), Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Sanjay Aneja
- Department of Therapeutic Radiology (S.A), Yale School of Medicine, New Haven, Connecticut
| | - Spyridon Bakas
- Center for Biomedical Image Computing and Analytics (S.B.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
- Richards Medical Research Laboratories (S.B.), Philadelphia, Pennsylvania
- Department of Radiology (S.B.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - MingDe Lin
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
- Visage Imaging Inc (K.B., M.L.), San Diego, California
| | - Michael Sabel
- Department of Neurosurgery (J.L., M.S.), Heinrich-Heine-University, Duesseldorf, Germany
| | - Mariam Aboian
- From the Department of Radiology and Biomedical Imaging (J.L., T.V., L.J., M.v.R., N.T., S.M., G.C.P., R.B., A.G., M.A.H., H.S., W.B., B.V.M.-N., A.A., M.L., M.A.), Yale School of Medicine, New Haven, Connecticut
| |
Collapse
|
33
|
Liu Z, Duan T, Zhang Y, Weng S, Xu H, Ren Y, Zhang Z, Han X. Radiogenomics: a key component of precision cancer medicine. Br J Cancer 2023; 129:741-753. [PMID: 37414827 PMCID: PMC10449908 DOI: 10.1038/s41416-023-02317-8] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 05/02/2023] [Accepted: 06/12/2023] [Indexed: 07/08/2023] Open
Abstract
Radiogenomics, focusing on the relationship between genomics and imaging phenotypes, has been widely applied to address tumour heterogeneity and predict immune responsiveness and progression. It is an inevitable consequence of current trends in precision medicine, as radiogenomics costs less than traditional genetic sequencing and provides access to whole-tumour information rather than limited biopsy specimens. By providing voxel-by-voxel genetic information, radiogenomics can allow tailored therapy targeting a complete, heterogeneous tumour or set of tumours. In addition to quantifying lesion characteristics, radiogenomics can also be used to distinguish benign from malignant entities, as well as patient characteristics, to better stratify patients according to disease risk, thereby enabling more precise imaging and screening. Here, we have characterised the radiogenomic application in precision medicine using a multi-omic approach. we outline the main applications of radiogenomics in diagnosis, treatment planning and evaluations in the field of oncology with the aim of developing quantitative and personalised medicine. Finally, we discuss the challenges in the field of radiogenomics and the scope and clinical applicability of these methods.
Collapse
Affiliation(s)
- Zaoqu Liu
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
- Interventional Institute of Zhengzhou University, 450052, Zhengzhou, Henan, China
- Interventional Treatment and Clinical Research Center of Henan Province, 450052, Zhengzhou, Henan, China
| | - Tian Duan
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
| | - Yuyuan Zhang
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
| | - Siyuan Weng
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
| | - Hui Xu
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
| | - Yuqing Ren
- Department of Respiratory and Critical Care Medicine, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China
| | - Zhenyu Zhang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China.
| | - Xinwei Han
- Department of Interventional Radiology, The First Affiliated Hospital of Zhengzhou University, 450052, Zhengzhou, Henan, China.
- Interventional Institute of Zhengzhou University, 450052, Zhengzhou, Henan, China.
- Interventional Treatment and Clinical Research Center of Henan Province, 450052, Zhengzhou, Henan, China.
| |
Collapse
|
34
|
Zhang H, Fan X, Zhang J, Wei Z, Feng W, Hu Y, Ni J, Yao F, Zhou G, Wan C, Zhang X, Wang J, Liu Y, You Y, Yu Y. Deep-learning and conventional radiomics to predict IDH genotyping status based on magnetic resonance imaging data in adult diffuse glioma. Front Oncol 2023; 13:1143688. [PMID: 37711207 PMCID: PMC10499353 DOI: 10.3389/fonc.2023.1143688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 08/17/2023] [Indexed: 09/16/2023] Open
Abstract
Objectives In adult diffuse glioma, preoperative detection of isocitrate dehydrogenase (IDH) status helps clinicians develop surgical strategies and evaluate patient prognosis. Here, we aim to identify an optimal machine-learning model for prediction of IDH genotyping by combining deep-learning (DL) signatures and conventional radiomics (CR) features as model predictors. Methods In this study, a total of 486 patients with adult diffuse gliomas were retrospectively collected from our medical center (n=268) and the public database (TCGA, n=218). All included patients were randomly divided into the training and validation sets by using nested 10-fold cross-validation. A total of 6,736 CR features were extracted from four MRI modalities in each patient, namely T1WI, T1CE, T2WI, and FLAIR. The LASSO algorithm was performed for CR feature selection. In each MRI modality, we applied a CNN+LSTM-based neural network to extract DL features and integrate these features into a DL signature after the fully connected layer with sigmoid activation. Eight classic machine-learning models were analyzed and compared in terms of their prediction performance and stability in IDH genotyping by combining the LASSO-selected CR features and integrated DL signatures as model predictors. In the validation sets, the prediction performance was evaluated by using accuracy and the area under the curve (AUC) of the receiver operating characteristics, while the model stability was analyzed by using the relative standard deviation of the AUC (RSDAUC). Subgroup analyses of DL signatures and CR features were also individually conducted to explore their independent prediction values. Results Logistic regression (LR) achieved favorable prediction performance (AUC: 0.920 ± 0.043, accuracy: 0.843 ± 0.044), whereas support vector machine with the linear kernel (l-SVM) displayed low prediction performance (AUC: 0.812 ± 0.052, accuracy: 0.821 ± 0.050). With regard to stability, LR also showed high robustness against data perturbation (RSDAUC: 4.7%). Subgroup analyses showed that DL signatures outperformed CR features (DL, AUC: 0.915 ± 0.054, accuracy: 0.835 ± 0.061, RSDAUC: 5.9%; CR, AUC: 0.830 ± 0.066, accuracy: 0.771 ± 0.051, RSDAUC: 8.0%), while DL and DL+CR achieved similar prediction results. Conclusion In IDH genotyping, LR is a promising machine-learning classification model. Compared with CR features, DL signatures exhibit markedly superior prediction values and discriminative capability.
Collapse
Affiliation(s)
- Hongjian Zhang
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Xiao Fan
- Department of Neurosurgery, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Junxia Zhang
- Department of Neurosurgery, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Zhiyuan Wei
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Wei Feng
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yifang Hu
- Department of Geriatric Endocrinology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Jiaying Ni
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Fushen Yao
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Gaoxin Zhou
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Cheng Wan
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Xin Zhang
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Junjie Wang
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yun Liu
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yongping You
- Department of Neurosurgery, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China
| | - Yun Yu
- Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, Jiangsu, China
- Institute of Medical Informatics and Management, Nanjing Medical University, Nanjing, Jiangsu, China
| |
Collapse
|
35
|
Duan S, Dong W, Hua Y, Zheng Y, Ren Z, Cao G, Wu F, Rong T, Liu B. Accurate Differentiation of Spinal Tuberculosis and Spinal Metastases Using MR-Based Deep Learning Algorithms. Infect Drug Resist 2023; 16:4325-4334. [PMID: 37424672 PMCID: PMC10329448 DOI: 10.2147/idr.s417663] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Accepted: 06/28/2023] [Indexed: 07/11/2023] Open
Abstract
Purpose To explore the application of deep learning (DL) methods based on T2 sagittal MR images for discriminating between spinal tuberculosis (STB) and spinal metastases (SM). Patients and Methods A total of 121 patients with histologically confirmed STB and SM across four institutions were retrospectively analyzed. Data from two institutions were used for developing deep learning models and internal validation, while the remaining institutions' data were used for external testing. Utilizing MVITV2, EfficientNet-B3, ResNet101, and ResNet34 as backbone networks, we developed four distinct DL models and evaluated their diagnostic performance based on metrics such as accuracy (ACC), area under the receiver operating characteristic curve (AUC), F1 score, and confusion matrix. Furthermore, the external test images were blindly evaluated by two spine surgeons with different levels of experience. We also used Gradient-Class Activation Maps to visualize the high-dimensional features of different DL models. Results For the internal validation set, MVITV2 outperformed other models with an accuracy of 98.7%, F1 score of 98.6%, and AUC of 0.98. Other models followed in this order: EfficientNet-B3 (ACC: 96.1%, F1 score: 95.9%, AUC: 0.99), ResNet101 (ACC: 85.5%, F1 score: 84.8%, AUC: 0.90), and ResNet34 (ACC: 81.6%, F1 score: 80.7%, AUC: 0.85). For the external test set, MVITV2 again performed excellently with an accuracy of 91.9%, F1 score of 91.5%, and an AUC of 0.95. EfficientNet-B3 came second (ACC: 85.9, F1 score: 91.5%, AUC: 0.91), followed by ResNet101 (ACC:80.8, F1 score: 80.0%, AUC: 0.87) and ResNet34 (ACC: 78.8, F1 score: 77.9%, AUC: 0.86). Additionally, the diagnostic accuracy of the less experienced spine surgeon was 73.7%, while that of the more experienced surgeon was 88.9%. Conclusion Deep learning based on T2WI sagittal images can help discriminate between STB and SM, and can achieve a level of diagnostic performance comparable with that produced by experienced spine surgeons.
Collapse
Affiliation(s)
- Shuo Duan
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, People’s Republic of China
| | - Weijie Dong
- Department of Orthopedics, Beijing Chest Hospital, Capital Medical University, Beijing, People’s Republic of China
| | - Yichun Hua
- Department of Medical Oncology, Beijing Tiantan Hospital, Capital Medical University, Beijing, People’s Republic of China
| | - Yali Zheng
- Department of Respiratory, Critical Care, and Sleep Medicine, Xiang’an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, People’s Republic of China
| | - Zengsuonan Ren
- Department of Orthopaedic Surgery, People’s Hospital of Hainan Tibetan Autonomous Prefecture, Hainan Tibetan Autonomous Prefecture, Qinghai Province, People’s Republic of China
| | - Guanmei Cao
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, People’s Republic of China
| | - Fangfang Wu
- Department of Respiratory, Critical Care, and Sleep Medicine, Xiang’an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, People’s Republic of China
| | - Tianhua Rong
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, People’s Republic of China
| | - Baoge Liu
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, People’s Republic of China
| |
Collapse
|
36
|
Duan S, Cao G, Hua Y, Hu J, Zheng Y, Wu F, Xu S, Rong T, Liu B. Identification of Origin for Spinal Metastases from MR Images: Comparison Between Radiomics and Deep Learning Methods. World Neurosurg 2023; 175:e823-e831. [PMID: 37059360 DOI: 10.1016/j.wneu.2023.04.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 04/06/2023] [Accepted: 04/07/2023] [Indexed: 04/16/2023]
Abstract
OBJECTIVE To determine whether spinal metastatic lesions originated from lung cancer or from other cancers based on spinal contrast-enhanced T1 (CET1) magnetic resonance (MR) images analyzed using radiomics (RAD) and deep learning (DL) methods. METHODS We recruited and retrospectively reviewed 173 patients diagnosed with spinal metastases at two different centers between July 2018 and June 2021. Of these, 68 involved lung cancer and 105 were other types of cancer. They were assigned to an internal cohort of 149 patients, randomly divided into a training set and a validation set, and to an external cohort of 24 patients. All patients underwent CET1-MR imaging before surgery or biopsy. We developed two predictive algorithms: a DL model and a RAD model. We compared performance between models, and against human radiological assessment, via accuracy (ACC) and receiver operating characteristic (ROC) analyses. Furthermore, we analyzed the correlation between RAD and DL features. RESULTS The DL model outperformed RAD model across the board, with ACC/ area under the receiver operating characteristic curve (AUC) values of 0.93/0.94 (DL) versus 0.84/0.93 (RAD) when applied to the training set from the internal cohort, 0.74/0.76 versus 0.72/0.75 when applied to the validation set, and 0.72/0.76 versus 0.69/0.72 when applied to the external test cohort. For the validation set, it also outperformed expert radiological assessment (ACC: 0.65, AUC: 0.68). We only found weak correlations between DL and RAD features. CONCLUSION The DL algorithm successfully identified the origin of spinal metastases from pre-operative CET1-MR images, outperforming both RAD models and expert assessment by trained radiologists.
Collapse
Affiliation(s)
- Shuo Duan
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Guanmei Cao
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yichun Hua
- Department of Medical Oncology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Junnan Hu
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yali Zheng
- Department of Respiratory, Critical Care, and Sleep Medicine, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Fangfang Wu
- Department of Respiratory, Critical Care, and Sleep Medicine, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Shuai Xu
- Department of Spinal Surgery, Peking University People's Hospital, Peking University, Beijing, China
| | - Tianhua Rong
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Baoge Liu
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing, China.
| |
Collapse
|
37
|
Sun W, Song C, Tang C, Pan C, Xue P, Fan J, Qiao Y. Performance of deep learning algorithms to distinguish high-grade glioma from low-grade glioma: A systematic review and meta-analysis. iScience 2023; 26:106815. [PMID: 37250800 PMCID: PMC10209541 DOI: 10.1016/j.isci.2023.106815] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 03/23/2023] [Accepted: 05/02/2023] [Indexed: 05/31/2023] Open
Abstract
This study aims to evaluate deep learning (DL) performance in differentiating low- and high-grade glioma. Search online database for studies continuously published from 1st January 2015 until 16th August 2022. The random-effects model was used for synthesis, based on pooled sensitivity (SE), specificity (SP), and area under the curve (AUC). Heterogeneity was estimated using the Higgins inconsistency index (I2). 33 were ultimately included in the meta-analysis. The overall pooled SE and SP were 94% and 93%, with an AUC of 0.98. There was great heterogeneity in this field. Our evidence-based study shows DL achieves high accuracy in glioma grading. Subgroup analysis reveals several limitations in this field: 1) Diagnostic trials require standard method for data merging for AI; 2) small sample size; 3) poor-quality image preprocessing; 4) not standard algorithm development; 5) not standard data report; 6) different definition of HGG and LGG; and 7) poor extrapolation.
Collapse
Affiliation(s)
- Wanyi Sun
- Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Cheng Song
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Chao Tang
- Shenzhen Maternity & Child Healthcare Hospital, Shenzhen, China
| | - Chenghao Pan
- Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Peng Xue
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jinhu Fan
- Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Youlin Qiao
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
38
|
Duan S, Hua Y, Cao G, Hu J, Cui W, Zhang D, Xu S, Rong T, Liu B. Differential diagnosis of benign and malignant vertebral compression fractures: Comparison and correlation of radiomics and deep learning frameworks based on spinal CT and clinical characteristics. Eur J Radiol 2023; 165:110899. [PMID: 37300935 DOI: 10.1016/j.ejrad.2023.110899] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 04/28/2023] [Accepted: 05/26/2023] [Indexed: 06/12/2023]
Abstract
PURPOSE Differentiating benign from malignant vertebral compression fractures (VCFs) is a diagnostic dilemma in clinical practice. To improve the accuracy and efficiency of diagnosis, we evaluated the performance of deep learning and radiomics methods based on computed tomography (CT) and clinical characteristics in differentiating between Osteoporosis VCFs (OVCFs) and malignant VCFs (MVCFs). METHODS We enrolled a total of 280 patients (155 with OVCFs and 125 with MVCFs) and randomly divided them into a training set (80%, n = 224) and a validation set (20%, n = 56). We developed three predictive models: a deep learning (DL) model, a radiomics (Rad) model, and a combined DL_Rad model, using CT and clinical characteristics data. The Inception_V3 served as the backbone of the DL model. The input data for the DL_Rad model consisted of the combined features of Rad and DCNN features. We calculated the receiver operating characteristic curve, area under the curve (AUC), and accuracy (ACC) to assess the performance of the models. Additionally, we calculated the correlation between Rad features and DCNN features. RESULTS For the training set, the DL_Rad model achieved the best results, with an AUC of 0.99 and ACC of 0.99, followed by the Rad model (AUC: 0.99, ACC: 0.97) and DL model (AUC: 0.99, ACC: 0.94). For the validation set, the DL_Rad model (with an AUC of 0.97 and ACC of 0.93) outperformed the Rad model (with an AUC: 0.93 and ACC: 0.91) and the DL model (with an AUC: 0.89 and ACC: 0.88). Rad features achieved better classifier performance than the DCNN features, and their general correlations were weak. CONCLUSIONS The Deep learnig model, Radiomics model, and Deep learning Radiomics model achieved promising results in discriminating MVCFs from OVCFs, and the DL_Rad model performed the best.
Collapse
Affiliation(s)
- Shuo Duan
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China
| | - Yichun Hua
- Department of Medical Oncology, Beijing Tiantan Hospital, Capital Medical University, China
| | - Guanmei Cao
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, China
| | - Junnan Hu
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China
| | - Wei Cui
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China
| | - Duo Zhang
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China
| | - Shuai Xu
- Department of Spinal Surgery, Peking University People's Hospital, Peking University, China
| | - Tianhua Rong
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China
| | - Baoge Liu
- Department of Orthopaedic Surgery, Beijing Tiantan Hospital, Capital Medical University, China; China National Clinical Research Center for Neurological Diseases, Beijing, China.
| |
Collapse
|
39
|
Luo J, Pan M, Mo K, Mao Y, Zou D. Emerging role of artificial intelligence in diagnosis, classification and clinical management of glioma. Semin Cancer Biol 2023; 91:110-123. [PMID: 36907387 DOI: 10.1016/j.semcancer.2023.03.006] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 03/05/2023] [Accepted: 03/08/2023] [Indexed: 03/12/2023]
Abstract
Glioma represents a dominant primary intracranial malignancy in the central nervous system. Artificial intelligence that mainly includes machine learning, and deep learning computational approaches, presents a unique opportunity to enhance clinical management of glioma through improving tumor segmentation, diagnosis, differentiation, grading, treatment, prediction of clinical outcomes (prognosis, and recurrence), molecular features, clinical classification, characterization of the tumor microenvironment, and drug discovery. A growing body of recent studies apply artificial intelligence-based models to disparate data sources of glioma, covering imaging modalities, digital pathology, high-throughput multi-omics data (especially emerging single-cell RNA sequencing and spatial transcriptome), etc. While these early findings are promising, future studies are required to normalize artificial intelligence-based models to improve the generalizability and interpretability of the results. Despite prominent issues, targeted clinical application of artificial intelligence approaches in glioma will facilitate the development of precision medicine of this field. If these challenges can be overcome, artificial intelligence has the potential to profoundly change the way patients with or at risk of glioma are provided with more rational care.
Collapse
Affiliation(s)
- Jiefeng Luo
- Department of Neurology, The Second Affiliated Hospital of Guangxi Medical University, Nanning 530007, Guangxi, China
| | - Mika Pan
- Department of Neurology, The Second Affiliated Hospital of Guangxi Medical University, Nanning 530007, Guangxi, China
| | - Ke Mo
- Clinical Research Center, The Second Affiliated Hospital of Guangxi Medical University, Nanning 530007, Guangxi, China
| | - Yingwei Mao
- Department of Biology, Pennsylvania State University, University Park, PA 16802, USA.
| | - Donghua Zou
- Department of Neurology, The Second Affiliated Hospital of Guangxi Medical University, Nanning 530007, Guangxi, China; Clinical Research Center, The Second Affiliated Hospital of Guangxi Medical University, Nanning 530007, Guangxi, China.
| |
Collapse
|
40
|
Zuo Z, Liu W, Zeng Y, Fan X, Li L, Chen J, Zhou X, Jiang Y, Yang X, Feng Y, Lu Y. Multiparametric magnetic resonance imaging-derived deep learning network to determine ferroptosis-related gene signatures in gliomas. Front Neurosci 2022; 16:1082867. [PMID: 36605558 PMCID: PMC9808079 DOI: 10.3389/fnins.2022.1082867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 12/02/2022] [Indexed: 12/24/2022] Open
Abstract
Introduction Ferroptosis-related gene (FRG) signature is important for assessing novel therapeutic approaches and prognosis in glioma. We trained a deep learning network for determining FRG signatures using multiparametric magnetic resonance imaging (MRI). Methods FRGs of patients with glioma were acquired from public databases. FRG-related risk score stratifying prognosis was developed from The Cancer Genome Atlas (TCGA) and validated using the Chinese Glioma Genome Atlas. Multiparametric MRI-derived glioma images and the corresponding genomic information were obtained for 122 cases from TCGA and The Cancer Imaging Archive. The deep learning network was trained using 3D-Resnet, and threefold cross-validation was performed to evaluate the predictive performance. Results The FRG-related risk score was associated with poor clinicopathological features and had a high predictive value for glioma prognosis. Based on the FRG-related risk score, patients with glioma were successfully classified into two subgroups (28 and 94 in the high- and low-risk groups, respectively). The deep learning networks TC (enhancing tumor and non-enhancing portion of the tumor core) mask achieved an average cross-validation accuracy of 0.842 and an average AUC of 0.781, while the deep learning networks WT (whole tumor and peritumoral edema) mask achieved an average cross-validation accuracy of 0.825 and an average AUC of 0.781. Discussion Our findings indicate that FRG signature is a prognostic indicator of glioma. In addition, we developed a deep learning network that has high classification accuracy in automatically determining FRG signatures, which may be an important step toward the clinical translation of novel therapeutic approaches and prognosis of glioma.
Collapse
Affiliation(s)
- Zhichao Zuo
- Department of Radiology, Xiangtan Central Hospital, Xiangtan, Hunan, China
| | - Wen Liu
- Department of Radiology, The Third Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Ying Zeng
- Department of Radiology, Xiangtan Central Hospital, Xiangtan, Hunan, China
| | - Xiaohong Fan
- The School of Mathematics and Computational Science, Xiangtan University, Xiangtan, Hunan, China
| | - Li Li
- Department of Radiology, Hunan Children’s Hospital, University of South China, Changsha, Hunan, China
| | - Jing Chen
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, Sichuan, China
| | - Xiao Zhou
- Department of Radiology, Xiangtan Central Hospital, Xiangtan, Hunan, China
| | - Yihong Jiang
- Department of Radiology, Xiangtan Central Hospital, Xiangtan, Hunan, China
| | - Xiuqi Yang
- Department of Radiology, Xiangtan Central Hospital, Xiangtan, Hunan, China
| | - Yujie Feng
- The School of Mathematics and Computational Science, Xiangtan University, Xiangtan, Hunan, China,*Correspondence: Yujie Feng,
| | - Yixin Lu
- Medical Imaging Department, Guangxi Medical University Cancer Hospital, Nanning, Guangxi, China,Yixin Lu,
| |
Collapse
|
41
|
Noninvasive Classification of Glioma Subtypes Using Multiparametric MRI to Improve Deep Learning. Diagnostics (Basel) 2022; 12:diagnostics12123063. [PMID: 36553070 PMCID: PMC9776470 DOI: 10.3390/diagnostics12123063] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 11/26/2022] [Accepted: 12/03/2022] [Indexed: 12/12/2022] Open
Abstract
Background: Deep learning (DL) methods can noninvasively predict glioma subtypes; however, there is no set paradigm for the selection of network structures and input data, including the image combination method, image processing strategy, type of numeric data, and others. Purpose: To compare different combinations of DL frameworks (ResNet, ConvNext, and vision transformer (VIT)), image preprocessing strategies, magnetic resonance imaging (MRI) sequences, and numerical data for increasing the accuracy of DL models for differentiating glioma subtypes prior to surgery. Methods: Our dataset consisted of 211 patients with newly diagnosed gliomas who underwent preoperative MRI with standard and diffusion-weighted imaging methods. Different data combinations were used as input for the three different DL classifiers. Results: The accuracy of the image preprocessing strategies, including skull stripping, segment addition, and individual treatment of slices, was 5%, 10%, and 12.5% higher, respectively, than that of the other strategies. The accuracy increased by 7.5% and 10% following the addition of ADC and numeric data, respectively. ResNet34 exhibited the best performance, which was 5% and 17.5% higher than that of ConvNext tiny and VIT-base, respectively. Data Conclusions: The findings demonstrated that the addition of quantitatively numeric data, ADC images, and effective image preprocessing strategies improved model accuracy for datasets of similar size. The performance of ResNet was superior for small or medium datasets.
Collapse
|
42
|
Zeng Q, Feng Z, Zhu Y, Zhang Y, Shu X, Wu A, Luo L, Cao Y, Xiong J, Li H, Zhou F, Jie Z, Tu Y, Li Z. Deep learning model for diagnosing early gastric cancer using preoperative computed tomography images. Front Oncol 2022; 12:1065934. [PMID: 36531076 PMCID: PMC9748811 DOI: 10.3389/fonc.2022.1065934] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 11/07/2022] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Early gastric cancer (EGC) is defined as a lesion restricted to the mucosa or submucosa, independent of size or evidence of regional lymph node metastases. Although computed tomography (CT) is the main technique for determining the stage of gastric cancer (GC), the accuracy of CT for determining tumor invasion of EGC was still unsatisfactory by radiologists. In this research, we attempted to construct an AI model to discriminate EGC in portal venous phase CT images. METHODS We retrospectively collected 658 GC patients from the first affiliated hospital of Nanchang university, and divided them into training and internal validation cohorts with a ratio of 8:2. As the external validation cohort, 93 GC patients were recruited from the second affiliated hospital of Soochow university. We developed several prediction models based on various convolutional neural networks, and compared their predictive performance. RESULTS The deep learning model based on the ResNet101 neural network represented sufficient discrimination of EGC. In two validation cohorts, the areas under the curves (AUCs) for the receiver operating characteristic (ROC) curves were 0.993 (95% CI: 0.984-1.000) and 0.968 (95% CI: 0.935-1.000), respectively, and the accuracy was 0.946 and 0.914. Additionally, the deep learning model can also differentiate between mucosa and submucosa tumors of EGC. CONCLUSIONS These results suggested that deep learning classifiers have the potential to be used as a screening tool for EGC, which is crucial in the individualized treatment of EGC patients.
Collapse
Affiliation(s)
- Qingwen Zeng
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
- Institute of Digestive Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
- Medical Innovation Center, The First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Zongfeng Feng
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
- Institute of Digestive Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Yanyan Zhu
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Yang Zhang
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
- Institute of Digestive Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Xufeng Shu
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Ahao Wu
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Lianghua Luo
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Yi Cao
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Jianbo Xiong
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Hong Li
- Department of Radiology, The Second Affiliated Hospital of Soochow University, Suzhou, Jiangsu, China
| | - Fuqing Zhou
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
| | - Zhigang Jie
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
- Institute of Digestive Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Yi Tu
- Department of Pathology, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| | - Zhengrong Li
- Department of Gastrointestinal Surgery, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, China
- Institute of Digestive Surgery, The First Affiliated Hospital of Nanchang University, Nanchang, Jiangxi, China
| |
Collapse
|
43
|
Li C, Li W, Liu C, Zheng H, Cai J, Wang S. Artificial intelligence in multi-parametric magnetic resonance imaging: A review. Med Phys 2022; 49:e1024-e1054. [PMID: 35980348 DOI: 10.1002/mp.15936] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/01/2022] [Accepted: 08/04/2022] [Indexed: 11/06/2022] Open
Abstract
Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Cheng Li
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Wen Li
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Chenyang Liu
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Shanshan Wang
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.,Peng Cheng Laboratory, Shenzhen, 518066, China.,Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangzhou, 510080, China
| |
Collapse
|
44
|
Zhao Y, Zhang J, Chen Y, Jiang J. A Novel Deep Learning Radiomics Model to Discriminate AD, MCI and NC: An Exploratory Study Based on Tau PET Scans from ADNI. Brain Sci 2022; 12:1067. [PMID: 36009130 PMCID: PMC9406185 DOI: 10.3390/brainsci12081067] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 08/09/2022] [Accepted: 08/10/2022] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVE We explored a novel model based on deep learning radiomics (DLR) to differentiate Alzheimer's disease (AD) patients, mild cognitive impairment (MCI) patients and normal control (NC) subjects. This model was validated in an exploratory study using tau positron emission tomography (tau-PET) scans. METHODS In this study, we selected tau-PET scans from the Alzheimer's Disease Neuroimaging Initiative database (ADNI), which included a total of 211 NC, 197 MCI, and 117 AD subjects. The dataset was divided into one training/validation group and one separate external group for testing. The proposed DLR model contained the following three steps: (1) pre-training of candidate deep learning models; (2) extraction and selection of DLR features; (3) classification based on support vector machine (SVM). In the comparative experiments, we compared the DLR model with three traditional models, including the SUVR model, traditional radiomics model, and a clinical model. Ten-fold cross-validation was carried out 200 times in the experiments. RESULTS Compared with other models, the DLR model achieved the best classification performance, with an accuracy of 90.76% ± 2.15% in NC vs. MCI, 88.43% ± 2.32% in MCI vs. AD, and 99.92% ± 0.51% in NC vs. AD. CONCLUSIONS Our proposed DLR model had the potential clinical value to discriminate AD, MCI and NC.
Collapse
Affiliation(s)
- Yan Zhao
- Nuclear Medicine and Molecular Imaging Key Laboratory of Sichuan Province, Luzhou 646000, China
- Department of Nuclear Medicine, Affiliated Hospital of Southwest Medical University, Luzhou 646000, China
- Institute of Nuclear Medicine, Southwest Medical University, Luzhou 646000, China
- School of Pharmacy, Southwest Medical University, Luzhou 646000, China
| | - Jieming Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
| | - Yue Chen
- Nuclear Medicine and Molecular Imaging Key Laboratory of Sichuan Province, Luzhou 646000, China
- Department of Nuclear Medicine, Affiliated Hospital of Southwest Medical University, Luzhou 646000, China
- Institute of Nuclear Medicine, Southwest Medical University, Luzhou 646000, China
- School of Pharmacy, Southwest Medical University, Luzhou 646000, China
| | - Jiehui Jiang
- Nuclear Medicine and Molecular Imaging Key Laboratory of Sichuan Province, Luzhou 646000, China
- Institute of Biomedical Engineering, School of Life Science, Shanghai University, Shanghai 200444, China
| |
Collapse
|
45
|
Chen S, Xu Y, Ye M, Li Y, Sun Y, Liang J, Lu J, Wang Z, Zhu Z, Zhang X, Zhang B. Predicting MGMT Promoter Methylation in Diffuse Gliomas Using Deep Learning with Radiomics. J Clin Med 2022; 11:jcm11123445. [PMID: 35743511 PMCID: PMC9224690 DOI: 10.3390/jcm11123445] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 06/08/2022] [Accepted: 06/13/2022] [Indexed: 02/01/2023] Open
Abstract
This study aimed to investigate the feasibility of predicting oxygen 6-methylguanine-DNA methyltransferase (MGMT) promoter methylation in diffuse gliomas by developing a deep learning approach using MRI radiomics. A total of 111 patients with diffuse gliomas participated in the retrospective study (56 patients with MGMT promoter methylation and 55 patients with MGMT promoter unmethylation). The radiomics features of the two regions of interest (ROI) (the whole tumor area and the tumor core area) for four sequences, including T1 weighted image (T1WI), T2 weighted image (T2WI), apparent diffusion coefficient (ADC) maps, and T1 contrast-enhanced (T1CE) MR images were extracted and jointly fed into the residual network. Then the deep learning method was developed and evaluated with a five-fold cross-validation, where in each fold, the dataset was randomly divided into training (80%) and validation (20%) cohorts. We compared the performance of all models using area under the curve (AUC) and average accuracy of validation cohorts and calculated the 10 most important features of the best model via a class activation map. Based on the ROI of the whole tumor, the predictive capacity of the T1CE and ADC model achieved the highest AUC value of 0.85. Based on the ROI of the tumor core, the T1CE and ADC model achieved the highest AUC value of 0.90. After comparison, the T1CE combined with the ADC model based on the ROI of the tumor core exhibited the best performance, with the highest average accuracy (0.91) and AUC (0.90) among all models. The deep learning method using MRI radiomics has excellent diagnostic performance with a high accuracy in predicting MGMT promoter methylation in diffuse gliomas.
Collapse
Affiliation(s)
- Sixuan Chen
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Yue Xu
- National Institute of Healthcare Data Science, Nanjing University, Nanjing 210023, China;
| | - Meiping Ye
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Yang Li
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Yu Sun
- School of Biological Science and Medical Engineering, Southeast University, Nanjing 211189, China; (Y.S.); (J.L.)
| | - Jiawei Liang
- School of Biological Science and Medical Engineering, Southeast University, Nanjing 211189, China; (Y.S.); (J.L.)
| | - Jiaming Lu
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Zhengge Wang
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Zhengyang Zhu
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
| | - Xin Zhang
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
- Correspondence:
| | - Bing Zhang
- Department of Radiology, The Affiliated Drum Tower Hospital of Nanjing University Medical School, Nanjing 210008, China; (S.C.); (M.Y.); (Y.L.); (J.L.); (Z.W.); (Z.Z.); (B.Z.)
- Institute of Brain Science, Nanjing University, Nanjing 210023, China
| |
Collapse
|
46
|
Jiang J, Zhang J, Li Z, Li L, Huang B, Alzheimer’s Disease Neuroimaging Initiative. Using Deep Learning Radiomics to Distinguish Cognitively Normal Adults at Risk of Alzheimer's Disease From Normal Control: An Exploratory Study Based on Structural MRI. Front Med (Lausanne) 2022; 9:894726. [PMID: 35530047 PMCID: PMC9070098 DOI: 10.3389/fmed.2022.894726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 03/28/2022] [Indexed: 11/24/2022] Open
Abstract
Objectives We proposed a novel deep learning radiomics (DLR) method to distinguish cognitively normal adults at risk of Alzheimer's disease (AD) from normal control based on T1-weighted structural MRI images. Methods In this study, we selected MRI data from the Alzheimer's Disease Neuroimaging Initiative Database (ADNI), which included 417 cognitively normal adults. These subjects were divided into 181 individuals at risk of Alzheimer's disease (preAD group) and 236 normal control individuals (NC group) according to standard uptake ratio >1.18 calculated by amyloid Positron Emission Tomography (PET). We further divided the preaAD group into APOE+ and APOE- subgroups according to whether APOE ε4 was positive or not. All data sets were divided into one training/validation group and one independent test group. The proposed DLR method included three steps: (1) the pre-training of basic deep learning (DL) models, (2) the extraction, selection and fusion of DLR features, and (3) classification. The support vector machine (SVM) was used as the classifier. In the comparative experiments, we compared our proposed DLR method with three existing models: hippocampal model, clinical model, and traditional radiomics model. Ten-fold cross-validation was performed with 100 time repetitions. Results The DLR method achieved the best classification performance between preAD and NC than other models with an accuracy of 89.85% ± 1.12%. In comparison, the accuracies of the other three models were 72.44% ± 1.37%, 82.00% ± 4.09% and 79.65% ± 2.21%. In addition, the DLR model also showed the best classification performance (85.45% ± 9.04% and 92.80% ± 2.61%) in the subgroup experiment. Conclusion The results showed that the DLR method provided a potentially clinical value to distinguish preAD from NC.
Collapse
Affiliation(s)
- Jiehui Jiang
- Department of Radiology, Gongli Hospital, School of Medicine, Shanghai University, Shanghai, China
- School of Life Sciences, Institute of Biomedical Engineering, Shanghai University, Shanghai, China
| | - Jieming Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Zhuoyuan Li
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Lanlan Li
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Bingcang Huang
- Department of Radiology, Gongli Hospital, School of Medicine, Shanghai University, Shanghai, China
| | | |
Collapse
|
47
|
Krauze AV, Zhuge Y, Zhao R, Tasci E, Camphausen K. AI-Driven Image Analysis in Central Nervous System Tumors-Traditional Machine Learning, Deep Learning and Hybrid Models. JOURNAL OF BIOTECHNOLOGY AND BIOMEDICINE 2022; 5:1-19. [PMID: 35106480 PMCID: PMC8802234 DOI: 10.26502/jbb.2642-91280046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
The interpretation of imaging in medicine in general and in oncology specifically remains problematic due to several limitations which include the need to incorporate detailed clinical history, patient and disease-specific history, clinical exam features, previous and ongoing treatment, and account for the dependency on reproducible human interpretation of multiple factors with incomplete data linkage. To standardize reporting, minimize bias, expedite management, and improve outcomes, the use of Artificial Intelligence (AI) has gained significant prominence in imaging analysis. In oncology, AI methods have as a result been explored in most cancer types with ongoing progress in employing AI towards imaging for oncology treatment, assessing treatment response, and understanding and communicating prognosis. Challenges remain with limited available data sets, variability in imaging changes over time augmented by a growing heterogeneity in analysis approaches. We review the imaging analysis workflow and examine how hand-crafted features also referred to as traditional Machine Learning (ML), Deep Learning (DL) approaches, and hybrid analyses, are being employed in AI-driven imaging analysis in central nervous system tumors. ML, DL, and hybrid approaches coexist, and their combination may produce superior results although data in this space is as yet novel, and conclusions and pitfalls have yet to be fully explored. We note the growing technical complexities that may become increasingly separated from the clinic and enforce the acute need for clinician engagement to guide progress and ensure that conclusions derived from AI-driven imaging analysis reflect that same level of scrutiny lent to other avenues of clinical research.
Collapse
Affiliation(s)
- A V Krauze
- Center for Cancer Research, National Cancer Institute, NIH, Building 10, Room B2-3637, Bethesda, USA
| | - Y Zhuge
- Center for Cancer Research, National Cancer Institute, NIH, Building 10, Room B2-3637, Bethesda, USA
| | - R Zhao
- University of British Columbia, Faculty of Medicine, 317 - 2194 Health Sciences Mall, Vancouver, Canada
| | - E Tasci
- Center for Cancer Research, National Cancer Institute, NIH, Building 10, Room B2-3637, Bethesda, USA
| | - K Camphausen
- Center for Cancer Research, National Cancer Institute, NIH, Building 10, Room B2-3637, Bethesda, USA
| |
Collapse
|
48
|
Germain P, Vardazaryan A, Padoy N, Labani A, Roy C, Schindler TH, El Ghannudi S. Deep Learning Supplants Visual Analysis by Experienced Operators for the Diagnosis of Cardiac Amyloidosis by Cine-CMR. Diagnostics (Basel) 2021; 12:diagnostics12010069. [PMID: 35054236 PMCID: PMC8774777 DOI: 10.3390/diagnostics12010069] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 12/24/2021] [Accepted: 12/27/2021] [Indexed: 12/03/2022] Open
Abstract
Background: Diagnosing cardiac amyloidosis (CA) from cine-CMR (cardiac magnetic resonance) alone is not reliable. In this study, we tested if a convolutional neural network (CNN) could outperform the visual diagnosis of experienced operators. Method: 119 patients with cardiac amyloidosis and 122 patients with left ventricular hypertrophy (LVH) of other origins were retrospectively selected. Diastolic and systolic cine-CMR images were preprocessed and labeled. A dual-input visual geometry group (VGG ) model was used for binary image classification. All images belonging to the same patient were distributed in the same set. Accuracy and area under the curve (AUC) were calculated per frame and per patient from a 40% held-out test set. Results were compared to a visual analysis assessed by three experienced operators. Results: frame-based comparisons between humans and a CNN provided an accuracy of 0.605 vs. 0.746 (p < 0.0008) and an AUC of 0.630 vs. 0.824 (p < 0.0001). Patient-based comparisons provided an accuracy of 0.660 vs. 0.825 (p < 0.008) and an AUC of 0.727 vs. 0.895 (p < 0.002). Conclusion: based on cine-CMR images alone, a CNN is able to discriminate cardiac amyloidosis from LVH of other origins better than experienced human operators (15 to 20 points more in absolute value for accuracy and AUC), demonstrating a unique capability to identify what the eyes cannot see through classical radiological analysis.
Collapse
Affiliation(s)
- Philippe Germain
- Department of Radiology, Nouvel Hopital Civil, University Hospital, 67000 Strasbourg, France; (A.L.); (C.R.); (S.E.G.)
- Correspondence:
| | - Armine Vardazaryan
- ICube, University of Strasbourg, CNRS, 67000 Strasbourg, France; (A.V.); (N.P.)
- IHU (Institut Hopitalo-Universitaire), 67000 Strasbourg, France
| | - Nicolas Padoy
- ICube, University of Strasbourg, CNRS, 67000 Strasbourg, France; (A.V.); (N.P.)
- IHU (Institut Hopitalo-Universitaire), 67000 Strasbourg, France
| | - Aissam Labani
- Department of Radiology, Nouvel Hopital Civil, University Hospital, 67000 Strasbourg, France; (A.L.); (C.R.); (S.E.G.)
| | - Catherine Roy
- Department of Radiology, Nouvel Hopital Civil, University Hospital, 67000 Strasbourg, France; (A.L.); (C.R.); (S.E.G.)
| | - Thomas Hellmut Schindler
- Mallinckrodt Institute of Radiology, Division of Nuclear Medicine, Washington University School of Medicine, Saint Louis, MO 63110, USA;
| | - Soraya El Ghannudi
- Department of Radiology, Nouvel Hopital Civil, University Hospital, 67000 Strasbourg, France; (A.L.); (C.R.); (S.E.G.)
- Department of Nuclear Medicine, Nouvel Hopital Civil, University Hospital, 67000 Strasbourg, France
| |
Collapse
|
49
|
Zhou Z. Artificial intelligence on MRI for molecular subtyping of diffuse gliomas: feature comparison, visualization, and correlation between radiomics and deep learning. Eur Radiol 2021; 32:745-746. [PMID: 34825932 DOI: 10.1007/s00330-021-08400-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Revised: 09/28/2021] [Accepted: 10/12/2021] [Indexed: 01/05/2023]
Affiliation(s)
- Zijian Zhou
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, 1400 Pressler St., Unit 1472, Houston, TX, 77030, USA.
| |
Collapse
|