1
|
Li D, Hu W, Ma L, Yang W, Liu Y, Zou J, Ge X, Han Y, Gan T, Cheng D, Ai K, Liu G, Zhang J. Deep learning radiomics nomograms predict Isocitrate dehydrogenase (IDH) genotypes in brain glioma: A multicenter study. Magn Reson Imaging 2025; 117:110314. [PMID: 39708927 DOI: 10.1016/j.mri.2024.110314] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 12/16/2024] [Accepted: 12/16/2024] [Indexed: 12/23/2024]
Abstract
PURPOSE To explore the feasibility of Deep learning radiomics nomograms (DLRN) in predicting IDH genotype. METHODS A total of 402 glioma patients from two independent centers were retrospectively included, and the data from center I was randomly divided into a training cohort (n = 239) and an internal validation cohort (n = 103) on a 7:3 basis. Center II served as an independent external validation cohort (n = 60). We developed a DLRN for IDH classification of gliomas based on T2 images. This hybrid model integrates deep learning features, radiomics features, and clinical features most relevant to IDH genotypes and finally classifies them using multivariate logistic regression analysis. We used the area under the curve (AUC) of the receiver operating characteristic (ROC) to evaluate the performance of the model and applied the DLRN score to the survival analysis of some of the follow-up glioma patients. RESULTS The proposed model had an area under the curve (AUC) of 0.98 in an externally validated cohort, and DLRN scores were significantly associated with the overall survival of glioma patients. CONCLUSIONS Deep learning radiomics nomograms performed well in non-invasively predicting IDH mutation status in gliomas, assisting stratified management and targeted therapy for glioma patients.
Collapse
Affiliation(s)
- Darui Li
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Wanjun Hu
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Laiyang Ma
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Wenxia Yang
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Yang Liu
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Jie Zou
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Xin Ge
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Yuping Han
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Tiejun Gan
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Dan Cheng
- Department of Radiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Kai Ai
- Philips Healthcare, Xi'an, China
| | - Guangyao Liu
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China
| | - Jing Zhang
- Department of Nuclear Magnetic Resonance, The Second Hospital & Clinical Medical School, Lanzhou University, Lanzhou 730030, China; Gansu Province Clinical Research Center for Functional and Molecular Imaging, Lanzhou 730030, China.
| |
Collapse
|
2
|
Nayak SS, Pendem S, Menon GR, Sampathila N, Koteshwar P. Quality Assessment of MRI-Radiomics-Based Machine Learning Methods in Classification of Brain Tumors: Systematic Review. Diagnostics (Basel) 2024; 14:2741. [PMID: 39682649 DOI: 10.3390/diagnostics14232741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2024] [Revised: 11/15/2024] [Accepted: 11/21/2024] [Indexed: 12/18/2024] Open
Abstract
BACKGROUND Brain tumors present a complex challenge in clinical oncology, where precise diagnosis and classification are pivotal for effective treatment planning. Radiomics, a burgeoning field in neuro-oncology, involves extracting and analyzing numerous quantitative features from medical images. This approach captures subtle spatial and textural information imperceptible to the human eye. However, implementation in clinical practice is still distant, and concerns have been raised regarding the methodological quality of radiomic studies. METHODOLOGY A systematic literature search was performed to identify original articles focused on the use of radiomics for brain tumors from 2015 based on the inclusion and exclusion criteria. The radiomic features train machine learning models for glioma classification, and data are split into training and testing subsets to validate the model accuracy, reliability, and generalizability. The present study systematically reviews the status of radiomic studies concerning brain tumors, also using the radiomics quality score (RQS) to assess the quality of the methodology used in each study. RESULTS A systematic search of PubMed identified 300 articles, with 18 studies meeting the inclusion criteria for qualitative synthesis. These studies collectively demonstrate the potential of radiomics-based machine learning models in accurately distinguishing between glioma subtypes and grades. Various imaging modalities, including MRI, PET/CT, and advanced techniques like ASL and DTI, were utilized to extract radiomic features for analysis. Machine learning algorithms such as deep learning networks, support vector machines, random forests, and logistic regression were applied to develop predictive models. CONCLUSIONS The present study indicates high accuracies in glioma classification, outperforming traditional imaging methods and inexperienced radiologists in some cases. Further validation and standardization efforts are warranted to facilitate the clinical integration of radiomics into routine practice, ultimately enhancing glioma management and patient outcomes. Open science practices: Machine learning using MRI radiomic features provides a simple, noninvasive, and cost-effective method for glioma classification, enhancing transparency, reproducibility, and collaboration within the scientific community.
Collapse
Affiliation(s)
- Shailesh S Nayak
- Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
| | - Saikiran Pendem
- Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
| | - Girish R Menon
- Kasturba Medical College, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
| | - Niranjana Sampathila
- Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
| | - Prakashini Koteshwar
- Kasturba Medical College, Manipal Academy of Higher Education, Manipal 576104, Karnataka, India
| |
Collapse
|
3
|
De Maria L, Ponzio F, Cho HH, Skogen K, Tsougos I, Gasparini M, Zeppieri M, Ius T, Ugga L, Panciani PP, Fontanella MM, Brinjikji W, Agosti E. The Current Diagnostic Performance of MRI-Based Radiomics for Glioma Grading: A Meta-Analysis. J Integr Neurosci 2024; 23:100. [PMID: 38812383 DOI: 10.31083/j.jin2305100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/28/2023] [Accepted: 01/04/2024] [Indexed: 05/30/2024] Open
Abstract
BACKGROUND Multiple radiomics models have been proposed for grading glioma using different algorithms, features, and sequences of magnetic resonance imaging. The research seeks to assess the present overall performance of radiomics for grading glioma. METHODS A systematic literature review of the databases Ovid MEDLINE PubMed, and Ovid EMBASE for publications published on radiomics for glioma grading between 2012 and 2023 was performed. The systematic review was carried out following the criteria of Preferred Reporting Items for Systematic Reviews and Meta-Analysis. RESULTS In the meta-analysis, a total of 7654 patients from 40 articles, were assessed. R-package mada was used for modeling the joint estimates of specificity (SPE) and sensitivity (SEN). Pooled event rates across studies were performed with a random-effects meta-analysis. The heterogeneity of SPE and SEN were based on the χ2 test. Overall values for SPE and SEN in the differentiation between high-grade gliomas (HGGs) and low-grade gliomas (LGGs) were 84% and 91%, respectively. With regards to the discrimination between World Health Organization (WHO) grade 4 and WHO grade 3, the overall SPE was 81% and the SEN was 89%. The modern non-linear classifiers showed a better trend, whereas textural features tend to be the best-performing (29%) and the most used. CONCLUSIONS Our findings confirm that present radiomics' diagnostic performance for glioma grading is superior in terms of SEN and SPE for the HGGs vs. LGGs discrimination task when compared to the WHO grade 4 vs. 3 task.
Collapse
Affiliation(s)
- Lucio De Maria
- Division of Neurosurgery, Department of Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, 25123 Brescia, Italy
| | - Francesco Ponzio
- Interuniversity Department of Regional and Urban Studies and Planning, Politecnico di Torino, 10125 Torino, Italy
| | - Hwan-Ho Cho
- Department of Medical Artificial Intelligence, Konyang University, 35365 Daejeon, Republic of Korea
| | - Karoline Skogen
- Department of Radiology and Nuclear Medicine, University of Oslo, 0372 Oslo, Norway
| | - Ioannis Tsougos
- Department of Medical Physics, University of Thessaly, 413 34 Larissa, Greece
| | - Mauro Gasparini
- Department of Mathematical Sciences "Giuseppe Luigi Lagrange", Politecnico di Torino, 10123 Torino, Italy
| | - Marco Zeppieri
- Department of Ophthalmology, University Hospital of Udine, 33100 Udine, Italy
| | - Tamara Ius
- Neurosurgery Unit, Head-Neck and NeuroScience Department University Hospital of Udine, p.le S. Maria della Misericordia 15, 33100 Udine, Italy
| | - Lorenzo Ugga
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", 80126 Naples, Italy
| | - Pier Paolo Panciani
- Division of Neurosurgery, Department of Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, 25123 Brescia, Italy
| | - Marco Maria Fontanella
- Division of Neurosurgery, Department of Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, 25123 Brescia, Italy
| | - Waleed Brinjikji
- Department of Neurosurgery and Interventional Neuroradiology, Mayo Clinic, Rochester, MN 55905, USA
| | - Edoardo Agosti
- Division of Neurosurgery, Department of Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, 25123 Brescia, Italy
| |
Collapse
|
4
|
Maskani M, Abbasi S, Etemad-Rezaee H, Abdolahi H, Zamanpour A, Montazerabadi A. Grading of Gliomas by Contrast-Enhanced CT Radiomics Features. J Biomed Phys Eng 2024; 14:151-158. [PMID: 38628893 PMCID: PMC11016825 DOI: 10.31661/jbpe.v0i0.2306-1628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 10/05/2023] [Indexed: 04/19/2024]
Abstract
Background Gliomas, as Central Nervous System (CNS) tumors, are greatly common with 80% of malignancy. Treatment methods for gliomas, such as surgery, radiation therapy, and chemotherapy depend on the grade, size, location, and the patient's age. Objective This study aimed to quantify glioma based on the radiomics analysis and classify its grade into High-grade Glioma (HGG) or Low-grade Glioma (LGG) by various machine-learning methods using contrast-enhanced brain Computerized Tomography (CT) scans. Material and Methods This retrospective study involved acquiring and segmenting data, selecting and extracting features, classifying, analyzing, and evaluating classifiers. The study included a total of 62 patients (31 with LGG and 31 with HGG). The tumors were segmented by an experienced CT-scan technologist with 3D slicer software. A total of 14 shape features, 18 histogram-based features, and 75 texture-based features were computed. The Area Under the Curve (AUC) and Receiver Operating Characteristic Curve (ROC) were used to evaluate and compare classification models. Results A total of 13 out of 107 features were selected to differentiate between LGGs and HGGs and to perform various classifier algorithms with different cross-validations. The best classifier algorithm was linear-discriminant with 93.5% accuracy, 96.77% sensitivity, 90.3% specificity, and 0.98% AUC in the differentiation of LGGs and HGGs. Conclusion The proposed method can identify LGG and HGG with 93.5% accuracy, 96.77% sensitivity, 90.3% specificity, and 0.98% AUC, leading to the best treatment for glioma patients by using CT scans based on radiomics analysis.
Collapse
Affiliation(s)
- Mohammad Maskani
- Department of Medical Physics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Samaneh Abbasi
- Department of Medical Physics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Hamidreza Etemad-Rezaee
- Department of Neurosurgery, Ghaem Teaching Hospital, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Hamid Abdolahi
- Department of Radiologic Sciences, Faculty of Allied Medical Sciences, Kerman University of Medical Sciences, Kerman, Iran
| | - Amir Zamanpour
- Department of Medical Physics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Alireza Montazerabadi
- Department of Medical Physics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
- Medical Physics Research Center, Mashhad University of Medical Sciences, Mashhad, Iran
| |
Collapse
|
5
|
Zheng YM, Pang J, Liu ZJ, Yuan MG, Li J, Wu ZJ, Jiang Y, Dong C. A CT-based Deep Learning Radiomics Nomogram for the Prediction of EGFR Mutation Status in Head and Neck Squamous Cell Carcinoma. Acad Radiol 2024; 31:628-638. [PMID: 37481418 DOI: 10.1016/j.acra.2023.06.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 06/18/2023] [Accepted: 06/24/2023] [Indexed: 07/24/2023]
Abstract
RATIONALE AND OBJECTIVES Accurately assessing epidermal growth factor receptor (EGFR) mutation status in head and neck squamous cell carcinoma (HNSCC) patients is crucial for prognosis and treatment selection. This study aimed to construct and validate a contrast-enhanced computed tomography (CECT)-based deep learning radiomics nomogram (DLRN) to predict EGFR mutation status of HNSCC. MATERIALS AND METHODS A total of 300 HNSCC patients who underwent CECT scans were enrolled in this study. Participants from two hospitals were separated into a training set (n = 200, 56 EGFR-negative and 144 EGFR-positive) from one hospital and an external test set from the other hospital (n = 100, 37 EGFR-negative and 63 EGFR-positive). The least absolute shrinkage and selection operator method was used to select the key features from CECT-based manually extracted radiomics (MER) features and features automatically extracted using a deep learning model (DL, extracted using a GoogLeNet model). The selected independent clinical factors, MER features, and DL features were then combined to construct a DLRN. The DLRN's performance was evaluated using receiver operating characteristics curves. RESULTS Five MER and six DL features were finally chosen. The DLRN, which includes "gender" and "necrotic areas," along with the selected features, predicted EGFR mutation status of HNSCC (EGFR-negative vs. positive) well in both the training (area under the curve [AUC], 0.901) and test (AUC, 0.875) sets. CONCLUSION A DLRN using CECT was built to predict EGFR mutation in HNSCC. The model showed high predictive ability and may aid in treatment selection and patient prognosis.
Collapse
Affiliation(s)
- Ying-Mei Zheng
- Health Management Center, The Affiliated Hospital of Qingdao University, Qingdao, China (Y.-m.Z.)
| | - Jing Pang
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China (J.P., J.L., Z.-j.W., C.D.)
| | - Zong-Jing Liu
- Department of Pediatric Hematology, The Affiliated Hospital of Qingdao University, Qingdao, China (Z.-j.L.)
| | - Ming-Gang Yuan
- Department of Nuclear Medicine, Affiliated Qingdao Central Hospital, Qingdao University, Qingdao, China (M.-g.Y.)
| | - Jie Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China (J.P., J.L., Z.-j.W., C.D.)
| | - Zeng-Jie Wu
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China (J.P., J.L., Z.-j.W., C.D.)
| | - Yan Jiang
- Department of Otolaryngology - Head and Neck Surgery, The Affiliated Hospital of Qingdao University, Qingdao, China (Y.J.)
| | - Cheng Dong
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China (J.P., J.L., Z.-j.W., C.D.).
| |
Collapse
|
6
|
Wang J, Chen Z, Cai C, Cai S. Ultrafast diffusion tensor imaging based on deep learning and multi-slice information sharing. Phys Med Biol 2024; 69:035011. [PMID: 38211309 DOI: 10.1088/1361-6560/ad1d6d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 01/11/2024] [Indexed: 01/13/2024]
Abstract
Objective. Diffusion tensor imaging (DTI) is excellent for non-invasively quantifying tissue microstructure. Theoretically DTI can be achieved with six different diffusion weighted images and one reference image, but the tensor estimation accuracy is poor in this case. Increasing the number of diffusion directions has benefits for the tensor estimation accuracy, which results in long scan time and makes DTI sensitive to motion. It would be beneficial to decrease the scan time of DTI by using fewer diffusion-weighted images without compromising reconstruction quality.Approach. A novel DTI scan scheme was proposed to achieve fast DTI, where only three diffusion directions per slice was required under a specific direction switching manner, and a deep-learning based reconstruction method was utilized using multi-slice information sharing and correspondingT1-weighted image for high-quality DTI reconstruction. A network with two encoders developed from U-Net was implemented for better utilizing the diffusion data redundancy between neighboring slices. The method performed direct nonlinear mapping from diffusion-weighted images to diffusion tensor.Main results. The performance of the proposed method was verified on the Human Connectome Project public data and clinical patient data. High-quality mean diffusivity, fractional anisotropy, and directionally encoded colormap can be achieved with only three diffusion directions per slice.Significance. High-quality DTI-derived maps can be achieved in less than one minute of scan time. The great reduction of scan time will help push the wider application of DTI in clinical practice.
Collapse
Affiliation(s)
- Jiechao Wang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen 361005, People's Republic of China
| | - Zunquan Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen 361005, People's Republic of China
| | - Congbo Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen 361005, People's Republic of China
| | - Shuhui Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen 361005, People's Republic of China
| |
Collapse
|
7
|
Herr J, Stoyanova R, Mellon EA. Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review. Crit Rev Oncog 2024; 29:33-65. [PMID: 38683153 DOI: 10.1615/critrevoncog.2023050852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/01/2024]
Abstract
Deep learning (DL) is poised to redefine the way medical images are processed and analyzed. Convolutional neural networks (CNNs), a specific type of DL architecture, are exceptional for high-throughput processing, allowing for the effective extraction of relevant diagnostic patterns from large volumes of complex visual data. This technology has garnered substantial interest in the field of neuro-oncology as a promising tool to enhance medical imaging throughput and analysis. A multitude of methods harnessing MRI-based CNNs have been proposed for brain tumor segmentation, classification, and prognosis prediction. They are often applied to gliomas, the most common primary brain cancer, to classify subtypes with the goal of guiding therapy decisions. Additionally, the difficulty of repeating brain biopsies to evaluate treatment response in the setting of often confusing imaging findings provides a unique niche for CNNs to help distinguish the treatment response to gliomas. For example, glioblastoma, the most aggressive type of brain cancer, can grow due to poor treatment response, can appear to grow acutely due to treatment-related inflammation as the tumor dies (pseudo-progression), or falsely appear to be regrowing after treatment as a result of brain damage from radiation (radiation necrosis). CNNs are being applied to separate this diagnostic dilemma. This review provides a detailed synthesis of recent DL methods and applications for intratumor segmentation, glioma classification, and prognosis prediction. Furthermore, this review discusses the future direction of MRI-based CNN in the field of neuro-oncology and challenges in model interpretability, data availability, and computation efficiency.
Collapse
Affiliation(s)
| | - Radka Stoyanova
- Department of Radiation Oncology, University of Miami Miller School of Medicine, Sylvester Comprehensive Cancer Center, Miami, Fl 33136, USA
| | - Eric Albert Mellon
- Department of Radiation Oncology, University of Miami Miller School of Medicine, Sylvester Comprehensive Cancer Center, Miami, Fl 33136, USA
| |
Collapse
|
8
|
Li J, Sun J, Wang N, Zhang Y. Study on the Relationship Between MRI Functional Imaging and Multiple Immunohistochemical Features of Glioma: A Noninvasive and More Precise Glioma Management. Mol Imaging 2024; 23:15353508241261583. [PMID: 38952400 PMCID: PMC11208885 DOI: 10.1177/15353508241261583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 05/09/2024] [Accepted: 05/23/2024] [Indexed: 07/03/2024] Open
Abstract
Objective To investigate the performance of diffusion-tensor imaging (DTI) and hydrogen proton magnetic resonance spectroscopy (1H-MRS) parameters in predicting the immunohistochemistry (IHC) biomarkers of glioma. Methods Patients with glioma confirmed by pathology from March 2015 to September 2019 were analyzed, the preoperative DTI and 1H-MRS images were collected, apparent diffusion coefficient (ADC) and fractional anisotropy (FA), in the lesion area were measured, the relative values relative ADC (rADC) and relative FA (rFA) were obtained by the ratio of them in the lesion area to the contralateral normal area. The peak of each metabolite in the lesion area of 1H-MRS image: N-acetylaspartate (NAA), choline (Cho), and creatine (Cr), and metabolite ratio: NAA/Cho, NAA/(Cho + Cr) were selected and calculated. The preoperative IHC data were collected including CD34, Ki-67, p53, S-100, syn, vimentin, NeuN, Nestin, and glial fibrillary acidic protein. Results One predicting parameter of DTI was screened, the rADC of the Ki-67 positive group was lower than that of the negative group. Two parameters of 1H-MRS were found to have significant reference values for glioma grades, the NAA and Cr decreased as the grade of glioma increased, moreover, Ki-67 Li was negatively correlated with NAA and Cr. Conclusion NAA and Cr have potential application value in predicting glioma grades and tumor proliferation activity. Only rADC has predictive value for Ki-67 expression among DTI parameters.
Collapse
Affiliation(s)
- Jing Li
- Department of Radiology, Tangshan Women and Children's Hospital, Tangshan, Hebei, China
| | - Jingtao Sun
- Department of Radiology, Tangshan Women and Children's Hospital, Tangshan, Hebei, China
| | - Ning Wang
- Department of Radiology and Nuclear Medicine, The First Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
| | - Yan Zhang
- Department of Radiology, The Second Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
| |
Collapse
|
9
|
Chen Z, Chen J, Zhao J, Liu B, Jiang S, Si D, Ding H, Nian Y, Yang X, Xiao J. What Matters in Radiological Image Segmentation? Effect of Segmentation Errors on the Diagnostic Related Features. J Digit Imaging 2023; 36:2088-2099. [PMID: 37340195 PMCID: PMC10501981 DOI: 10.1007/s10278-023-00865-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 05/29/2023] [Accepted: 05/31/2023] [Indexed: 06/22/2023] Open
Abstract
Segmentation is a crucial step in extracting the medical image features for clinical diagnosis. Though multiple metrics have been proposed to evaluate the segmentation performance, there is no clear study on how or to what extent the segmentation errors will affect the diagnostic related features used in clinical practice. Therefore, we proposed a segmentation robustness plot (SRP) to build the link between segmentation errors and clinical acceptance, where relative area under the curve (R-AUC) was designed to help clinicians to identify the robust diagnostic related image features. In experiments, we first selected representative radiological series from time series (cardiac first-pass perfusion) and spatial series (T2 weighted images on brain tumors) of magnetic resonance images, respectively. Then, dice similarity coefficient (DSC) and Hausdorff distance (HD), as the widely used evaluation metrics, were used to systematically control the degree of the segmentation errors. Finally, the differences between diagnostic related image features extracted from the ground truth and the derived segmentation were analyzed, using the statistical method large sample size T-test to calculate the corresponding p values. The results are denoted in the SRP, where the x-axis indicates the segmentation performance using the aforementioned evaluation metric, and the y-axis shows the severity of the corresponding feature changes, which are expressed in either the p values for a single case or the proportion of patients without significant change. The experimental results in SRP show that when DSC is above 0.95 and HD is below 3 mm, the segmentation errors will not change the features significantly in most cases. However, when segmentation gets worse, additional metrics are required for further analysis. In this way, the proposed SRP indicates the impact of the segmentation errors on the severity of the corresponding feature changes. By using SRP, one could easily define the acceptable segmentation errors in a challenge. Additionally, the R-AUC calculated from SRP provides an objective reference to help the selection of reliable features in image analysis.
Collapse
Affiliation(s)
- Zihang Chen
- Bioengineering College, Chongqing University, Chongqing, China
| | - Jiafei Chen
- The department of radiology, Southwest Hospital, Chongqing, China
| | - Jun Zhao
- The department of radiology, Southwest Hospital, Chongqing, China
| | - Bowei Liu
- Center for Biomedical Imaging Research, Tsinghua University, Beijing, China
| | - Shuanglong Jiang
- Bio-Med Informatics Research Center & Clinical Research Center, The Second Affiliated Hospital, Army Medical University, Chongqing, China
| | - Dongyue Si
- Center for Biomedical Imaging Research, Tsinghua University, Beijing, China
| | - Haiyan Ding
- Center for Biomedical Imaging Research, Tsinghua University, Beijing, China
| | - Yongjian Nian
- School of Biomedical Engineering, Third Military Medical University, Chongqing, China
| | - Xiaochao Yang
- School of Biomedical Engineering, Third Military Medical University, Chongqing, China
| | - Jingjing Xiao
- Bio-Med Informatics Research Center & Clinical Research Center, The Second Affiliated Hospital, Army Medical University, Chongqing, China
| |
Collapse
|
10
|
Wang J, Chen Z, Chen J. Diagnostic value of MRI radiomics in differentiating high‑grade glioma from low‑grade glioma: A meta‑analysis. Oncol Lett 2023; 26:436. [PMID: 37664663 PMCID: PMC10472021 DOI: 10.3892/ol.2023.14023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 07/13/2023] [Indexed: 09/05/2023] Open
Abstract
No clear conclusions have yet been reached regarding the accuracy of magnetic resonance imaging (MRI) radiomics in distinguishing high-grade glioma (HGG) from low-grade glioma (LGG). In the present study, a meta-analysis was conducted to determine the diagnostic value of MRI radiomics in differentiating between HGG and LGG, in order to guide their clinical diagnosis. PubMed, Embase and the Cochrane Library databases were searched up to November 2022. The search included studies in which true positive, false positive, true negative and false negative values for the differentiation of HGG from LGG were reported or could be calculated by retrograde extrapolation. Duplicate publications, research without full text, studies with incomplete information or unextractable data, animal studies, reviews and systematic reviews were excluded. STATA 15.1 was used to analyze the data. The meta-analysis included 15 studies, which comprised a total of 1,124 patients, of which 701 had HGG and 423 had LGG. The pooled sensitivity and specificity of the studies overall were 0.92 (95% CI: 0.89-0.95) and 0.89 (95% CI: 0.85-0.92), respectively. The positive and negative likelihood ratios of the studies overall were 7.89 (95% CI: 6.01-10.37) and 0.09 (95% CI: 0.07-0.12), respectively. The pooled diagnostic odds ratio of the studies was 85.20 (95% CI: 54.52-133.14). The area under the summary receiver operating characteristic curve was 0.91. These findings indicate that radiomics may be an accurate tool for the differentiation of glioma grades. However, further research is needed to verify the most appropriate of these technologies.
Collapse
Affiliation(s)
- Jiefang Wang
- Department of Radiology, Quanzhou First Hospital Affiliated to Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Zhichao Chen
- Department of Hepatobiliary and Pancreatic Surgery, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Jieyun Chen
- Department of Radiology, Quanzhou First Hospital Affiliated to Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| |
Collapse
|
11
|
Liu Y, Wu M. Deep learning in precision medicine and focus on glioma. Bioeng Transl Med 2023; 8:e10553. [PMID: 37693051 PMCID: PMC10486341 DOI: 10.1002/btm2.10553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 04/13/2023] [Accepted: 05/08/2023] [Indexed: 09/12/2023] Open
Abstract
Deep learning (DL) has been successfully applied to different fields for a range of tasks. In medicine, DL methods have been also used to improve the efficiency of disease diagnosis. In this review, we first summarize the history of the development of artificial intelligence models, demonstrate the features of the subtypes of machine learning and different DL networks, and then explore their application in the different fields of precision medicine, such as cardiology, gastroenterology, ophthalmology, dermatology, and oncology. By digging more information and extracting multilevel features from medical data, we found that DL helps doctors assess diseases automatically and monitor patients' physical health. In gliomas, research regarding application prospect of DL was mainly shown through magnetic resonance imaging and then by pathological slides. However, multi-omics data, such as whole exome sequence, RNA sequence, proteomics, and epigenomics, have not been covered thus far. In general, the quality and quantity of DL datasets still need further improvements, and more fruitful multi-omics characteristics will bring more comprehensive and accurate diagnosis in precision medicine and glioma.
Collapse
Affiliation(s)
- Yihao Liu
- Hunan Key Laboratory of Cancer Metabolism, Hunan Cancer Hospital and the Affiliated Cancer Hospital of Xiangya School of MedicineCentral South UniversityChangshaHunanChina
- NHC Key Laboratory of Carcinogenesis, Xiangya HospitalCentral South UniversityChangshaHunanChina
- Key Laboratory of Carcinogenesis and Cancer Invasion of the Chinese Ministry of Education, Cancer Research InstituteCentral South UniversityChangshaHunanChina
| | - Minghua Wu
- Hunan Key Laboratory of Cancer Metabolism, Hunan Cancer Hospital and the Affiliated Cancer Hospital of Xiangya School of MedicineCentral South UniversityChangshaHunanChina
- NHC Key Laboratory of Carcinogenesis, Xiangya HospitalCentral South UniversityChangshaHunanChina
- Key Laboratory of Carcinogenesis and Cancer Invasion of the Chinese Ministry of Education, Cancer Research InstituteCentral South UniversityChangshaHunanChina
| |
Collapse
|
12
|
楚 智, 屈 耀, 钟 涛, 梁 淑, 温 志, 张 煜. [A Dual-Aware deep learning framework for identification of glioma isocitrate dehydrogenase genotype using magnetic resonance amide proton transfer modalities]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2023; 43:1379-1387. [PMID: 37712275 PMCID: PMC10505564 DOI: 10.12122/j.issn.1673-4254.2023.08.15] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Indexed: 09/16/2023]
Abstract
OBJECTIVE To propose a Dual-Aware deep learning framework for genotyping of isocitrate dehydrogenase (IDH) in gliomas based on magnetic resonance amide proton transfer (APT) modality data as a means to assist non-invasive diagnosis of gliomas. METHODS We collected multimodal magnetic resonance imaging (MRI) imaging data of the brain from 118 cases of gliomas, including 68 wild-type and 50 mutant type cases. The delineation of the ROI of brain glioma was completed in all the cases. APT modality imaging does not require contrast agents, and its signal intensity on tumors is positively correlated with tumor malignancy, and the signal intensity on wild-type IDH is higher than that on mutant IDH. For APT modalities, tumor imaging and derived areas are morphologically variable and lack prominent edge contour characteristics compared with other modalities. Based on these characteristics, we propose the Dual-Aware framework, which introduces the Multi-Aware framework to mine multi-scale features, and the Edge Aware module mines the edge features for automatic genotype identification. RESULTS The introduction of two types of Aware mechanisms effectively improved the identification rate of the model for glioma IDH genotyping. The accuracy and AUC for each modality data were enhanced, and the best performance was achieved on the APT modality with a prediction accuracy of 83.1% and an AUC of 0.822, suggesting its advantages and effectiveness for identifying glioma IDH genotypes. CONCLUSION The proposed deep learning algorithm model constructed based on the image characteristics of the APT modality is effective for glioma IDH genotyping and identification task and may potentially replace the commonly used T1CE modality to avoid contrast agent injection and achieve non- invasive IDH genotyping.
Collapse
Affiliation(s)
- 智钦 楚
- 南方医科大学生物医学工程学院,广东 广州 510515School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
- 广东省医学图像处理重点实验室,广东 广州 510515Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 耀铭 屈
- 南方医科大学珠江医院放射科,广东 广州 510282Department of Radiology, Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - 涛 钟
- 南方医科大学生物医学工程学院,广东 广州 510515School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
- 广东省医学图像处理重点实验室,广东 广州 510515Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 淑君 梁
- 南方医科大学生物医学工程学院,广东 广州 510515School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
- 广东省医学图像处理重点实验室,广东 广州 510515Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| | - 志波 温
- 南方医科大学珠江医院放射科,广东 广州 510282Department of Radiology, Zhujiang Hospital, Southern Medical University, Guangzhou 510282, China
| | - 煜 张
- 南方医科大学生物医学工程学院,广东 广州 510515School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China
- 广东省医学图像处理重点实验室,广东 广州 510515Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China
| |
Collapse
|
13
|
Zheng YM, Che JY, Yuan MG, Wu ZJ, Pang J, Zhou RZ, Li XL, Dong C. A CT-Based Deep Learning Radiomics Nomogram to Predict Histological Grades of Head and Neck Squamous Cell Carcinoma. Acad Radiol 2023; 30:1591-1599. [PMID: 36460582 DOI: 10.1016/j.acra.2022.11.007] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/01/2022] [Accepted: 11/10/2022] [Indexed: 12/03/2022]
Abstract
RATIONALE AND OBJECTIVES Accurate pretreatment assessment of histological differentiation grade of head and neck squamous cell carcinoma (HNSCC) is crucial for prognosis evaluation. This study aimed to construct and validate a contrast-enhanced computed tomography (CECT)-based deep learning radiomics nomogram (DLRN) to predict histological differentiation grades of HNSCC. MATERIALS AND METHODS A total of 204 patients with HNSCC who underwent CECT scans were enrolled in this study. The participants recruited from two hospitals were split into a training set (n=124, 74 well/moderately differentiated and 50 poorly differentiated) of patients from one hospital and an external test set of patients from the other hospital (n=80, 49 well/moderately differentiated and 31 poorly differentiated). CECT-based manually-extracted radiomics (MER) features and deep learning (DL) features were extracted and selected. The selected MER features and DL features were then combined to construct a DLRN via multivariate logistic regression. The predictive performance of the DLRN was assessed using ROCs and decision curve analysis (DCA). RESULTS Three MER features and seven DL features were finally selected. The DLRN incorporating the selected MER and DL features showed good predictive value for the histological differentiation grades of HNSCC (well/moderately differentiated vs. poorly differentiated) in both the training (AUC, 0.878) and test (AUC, 0.822) sets. DCA demonstrated that the DLRN was clinically useful for predicting histological differentiation grades of HNSCC. CONCLUSION A CECT-based DLRN was constructed to predict histological differentiation grades of HNSCC. The DLRN showed good predictive efficacy and might be useful for prognostic evaluation of patients with HNSCC.
Collapse
Affiliation(s)
- Ying-Mei Zheng
- Health Management Center, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Jun-Yi Che
- Department of Radiology, Qingdao Municipal Hospital, Qingdao, China
| | - Ming-Gang Yuan
- Department of Nuclear Medicine, Affiliated Qingdao Central Hospital, Qingdao University, Qingdao, China
| | - Zeng-Jie Wu
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Jing Pang
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Rui-Zhi Zhou
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Xiao-Li Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Cheng Dong
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China.
| |
Collapse
|
14
|
AGGN: Attention-based glioma grading network with multi-scale feature extraction and multi-modal information fusion. Comput Biol Med 2023; 152:106457. [PMID: 36571937 DOI: 10.1016/j.compbiomed.2022.106457] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/06/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022]
Abstract
In this paper, a magnetic resonance imaging (MRI) oriented novel attention-based glioma grading network (AGGN) is proposed. By applying the dual-domain attention mechanism, both channel and spatial information can be considered to assign weights, which benefits highlighting the key modalities and locations in the feature maps. Multi-branch convolution and pooling operations are applied in a multi-scale feature extraction module to separately obtain shallow and deep features on each modality, and a multi-modal information fusion module is adopted to sufficiently merge low-level detailed and high-level semantic features, which promotes the synergistic interaction among different modality information. The proposed AGGN is comprehensively evaluated through extensive experiments, and the results have demonstrated the effectiveness and superiority of the proposed AGGN in comparison to other advanced models, which also presents high generalization ability and strong robustness. In addition, even without the manually labeled tumor masks, AGGN can present considerable performance as other state-of-the-art algorithms, which alleviates the excessive reliance on supervised information in the end-to-end learning paradigm.
Collapse
|
15
|
A Survey of Radiomics in Precision Diagnosis and Treatment of Adult Gliomas. J Clin Med 2022; 11:jcm11133802. [PMID: 35807084 PMCID: PMC9267404 DOI: 10.3390/jcm11133802] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 06/18/2022] [Accepted: 06/29/2022] [Indexed: 02/04/2023] Open
Abstract
Glioma is the most common primary malignant tumor of the adult central nervous system (CNS), which mostly shows invasive growth. In most cases, surgery is often difficult to completely remove, and the recurrence rate and mortality of patients are high. With the continuous development of molecular genetics and the great progress of molecular biology technology, more and more molecular biomarkers have been proved to have important guiding significance in the individualized diagnosis, treatment, and prognosis evaluation of glioma. With the updates of the World Health Organization (WHO) classification of tumors of the CNS in 2021, the diagnosis and treatment of glioma has entered the era of precision medicine in the true sense. Due to its ability to non-invasively achieve accurate identification of glioma from other intracranial tumors, and to predict the grade, genotyping, treatment response, and prognosis of glioma, which provides a scientific basis for the clinical application of individualized diagnosis and treatment model of glioma, radiomics has become a research hotspot in the field of precision medicine. This paper reviewed the research related to radiomics of adult gliomas published in recent years and summarized the research proceedings of radiomics in differential diagnosis, preoperative grading and genotyping, treatment and efficacy evaluation, and survival prediction of adult gliomas.
Collapse
|
16
|
Li J, Liu X, Wang X, Liu H, Lin Z, Xiong N. Diffusion Tensor Imaging Radiomics for Diagnosis of Parkinson’s Disease. Brain Sci 2022; 12:brainsci12070851. [PMID: 35884658 PMCID: PMC9313106 DOI: 10.3390/brainsci12070851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Revised: 06/13/2022] [Accepted: 06/14/2022] [Indexed: 11/25/2022] Open
Abstract
Background: Diagnosis of Parkinson’s Disease (PD) based on clinical symptoms and scale scores is mostly objective, and the accuracy of neuroimaging for PD diagnosis remains controversial. This study aims to introduce a radiomic tool to improve the sensitivity and specificity of diagnosis based on Diffusion Tensor Imaging (DTI) metrics. Methods: In this machine learning-based retrospective study, we collected basic clinical information and DTI images from 54 healthy controls (HCs) and 56 PD patients. Among them, 60 subjects (30 PD patients and 30 HCs) were assigned to the training group, whereas the test cohort was 26 PD patients and 24 HCs. After the feature extraction and selection using newly developed image processing software Ray-plus, LASSO regression was used to finalize radiomic features. Results: A total of 4600 radiomic features were extracted, of which 12 were finally selected. The values of the AUC (area under the subject operating curve) in the training group, the validation group, and overall were 0.911, 0.931, and 0.919, respectively. Conclusion: This study introduced a novel radiometric and computer algorithm based on DTI images, which can help increase the sensitivity and specificity of PD screening.
Collapse
Affiliation(s)
- Jingwen Li
- Department of Neurology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (J.L.); (X.W.); (H.L.)
| | - Xiaoming Liu
- Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China;
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Xinyi Wang
- Department of Neurology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (J.L.); (X.W.); (H.L.)
| | - Hanshu Liu
- Department of Neurology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (J.L.); (X.W.); (H.L.)
| | - Zhicheng Lin
- Laboratory of Psychiatric Neurogenomics, McLean Hospital, Harvard Medical School, Belmont, MA 02478, USA;
| | - Nian Xiong
- Department of Neurology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (J.L.); (X.W.); (H.L.)
- Wuhan Red Cross Hospital, Wuhan 430022, China
- Correspondence:
| |
Collapse
|
17
|
Wang X, Wang R, Yang S, Zhang J, Wang M, Zhong D, Zhang J, Han X. Combining Radiology and Pathology for Automatic Glioma Classification. Front Bioeng Biotechnol 2022; 10:841958. [PMID: 35387307 PMCID: PMC8977526 DOI: 10.3389/fbioe.2022.841958] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 02/23/2022] [Indexed: 11/17/2022] Open
Abstract
Subtype classification is critical in the treatment of gliomas because different subtypes lead to different treatment options and postoperative care. Although many radiological- or histological-based glioma classification algorithms have been developed, most of them focus on single-modality data. In this paper, we propose an innovative two-stage model to classify gliomas into three subtypes (i.e., glioblastoma, oligodendroglioma, and astrocytoma) based on radiology and histology data. In the first stage, our model classifies each image as having glioblastoma or not. Based on the obtained non-glioblastoma images, the second stage aims to accurately distinguish astrocytoma and oligodendroglioma. The radiological images and histological images pass through the two-stage design with 3D and 2D models, respectively. Then, an ensemble classification network is designed to automatically integrate the features of the two modalities. We have verified our method by participating in the MICCAI 2020 CPM-RadPath Challenge and won 1st place. Our proposed model achieves high performance on the validation set with a balanced accuracy of 0.889, Cohen’s Kappa of 0.903, and an F1-score of 0.943. Our model could advance multimodal-based glioma research and provide assistance to pathologists and neurologists in diagnosing glioma subtypes. The code has been publicly available online at https://github.com/Xiyue-Wang/1st-in-MICCAI2020-CPM.
Collapse
Affiliation(s)
- Xiyue Wang
- College of Biomedical Engineering, Sichuan University, Chengdu, China.,College of Computer Science, Sichuan University, Chengdu, China
| | - Ruijie Wang
- School of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an, China
| | | | | | - Minghui Wang
- College of Biomedical Engineering, Sichuan University, Chengdu, China.,College of Computer Science, Sichuan University, Chengdu, China
| | - Dexing Zhong
- School of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an, China.,Pazhou Lab, Guangzhou, China.,State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China
| | - Jing Zhang
- College of Biomedical Engineering, Sichuan University, Chengdu, China
| | | |
Collapse
|
18
|
Afridi M, Jain A, Aboian M, Payabvash S. Brain Tumor Imaging: Applications of Artificial Intelligence. Semin Ultrasound CT MR 2022; 43:153-169. [PMID: 35339256 PMCID: PMC8961005 DOI: 10.1053/j.sult.2022.02.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Artificial intelligence has become a popular field of research with goals of integrating it into the clinical decision-making process. A growing number of predictive models are being employed utilizing machine learning that includes quantitative, computer-extracted imaging features known as radiomic features, and deep learning systems. This is especially true in brain-tumor imaging where artificial intelligence has been proposed to characterize, differentiate, and prognostication. We reviewed current literature regarding the potential uses of machine learning-based, and deep learning-based artificial intelligence in neuro-oncology as it pertains to brain tumor molecular classification, differentiation, and treatment response. While there is promising evidence supporting the use of artificial intelligence in neuro-oncology, there are still more investigations needed on a larger, multicenter scale along with a streamlined and standardized image processing workflow prior to its introduction in routine clinical decision-making protocol.
Collapse
Affiliation(s)
- Muhammad Afridi
- School of Osteopathic Medicine, Rowan University, Stratford, NJ
| | - Abhi Jain
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT
| | - Mariam Aboian
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT
| | - Seyedmehdi Payabvash
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT.
| |
Collapse
|
19
|
Qin C, Hu W, Wang X, Ma X. Application of Artificial Intelligence in Diagnosis of Craniopharyngioma. Front Neurol 2022; 12:752119. [PMID: 35069406 PMCID: PMC8770750 DOI: 10.3389/fneur.2021.752119] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 11/12/2021] [Indexed: 12/24/2022] Open
Abstract
Craniopharyngioma is a congenital brain tumor with clinical characteristics of hypothalamic-pituitary dysfunction, increased intracranial pressure, and visual field disorder, among other injuries. Its clinical diagnosis mainly depends on radiological examinations (such as Computed Tomography, Magnetic Resonance Imaging). However, assessing numerous radiological images manually is a challenging task, and the experience of doctors has a great influence on the diagnosis result. The development of artificial intelligence has brought about a great transformation in the clinical diagnosis of craniopharyngioma. This study reviewed the application of artificial intelligence technology in the clinical diagnosis of craniopharyngioma from the aspects of differential classification, prediction of tissue invasion and gene mutation, prognosis prediction, and so on. Based on the reviews, the technical route of intelligent diagnosis based on the traditional machine learning model and deep learning model were further proposed. Additionally, in terms of the limitations and possibilities of the development of artificial intelligence in craniopharyngioma diagnosis, this study discussed the attentions required in future research, including few-shot learning, imbalanced data set, semi-supervised models, and multi-omics fusion.
Collapse
Affiliation(s)
- Caijie Qin
- Institute of Information Engineering, Sanming University, Sanming, China
| | - Wenxing Hu
- University of New South Wales, Sydney, NSW, Australia
| | - Xinsheng Wang
- School of Information Science and Engineering, Harbin Institute of Technology at Weihai, Weihai, China
| | - Xibo Ma
- CBSR & NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
20
|
van Kempen EJ, Post M, Mannil M, Kusters B, ter Laan M, Meijer FJA, Henssen DJHA. Accuracy of Machine Learning Algorithms for the Classification of Molecular Features of Gliomas on MRI: A Systematic Literature Review and Meta-Analysis. Cancers (Basel) 2021; 13:cancers13112606. [PMID: 34073309 PMCID: PMC8198025 DOI: 10.3390/cancers13112606] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 05/17/2021] [Accepted: 05/18/2021] [Indexed: 12/12/2022] Open
Abstract
Simple Summary Glioma prognosis and treatment are based on histopathological characteristics and molecular profile. Following the World Health Organization (WHO) guidelines (2016), the most important molecular diagnostic markers include IDH1/2-genotype and 1p/19q codeletion status, although more recent publications also include ARTX genotype and TERT- and MGMT promoter methylation. Machine learning algorithms (MLAs), however, were described to successfully determine these molecular characteristics non-invasively by using magnetic resonance imaging (MRI) data. The aim of this review and meta-analysis was to define the diagnostic accuracy of MLAs with regard to these different molecular markers. We found high accuracies of MLAs to predict each individual molecular marker, with IDH1/2-genotype being the most investigated and the most accurate. Radiogenomics could therefore be a promising tool for discriminating genetically determined gliomas in a non-invasive fashion. Although encouraging results are presented here, large-scale, prospective trials with external validation groups are warranted. Abstract Treatment planning and prognosis in glioma treatment are based on the classification into low- and high-grade oligodendroglioma or astrocytoma, which is mainly based on molecular characteristics (IDH1/2- and 1p/19q codeletion status). It would be of great value if this classification could be made reliably before surgery, without biopsy. Machine learning algorithms (MLAs) could play a role in achieving this by enabling glioma characterization on magnetic resonance imaging (MRI) data without invasive tissue sampling. The aim of this study is to provide a performance evaluation and meta-analysis of various MLAs for glioma characterization. Systematic literature search and meta-analysis were performed on the aggregated data, after which subgroup analyses for several target conditions were conducted. This study is registered with PROSPERO, CRD42020191033. We identified 724 studies; 60 and 17 studies were eligible to be included in the systematic review and meta-analysis, respectively. Meta-analysis showed excellent accuracy for all subgroups, with the classification of 1p/19q codeletion status scoring significantly poorer than other subgroups (AUC: 0.748, p = 0.132). There was considerable heterogeneity among some of the included studies. Although promising results were found with regard to the ability of MLA-tools to be used for the non-invasive classification of gliomas, large-scale, prospective trials with external validation are warranted in the future.
Collapse
Affiliation(s)
- Evi J. van Kempen
- Department of Medical Imaging, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands; (E.J.v.K.); (M.P.); (F.J.A.M.)
| | - Max Post
- Department of Medical Imaging, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands; (E.J.v.K.); (M.P.); (F.J.A.M.)
| | - Manoj Mannil
- Clinic of Radiology, University Hospital Münster, WWU University of Münster, 48149 Münster, Germany;
| | - Benno Kusters
- Department of Pathology, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands;
| | - Mark ter Laan
- Department of Neurosurgery, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands;
| | - Frederick J. A. Meijer
- Department of Medical Imaging, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands; (E.J.v.K.); (M.P.); (F.J.A.M.)
| | - Dylan J. H. A. Henssen
- Department of Medical Imaging, Radboud University Medical Center, Radboud University, 6500HB Nijmegen, The Netherlands; (E.J.v.K.); (M.P.); (F.J.A.M.)
- Correspondence:
| |
Collapse
|
21
|
Fang S, Fan Z, Sun Z, Li Y, Liu X, Liang Y, Liu Y, Zhou C, Zhu Q, Zhang H, Li T, Li S, Jiang T, Wang Y, Wang L. Radiomics Features Predict Telomerase Reverse Transcriptase Promoter Mutations in World Health Organization Grade II Gliomas via a Machine-Learning Approach. Front Oncol 2021; 10:606741. [PMID: 33643908 PMCID: PMC7905226 DOI: 10.3389/fonc.2020.606741] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 12/24/2020] [Indexed: 12/16/2022] Open
Abstract
The detection of mutations in telomerase reverse transcriptase promoter (pTERT) is important since preoperative diagnosis of pTERT status helps with evaluating prognosis and determining the surgical strategy. Here, we aimed to establish a radiomics-based machine-learning algorithm and evaluated its performance with regard to the prediction of mutations in pTERT in patients with World Health Organization (WHO) grade II gliomas. In total, 164 patients with WHO grade II gliomas were enrolled in this retrospective study. We extracted a total of 1,293 radiomics features from multi-parametric magnetic resonance imaging scans. Elastic net (used for feature selection) and support vector machine with linear kernel were applied in nested 10-fold cross-validation loops. The predictive model was evaluated by receiver operating characteristic and precision-recall analyses. We performed an unpaired t-test to compare the posterior predictive probabilities among patients with differing pTERT statuses. We selected 12 valuable radiomics features using nested 10-fold cross-validation loops. The area under the curve (AUC) was 0.8446 (95% confidence interval [CI], 0.7735–0.9065) with an optimal summed value of sensitivity of 0.9355 (95% CI, 0.8802–0.9788) and specificity of 0.6197 (95% CI, 0.5071–0.7371). The overall accuracy was 0.7988 (95% CI, 0.7378–0.8598). The F1-score was 0.8406 (95% CI, 0.7684–0.902) with an optimal precision of 0.7632 (95% CI, 0.6818–0.8364) and recall of 0.9355 (95% CI, 0.8802–0.9788). Posterior probabilities of pTERT mutations were significantly different between patients with wild-type and mutant TERT promoters. Our findings suggest that a radiomics analysis with a machine-learning algorithm can be useful for predicting pTERT status in patients with WHO grade II glioma and may aid in glioma management.
Collapse
Affiliation(s)
- Shengyu Fang
- Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Ziwen Fan
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Zhiyan Sun
- Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Yiming Li
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Xing Liu
- Department of Pathology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yuchao Liang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yukun Liu
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Chunyao Zhou
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Qiang Zhu
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Hong Zhang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Tianshi Li
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Shaowu Li
- Department of Neuroradiology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Tao Jiang
- Beijing Neurosurgical Institute, Capital Medical University, Beijing, China.,Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yinyan Wang
- Beijing Neurosurgical Institute, Capital Medical University, Beijing, China.,Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Lei Wang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
22
|
Bhandari AP, Liong R, Koppen J, Murthy SV, Lasocki A. Noninvasive Determination of IDH and 1p19q Status of Lower-grade Gliomas Using MRI Radiomics: A Systematic Review. AJNR Am J Neuroradiol 2020; 42:94-101. [PMID: 33243896 DOI: 10.3174/ajnr.a6875] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2020] [Accepted: 08/17/2020] [Indexed: 12/18/2022]
Abstract
BACKGROUND Determination of isocitrate dehydrogenase (IDH) status and, if IDH-mutant, assessing 1p19q codeletion are an important component of diagnosis of World Health Organization grades II/III or lower-grade gliomas. This has led to research into noninvasively correlating imaging features ("radiomics") with genetic status. PURPOSE Our aim was to perform a diagnostic test accuracy systematic review for classifying IDH and 1p19q status using MR imaging radiomics, to provide future directions for integration into clinical radiology. DATA SOURCES Ovid (MEDLINE), Scopus, and the Web of Science were searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Diagnostic Test Accuracy guidelines. STUDY SELECTION Fourteen journal articles were selected that included 1655 lower-grade gliomas classified by their IDH and/or 1p19q status from MR imaging radiomic features. DATA ANALYSIS For each article, the classification of IDH and/or 1p19q status using MR imaging radiomics was evaluated using the area under curve or descriptive statistics. Quality assessment was performed with the Quality Assessment of Diagnostic Accuracy Studies 2 tool and the radiomics quality score. DATA SYNTHESIS The best classifier of IDH status was with conventional radiomics in combination with convolutional neural network-derived features (area under the curve = 0.95, 94.4% sensitivity, 86.7% specificity). Optimal classification of 1p19q status occurred with texture-based radiomics (area under the curve = 0.96, 90% sensitivity, 89% specificity). LIMITATIONS A meta-analysis showed high heterogeneity due to the uniqueness of radiomic pipelines. CONCLUSIONS Radiogenomics is a potential alternative to standard invasive biopsy techniques for determination of IDH and 1p19q status in lower-grade gliomas but requires translational research for clinical uptake.
Collapse
Affiliation(s)
- A P Bhandari
- From the Department of Anatomy (A.P.B.) .,Townsville University Hospital (A.P.B., J.K.), Douglas, Queensland, Australia
| | - R Liong
- Department of Medical Imaging Research Office (R.L.), Royal Brisbane and Women's Hospital, Herston, Queensland, Australia
| | - J Koppen
- Townsville University Hospital (A.P.B., J.K.), Douglas, Queensland, Australia
| | - S V Murthy
- College of Medicine and Dentistry (S.V.M.), James Cook University, Townsville, Queensland, Australia
| | - A Lasocki
- Department of Cancer Imaging (A.L.), Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia.,Sir Peter MacCallum Department of Oncology (A.L.), The University of Melbourne, Melbourne, Victoria, Australia
| |
Collapse
|
23
|
Deep learning shows the capability of high-level computer-aided diagnosis in malignant lymphoma. J Transl Med 2020; 100:1300-1310. [PMID: 32472096 DOI: 10.1038/s41374-020-0442-3] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 05/11/2020] [Accepted: 05/11/2020] [Indexed: 12/22/2022] Open
Abstract
A pathological evaluation is one of the most important methods for the diagnosis of malignant lymphoma. A standardized diagnosis is occasionally difficult to achieve even by experienced hematopathologists. Therefore, established procedures including a computer-aided diagnosis are desired. This study aims to classify histopathological images of malignant lymphomas through deep learning, which is a computer algorithm and type of artificial intelligence (AI) technology. We prepared hematoxylin and eosin (H&E) slides of a lesion area from 388 sections, namely, 259 with diffuse large B-cell lymphoma, 89 with follicular lymphoma, and 40 with reactive lymphoid hyperplasia, and created whole slide images (WSIs) using a whole slide system. WSI was annotated in the lesion area by experienced hematopathologists. Image patches were cropped from the WSI to train and evaluate the classifiers. Image patches at magnifications of ×5, ×20, and ×40 were randomly divided into a test set and a training and evaluation set. The classifier was assessed using the test set through a cross-validation after training. The classifier achieved the highest levels of accuracy of 94.0%, 93.0%, and 92.0% for image patches with magnifications of ×5, ×20, and ×40, respectively, in comparison to diffuse large B-cell lymphoma, follicular lymphoma, and reactive lymphoid hyperplasia. Comparing the diagnostic accuracies between the proposed classifier and seven pathologists, including experienced hematopathologists, using the test set made up of image patches with magnifications of ×5, ×20, and ×40, the best accuracy demonstrated by the classifier was 97.0%, whereas the average accuracy achieved by the pathologists using WSIs was 76.0%, with the highest accuracy reaching 83.3%. In conclusion, the neural classifier can outperform pathologists in a morphological evaluation. These results suggest that the AI system can potentially support the diagnosis of malignant lymphoma.
Collapse
|