An Automatic Deep Learning-Based Workflow for Glioblastoma Survival Prediction Using Preoperative Multimodal MR Images: A Feasibility Study

A Review of Artificial Intelligence-Based Systems for Non-Invasive Glioblastoma Diagnosis

BACKGROUND

Glioblastoma multiforme (GBM) is an aggressive brain tumor with a poor prognosis. Traditional diagnosis relies on invasive biopsies, which pose surgical risks. Advances in artificial intelligence (AI) and machine learning (ML) have improved non-invasive GBM diagnosis using magnetic resonance imaging (MRI), offering potential advantages in accuracy and efficiency.

OBJECTIVE

This review aims to identify the methodologies and technologies employed in AI-based GBM diagnostics. It further evaluates the performance of AI models using standard metrics, highlighting both their strengths and limitations.

METHODOLOGY

In accordance with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, a systematic review was conducted across major academic databases. A total of 104 articles were identified in the initial search, and 15 studies were selected for final analysis after applying inclusion and exclusion criteria.

OUTCOMES

The included studies indicated that the signal T1-weighted imaging (T1WI) is the most frequently used MRI modality in AI-based GBM diagnostics. Multimodal approaches integrating T1WI with diffusion-weighted imaging (DWI) and apparent diffusion coefficient (ADC) have demonstrated improved classification performance. Additionally, AI models have shown potential in surpassing conventional diagnostic methods, enabling automated tumor classification and enhancing prognostic predictions.

Application of artificial intelligence in forecasting survival in high-grade glioma: systematic review and meta-analysis involving 79,638 participants

High-grade glioma (HGG) is an aggressive brain tumor with poor survival rates. Predicting survival outcomes is critical for personalized treatment planning. In recent years, artificial intelligence (AI), particularly machine learning (ML) and deep learning (DL) models, has emerged as a promising approach for enhancing prognostic accuracy in HGG but this study especially focused on the potential of AI in the recurrence of HGG. A systematic review and meta-analysis were conducted to assess the performance of AI-based models in predicting survival outcomes for HGG patients. Relevant studies were retrieved from PubMed, Embase, Scopus, and Web of Science until 2 Dec 2024, using predefined keywords ("High-Grade Glioma", "Survival" and "Machine Learning") without date or language restrictions. Data extraction and quality assessment were performed in accordance with PRISMA and PROBAST guidelines. In this study were included. The pooled diagnostic metric, the area under the curve (AUC), was analyzed using random-effects models. A total of 39 studies with 29 various algorithms and 79,638 patients were included, with 15 studies contributing to the meta-analysis. The most commonly used algorithms were random forest (RF) and logistic regression (LR), which demonstrated robust predictive accuracy. The pooled AUCs for one-year, two-year, three-year and overall survival predictions were 0.816, 0.854, 0.871 and 0.789 respectively. Subgroup analysis revealed that RSF achieved the highest predictive accuracy with an AUC of 0.91 (95% CI: 0.84-0.98), while LR followed with an AUC of 0.89 (95% CI: 0.82-0.96). Models integrating clinical, radiomics, and genetic features consistently outperformed single-data-type models. MRI was the most frequently utilized imaging modality. AI-based models, particularly ML and DL algorithms, show significant potential for improving survival prediction in HGG patients. By integrating multimodal data, these models offer valuable tools for personalized treatment planning, although further validation in prospective, multicenter studies is needed to ensure clinical applicability.

Predicting survival in malignant glioma using artificial intelligence

Malignant gliomas, including glioblastoma, are amongst the most aggressive primary brain tumours, characterised by rapid progression and a poor prognosis. Survival analysis is an essential aspect of glioma management and research, as most studies use time-to-event outcomes to assess overall survival (OS) and progression-free survival (PFS) as key measures to evaluate patients. However, predicting survival using traditional methods such as the Kaplan-Meier estimator and the Cox Proportional Hazards (CPH) model has faced many challenges and inaccuracies. Recently, advances in artificial intelligence (AI), including machine learning (ML) and deep learning (DL), have enabled significant improvements in survival prediction for glioma patients by integrating multimodal data such as imaging, clinical parameters and molecular biomarkers. This study highlights the comparative effectiveness of imaging-based, non-imaging and combined AI models. Imaging models excel at identifying tumour-specific features through radiomics, achieving high predictive accuracy. Non-imaging approaches also excel in utilising clinical and genetic data to provide complementary insights, whilst combined methods integrate multiple data modalities and have the greatest potential for accurate survival prediction. Limitations include data heterogeneity, interpretability challenges and computational demands, particularly in resource-limited settings. Solutions such as federated learning, lightweight AI models and explainable AI frameworks are proposed to overcome these barriers. Ultimately, the integration of advanced AI techniques promises to transform glioma management by enabling personalised treatment strategies and improved prognostic accuracy.

Survival prediction of glioblastoma patients using machine learning and deep learning: a systematic review

Glioblastoma Multiforme (GBM), classified as a grade IV glioma by the World Health Organization (WHO), is a prevalent and notably aggressive form of brain tumor derived from glial cells. It stands as one of the most severe forms of primary brain cancer in humans. The median survival time of GBM patients is only 12-15 months, making it the most lethal type of brain tumor. Every year, about 200,000 people worldwide succumb to this disease. GBM is also highly heterogeneous, meaning that its characteristics and behavior vary widely among different patients. This leads to different outcomes and survival times for each individual. Predicting the survival of GBM patients accurately can have multiple benefits. It can enable optimal and personalized treatment planning based on the patient's condition and prognosis. It can also support the patients and their families to cope with the possible outcomes and make informed decisions about their care and quality of life. Furthermore, it can assist the researchers and scientists to discover the most relevant biomarkers, features, and mechanisms of the disease and to design more effective and personalized therapies. Artificial intelligence methods, such as machine learning and deep learning, have been widely applied to survival prediction in various fields, such as breast cancer, lung cancer, gastric cancer, cervical cancer, liver cancer, prostate cancer, and covid 19. This systematic review summarizes the current state-of-the-art methods for predicting glioblastoma survival using different types of input data, such as clinical features, molecular markers, imaging features, radiomics features, omics data or a combination of them. Following PRISMA guidelines, we searched databases from 2015 to 2024, reviewing 107 articles meeting our criteria. We analyzed the data sources, methods, performance metrics and outcomes of the studies. We found that random forest was the most popular method, and a combination of radiomics and clinical data was the most common input data.

End-to-End Multi-task Learning Architecture for Brain Tumor Analysis with Uncertainty Estimation in MRI Images

Brain tumors are a threat to life for every other human being, be it adults or children. Gliomas are one of the deadliest brain tumors with an extremely difficult diagnosis. The reason is their complex and heterogenous structure which gives rise to subjective as well as objective errors. Their manual segmentation is a laborious task due to their complex structure and irregular appearance. To cater to all these issues, a lot of research has been done and is going on to develop AI-based solutions that can help doctors and radiologists in the effective diagnosis of gliomas with the least subjective and objective errors, but an end-to-end system is still missing. An all-in-one framework has been proposed in this research. The developed end-to-end multi-task learning (MTL) architecture with a feature attention module can classify, segment, and predict the overall survival of gliomas by leveraging task relationships between similar tasks. Uncertainty estimation has also been incorporated into the framework to enhance the confidence level of healthcare practitioners. Extensive experimentation was performed by using combinations of MRI sequences. Brain tumor segmentation (BraTS) challenge datasets of 2019 and 2020 were used for experimental purposes. Results of the best model with four sequences show 95.1% accuracy for classification, 86.3% dice score for segmentation, and a mean absolute error (MAE) of 456.59 for survival prediction on the test data. It is evident from the results that deep learning-based MTL models have the potential to automate the whole brain tumor analysis process and give efficient results with least inference time without human intervention. Uncertainty quantification confirms the idea that more data can improve the generalization ability and in turn can produce more accurate results with less uncertainty. The proposed model has the potential to be utilized in a clinical setup for the initial screening of glioma patients.

Deep-learning radiomics based on ultrasound can objectively evaluate thyroid nodules and assist in improving the diagnostic level of ultrasound physicians

Background

The incidence rate of thyroid nodules has reached 65%, but only 5-15% of these modules are malignant. Therefore, accurately determining the benign and malignant nature of thyroid nodules can prevent unnecessary treatment. We aimed to develop a deep-learning (DL) radiomics model based on ultrasound (US), explore its diagnostic efficacy for benign and malignant thyroid nodules, and verify whether it improved the diagnostic level of physicians.

Methods

We retrospectively included 1,076 thyroid nodules from 817 patients at three institutions. The radiomics and DL features of the US images were extracted and used to construct radiomics signature (Rad_sig) and deep-learning signature (DL_sig). A Pearson correlation analysis and least absolute shrinkage and selection operator (LASSO) regression analysis were used for feature selection. Clinical US semantic signature (C_US_sig) was constructed based on clinical information and US semantic features. Next, a combined model was constructed based on the above three signatures in the form of a nomogram. The model was constructed using a development set (institution 1: 719 nodules), and the model was evaluated using two external validation sets (institution 2: 74 nodules, and institution 3: 283 nodules). The performance of the model was assessed using decision curve analysis (DCA) and calibration curves. Furthermore, the C_US_sigs of junior physicians, senior physicians, and expers were constructed. The DL radiomics model was used to assist the physicians with different levels of experience in the interpretation of thyroid nodules.

Results

In the development and validation sets, the combined model showed the highest performance, with areas under the curve (AUCs) of 0.947, 0.917, and 0.929, respectively. The DCA results showed that the comprehensive nomogram had the best clinical utility. The calibration curves indicated good calibration for all models. The AUCs for distinguishing between benign and malignant thyroid nodules by junior physicians, senior physicians, and experts were 0.714-0.752, 0.740-0.824, and 0.891-0.908, respectively; however, with the assistance of DL radiomics, the AUCs reached 0.858-0.923, 0.888-0.944, and 0.912-0.919, respectively.

Conclusions

The nomogram based on DL radiomics had high diagnostic efficacy for thyroid nodules, and DL radiomics could assist physicians with different levels of experience to improve their diagnostic level.

Convolutional Neural Networks for Glioma Segmentation and Prognosis: A Systematic Review

Deep learning (DL) is poised to redefine the way medical images are processed and analyzed. Convolutional neural networks (CNNs), a specific type of DL architecture, are exceptional for high-throughput processing, allowing for the effective extraction of relevant diagnostic patterns from large volumes of complex visual data. This technology has garnered substantial interest in the field of neuro-oncology as a promising tool to enhance medical imaging throughput and analysis. A multitude of methods harnessing MRI-based CNNs have been proposed for brain tumor segmentation, classification, and prognosis prediction. They are often applied to gliomas, the most common primary brain cancer, to classify subtypes with the goal of guiding therapy decisions. Additionally, the difficulty of repeating brain biopsies to evaluate treatment response in the setting of often confusing imaging findings provides a unique niche for CNNs to help distinguish the treatment response to gliomas. For example, glioblastoma, the most aggressive type of brain cancer, can grow due to poor treatment response, can appear to grow acutely due to treatment-related inflammation as the tumor dies (pseudo-progression), or falsely appear to be regrowing after treatment as a result of brain damage from radiation (radiation necrosis). CNNs are being applied to separate this diagnostic dilemma. This review provides a detailed synthesis of recent DL methods and applications for intratumor segmentation, glioma classification, and prognosis prediction. Furthermore, this review discusses the future direction of MRI-based CNN in the field of neuro-oncology and challenges in model interpretability, data availability, and computation efficiency.

Survival and grade of the glioma prediction using transfer learning

Glioblastoma is a highly malignant brain tumor with a life expectancy of only 3-6 months without treatment. Detecting and predicting its survival and grade accurately are crucial. This study introduces a novel approach using transfer learning techniques. Various pre-trained networks, including EfficientNet, ResNet, VGG16, and Inception, were tested through exhaustive optimization to identify the most suitable architecture. Transfer learning was applied to fine-tune these models on a glioblastoma image dataset, aiming to achieve two objectives: survival and tumor grade prediction.The experimental results show 65% accuracy in survival prediction, classifying patients into short, medium, or long survival categories. Additionally, the prediction of tumor grade achieved an accuracy of 97%, accurately differentiating low-grade gliomas (LGG) and high-grade gliomas (HGG). The success of the approach is attributed to the effectiveness of transfer learning, surpassing the current state-of-the-art methods. In conclusion, this study presents a promising method for predicting the survival and grade of glioblastoma. Transfer learning demonstrates its potential in enhancing prediction models, particularly in scenarios with limited large datasets. These findings hold promise for improving diagnostic and treatment approaches for glioblastoma patients.

Artificial intelligence in neuroimaging of brain tumors: reality or still promise?

PURPOSE OF REVIEW

To provide an updated overview of artificial intelligence (AI) applications in neuro-oncologic imaging and discuss current barriers to wider clinical adoption.

RECENT FINDINGS

A wide variety of AI applications in neuro-oncologic imaging have been developed and researched, spanning tasks from pretreatment brain tumor classification and segmentation, preoperative planning, radiogenomics, prognostication and survival prediction, posttreatment surveillance, and differentiating between pseudoprogression and true disease progression. While earlier studies were largely based on data from a single institution, more recent studies have demonstrated that the performance of these algorithms are also effective on external data from other institutions. Nevertheless, most of these algorithms have yet to see widespread clinical adoption, given the lack of prospective studies demonstrating their efficacy and the logistical difficulties involved in clinical implementation.

SUMMARY

While there has been significant progress in AI and neuro-oncologic imaging, clinical utility remains to be demonstrated. The next wave of progress in this area will be driven by prospective studies measuring outcomes relevant to clinical practice and go beyond retrospective studies which primarily aim to demonstrate high performance.

Assessment of brain cancer atlas maps with multimodal imaging features

BACKGROUND

Glioblastoma Multiforme (GBM) is a fast-growing and highly aggressive brain tumor that invades the nearby brain tissue and presents secondary nodular lesions across the whole brain but generally does not spread to distant organs. Without treatment, GBM can result in death in about 6 months. The challenges are known to depend on multiple factors: brain localization, resistance to conventional therapy, disrupted tumor blood supply inhibiting effective drug delivery, complications from peritumoral edema, intracranial hypertension, seizures, and neurotoxicity.

MAIN TEXT

Imaging techniques are routinely used to obtain accurate detections of lesions that localize brain tumors. Especially magnetic resonance imaging (MRI) delivers multimodal images both before and after the administration of contrast, which results in displaying enhancement and describing physiological features as hemodynamic processes. This review considers one possible extension of the use of radiomics in GBM studies, one that recalibrates the analysis of targeted segmentations to the whole organ scale. After identifying critical areas of research, the focus is on illustrating the potential utility of an integrated approach with multimodal imaging, radiomic data processing and brain atlases as the main components. The templates associated with the outcome of straightforward analyses represent promising inference tools able to spatio-temporally inform on the GBM evolution while being generalizable also to other cancers.

CONCLUSIONS

The focus on novel inference strategies applicable to complex cancer systems and based on building radiomic models from multimodal imaging data can be well supported by machine learning and other computational tools potentially able to translate suitably processed information into more accurate patient stratifications and evaluations of treatment efficacy.

Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging

Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.

Reliability as a Precondition for Trust—Segmentation Reliability Analysis of Radiomic Features Improves Survival Prediction

Machine learning results based on radiomic analysis are often not transferrable. A potential reason for this is the variability of radiomic features due to varying human made segmentations. Therefore, the aim of this study was to provide comprehensive inter-reader reliability analysis of radiomic features in five clinical image datasets and to assess the association of inter-reader reliability and survival prediction. In this study, we analyzed 4598 tumor segmentations in both computed tomography and magnetic resonance imaging data. We used a neural network to generate 100 additional segmentation outlines for each tumor and performed a reliability analysis of radiomic features. To prove clinical utility, we predicted patient survival based on all features and on the most reliable features. Survival prediction models for both computed tomography and magnetic resonance imaging datasets demonstrated less statistical spread and superior survival prediction when based on the most reliable features. Mean concordance indices were C_mean = 0.58 [most reliable] vs. C_mean = 0.56 [all] (p < 0.001, CT) and C_mean = 0.58 vs. C_mean = 0.57 (p = 0.23, MRI). Thus, preceding reliability analyses and selection of the most reliable radiomic features improves the underlying model’s ability to predict patient survival across clinical imaging modalities and tumor entities.

AI-Driven Image Analysis in Central Nervous System Tumors-Traditional Machine Learning, Deep Learning and Hybrid Models

The interpretation of imaging in medicine in general and in oncology specifically remains problematic due to several limitations which include the need to incorporate detailed clinical history, patient and disease-specific history, clinical exam features, previous and ongoing treatment, and account for the dependency on reproducible human interpretation of multiple factors with incomplete data linkage. To standardize reporting, minimize bias, expedite management, and improve outcomes, the use of Artificial Intelligence (AI) has gained significant prominence in imaging analysis. In oncology, AI methods have as a result been explored in most cancer types with ongoing progress in employing AI towards imaging for oncology treatment, assessing treatment response, and understanding and communicating prognosis. Challenges remain with limited available data sets, variability in imaging changes over time augmented by a growing heterogeneity in analysis approaches. We review the imaging analysis workflow and examine how hand-crafted features also referred to as traditional Machine Learning (ML), Deep Learning (DL) approaches, and hybrid analyses, are being employed in AI-driven imaging analysis in central nervous system tumors. ML, DL, and hybrid approaches coexist, and their combination may produce superior results although data in this space is as yet novel, and conclusions and pitfalls have yet to be fully explored. We note the growing technical complexities that may become increasingly separated from the clinic and enforce the acute need for clinician engagement to guide progress and ensure that conclusions derived from AI-driven imaging analysis reflect that same level of scrutiny lent to other avenues of clinical research.