Machine-learning based radiogenomics analysis of MRI features and metagenes in glioblastoma multiforme patients with different survival time

Predictive modeling with linear machine learning can estimate glioblastoma survival in months based solely on MGMT-methylation status, age and sex

PURPOSE

Machine Learning (ML) has become an essential tool for analyzing biomedical data, facilitating the prediction of treatment outcomes and patient survival. However, the effectiveness of ML models heavily relies on both the choice of algorithms and the quality of the input data. In this study, we aimed to develop a novel predictive model to estimate individual survival for patients diagnosed with glioblastoma (GBM), focusing on key variables such as O6-Methylguanine-DNA Methyltransferase (MGMT) methylation status, age, and sex.

METHODS

To identify the optimal approach, we utilized retrospective data from 218 patients treated at our brain tumor center. The performance of the ML models was evaluated within repeated tenfold regression. The pipeline comprised five regression estimators, including both linear and non-linear algorithms. Permutation feature importance highlighted the feature with the most significant impact on the model. Statistical significance was assessed using a permutation test procedure.

RESULTS

The best machine learning algorithm achieved a mean absolute error (MAE) of 12.65 (SD = ± 2.18) and an explained variance (EV) of 7% (SD = ± 1.8%) with p < 0.001. Linear algorithms led to more accurate predictions than non-linear estimators. Feature importance testing indicated that age and positive MGMT-methylation influenced the predictions the most.

CONCLUSION

In summary, here we provide a novel approach allowing to predict GBM patient's survival in months solely based on key parameters such as age, sex and MGMT-methylation status and underscores MGMT-methylation status as key prognostic factor for GBM patients survival.

Predicting the Outcome and Survival of Patients with Spinal Cord Injury Using Machine Learning Algorithms: A Systematic Review

BACKGROUND

Spinal cord injury (SCI) is a significant public health issue, leading to physical, psychological, and social complications. Machine learning (ML) algorithms have shown potential in diagnosing and predicting the functional and neurologic outcomes of subjects with SCI. ML algorithms can predict scores for SCI classification systems and accurately predict outcomes by analyzing large amounts of data. This systematic review aimed to examine the performance of ML algorithms for diagnosing and predicting the outcomes of subjects with SCI.

METHODS

The literature was comprehensively searched for the pertinent studies from inception to May 25, 2023. Therefore, electronic databases of PubMed, Embase, Scopus, and Web of Science were systematically searched with individual search syntax.

RESULTS

A total of 9424 individuals diagnosed with SCI across multiple studies were analyzed. Among the 21 studies included, 5 specifically aimed to evaluate diagnostic accuracy, while the remaining 16 focused on exploring prognostic factors or management strategies.

CONCLUSIONS

ML and deep learning (DL) have shown great potential in various aspects of SCI. ML and DL algorithms have been employed multiple times in predicting and diagnosing patients with SCI. While there are studies on diagnosing acute SCI using DL algorithms, further research is required in this area.

SurvNet: A low-complexity convolutional neural network for survival time classification of patients with glioblastoma

Background and objective

Malignant primary brain tumors cause the greatest number of years of life lost than any other cancer. Grade 4 glioma is particularly devastating: The median survival without any treatment is less than six months and with standard-of-care treatment is only 14.6 months. Accurate identification of the overall survival time of patients with brain tumors is of profound importance in many clinical applications. Automated image analytics with magnetic resonance imaging (MRI) can provide insights into the prognosis of patients with brain tumors.

Methods

In this paper, We propose SurvNet, a low-complexity deep learning architecture based on the convolutional neural network to classify the overall survival time of patients with brain tumors into long-time and short-time survival cohorts. Through the incorporation of diverse MRI modalities as inputs, we facilitate deep feature extraction at various anatomical sites, thereby augmenting the precision of predictive modeling. We compare SurvNet with the Inception V3, VGG 16 and ensemble CNN models on pre-operative magnetic resonance image datasets. We also analyzed the effect of segmented brain tumors and training data on the system performance.

Results

Several measures, such as accuracy, precision, and recall, are calculated to examine the perfor-mance of SurvNet on three-fold cross-validation. SurvNet with T1 MRI modality achieved a 62.7 % accuracy, compared with 52.9 % accuracy of the Inception V3 model, 58.5 % accuracy of the VGG 16 model, and 54.9 % of the ensemble CNN model. By increasing the MRI input modalities, SurvNet becomes more accurate and achieves 76.5 % accuracy with four MRI modalities. Combining the segmented data, SurvNet achieved the highest accuracy of 82.4 %.

Conclusions

The research results show that SurvNet achieves higher metrics such as accuracy and f1-score than the comparisons. Our research also proves that by using multiparametric MRI modalities, SurvNet is able to learn more image features and performs a better classification accuracy. We can conclude that SurvNet with the complete scenario, i.e., segmented data and four MRI modalities, achieved the best accuracy, showing the validity of segmentation information during the survival time prediction process.

A radiomics and genomics-derived model for predicting metastasis and prognosis in colorectal cancer

Approximately 50% of colorectal cancer (CRC) patients would develop metastasis with poor prognosis, therefore, it is necessary to effectively predict metastasis in clinical treatment. In this study, we aimed to establish a machine-learning model for predicting metastasis in CRC patients by considering radiomics and transcriptomics simultaneously. Here, 1023 patients with CRC from three centers were collected and divided into five queues (Dazhou Central Hospital n = 517, Nanchong Central Hospital n = 120 and the Cancer Genome Atlas (TCGA) n = 386). A total of 854 radiomics features were extracted from tumor lesions on CT images, and 217 differentially expressed genes were obtained from non-metastasis and metastasis tumor tissues using RNA sequencing. Based on radiotranscriptomic (RT) analysis, a novel RT model was developed and verified through genetic algorithms (GA). Interleukin (IL)-26, a biomarker in RT model, was verified for its biological function in CRC metastasis. Furthermore, 15 radiomics variables were screened through stepwise regression, which was highly correlated with the IL26 expression level. Finally, a radiomics model (RA) was established by combining GA and stepwise regression analysis with radiomics features. The RA model exhibited favorable discriminatory ability and accuracy for metastasis prediction in two independent verification cohorts. We designed multicenter, multi-scale cohorts to construct and verify novel combined radiomics and genomics models for predicting metastasis in CRC. Overall, RT model and RA model might help clinicians in directing personalized diagnosis and therapeutic regimen selection for patients with CRC.

Radiogenomic biomarkers for immunotherapy in glioblastoma: A systematic review of magnetic resonance imaging studies

Background

Immunotherapy is an effective "precision medicine" treatment for several cancers. Imaging signatures of the underlying genome (radiogenomics) in glioblastoma patients may serve as preoperative biomarkers of the tumor-host immune apparatus. Validated biomarkers would have the potential to stratify patients during immunotherapy clinical trials, and if trials are beneficial, facilitate personalized neo-adjuvant treatment. The increased use of whole genome sequencing data, and the advances in bioinformatics and machine learning make such developments plausible. We performed a systematic review to determine the extent of development and validation of immune-related radiogenomic biomarkers for glioblastoma.

Methods

A systematic review was performed following PRISMA guidelines using the PubMed, Medline, and Embase databases. Qualitative analysis was performed by incorporating the QUADAS 2 tool and CLAIM checklist. PROSPERO registered: CRD42022340968. Extracted data were insufficiently homogenous to perform a meta-analysis.

Results

Nine studies, all retrospective, were included. Biomarkers extracted from magnetic resonance imaging volumes of interest included apparent diffusion coefficient values, relative cerebral blood volume values, and image-derived features. These biomarkers correlated with genomic markers from tumor cells or immune cells or with patient survival. The majority of studies had a high risk of bias and applicability concerns regarding the index test performed.

Conclusions

Radiogenomic immune biomarkers have the potential to provide early treatment options to patients with glioblastoma. Targeted immunotherapy, stratified by these biomarkers, has the potential to allow individualized neo-adjuvant precision treatment options in clinical trials. However, there are no prospective studies validating these biomarkers, and interpretation is limited due to study bias with little evidence of generalizability.

New perspectives: glioma in adult patients

The purpose of this editorial is to consider some of the aspects of the diagnosis and treatment of adult gliomas. These are rare diseases with all their limitations. Innovations in diagnosis and therapy and their constraints are analyzed and compared with the current treatment reality. Aspects affecting these patients' quality of life are highlighted.

Radiogenomic classification for MGMT promoter methylation status using multi-omics fused feature space for least invasive diagnosis through mpMRI scans

Accurate radiogenomic classification of brain tumors is important to improve the standard of diagnosis, prognosis, and treatment planning for patients with glioblastoma. In this study, we propose a novel two-stage MGMT Promoter Methylation Prediction (MGMT-PMP) system that extracts latent features fused with radiomic features predicting the genetic subtype of glioblastoma. A novel fine-tuned deep learning architecture, namely Deep Learning Radiomic Feature Extraction (DLRFE) module, is proposed for latent feature extraction that fuses the quantitative knowledge to the spatial distribution and the size of tumorous structure through radiomic features: (GLCM, HOG, and LBP). The application of the novice rejection algorithm has been found significantly effective in selecting and isolating the negative training instances out of the original dataset. The fused feature vectors are then used for training and testing by k-NN and SVM classifiers. The 2021 RSNA Brain Tumor challenge dataset (BraTS-2021) consists of four structural mpMRIs, viz. fluid-attenuated inversion-recovery, T1-weighted, T1-weighted contrast enhancement, and T2-weighted. We evaluated the classification performance, for the very first time in published form, in terms of measures like accuracy, F₁-score, and Matthews correlation coefficient. The Jackknife tenfold cross-validation was used for training and testing BraTS-2021 dataset validation. The highest classification performance is (96.84 ± 0.09)%, (96.08 ± 0.10)%, and (97.44 ± 0.14)% as accuracy, sensitivity, and specificity respectively to detect MGMT methylation status for patients suffering from glioblastoma. Deep learning feature extraction with radiogenomic features, fusing imaging phenotypes and molecular structure, using rejection algorithm has been found to perform outclass capable of detecting MGMT methylation status of glioblastoma patients. The approach relates the genomic variation with radiomic features forming a bridge between two areas of research that may prove useful for clinical treatment planning leading to better outcomes.

EREG is the core onco-immunological biomarker of cuproptosis and mediates the cross-talk between VEGF and CD99 signaling in glioblastoma

BACKGROUND

Glioma is the most prevalent primary tumor of the central nervous system. Glioblastoma multiforme (GBM) is the most malignant form of glioma with an extremely poor prognosis. A novel, regulated cell death form of copper-induced cell death called "cuproptosis" provides a new prospect for cancer treatment by regulating cuproptosis.

METHODS

Data from bulk RNA sequencing (RNA-seq) analysis (The Cancer Genome Atlas cohort and Chinese Glioma Genome Atlas cohort) and single cell RNA-seq (scRNA-seq) analysis were integrated to reveal their relationships. A scoring system was constructed according to the cuproptosis-related gene expression, and core genes were experimentally verified using real-time quantitative reverse transcription polymerase chain reaction (qRT-PCR), Western blot (WB), immunohistochemistry (IHC), and immunofluorescence (IF). Moreover, cell counting kit-8 (CCK8), colony formation, 5-ethynyl-2'-deoxyuridine (EdU) incorporation, transwell, and flow cytometry cell cycle were performed to evaluate cell proliferation, invasion, and migration.

RESULTS

The Cuproptosis Activation Scoring (CuAS) Model has stable and independent prognostic efficacy, as verified by two CGGA datasets. Epiregulin (EREG), the gene of the model has the most contributions in the principal component analysis (PCA), is an onco-immunological gene that can affect immunity by influencing the expression of programmed death-ligand 1 (PD-L1) and mediate the process of cuproptosis by influencing the expression of ferredoxin 1 (FDX1). Single cell transcriptome analysis revealed that high CuAS GBM cells are found in vascular endothelial growth factor A (VEGFA) + malignant cells. Oligodendrocyte transcription factor 1 (OLIG1) + malignant is the original clone, and VEGF and CD99 are the differential pathways of specific cell communication between the high and low CuAS groups. This was also demonstrated by immunofluorescence in the tissue sections. Furthermore, CuAS has therapeutic potential for immunotherapy, and we predict that many drugs (methotrexate, NU7441, KU -0063794, GDC-0941, cabozantinib, and NVP-BEZ235) may be used in patients with high CuAS.

CONCLUSION

EREG is the core onco-immunological biomarker of CuAS and modulates the cross-talk between VEGF and CD99 signaling in glioblastoma, and CuAS may provide support for immunotherapy and chemotherapy.

A Review of Fusion Methods for Omics and Imaging Data

The development of omics data and biomedical images has greatly advanced the progress of precision medicine in diagnosis, treatment, and prognosis. The fusion of omics and imaging data, i.e., omics-imaging fusion, offers a new strategy for understanding complex diseases. However, due to a variety of issues such as the limited number of samples, high dimensionality of features, and heterogeneity of different data types, efficiently learning complementary or associated discriminative fusion information from omics and imaging data remains a challenge. Recently, numerous machine learning methods have been proposed to alleviate these problems. In this review, from the perspective of fusion levels and fusion methods, we first provide an overview of preprocessing and feature extraction methods for omics and imaging data, and comprehensively analyze and summarize the basic forms and variations of commonly used and newly emerging fusion methods, along with their advantages, disadvantages and the applicable scope. We then describe public datasets and compare experimental results of various fusion methods on the ADNI and TCGA datasets. Finally, we discuss future prospects and highlight remaining challenges in the field.

Combination of pre-treatment dynamic [18F]FET PET radiomics and conventional clinical parameters for the survival stratification in patients with IDH-wildtype glioblastoma

PURPOSE

The aim of this study was to build and evaluate a prediction model which incorporates clinical parameters and radiomic features extracted from static as well as dynamic [18F]FET PET for the survival stratification in patients with newly diagnosed IDH-wildtype glioblastoma.

METHODS

A total of 141 patients with newly diagnosed IDH-wildtype glioblastoma and dynamic [18F]FET PET prior to surgical intervention were included. Patients with a survival time ≤ 12 months were classified as short-term survivors. First order, shape, and texture radiomic features were extracted from pre-treatment static (tumor-to-background ratio; TBR) and dynamic (time-to-peak; TTP) images, respectively, and randomly divided into a training (n = 99) and a testing cohort (n = 42). After feature normalization, recursive feature elimination was applied for feature selection using 5-fold cross-validation on the training cohort, and a machine learning model was constructed to compare radiomic models and combined clinical-radiomic models with selected radiomic features and clinical parameters. The area under the ROC curve (AUC), accuracy, sensitivity, specificity, and positive and negative predictive values were calculated to assess the predictive performance for identifying short-term survivors in both the training and testing cohort.

RESULTS

A combined clinical-radiomic model comprising six clinical parameters and six selected dynamic radiomic features achieved highest predictability of short-term survival with an AUC of 0.74 (95% confidence interval, 0.60-0.88) in the independent testing cohort.

CONCLUSIONS

This study successfully built and evaluated prediction models using [18F]FET PET-based radiomic features and clinical parameters for the individualized assessment of short-term survival in patients with a newly diagnosed IDH-wildtype glioblastoma. The combination of both clinical parameters and dynamic [18F]FET PET-based radiomic features reached highest accuracy in identifying patients at risk. Although the achieved accuracy level remained moderate, our data shows that the integration of dynamic [18F]FET PET radiomic data into clinical prediction models may improve patient stratification beyond established prognostic markers.

Current Evidence, Limitations and Future Challenges of Survival Prediction for Glioblastoma Based on Advanced Noninvasive Methods: A Narrative Review

Background and Objectives: Survival estimation for patients diagnosed with Glioblastoma (GBM) is an important information to consider in patient management and communication. Despite some known risk factors, survival estimation remains a major challenge. Novel non-invasive technologies such as radiomics and artificial intelligence (AI) have been implemented to increase the accuracy of these predictions. In this article, we reviewed and discussed the most significant available research on survival estimation for GBM through advanced non-invasive methods. Materials and Methods: PubMed database was queried for articles reporting on survival prognosis for GBM through advanced image and data management methods. Articles including in their title or abstract the following terms were initially screened: ((glioma) AND (survival)) AND ((artificial intelligence) OR (radiomics)). Exclusively English full-text articles, reporting on humans, published as of 1 September 2022 were considered. Articles not reporting on overall survival, evaluating the effects of new therapies or including other tumors were excluded. Research with a radiomics-based methodology were evaluated using the radiomics quality score (RQS). Results: 382 articles were identified. After applying the inclusion criteria, 46 articles remained for further analysis. These articles were thoroughly assessed, summarized and discussed. The results of the RQS revealed some of the limitations of current radiomics investigation on this field. Limitations of analyzed studies included data availability, patient selection and heterogeneity of methodologies. Future challenges on this field are increasing data availability, improving the general understanding of how AI handles data and establishing solid correlations between image features and tumor's biology. Conclusions: Radiomics and AI methods of data processing offer a new paradigm of possibilities to tackle the question of survival prognosis in GBM.

U-Net Based Segmentation and Characterization of Gliomas

(1) Background: Gliomas are the most common primary brain neoplasms accounting for roughly 40−50% of all malignant primary central nervous system tumors. We aim to develop a deep learning-based framework for automated segmentation and prediction of biomarkers and prognosis in patients with gliomas. (2) Methods: In this retrospective two center study, patients were included if they (1) had a diagnosis of glioma with known surgical histopathology and (2) had preoperative MRI with FLAIR sequence. The entire tumor volume including FLAIR hyperintense infiltrative component and necrotic and cystic components was segmented. Deep learning-based U-Net framework was developed based on symmetric architecture from the 512 × 512 segmented maps from FLAIR as the ground truth mask. (3) Results: The final cohort consisted of 208 patients with mean ± standard deviation of age (years) of 56 ± 15 with M/F of 130/78. DSC of the generated mask was 0.93. Prediction for IDH-1 and MGMT status had a performance of AUC 0.88 and 0.62, respectively. Survival prediction of <18 months demonstrated AUC of 0.75. (4) Conclusions: Our deep learning-based framework can detect and segment gliomas with excellent performance for the prediction of IDH-1 biomarker status and survival.

Artificial intelligence and machine learning in precision medicine: A paradigm shift in big data analysis

The integration of artificial intelligence in precision medicine has revolutionized healthcare delivery. Precision medicine identifies the phenotype of particular patients with less-common responses to treatment. Recent studies have demonstrated that translational research exploring the convergence between artificial intelligence and precision medicine will help solve the most difficult challenges facing precision medicine. Here, we discuss different aspects of artificial intelligence in precision medicine that improve healthcare delivery. First, we discuss how artificial intelligence changes the landscape of precision medicine and the evolution of artificial intelligence in precision medicine. Second, we highlight the synergies between artificial intelligence and precision medicine and promises of artificial intelligence and precision medicine in healthcare delivery. Third, we briefly explain the promise of big data analytics and the integration of nanomaterials in precision medicine. Last, we highlight the challenges and opportunities of artificial intelligence in precision medicine.

CT-Based Radiomics Nomogram Improves Risk Stratification and Prediction of Early Recurrence in Hepatocellular Carcinoma After Partial Hepatectomy

Objectives

To develop and validate an intuitive computed tomography (CT)-based radiomics nomogram for the prediction and risk stratification of early recurrence (ER) in hepatocellular carcinoma (HCC) patients after partial hepatectomy.

Methods

A total of 132 HCC patients treated with partial hepatectomy were retrospectively enrolled and assigned to training and test sets. Least absolute shrinkage and selection operator and gradient boosting decision tree were used to extract quantitative radiomics features from preoperative contrast-enhanced CT images of the HCC patients. The radiomics features with predictive value for ER were used, either alone or in combination with other predictive features, to construct predictive models. The best performing model was then selected to develop an intuitive, simple-to-use nomogram, and its performance in the prediction and risk stratification of ER was evaluated using the area under the receiver operating characteristic curve (AUC), calibration curve, and decision curve analysis (DCA).

Results

The radiomics model based on the radiomics score (Rad-score) achieved AUCs of 0.870 and 0.890 in the training and test sets, respectively. Among the six predictive models, the combined model based on the Rad-score, Edmondson grade, and tumor size had the highest AUCs of 0.907 in the training set and 0.948 in the test set and was used to develop an intuitive nomogram. Notably, the calibration curve and DCA for the nomogram showed good calibration and clinical application. Moreover, the risk of ER was significantly different between the high- and low-risk groups stratified by the nomogram (p <0.001).

Conclusions

The CT-based radiomics nomogram developed in this study exhibits outstanding performance for ER prediction and risk stratification. As such, this intuitive nomogram holds promise as a more effective and user-friendly tool in predicting ER for HCC patients after partial hepatectomy.

Survival prediction on intrahepatic cholangiocarcinoma with histomorphological analysis on the whole slide images

Intrahepatic cholangiocarcinoma (ICC) is cancer that originates from the liver's secondary ductal epithelium or branch. Due to the lack of early-stage clinical symptoms and very high mortality, the 5-year postoperative survival rate is only about 35%. A critical step to improve patients' survival is accurately predicting their survival status and giving appropriate treatment. The tumor microenvironment of ICC is the immediate environment on which the tumor cell growth depends. The differentiation of tumor glands, the stroma status, and the tumor-infiltrating lymphocytes in such environments are strictly related to the tumor progress. It is crucial to develop a computerized system for characterizing the tumor environment. This work aims to develop the quantitative histomorphological features that describe lymphocyte density distribution at the cell level and the different components at the tumor's tissue level in H&E-stained whole slide images (WSIs). The goal is to explore whether these features could stratify patients' survival. This study comprised of 127 patients diagnosed with ICC after surgery, where 78 cases were randomly chosen as the modeling set, and the rest of the 49 cases were testing set. Deep learning-based models were developed for tissue segmentation and lymphocyte detection in the WSIs. A total of 107-dimensional features, including different type of graph features on the WSIs were extracted by exploring the histomorphological patterns of these identified tumor tissue and lymphocytes. The top 3 discriminative features were chosen with the mRMR algorithm via 5-fold cross-validation to predict the patient's survival. The model's performance was evaluated on the independent testing set, which achieved an AUC of 0.6818 and the log-rank test p-value of 0.03. The Cox multivariable test was used to control the TNM staging, γ-Glutamytransferase, and the Peritumoral Glisson's Sheath Invasion. It showed that our model could independently predict survival risk with a p-value of 0.048 and HR (95% confidence interval) of 2.90 (1.01-8.32). These results indicated that the composition in tissue-level and global arrangement of lymphocytes in the cell-level could distinguish ICC patients' survival risk.

Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging

Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.

Differentiation of Cerebral Dissecting Aneurysm from Hemorrhagic Saccular Aneurysm by Machine-Learning Based on Vessel Wall MRI: A Multicenter Study

The differential diagnosis of a cerebral dissecting aneurysm (DA) and a hemorrhagic saccular aneurysm (SA) often depends on the intraoperative findings; thus, improved non-invasive imaging diagnosis before surgery is essential to distinguish between these two aneurysms, in order to provide the correct formulation of surgical procedure. We aimed to build a radiomic model based on high-resolution vessel wall magnetic resonance imaging (VW-MRI) and a machine-learning algorithm. In total, 851 radiomic features from 146 cases were analyzed retrospectively, and the ElasticNet algorithm was used to establish the radiomic model in a training set of 77 cases. A clinico-radiological model using clinical features and MRI features was also built. Then an integrated model was built by combining the radiomic model and clinico-radiological model. The area under the ROC curve (AUC) was used to quantify the performance of models. The models were evaluated using leave-one-out cross-validation in a training set, and further validated in an external test set of 69 cases. The diagnostic performance of experienced radiologists was also assessed for comparison. Eight features were used to establish the radiomic model, and the radiomic model performs better (AUC = 0.831) than the clinico-radiological model (AUC = 0.717), integrated model (AUC = 0.813), and even experienced radiologists (AUC = 0.801). Therefore, a radiomic model based on VW-MRI can reliably be used to distinguish DA and hemorrhagic SA, and, thus, be widely applied in clinical practice.

What Genetics Can Do for Oncological Imaging: A Systematic Review of the Genetic Validation Data Used in Radiomics Studies

(1) Background: Radiogenomics is motivated by the concept that biomedical images contain information that reflects underlying pathophysiology. This review focused on papers that used genetics to validate their radiomics models and outcomes and assess their contribution to this emerging field. (2) Methods: All original research with the words radiomics and genomics in English and performed in humans up to 31 January 2022, were identified on Medline and Embase. The quality of the studies was assessed with Radiomic Quality Score (RQS) and the Cochrane recommendation for diagnostic accuracy study Quality Assessment 2. (3) Results: 45 studies were included in our systematic review, and more than 50% were published in the last two years. The studies had a mean RQS of 12, and the studied tumors were very diverse. Up to 83% investigated the prognosis as the main outcome, with the rest focusing on response to treatment and risk assessment. Most applied either transcriptomics (54%) and/or genetics (35%) for genetic validation. (4) Conclusions: There is enough evidence to state that new science has emerged, focusing on establishing an association between radiological features and genomic/molecular expression to explain underlying disease mechanisms and enhance prognostic, risk assessment, and treatment response radiomics models in cancer patients.

A Comparative and Summative Study of Radiomics-based Overall Survival Prediction in Glioblastoma Patients

PURPOSE

This study aimed to assess different machine learning models based on radiomic features, Visually Accessible Rembrandt Images features and clinical characteristics in overall survival prediction of glioblastoma and to identify the reproducible features.

MATERIALS AND METHODS

Patients with preoperative magnetic resonance scans were allocated into 3 data sets. The Least Absolute Shrinkage and Selection Operator was used for feature selection. The prediction models were built by random survival forest (RSF) and Cox regression. C-index and integrated Brier scores were calculated to compare model performances.

RESULTS

Patients with cortical involvement had shorter survival times in the training set (P = 0.006). Random survival forest showed higher C-index than Cox, and the RSF model based on the radiomic features was the best one (testing set: C-index = 0.935 ± 0.023). Ten reproducible radiomic features were summarized.

CONCLUSIONS

The RSF model based on radiomic features had promising potential in predicting overall survival of glioblastoma. Ten reproducible features were identified.

Radiomics for precision medicine in glioblastoma

INTRODUCTION

Being the most common primary brain tumor, glioblastoma presents as an extremely challenging malignancy to treat with dismal outcomes despite treatment. Varying molecular epidemiology of glioblastoma between patients and intra-tumoral heterogeneity explains the failure of current one-size-fits-all treatment modalities. Radiomics uses machine learning to identify salient features of the tumor on brain imaging and promises patient-specific management in glioblastoma patients.

METHODS

We performed a comprehensive review of the available literature on studies investigating the role of radiomics and radiogenomics models for the diagnosis, stratification, prognostication as well as treatment planning and monitoring of glioblastoma.

RESULTS

Classifiers based on a combination of various MRI sequences, genetic information and clinical data can predict non-invasive tumor diagnosis, overall survival and treatment response with reasonable accuracy. However, the use of radiomics for glioblastoma treatment remains in infancy as larger sample sizes, standardized image acquisition and data extraction techniques are needed to develop machine learning models that can be translated effectively into clinical practice.

CONCLUSION

Radiomics has the potential to transform the scope of glioblastoma management through personalized medicine.

MRI-Based Machine Learning in Differentiation Between Benign and Malignant Breast Lesions

Background

Differential diagnosis between benign and malignant breast lesions is of crucial importance relating to follow-up treatment. Recent development in texture analysis and machine learning may lead to a new solution to this problem.

Method

This current study enrolled a total number of 265 patients (benign breast lesions:malignant breast lesions = 71:194) diagnosed in our hospital and received magnetic resonance imaging between January 2014 and August 2017. Patients were randomly divided into the training group and validation group (4:1), and two radiologists extracted their texture features from the contrast-enhanced T1-weighted images. We performed five different feature selection methods including Distance correlation, Gradient Boosting Decision Tree (GBDT), least absolute shrinkage and selection operator (LASSO), random forest (RF), eXtreme gradient boosting (Xgboost) and five independent classification models were built based on Linear discriminant analysis (LDA) algorithm.

Results

All five models showed promising results to discriminate malignant breast lesions from benign breast lesions, and the areas under the curve (AUCs) of receiver operating characteristic (ROC) were all above 0.830 in both training and validation groups. The model with a better discriminating ability was the combination of LDA + gradient boosting decision tree (GBDT). The sensitivity, specificity, AUC, and accuracy in the training group were 0.814, 0.883, 0.922, and 0.868, respectively; LDA + random forest (RF) also suggests promising results with the AUC of 0.906 in the training group.

Conclusion

The evidence of this study, while preliminary, suggested that a combination of MRI texture analysis and LDA algorithm could discriminate benign breast lesions from malignant breast lesions. Further multicenter researches in this field would be of great help in the validation of the result.

MRI-based machine learning for determining quantitative and qualitative characteristics affecting the survival of glioblastoma multiforme

PURPOSE

Our current study aims to consider the image biomarkers extracted from the MRI images for exploring their effects on glioblastoma multiforme (GBM) patients' survival. Determining its biomarker helps better manage the disease and evaluate treatments. It has been proven that imaging features could be used as a biomarker. The purpose of this study is to investigate the features in MRI and clinical features as the biomarker association of survival of GBM.

METHODS

55 patients were considered with five clinical features, 10 qualities pre-operative MRI image features, and six quantitative features obtained using BraTumIA software. It was run ANN, C5, Bayesian, and Cox models in two phases for determining important variables. In the first phase, we selected the quality features that occur at least in three models and quantitative in two models. In the second phase, models were run with the extracted features, and then the probability value of variables in each model was calculated.

RESULTS

The mean of accuracy, sensitivity, specificity, and area under curve (AUC) after running four machine learning techniques were 80.47, 82.54, 79.78, and 0.85, respectively. In the second step, the mean of accuracy, sensitivity, specificity, and AUC were 79.55, 78.71, 79.83, and 0.87, respectively.

CONCLUSION

We found the largest size of the width, the largest size of length, radiotherapy, volume of enhancement, volume of nCET, satellites, enhancing margin, and age feature are important features.

COVID-19 discrimination framework for X-ray images by considering radiomics, selective information, feature ranking, and a novel hybrid classifier

In medical imaging procedures for the detection of coronavirus, apart from medical tests, approval of diagnosis has special significance. Imaging procedures are also useful for detecting the damage caused by COVID-19. Chest X-ray imaging is frequently used to diagnose COVID-19 and different pneumonias. This paper presents a task-specific framework to detect coronavirus in X-ray images. Binary classification of three different labels (healthy, bacterial pneumonia, and COVID-19) was performed on two differentiated data sets in which corona is stated as positive. First-order statistics, gray level co-occurrence matrix, gray level run length matrix, and gray level size zone matrix were analyzed to form fifteen sub-data sets and to ascertain the necessary radiomics. Two normalization methods are compared to make the data meaningful. Furthermore, five feature ranking approaches (Bhattacharyya, entropy, Roc, t-test, and Wilcoxon) are mentioned to provide necessary information to a state-of-the-art classifier based on Gauss-map-based chaotic particle swarm optimization and neural networks. The proposed framework was designed according to the analyses about radiomics, normalization approaches, and filter-based feature ranking methods. In experiments, seven metrics were evaluated to objectively determine the results: accuracy, area under the receiver operating characteristic (ROC) curve, sensitivity, specificity, g-mean, precision, and f-measure. The proposed framework showed promising scores on two X-ray-based data sets, especially with the accuracy and area under the ROC curve rates exceeding 99% for the classification of coronavirus vs. others.

Predicting local failure of brain metastases after stereotactic radiosurgery with radiomics on planning MR images and dose maps

PURPOSE

Stereotactic radiosurgery (SRS) has become an important modality in the treatment of brain metastases. The purpose of this study is to investigate the potential of radiomic features from planning magnetic resonance (MR) images and dose maps to predict local failure after SRS for brain metastases.

MATERIALS/METHODS

Twenty-eight patients who received Gamma Knife (GK) radiosurgery for brain metastases were retrospectively reviewed in this IRB-approved study. 179 irradiated tumors included 42 that locally failed within one-year follow-up. Using SRS tumor volumes, radiomic features were calculated on T1-weighted contrast-enhanced MR images acquired for treatment planning and planned dose maps. 125 radiomic features regarding tumor shape, dose distribution, MR intensities and textures were extracted for each tumor. Logistic regression with automatic feature selection was built to predict tumor progression from local control after SRS. Feature selection and model evaluation using receiver operating characteristic (ROC) curves were performed in a nested cross validation (CV) scheme. The associations between selected radiomic features and treatment outcomes were statistically assessed by univariate analysis.

RESULTS

The logistic model with feature selection achieved ROC AUC of 0.82 ± 0.09 on 5-fold CV, providing 83% sensitivity and 70% specificity for predicting local failure. A total of 10 radiomic features including 1 shape feature, 6 MR images and 3 dose distribution features were selected. These features were significantly associated with treatment outcomes (p < 0.05). The model was validated on independent holdout data with an AUC of 0.78.

CONCLUSIONS

Radiomic features from planning MR images and dose maps provided prognostic information in SRS for brain metastases. A model built on the radiomic features shows promise for early prediction of tumor local failure after treatment, potentially aiding in personalized care for brain metastases.

Differentiation of Low-Grade Astrocytoma From Anaplastic Astrocytoma Using Radiomics-Based Machine Learning Techniques

Purpose

To investigate the diagnostic ability of radiomics-based machine learning in differentiating atypical low-grade astrocytoma (LGA) from anaplastic astrocytoma (AA).

Methods

The current study involved 175 patients diagnosed with LGA (n = 95) or AA (n = 80) and treated in the Neurosurgery Department of West China Hospital from April 2010 to December 2019. Radiomics features were extracted from pre-treatment contrast-enhanced T1 weighted imaging (T1C). Nine diagnostic models were established with three selection methods [Distance Correlation, least absolute shrinkage, and selection operator (LASSO), and Gradient Boosting Decision Tree (GBDT)] and three classification algorithms [Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), and random forest (RF)]. The sensitivity, specificity, accuracy, and areas under receiver operating characteristic curve (AUC) of each model were calculated. Diagnostic ability of each model was evaluated based on these indexes.

Results

Nine radiomics-based machine learning models with promising diagnostic performances were established. For LDA-based models, the optimal one was the combination of LASSO + LDA with AUC of 0.825. For SVM-based modes, Distance Correlation + SVM represented the most promising diagnostic performance with AUC of 0.808. And for RF-based models, Distance Correlation + RF were observed to be the optimal model with AUC of 0.821.

Conclusion

Radiomic-based machine-learning has the potential to be utilized in differentiating atypical LGA from AA with reliable diagnostic performance.

Machine learning applications to neuroimaging for glioma detection and classification: An artificial intelligence augmented systematic review

Glioma is the most common primary intraparenchymal tumor of the brain and the 5-year survival rate of high-grade glioma is poor. Magnetic resonance imaging (MRI) is essential for detecting, characterizing and monitoring brain tumors but definitive diagnosis still relies on surgical pathology. Machine learning has been applied to the analysis of MRI data in glioma research and has the potential to change clinical practice and improve patient outcomes. This systematic review synthesizes and analyzes the current state of machine learning applications to glioma MRI data and explores the use of machine learning for systematic review automation. Various datapoints were extracted from the 153 studies that met inclusion criteria and analyzed. Natural language processing (NLP) analysis involved keyword extraction, topic modeling and document classification. Machine learning has been applied to tumor grading and diagnosis, tumor segmentation, non-invasive genomic biomarker identification, detection of progression and patient survival prediction. Model performance was generally strong (AUC = 0.87 ± 0.09; sensitivity = 0.87 ± 0.10; specificity = 0.0.86 ± 0.10; precision = 0.88 ± 0.11). Convolutional neural network, support vector machine and random forest algorithms were top performers. Deep learning document classifiers yielded acceptable performance (mean 5-fold cross-validation AUC = 0.71). Machine learning tools and data resources were synthesized and summarized to facilitate future research. Machine learning has been widely applied to the processing of MRI data in glioma research and has demonstrated substantial utility. NLP and transfer learning resources enabled the successful development of a replicable method for automating the systematic review article screening process, which has potential for shortening the time from discovery to clinical application in medicine.

Considerable effects of imaging sequences, feature extraction, feature selection, and classifiers on radiomics-based prediction of microvascular invasion in hepatocellular carcinoma using magnetic resonance imaging

BACKGROUND

Microvascular invasion (MVI) has a significant effect on the prognosis of hepatocellular carcinoma (HCC), but its preoperative identification is challenging. Radiomics features extracted from medical images, such as magnetic resonance (MR) images, can be used to predict MVI. In this study, we explored the effects of different imaging sequences, feature extraction and selection methods, and classifiers on the performance of HCC MVI predictive models.

METHODS

After screening against the inclusion criteria, 69 patients with HCC and preoperative gadoxetic acid-enhanced MR images were enrolled. In total, 167 features were extracted from the MR images of each sequence for each patient. Experiments were designed to investigate the effects of imaging sequence, number of gray levels (Ng), quantization algorithm, feature selection method, and classifiers on the performance of radiomics biomarkers in the prediction of HCC MVI. We trained and tested these models using leave-one-out cross-validation (LOOCV).

RESULTS

The radiomics model based on the images of the hepatobiliary phase (HBP) had better predictive performance than those based on the arterial phase (AP), portal venous phase (PVP), and pre-enhanced T1-weighted images [area under the receiver operating characteristic (ROC) curve (AUC) =0.792 vs. 0.641/0.634/0.620, P=0.041/0.021/0.010, respectively]. Compared with the equal-probability and Lloyd-Max algorithms, the radiomics features obtained using the Uniform quantization algorithm had a better performance (AUC =0.643/0.666 vs. 0.792, P=0.002/0.003, respectively). Among the values of 8, 16, 32, 64, and 128, the best predictive performance was achieved when the Ng was 64 (AUC =0.792 vs. 0.584/0.697/0.677/0.734, P<0.001/P=0.039/0.001/0.137, respectively). We used a two-stage feature selection method which combined the least absolute shrinkage and selection operator (LASSO) and recursive feature elimination (RFE) gradient boosting decision tree (GBDT), which achieved better stability than and outperformed LASSO, minimum redundancy maximum relevance (mRMR), and support vector machine (SVM)-RFE (stability =0.967 vs. 0.837/0.623/0.390, respectively; AUC =0.850 vs. 0.792/0.713/0.699, P=0.142/0.007/0.003, respectively). The model based on the radiomics features of HBP images using the GBDT classifier showed a better performance for the preoperative prediction of MVI compared with logistic regression (LR), SVM, and random forest (RF) classifiers (AUC =0.895 vs. 0.850/0.834/0.884, P=0.558/0.229/0.058, respectively). With the optimal combination of these factors, we established the best model, which had an AUC of 0.895, accuracy of 87.0%, specificity of 82.5%, and sensitivity of 93.1%.

CONCLUSIONS

Imaging sequences, feature extraction and selection methods, and classifiers can have a considerable effect on the predictive performance of radiomics models for HCC MVI.

Multiparametric MRI texture analysis in prediction of glioma biomarker status: added value of MR diffusion

Background

Early identification of glioma molecular phenotypes can lead to understanding of patient prognosis and treatment guidance. We aimed to develop a multiparametric MRI texture analysis model using a combination of conventional and diffusion MRI to predict a wide range of biomarkers in patients with glioma.

Methods

In this retrospective study, patients were included if they (1) had diagnosis of gliomas with known IDH1, EGFR, MGMT, ATRX, TP53, and PTEN status from surgical pathology and (2) had preoperative MRI including FLAIR, T1c+ and diffusion for radiomic texture analysis. Statistical analysis included logistic regression and receiver-operating characteristic (ROC) curve analysis to determine the optimal model for predicting glioma biomarkers. A comparative analysis between ROCs (conventional only vs conventional + diffusion) was performed.

Results

From a total of 111 patients included, 91 (82%) were categorized to training and 20 (18%) to test datasets. Constructed cross-validated model using a combination of texture features from conventional and diffusion MRI resulted in overall AUC/accuracy of 1/79% for IDH1, 0.99/80% for ATRX, 0.79/67% for MGMT, and 0.77/66% for EGFR. The addition of diffusion data to conventional MRI features significantly (P < .05) increased predictive performance for IDH1, MGMT, and ATRX. The overall accuracy of the final model in predicting biomarkers in the test group was 80% (IDH1), 70% (ATRX), 70% (MGMT), and 75% (EGFR).

Conclusion

Addition of MR diffusion to conventional MRI features provides added diagnostic value in preoperative determination of IDH1, MGMT, and ATRX in patients with glioma.

The Nomogram of MRI-based Radiomics with Complementary Visual Features by Machine Learning Improves Stratification of Glioblastoma Patients: A Multicenter Study

BACKGROUND

Glioblastomas (GBMs) represent both the most common and the most highly malignant primary brain tumors. The subjective visual imaging features from MRI make it challenging to predict the overall survival (OS) of GBM. Radiomics can quantify image features objectively as an emerging technique. A pragmatic and objective method in the clinic to assess OS is strongly in need.

PURPOSE

To construct a radiomics nomogram to stratify GBM patients into long- vs. short-term survival.

STUDY TYPE

Retrospective.

POPULATION

One-hundred and fifty-eight GBM patients from Brain Tumor Segmentation Challenge 2018 (BRATS2018) were for model construction and 32 GBM patients from the local hospital for external validation.

FIELD STRENGTH/SEQUENCE

1.5 T and 3.0 T MRI Scanners, T₁ WI, T₂ WI, T₂ FLAIR, and contrast-enhanced T₁ WI sequences ASSESSMENT: All patients were divided into long-term or short-term based on a survival of greater or fewer than 12 months. All BRATS2018 subjects were divided into training and test sets, and images were assessed for ependymal and pia mater involvement (EPI) and multifocality by three experienced neuroradiologists. All tumor tissues from multiparametric MRI were fully automatically segmented into three subregions to calculate the radiomic features. Based on the training set, the most powerful radiomic features were selected to constitute radiomic signature.

STATISTICAL TESTS

Receiver operating characteristic (ROC) curve, sensitivity, specificity, and the Hosmer-Lemeshow test.

RESULTS

The nomogram had a survival prediction accuracy of 0.878 and 0.875, a specificity of 0.875 and 0.583, and a sensitivity of 0.704 and 0.833, respectively, in the training and test set. The ROC curve showed the accuracy of the nomogram, radiomic signature, age, and EPI for external validation set were 0.858, 0.826, 0.664, and 0.66 in the validate set, respectively.

DATA CONCLUSION

Radiomics nomogram integrated with radiomic signature, EPI, and age was found to be robust for the stratification of GBM patients into long- vs. short-term survival.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY STAGE: 2.

Survival prediction in glioblastoma on post-contrast magnetic resonance imaging using filtration based first-order texture analysis: Comparison of multiple machine learning models

OBJECTIVE

Magnetic resonance texture analysis (MRTA) is a relatively new technique that can be a valuable addition to clinical and imaging parameters in predicting prognosis. In the present study, we investigated the efficacy of MRTA for glioblastoma survival using T1 contrast-enhanced (CE) images for texture analysis.

METHODS

We evaluated the diagnostic performance of multiple machine learning models based on first-order histogram statistical parameters derived from T1-weighted CE images in the survival stratification of glioblastoma multiforme (GBM). Retrospective evaluation of 85 patients with GBM was performed. Thirty-six first-order texture parameters at six spatial scale filters (SSF) were extracted on the T1 CE axial images for the whole tumor using commercially available research software. Several machine learning classification models (in four broad categories: linear, penalized linear, non-linear, and ensemble classifiers) were evaluated to assess the survival prediction performance using optimal features. Principal component analysis was used prior to fitting the linear classifiers in order to reduce the dimensionality of the feature inputs. Fivefold cross-validation was used to partition the data iteratively into training and testing sets. The area under the receiver operating characteristic curve (AUC) was used to assess the diagnostic performance.

RESULTS

The neural network model was the highest performing model with the highest observed AUC (0.811) and cross-validated AUC (0.71). The most important variable was the age at diagnosis, with mean and mean of positive pixels (MPP) for SSF = 0 being the second and third most important, followed by skewness for SSF = 0 and SSF = 4.

CONCLUSIONS

First-order texture features, when combined with age at presentation, show good accuracy in predicting GBM survival.

Imaging genomics for accurate diagnosis and treatment of tumors: A cutting edge overview

Imaging genomics refers to the establishment of the connection between invasive gene expression features and non-invasive imaging features. Tumor imaging genomics can not only understand the macroscopic phenotype of tumor, but also can deeply analyze the cellular and molecular characteristics of tumor tissue. In recent years, tumor imaging genomics has been a key in the field of medicine. The incidence of cancer in China has increased significantly, which is the main reason of disease death of urban residents. With the rapid development of imaging medicine, depending on imaging genomics, many experts have made remarkable achievements in tumor screening and diagnosis, prognosis evaluation, new treatment targets and understanding of tumor biological mechanism. This review analyzes the relationship between tumor radiology and gene expression, which provides a favorable direction for clinical staging, prognosis evaluation and accurate treatment of tumors.

MRI Radiomic Features to Predict IDH1 Mutation Status in Gliomas: A Machine Learning Approach using Gradient Tree Boosting

Patients with gliomas, isocitrate dehydrogenase 1 (IDH1) mutation status have been studied as a prognostic indicator. Recent advances in machine learning (ML) have demonstrated promise in utilizing radiomic features to study disease processes in the brain. We investigate whether ML analysis of multiparametric radiomic features from preoperative Magnetic Resonance Imaging (MRI) can predict IDH1 mutation status in patients with glioma. This retrospective study included patients with glioma with known IDH1 status and preoperative MRI. Radiomic features were extracted from Fluid-Attenuated Inversion Recovery (FLAIR) and Diffused Weighted Imaging (DWI). The dataset was split into training, validation, and testing sets by stratified sampling. Synthetic Minority Oversampling Technique (SMOTE) was applied to the training sets. eXtreme Gradient Boosting (XGBoost) classifiers were trained, and the hyperparameters were tuned. Receiver operating characteristic curve (ROC), accuracy, and f1-scores were collected. A total of 100 patients (age: 55 ± 15, M/F 60/40); with IDH1 mutant (n = 22) and IDH1 wildtype (n = 78) were included. The best performance was seen with a DWI-trained XGBoost model, which achieved ROC with Area Under the Curve (AUC) of 0.97, accuracy of 0.90, and f1-score of 0.75 on the test set. The FLAIR-trained XGBoost model achieved ROC with AUC of 0.95, accuracy of 0.90, f1-score of 0.75 on the test set. A model that was trained on combined FLAIR-DWI radiomic features did not provide incremental accuracy. The results show that a XGBoost classifier using multiparametric radiomic features derived from preoperative MRI can predict IDH1 mutation status with > 90% accuracy.

Radiomic Immunophenotyping of GSEA-Assessed Immunophenotypes of Glioblastoma and Its Implications for Prognosis: A Feasibility Study

Simple Summary

Characterization of immunophenotypes in GBM is important for therapeutic stratification and helps predict treatment response and prognosis. However, identifying immunophenotypes of patients with GBM requires multiple laboratory experiments and is time consuming. We developed a non-invasive method to evaluate enrichment levels of CTL, aDC, Treg, and MDSC immune cells to classify immunophenotypes of GBM tumor microenvironment with radiomic features of MR imaging. Five immunophenotypes (G1–G5) of GBM can be classified with specific gene set enrichment analysis. G2 had the worst prognosis and comprised highly enriched MDSCs and lowly enriched CTLs. G3 had the best prognosis and comprised lowly enriched MDSCs and Tregs and highly enriched CTLs. Moreover, the developed radiomics models can successfully identified these two groups by immune cell subsets enriched levels prediction. Therefore, it is possible to characterize immunophenotypes of GBM and predict patient prognosis with radiomics methods.

Abstract

Characterization of immunophenotypes in glioblastoma (GBM) is important for therapeutic stratification and helps predict treatment response and prognosis. Radiomics can be used to predict molecular subtypes and gene expression levels. However, whether radiomics aids immunophenotyping prediction is still unknown. In this study, to classify immunophenotypes in patients with GBM, we developed machine learning-based magnetic resonance (MR) radiomic models to evaluate the enrichment levels of four immune subsets: Cytotoxic T lymphocytes (CTLs), activated dendritic cells, regulatory T cells (Tregs), and myeloid-derived suppressor cells (MDSCs). Independent testing data and the leave-one-out cross-validation method were used to evaluate model effectiveness and model performance, respectively. We identified five immunophenotypes (G1 to G5) based on the enrichment level for the four immune subsets. G2 had the worst prognosis and comprised highly enriched MDSCs and lowly enriched CTLs. G3 had the best prognosis and comprised lowly enriched MDSCs and Tregs and highly enriched CTLs. The average accuracy of T1-weighted contrasted MR radiomics models of the enrichment level for the four immune subsets reached 79% and predicted G2, G3, and the “immune-cold” phenotype (G1) according to our radiomics models. Our radiomic immunophenotyping models feasibly characterize the immunophenotypes of GBM and can predict patient prognosis.

DeepSurvNet: deep survival convolutional network for brain cancer survival rate classification based on histopathological images

Histopathological whole slide images of haematoxylin and eosin (H&E)-stained biopsies contain valuable information with relation to cancer disease and its clinical outcomes. Still, there are no highly accurate automated methods to correlate histolopathological images with brain cancer patients' survival, which can help in scheduling patients therapeutic treatment and allocate time for preclinical studies to guide personalized treatments. We now propose a new classifier, namely, DeepSurvNet powered by deep convolutional neural networks, to accurately classify in 4 classes brain cancer patients' survival rate based on histopathological images (class I, 0-6 months; class II, 6-12 months; class III, 12-24 months; and class IV, >24 months survival after diagnosis). After training and testing of DeepSurvNet model on a public brain cancer dataset, The Cancer Genome Atlas, we have generalized it using independent testing on unseen samples. Using DeepSurvNet, we obtained precisions of 0.99 and 0.8 in the testing phases on the mentioned datasets, respectively, which shows DeepSurvNet is a reliable classifier for brain cancer patients' survival rate classification based on histopathological images. Finally, analysis of the frequency of mutations revealed differences in terms of frequency and type of genes associated to each class, supporting the idea of a different genetic fingerprint associated to patient survival. We conclude that DeepSurvNet constitutes a new artificial intelligence tool to assess the survival rate in brain cancer. Graphical abstract A DCNN model was generated to accurately predict survival rates of brain cancer patients (classified in 4 different classes) accurately. After training the model using images from H&E stained tissue biopsies from The Cancer Genome Atlas database (TCGA, left), the model can predict for each patient, based on a histological image (top right), its survival class accurately (bottom right).

Overlooked pitfalls in multi-class machine learning classification in radiation oncology and how to avoid them

In radiation oncology, Machine Learning classification publications are typically related to two outcome classes, e.g. the presence or absence of distant metastasis. However, multi-class classification problems also have great clinical relevance, e.g., predicting the grade of a treatment complication following lung irradiation. This work comprised two studies aimed at making work in this domain less prone to statistical blindsides. In multi-class classification, AUC is not defined, whereas correlation coefficients are. It may seem like solely quoting the correlation coefficient value (in lieu of the AUC value) is a suitable choice. In the first study, we illustrated using Monte Carlo (MC) models why this choice is misleading. We also considered the special case where the multiple classes are not ordinal, but nominal, and explained why Pearson or Spearman correlation coefficients are not only providing incomplete information but are actually meaningless. The second study concerned surrogate biomarkers for a clinical endpoint, which have purported benefits including potential for early assessment, being inexpensive, and being non-invasive. Using a MC experiment, we showed how conclusions derived from surrogate markers can be misleading. The simulated endpoint was radiation toxicity (scale of 0-5). The surrogate marker was the true toxicity grade plus a noise term. Five patient cohorts were simulated, including one control. Two of the cohorts were designed to have a statistically significant difference in toxicity. Under 1000 repeated experiments using the biomarker, these two cohorts were often found to be statistically indistinguishable, with the fraction of such occurrences rising with the level of noise.

TCGA-TCIA Impact on Radiogenomics Cancer Research: A Systematic Review

In the last decade, the development of radiogenomics research has produced a significant amount of papers describing relations between imaging features and several molecular 'omic signatures arising from next-generation sequencing technology and their potential role in the integrated diagnostic field. The most vulnerable point of many of these studies lies in the poor number of involved patients. In this scenario, a leading role is played by The Cancer Genome Atlas (TCGA) and The Cancer Imaging Archive (TCIA), which make available, respectively, molecular 'omic data and linked imaging data. In this review, we systematically collected and analyzed radiogenomic studies based on TCGA-TCIA data. We organized literature per tumor type and molecular 'omic data in order to discuss salient imaging genomic associations and limitations of each study. Finally, we outlined the potential clinical impact of radiogenomics to improve the accuracy of diagnosis and the prediction of patient outcomes in oncology.

Why imaging data alone is not enough: AI-based integration of imaging, omics, and clinical data

Artificial intelligence (AI) is currently regaining enormous interest due to the success of machine learning (ML), and in particular deep learning (DL). Image analysis, and thus radiomics, strongly benefits from this research. However, effectively and efficiently integrating diverse clinical, imaging, and molecular profile data is necessary to understand complex diseases, and to achieve accurate diagnosis in order to provide the best possible treatment. In addition to the need for sufficient computing resources, suitable algorithms, models, and data infrastructure, three important aspects are often neglected: (1) the need for multiple independent, sufficiently large and, above all, high-quality data sets; (2) the need for domain knowledge and ontologies; and (3) the requirement for multiple networks that provide relevant relationships among biological entities. While one will always get results out of high-dimensional data, all three aspects are essential to provide robust training and validation of ML models, to provide explainable hypotheses and results, and to achieve the necessary trust in AI and confidence for clinical applications.

Machine-learning based radiogenomics analysis of MRI features and metagenes in glioblastoma multiforme patients with different survival time

Background

This study aimed to examine multi‐dimensional MRI features’ predictability on survival outcome and associations with differentially expressed Genes (RNA Sequencing) in groups of glioblastoma multiforme (GBM) patients.

Methods

Radiomics features were extracted from segmented lesions of T2‐FLAIR MRI data of 137 GBM patients. Radiomics features include intensity, shape and textural features in seven classes were included in the analysis. Patients were divided into two groups depending on their survival time (shorter or longer than 1‐year survival). Four different machine learning algorithms were implemented to construct the prediction models. Features with top importance (importance >0.04) were selected to construct the prediction model using the model with the best performance. The interactions between image features and genomics were then analysed with Pearson's correlation analysis.

Results

The GBDT model with 72 features with highest importance had the highest accuracy of 0.81 on both short and long survival time classes, and the area under the curve (AUC) of the receiver operative characteristic (ROC) of the short and long survival time class were 0.79 and 0.81. Six metagenes showed significant interactive effect (P < 0.05), and Pearson's correlation analysis revealed that three of these metagenes (TIMP1,ROS1 EREG) showed moderate (0.3 < |r| < 0.5) or high correlation (|r| > 0.5) with image features.

Conclusion

Radiogenomics analysis shows that MRI features are predictive of survival outcomes, and image features are highly associated with selective metagenes. Radiogenomics analysis is a useful method for optimizing clinical diagnosis and selecting effective treatments.