Cancer imaging phenomics toolkit: quantitative imaging analytics for precision diagnostics and predictive modeling of clinical outcome

Predicting Cognitive Functioning for Patients with a High-Grade Glioma: Evaluating Different Representations of Tumor Location in a Common Space

Cognitive functioning is increasingly considered when making treatment decisions for patients with a brain tumor in view of a personalized onco-functional balance. Ideally, one can predict cognitive functioning of individual patients to make treatment decisions considering this balance. To make accurate predictions, an informative representation of tumor location is pivotal, yet comparisons of representations are lacking. Therefore, this study compares brain atlases and principal component analysis (PCA) to represent voxel-wise tumor location. Pre-operative cognitive functioning was predicted for 246 patients with a high-grade glioma across eight cognitive tests while using different representations of voxel-wise tumor location as predictors. Voxel-wise tumor location was represented using 13 different frequently-used population average atlases, 13 randomly generated atlases, and 13 representations based on PCA. ElasticNet predictions were compared between representations and against a model solely using tumor volume. Preoperative cognitive functioning could only partly be predicted from tumor location. Performances of different representations were largely similar. Population average atlases did not result in better predictions compared to random atlases. PCA-based representation did not clearly outperform other representations, although summary metrics indicated that PCA-based representations performed somewhat better in our sample. Representations with more regions or components resulted in less accurate predictions. Population average atlases possibly cannot distinguish between functionally distinct areas when applied to patients with a glioma. This stresses the need to develop and validate methods for individual parcellations in the presence of lesions. Future studies may test if the observed small advantage of PCA-based representations generalizes to other data.

Multivariate testing and effect size measures for batch effect evaluation in radiomic features

While precision medicine applications of radiomics analysis are promising, differences in image acquisition can cause "batch effects" that reduce reproducibility and affect downstream predictive analyses. Harmonization methods such as ComBat have been developed to correct these effects, but evaluation methods for quantifying batch effects are inconsistent. In this study, we propose the use of the multivariate statistical test PERMANOVA and the Robust Effect Size Index (RESI) to better quantify and characterize batch effects in radiomics data. We evaluate these methods in both simulated and real radiomics features extracted from full-field digital mammography (FFDM) data. PERMANOVA demonstrated higher power than standard univariate statistical testing, and RESI was able to interpretably quantify the effect size of site at extremely large sample sizes. These methods show promise as more powerful and interpretable methods for the detection and quantification of batch effects in radiomics studies.

The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)

Pediatric tumors of the central nervous system are the most common cause of cancer-related death in children. The five-year survival rate for high-grade gliomas in children is less than 20%. Due to their rarity, the diagnosis of these entities is often delayed, their treatment is mainly based on historic treatment concepts, and clinical trials require multi-institutional collaborations. The MICCAI Brain Tumor Segmentation (BraTS) Challenge is a landmark community benchmark event with a successful history of 12 years of resource creation for the segmentation and analysis of adult glioma. Here we present the CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs 2023 challenge, which represents the first BraTS challenge focused on pediatric brain tumors with data acquired across multiple international consortia dedicated to pediatric neuro-oncology and clinical trials. The BraTS-PEDs 2023 challenge focuses on benchmarking the development of volumentric segmentation algorithms for pediatric brain glioma through standardized quantitative performance evaluation metrics utilized across the BraTS 2023 cluster of challenges. Models gaining knowledge from the BraTS-PEDs multi-parametric structural MRI (mpMRI) training data will be evaluated on separate validation and unseen test mpMRI dataof high-grade pediatric glioma. The CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs 2023 challenge brings together clinicians and AI/imaging scientists to lead to faster development of automated segmentation techniques that could benefit clinical trials, and ultimately the care of children with brain tumors.

Survival analysis using deep learning with medical imaging

There is widespread interest in using deep learning to build prediction models for medical imaging data. These deep learning methods capture the local structure of the image and require no manual feature extraction. Despite the importance of modeling survival in the context of medical data analysis, research on deep learning methods for modeling the relationship of imaging and time-to-event data is still under-developed. We provide an overview of deep learning methods for time-to-event outcomes and compare several deep learning methods to Cox model based methods through the analysis of a histology dataset of gliomas.

Tumour Size and Overall Survival in a Cohort of Patients with Unifocal Glioblastoma: A Uni- and Multivariable Prognostic Modelling and Resampling Study

Published models inconsistently associate glioblastoma size with overall survival (OS). This study aimed to investigate the prognostic effect of tumour size in a large cohort of patients diagnosed with GBM and interrogate how sample size and non-linear transformations may impact on the likelihood of finding a prognostic effect. In total, 279 patients with a IDH-wildtype unifocal WHO grade 4 GBM between 2014 and 2020 from a retrospective cohort were included. Uni-/multivariable association between core volume, whole volume (CV and WV), and diameter with OS was assessed with (1) Cox proportional hazard models +/- log transformation and (2) resampling with 1,000,000 repetitions and varying sample size to identify the percentage of models, which showed a significant effect of tumour size. Models adjusted for operation type and a diameter model adjusted for all clinical variables remained significant (p = 0.03). Multivariable resampling increased the significant effects (p < 0.05) of all size variables as sample size increased. Log transformation also had a large effect on the chances of a prognostic effect of WV. For models adjusted for operation type, 19.5% of WV vs. 26.3% log-WV (n = 50) and 69.9% WV and 89.9% log-WV (n = 279) were significant. In this large well-curated cohort, multivariable modelling and resampling suggest tumour volume is prognostic at larger sample sizes and with log transformation for WV.

Integrating imaging and genomic data for the discovery of distinct glioblastoma subtypes: a joint learning approach

Glioblastoma is a highly heterogeneous disease, with variations observed at both phenotypical and molecular levels. Personalized therapies would be facilitated by non-invasive in vivo approaches for characterizing this heterogeneity. In this study, we developed unsupervised joint machine learning between radiomic and genomic data, thereby identifying distinct glioblastoma subtypes. A retrospective cohort of 571 IDH-wildtype glioblastoma patients were included in the study, and pre-operative multi-parametric MRI scans and targeted next-generation sequencing (NGS) data were collected. L21-norm minimization was used to select a subset of 12 radiomic features from the MRI scans, and 13 key driver genes from the five main signal pathways most affected in glioblastoma were selected from the genomic data. Subtypes were identified using a joint learning approach called Anchor-based Partial Multi-modal Clustering on both radiomic and genomic modalities. Kaplan-Meier analysis identified three distinct glioblastoma subtypes: high-risk, medium-risk, and low-risk, based on overall survival outcome (p < 0.05, log-rank test; Hazard Ratio = 1.64, 95% CI 1.17-2.31, Cox proportional hazard model on high-risk and low-risk subtypes). The three subtypes displayed different phenotypical and molecular characteristics in terms of imaging histogram, co-occurrence of genes, and correlation between the two modalities. Our findings demonstrate the synergistic value of integrated radiomic signatures and molecular characteristics for glioblastoma subtyping. Joint learning on both modalities can aid in better understanding the molecular basis of phenotypical signatures of glioblastoma, and provide insights into the biological underpinnings of tumor formation and progression.

Predictive analytics and early intervention in healthcare social work: a scoping review

This scoping review investigates the untapped potential of predictive analytics in healthcare social work, specifically targeting early intervention frameworks. Despite the escalating attention predictive analytics has garnered across multiple disciplines, its tailored application in social work remains notably sparse. This study endeavors to fill this lacuna by meticulously reviewing the extant literature and delineating the prospective advantages and inherent constraints of integrating predictive analytics into healthcare social work. The outcomes of this inquiry enrich the prevailing dialogue on the utility of predictive analytics in healthcare, offering indispensable perspectives for practitioners and policymakers in the social work domain.

Investigating Causal Genetic Effects on Overall Survival of Glioblastoma Patients using Normalizing Flow and Structural Causal Model

Glioblastoma (GBM) is the most common and aggressive brain tumor with short overall survival (OS) of about 15 months. Understanding the causal factors affecting the patient survival is crucial for disease prognosis and treatment planning. Although previous efforts on survival prediction using multi-omics data has yielded useful predictive models, the causation of the correlated genetic risk factors has not been addressed. Recent advances in causal deep learning models enable the study of causality from complex dataset. In this paper, we leverage the recently proposed structural causal model (SCM) with normalizing flows parameterized by deep networks to perform the counterfactual query to investigate the causal relationship between gene mutation and OS with the presence of other confounders including sex, age and radiomics features. The query amounts to the question that what the survival days will be if the gene mutation status has been changed, i.e., from mutant to non-mutant and vice versa. The trained causal model will infer the counterfactual outcome given the intervention on specific gene mutation. We apply multivariate Cox-PH model to find the genes associated with survival, and investigate the causal genetic effect by comparing the original and counterfactual survival days in a bi-directional fashion. Particularly, the following two scenarios are considered: (1) intervention on a specific gene with non-mutant status to generate the counterfactual survival days as if the gene is mutant, with which the original survival days of the subjects with that mutant gene will be compared; (2) intervention on the gene with mutant status and perform the comparison with survival days of subjects with that non-mutant gene. Our experimental results show that no causation of two correlated genes (NF1, RB1) was revealed in the cohort (n=181), while their genetic effects on OS in terms of prolonging or shortening are generally in accordance with clinical findings.

Identification of phenomic data in the pathogenesis of cancers of the gastrointestinal (GI) tract in the UK biobank

Gastrointestinal (GI) cancers account for a significant incidence and mortality rates of cancers globally. Utilization of a phenomic data approach allows researchers to reveal the mechanisms and molecular pathogenesis of these conditions. We aimed to investigate the association between the phenomic features and GI cancers in a large cohort study. We included 502,369 subjects aged 37-73 years in the UK Biobank recruited since 2006, followed until the date of the first cancer diagnosis, date of death, or the end of follow-up on December 31st, 2016, whichever occurred first. Socio-demographic factors, blood chemistry, anthropometric measurements and lifestyle factors of participants collected at baseline assessment were analysed. Unvariable and multivariable logistic regression were conducted to determine the significant risk factors for the outcomes of interest, based on the odds ratio (OR) and 95% confidence intervals (CI). The analysis included a total of 441,141 participants, of which 7952 (1.8%) were incident GI cancer cases and 433,189 were healthy controls. A marker, cystatin C was associated with total and each gastrointestinal cancer (adjusted OR 2.43; 95% CI 2.23-2.64). In this cohort, compared to Asians, the Whites appeared to have a higher risk of developing gastrointestinal cancers. Several other factors were associated with distinct GI cancers. Cystatin C and race appear to be important features in GI cancers, suggesting some overlap in the molecular pathogenesis of GI cancers. Given the small proportion of Asians within the UK Biobank, the association between race and GI cancers requires further confirmation.

PAHPhysRAD: A Digital Imaging and Communications in Medicine Research Tool for Segmentation and Radiomic Feature Extraction

Introduction

Segmentation and analysis of organs at risks (OARs) and tumor volumes are integral concepts in the development of radiotherapy treatment plans and prediction of patients' treatment outcomes.

Aims

To develop a research tool, PAHPhysRAD, that can be used to semi- and fully automate segmentation of OARs. In addition, the proposed software seeks to extract 3214 radiomic features from tumor volumes and user-specified dose-volume parameters.

Materials and Methods

Developed within MATLAB, PAHPhysRAD provides a comprehensive suite of segmentation tools, including manual, semi-automatic, and automatic options. For semi-autosegmentation, meta AI's Segment Anything Model was incorporated using the bounding box methods. Autosegmentation of OARs and tumor volume are implemented through a module that enables the addition of models in Open Neural Network Exchange format. To validate the radiomic feature extraction module in PAHPhysRAD, radiomic features extracted from gross tumor volume of 15 non-small cell lung carcinoma patients were compared against the features extracted from 3D Slicer™. The dose-volume parameters extraction module was validated using the dose volume data extracted from 28 tangential field-based breast treatment planning datasets. The volume receiving ≥20 Gy (V20) for ipsilateral lung and the mean doses received by the heart and ipsilateral lung, were compared against the parameters extracted from Eclipse.

Results

The Wilcoxon signed-rank test revealed no significant difference between the majority of the radiomic features derived from PAHPhysRAD and 3D Slicer. The average mean lung and heart doses calculated in Eclipse were 5.51 ± 2.28 Gy and 1.64 ± 1.98 Gy, respectively. Similarly, the average mean lung and heart doses calculated in PAHPhysRAD were 5.45 ± 2.89 Gy and 1.67 ± 2.08 Gy, respectively.

Conclusion

The MATLAB-based graphical user interface, PAHPhysRAD, offers a user-friendly platform for viewing and analyzing medical scans with options to extract radiomic features and dose-volume parameters. Its versatility, compatibility, and potential for further development make it an asset in medical image analysis.

MGMT promoter methylation status prediction using MRI scans? An extensive experimental evaluation of deep learning models

The number of studies on deep learning for medical diagnosis is expanding, and these systems are often claimed to outperform clinicians. However, only a few systems have shown medical efficacy. From this perspective, we examine a wide range of deep learning algorithms for the assessment of glioblastoma - a common brain tumor in older adults that is lethal. Surgery, chemotherapy, and radiation are the standard treatments for glioblastoma patients. The methylation status of the MGMT promoter, a specific genetic sequence found in the tumor, affects chemotherapy's effectiveness. MGMT promoter methylation improves chemotherapy response and survival in several cancers. MGMT promoter methylation is determined by a tumor tissue biopsy, which is then genetically tested. This lengthy and invasive procedure increases the risk of infection and other complications. Thus, researchers have used deep learning models to examine the tumor from brain MRI scans to determine the MGMT promoter's methylation state. We employ deep learning models and one of the largest public MRI datasets of 585 participants to predict the methylation status of the MGMT promoter in glioblastoma tumors using MRI scans. We test these models using Grad-CAM, occlusion sensitivity, feature visualizations, and training loss landscapes. Our results show no correlation between these two, indicating that external cohort data should be used to verify these models' performance to assure the accuracy and reliability of deep learning systems in cancer diagnosis.

Brain tumour genetic network signatures of survival

Tumour heterogeneity is increasingly recognized as a major obstacle to therapeutic success across neuro-oncology. Gliomas are characterized by distinct combinations of genetic and epigenetic alterations, resulting in complex interactions across multiple molecular pathways. Predicting disease evolution and prescribing individually optimal treatment requires statistical models complex enough to capture the intricate (epi)genetic structure underpinning oncogenesis. Here, we formalize this task as the inference of distinct patterns of connectivity within hierarchical latent representations of genetic networks. Evaluating multi-institutional clinical, genetic and outcome data from 4023 glioma patients over 14 years, across 12 countries, we employ Bayesian generative stochastic block modelling to reveal a hierarchical network structure of tumour genetics spanning molecularly confirmed glioblastoma, IDH-wildtype; oligodendroglioma, IDH-mutant and 1p/19q codeleted; and astrocytoma, IDH-mutant. Our findings illuminate the complex dependence between features across the genetic landscape of brain tumours and show that generative network models reveal distinct signatures of survival with better prognostic fidelity than current gold standard diagnostic categories.

An artificial intelligence-assisted diagnosis modeling software (AIMS) platform based on medical images and machine learning: a development and validation study

Background

Supervised machine learning methods [both radiomics and convolutional neural network (CNN)-based deep learning] are usually employed to develop artificial intelligence models with medical images for computer-assisted diagnosis and prognosis of diseases. A classical machine learning-based modeling workflow involves a series of interconnected components and various algorithms, but this makes it challenging, tedious, and labor intensive for radiologists and researchers to build customized models for specific clinical applications if they lack expertise in machine learning methods.

Methods

We developed a user-friendly artificial intelligence-assisted diagnosis modeling software (AIMS) platform, which supplies standardized machine learning-based modeling workflows for computer-assisted diagnosis and prognosis systems with medical images. In contrast to other existing software platforms, AIMS contains both radiomics and CNN-based deep learning workflows, making it an all-in-one software platform for machine learning-based medical image analysis. The modular design of AIMS allows users to build machine learning models easily, test models comprehensively, and fairly compare the performance of different models in a specific application. The graphical user interface (GUI) enables users to process large numbers of medical images without programming or script addition. Furthermore, AIMS also provides a flexible image processing toolkit (e.g., semiautomatic segmentation, registration, morphological operations) to rapidly create lesion labels for multiphase analysis, multiregion analysis of an individual tumor (e.g., tumor mass and peritumor), and multimodality analysis.

Results

The functionality and efficiency of AIMS were demonstrated in 3 independent experiments in radiation oncology, where multiphase, multiregion, and multimodality analyses were performed, respectively. For clear cell renal cell carcinoma (ccRCC) Fuhrman grading with multiphase analysis (sample size =187), the area under the curve (AUC) value of the AIMS was 0.776; for ccRCC Fuhrman grading with multiregion analysis (sample size =177), the AUC value of the AIMS was 0.848; for prostate cancer Gleason grading with multimodality analysis (sample size =206), the AUC value of the AIMS was 0.980.

Conclusions

AIMS provides a user-friendly infrastructure for radiologists and researchers, lowering the barrier to building customized machine learning-based computer-assisted diagnosis models for medical image analysis.

Deep learning-based algorithm for postoperative glioblastoma MRI segmentation: a promising new tool for tumor burden assessment

OBJECTIVE

Clinical and surgical decisions for glioblastoma patients depend on a tumor imaging-based evaluation. Artificial Intelligence (AI) can be applied to magnetic resonance imaging (MRI) assessment to support clinical practice, surgery planning and prognostic predictions. In a real-world context, the current obstacles for AI are low-quality imaging and postoperative reliability. The aim of this study is to train an automatic algorithm for glioblastoma segmentation on a clinical MRI dataset and to obtain reliable results both pre- and post-operatively.

METHODS

The dataset used for this study comprises 237 (71 preoperative and 166 postoperative) MRIs from 71 patients affected by a histologically confirmed Grade IV Glioma. The implemented U-Net architecture was trained by transfer learning to perform the segmentation task on postoperative MRIs. The training was carried out first on BraTS2021 dataset for preoperative segmentation. Performance is evaluated using DICE score (DS) and Hausdorff 95% (H95).

RESULTS

In preoperative scenario, overall DS is 91.09 (± 0.60) and H95 is 8.35 (± 1.12), considering tumor core, enhancing tumor and whole tumor (ET and edema). In postoperative context, overall DS is 72.31 (± 2.88) and H95 is 23.43 (± 7.24), considering resection cavity (RC), gross tumor volume (GTV) and whole tumor (WT). Remarkably, the RC segmentation obtained a mean DS of 63.52 (± 8.90) in postoperative MRIs.

CONCLUSIONS

The performances achieved by the algorithm are consistent with previous literature for both pre-operative and post-operative glioblastoma's MRI evaluation. Through the proposed algorithm, it is possible to reduce the impact of low-quality images and missing sequences.

A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network

Pediatric brain and spinal cancers remain the leading cause of cancer-related death in children. Advancements in clinical decision-support in pediatric neuro-oncology utilizing the wealth of radiology imaging data collected through standard care, however, has significantly lagged other domains. Such data is ripe for use with predictive analytics such as artificial intelligence (AI) methods, which require large datasets. To address this unmet need, we provide a multi-institutional, large-scale pediatric dataset of 23,101 multi-parametric MRI exams acquired through routine care for 1,526 brain tumor patients, as part of the Children's Brain Tumor Network. This includes longitudinal MRIs across various cancer diagnoses, with associated patient-level clinical information, digital pathology slides, as well as tissue genotype and omics data. To facilitate downstream analysis, treatment-naïve images for 370 subjects were processed and released through the NCI Childhood Cancer Data Initiative via the Cancer Data Service. Through ongoing efforts to continuously build these imaging repositories, our aim is to accelerate discovery and translational AI models with real-world data, to ultimately empower precision medicine for children.

Role of MRI radiomics for the prediction of MYCN amplification in neuroblastomas

OBJECTIVES

We evaluate MR radiomics and develop machine learning-based classifiers to predict MYCN amplification in neuroblastomas.

METHODS

A total of 120 patients with neuroblastomas and baseline MR imaging examination available were identified of whom 74 (mean age ± standard deviation [SD] of 6 years and 2 months ± 4 years and 9 months; 43 females and 31 males, 14 MYCN amplified) underwent imaging at our institution. This was therefore used to develop radiomics models. The model was tested in a cohort of children with the same diagnosis but imaged elsewhere (n = 46, mean age ± SD: 5 years 11 months ± 3 years 9 months, 26 females and 14 MYCN amplified). Whole tumour volumes of interest were adopted to extract first-order histogram and second-order radiomics features. Interclass correlation coefficient and maximum relevance and minimum redundancy algorithm were applied for feature selection. Logistic regression, support vector machine, and random forest were employed as the classifiers. Receiver operating characteristic (ROC) analysis was performed to evaluate the diagnostic accuracy of the classifiers on the external test set.

RESULTS

The logistic regression model and the random forest both showed an AUC of 0.75. The support vector machine classifier obtained an AUC of 0.78 on the test set with a sensitivity of 64% and a specificity of 72%.

CONCLUSION

The study provides preliminary retrospective evidence demonstrating the feasibility of MRI radiomics in predicting MYCN amplification in neuroblastomas. Future studies are needed to explore the correlation between other imaging features and genetic markers and to develop multiclass predictive models.

KEY POINTS

• MYCN amplification in neuroblastomas is an important determinant of disease prognosis. • Radiomics analysis of pre-treatment MR examinations can be used to predict MYCN amplification in neuroblastomas. • Radiomics machine learning models showed good generalisability to external test set, demonstrating reproducibility of the computational models.

The Río Hortega University Hospital Glioblastoma dataset: A comprehensive collection of preoperative, early postoperative and recurrence MRI scans (RHUH-GBM)

Glioblastoma, a highly aggressive primary brain tumor, is associated with poor patient outcomes. Although magnetic resonance imaging (MRI) plays a critical role in diagnosing, characterizing, and forecasting glioblastoma progression, public MRI repositories present significant drawbacks, including insufficient postoperative and follow-up studies as well as expert tumor segmentations. To address these issues, we present the "Río Hortega University Hospital Glioblastoma Dataset (RHUH-GBM)," a collection of multiparametric MRI images, volumetric assessments, molecular data, and survival details for glioblastoma patients who underwent total or near-total enhancing tumor resection. The dataset features expert-corrected segmentations of tumor subregions, offering valuable ground truth data for developing algorithms for postoperative and follow-up MRI scans.

Current role of machine learning and radiogenomics in precision neuro-oncology

In the past few years, artificial intelligence (AI) has been increasingly used to create tools that can enhance workflow in medicine. In particular, neuro-oncology has benefited from the use of AI and especially machine learning (ML) and radiogenomics, which are subfields of AI. ML can be used to develop algorithms that dynamically learn from available medical data in order to automatically do specific tasks. On the other hand, radiogenomics can identify relationships between tumor genetics and imaging features, thus possibly giving new insights into the pathophysiology of tumors. Therefore, ML and radiogenomics could help treatment tailoring, which is crucial in personalized neuro-oncology. The aim of this review is to illustrate current and possible future applications of ML and radiomics in neuro-oncology.

Within-Modality Synthesis and Novel Radiomic Evaluation of Brain MRI Scans

One of the most common challenges in brain MRI scans is to perform different MRI sequences depending on the type and properties of tissues. In this paper, we propose a generative method to translate T2-Weighted (T2W) Magnetic Resonance Imaging (MRI) volume from T2-weight-Fluid-attenuated-Inversion-Recovery (FLAIR) and vice versa using Generative Adversarial Networks (GAN). To evaluate the proposed method, we propose a novel evaluation schema for generative and synthetic approaches based on radiomic features. For the evaluation purpose, we consider 510 pair-slices from 102 patients to train two different GAN-based architectures Cycle GAN and Dual Cycle-Consistent Adversarial network (DC²Anet). The results indicate that generative methods can produce similar results to the original sequence without significant change in the radiometric feature. Therefore, such a method can assist clinics to make decisions based on the generated image when different sequences are not available or there is not enough time to re-perform the MRI scans.

The Brain Tumor Segmentation (BraTS) Challenge 2023: Brain MR Image Synthesis for Tumor Segmentation (BraSyn)

Automated brain tumor segmentation methods have become well-established and reached performance levels offering clear clinical utility. These methods typically rely on four input magnetic resonance imaging (MRI) modalities: T1-weighted images with and without contrast enhancement, T2-weighted images, and FLAIR images. However, some sequences are often missing in clinical practice due to time constraints or image artifacts, such as patient motion. Consequently, the ability to substitute missing modalities and gain segmentation performance is highly desirable and necessary for the broader adoption of these algorithms in the clinical routine. In this work, we present the establishment of the Brain MR Image Synthesis Benchmark (BraSyn) in conjunction with the Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2023. The primary objective of this challenge is to evaluate image synthesis methods that can realistically generate missing MRI modalities when multiple available images are provided. The ultimate aim is to facilitate automated brain tumor segmentation pipelines. The image dataset used in the benchmark is diverse and multi-modal, created through collaboration with various hospitals and research institutions.

Integrative Imaging Informatics for Cancer Research: Workflow Automation for Neuro-Oncology (I3CR-WANO)

PURPOSE

Efforts to use growing volumes of clinical imaging data to generate tumor evaluations continue to require significant manual data wrangling, owing to data heterogeneity. Here, we propose an artificial intelligence-based solution for the aggregation and processing of multisequence neuro-oncology MRI data to extract quantitative tumor measurements.

MATERIALS AND METHODS

Our end-to-end framework (1) classifies MRI sequences using an ensemble classifier, (2) preprocesses the data in a reproducible manner, (3) delineates tumor tissue subtypes using convolutional neural networks, and (4) extracts diverse radiomic features. Moreover, it is robust to missing sequences and adopts an expert-in-the-loop approach in which the segmentation results may be manually refined by radiologists. After the implementation of the framework in Docker containers, it was applied to two retrospective glioma data sets collected from the Washington University School of Medicine (WUSM; n = 384) and The University of Texas MD Anderson Cancer Center (MDA; n = 30), comprising preoperative MRI scans from patients with pathologically confirmed gliomas.

RESULTS

The scan-type classifier yielded an accuracy of >99%, correctly identifying sequences from 380 of 384 and 30 of 30 sessions from the WUSM and MDA data sets, respectively. Segmentation performance was quantified using the Dice Similarity Coefficient between the predicted and expert-refined tumor masks. The mean Dice scores were 0.882 (±0.244) and 0.977 (±0.04) for whole-tumor segmentation for WUSM and MDA, respectively.

CONCLUSION

This streamlined framework automatically curated, processed, and segmented raw MRI data of patients with varying grades of gliomas, enabling the curation of large-scale neuro-oncology data sets and demonstrating high potential for integration as an assistive tool in clinical practice.

MRI-Based Deep Learning Tools for MGMT Promoter Methylation Detection: A Thorough Evaluation

Glioblastoma is the most aggressive primary brain tumor, which almost systematically relapses despite surgery (when possible) followed by radio-chemotherapy temozolomide-based treatment. Upon relapse, one option for treatment is another chemotherapy, lomustine. The efficacy of these chemotherapy regimens depends on the methylation of a specific gene promoter known as MGMT, which is the main prognosis factor for glioblastoma. Knowing this biomarker is a key issue for the clinician to personalize and adapt treatment to the patient at primary diagnosis for elderly patients, in particular, and also upon relapse. The association between MRI-derived information and the prediction of MGMT promoter status has been discussed in many studies, and some, more recently, have proposed the use of deep learning algorithms on multimodal scans to extract this information, but they have failed to reach a consensus. Therefore, in this work, beyond the classical performance figures usually displayed, we seek to compute confidence scores to see if a clinical application of such methods can be seriously considered. The systematic approach carried out, using different input configurations and algorithms as well as the exact methylation percentage, led to the following conclusion: current deep learning methods are unable to determine MGMT promoter methylation from MRI data.

Peri-implant diseases diagnosis, prognosis and dental implant monitoring: a narrative review of novel strategies and clinical impact

BACKGROUND

The diagnosis of peri-implantar and periodontal relies mainly on a set of clinical measures and the evaluation of radiographic images. However, these clinical settings alone are not sufficient to determine, much less predict, periimplant bone loss or future implant failure. Early diagnosis of periimplant diseases and its rate of progress may be possible through biomarkers assessment. Once identified, biomarkers of peri-implant and periodontal tissue destruction may alert the clinicians before clinical signs show up. Therefore, it is important to consider developing chair-side diagnostic tests with specificity for a particular biomarker, indicating the current activity of the disease.

METHODS

A search strategy was created at Pubmed and Web of Science to answer the question: "How the molecular point-of-care tests currently available can help in the early detection of peri-implant diseases and throws light on improvements in point of care diagnostics devices?"

RESULTS

The PerioSafe® PRO DRS (dentognostics GmbH, Jena) and ImplantSafe® DR (dentognostics GmbH, Jena ORALyzer® test kits, already used clinically, can be a helpful adjunct tool in enhancing the diagnosis and prognosis of periodontal/peri-implantar diseases. With the advances of sensor technology, the biosensors can perform daily monitoring of dental implants or periodontal diseases, making contributions to personal healthcare and improve the current status quo of health management and human health.

CONCLUSIONS

Based on the findings, more emphasis is given to the role of biomarkers in diagnosing and monitoring periodontal and peri-implant diseases. By combining these strategies with traditional protocols, professionals could increase the accuracy of early detection of peri-implant and periodontal diseases, predicting disease progression, and monitoring of treatment outcomes.

Radiomic tumor phenotypes augment molecular profiling in predicting recurrence free survival after breast neoadjuvant chemotherapy

BACKGROUND

Early changes in breast intratumor heterogeneity during neoadjuvant chemotherapy may reflect the tumor's ability to adapt and evade treatment. We investigated the combination of precision medicine predictors of genomic and MRI data towards improved prediction of recurrence free survival (RFS).

METHODS

A total of 100 women from the ACRIN 6657/I-SPY 1 trial were retrospectively analyzed. We estimated MammaPrint, PAM50 ROR-S, and p53 mutation scores from publicly available gene expression data and generated four, voxel-wise 3-D radiomic kinetic maps from DCE-MR images at both pre- and early-treatment time points. Within the primary lesion from each kinetic map, features of change in radiomic heterogeneity were summarized into 6 principal components.

RESULTS

We identify two imaging phenotypes of change in intratumor heterogeneity (p < 0.01) demonstrating significant Kaplan-Meier curve separation (p < 0.001). Adding phenotypes to established prognostic factors, functional tumor volume (FTV), MammaPrint, PAM50, and p53 scores in a Cox regression model improves the concordance statistic for predicting RFS from 0.73 to 0.79 (p = 0.002).

CONCLUSIONS

These results demonstrate an important step in combining personalized molecular signatures and longitudinal imaging data towards improved prognosis.

Predicting Regions of Local Recurrence in Glioblastomas Using Voxel-Based Radiomic Features of Multiparametric Postoperative MRI

The globally accepted surgical strategy in glioblastomas is removing the enhancing tumor. However, the peritumoral region harbors infiltration areas responsible for future tumor recurrence. This study aimed to evaluate a predictive model that identifies areas of future recurrence using a voxel-based radiomics analysis of magnetic resonance imaging (MRI) data. This multi-institutional study included a retrospective analysis of patients diagnosed with glioblastoma who underwent surgery with complete resection of the enhancing tumor. Fifty-five patients met the selection criteria. The study sample was split into training (N = 40) and testing (N = 15) datasets. Follow-up MRI was used for ground truth definition, and postoperative structural multiparametric MRI was used to extract voxel-based radiomic features. Deformable coregistration was used to register the MRI sequences for each patient, followed by segmentation of the peritumoral region in the postoperative scan and the enhancing tumor in the follow-up scan. Peritumoral voxels overlapping with enhancing tumor voxels were labeled as recurrence, while non-overlapping voxels were labeled as nonrecurrence. Voxel-based radiomic features were extracted from the peritumoral region. Four machine learning-based classifiers were trained for recurrence prediction. A region-based evaluation approach was used for model evaluation. The Categorical Boosting (CatBoost) classifier obtained the best performance on the testing dataset with an average area under the curve (AUC) of 0.81 ± 0.09 and an accuracy of 0.84 ± 0.06, using region-based evaluation. There was a clear visual correspondence between predicted and actual recurrence regions. We have developed a method that accurately predicts the region of future tumor recurrence in MRI scans of glioblastoma patients. This could enable the adaptation of surgical and radiotherapy treatment to these areas to potentially prolong the survival of these patients.

Radiogenomic classification for MGMT promoter methylation status using multi-omics fused feature space for least invasive diagnosis through mpMRI scans

Accurate radiogenomic classification of brain tumors is important to improve the standard of diagnosis, prognosis, and treatment planning for patients with glioblastoma. In this study, we propose a novel two-stage MGMT Promoter Methylation Prediction (MGMT-PMP) system that extracts latent features fused with radiomic features predicting the genetic subtype of glioblastoma. A novel fine-tuned deep learning architecture, namely Deep Learning Radiomic Feature Extraction (DLRFE) module, is proposed for latent feature extraction that fuses the quantitative knowledge to the spatial distribution and the size of tumorous structure through radiomic features: (GLCM, HOG, and LBP). The application of the novice rejection algorithm has been found significantly effective in selecting and isolating the negative training instances out of the original dataset. The fused feature vectors are then used for training and testing by k-NN and SVM classifiers. The 2021 RSNA Brain Tumor challenge dataset (BraTS-2021) consists of four structural mpMRIs, viz. fluid-attenuated inversion-recovery, T1-weighted, T1-weighted contrast enhancement, and T2-weighted. We evaluated the classification performance, for the very first time in published form, in terms of measures like accuracy, F₁-score, and Matthews correlation coefficient. The Jackknife tenfold cross-validation was used for training and testing BraTS-2021 dataset validation. The highest classification performance is (96.84 ± 0.09)%, (96.08 ± 0.10)%, and (97.44 ± 0.14)% as accuracy, sensitivity, and specificity respectively to detect MGMT methylation status for patients suffering from glioblastoma. Deep learning feature extraction with radiogenomic features, fusing imaging phenotypes and molecular structure, using rejection algorithm has been found to perform outclass capable of detecting MGMT methylation status of glioblastoma patients. The approach relates the genomic variation with radiomic features forming a bridge between two areas of research that may prove useful for clinical treatment planning leading to better outcomes.

Unsupervised machine learning using K-means identifies radiomic subgroups of pediatric low-grade gliomas that correlate with key molecular markers

INTRODUCTION

Despite advancements in molecular and histopathologic characterization of pediatric low-grade gliomas (pLGGs), there remains significant phenotypic heterogeneity among tumors with similar categorizations. We hypothesized that an unsupervised machine learning approach based on radiomic features may reveal distinct pLGG imaging subtypes.

METHODS

Multi-parametric MR images (T1 pre- and post-contrast, T2, and T2 FLAIR) from 157 patients with pLGGs were collected and 881 quantitative radiomic features were extracted from tumorous region. Clustering was performed using K-means after applying principal component analysis (PCA) for feature dimensionality reduction. Molecular and demographic data was obtained from the PedCBioportal and compared between imaging subtypes.

RESULTS

K-means identified three distinct imaging-based subtypes. Subtypes differed in mutational frequencies of BRAF (p < 0.05) as well as the gene expression of BRAF (p<0.05). It was also found that age (p < 0.05), tumor location (p < 0.01), and tumor histology (p < 0.0001) differed significantly between the imaging subtypes.

CONCLUSION

In this exploratory work, it was found that clustering of pLGGs based on radiomic features identifies distinct, imaging-based subtypes that correlate with important molecular markers and demographic details. This finding supports the notion that incorporation of radiomic data could augment our ability to better characterize pLGGs.

Multiparametric Quantitative Imaging Biomarker as a Multivariate Descriptor of Health: A Roadmap

Multiparametric quantitative imaging biomarkers (QIBs) offer distinct advantages over single, univariate descriptors because they provide a more complete measure of complex, multidimensional biological systems. In disease, where structural and functional disturbances occur across a multitude of subsystems, multivariate QIBs are needed to measure the extent of system malfunction. This paper, the first Use Case in a series of articles on multiparameter imaging biomarkers, considers multiple QIBs as a multidimensional vector to represent all relevant disease constructs more completely. The approach proposed offers several advantages over QIBs as multiple endpoints and avoids combining them into a single composite that obscures the medical meaning of the individual measurements. We focus on establishing statistically rigorous methods to create a single, simultaneous measure from multiple QIBs that preserves the sensitivity of each univariate QIB while incorporating the correlation among QIBs. Details are provided for metrological methods to quantify the technical performance. Methods to reduce the set of QIBs, test the superiority of the mp-QIB model to any univariate QIB model, and design study strategies for generating precision and validity claims are also provided. QIBs of Alzheimer's Disease from the ADNI merge data set are used as a case study to illustrate the methods described.

Federated learning enables big data for rare cancer boundary detection

Although machine learning (ML) has shown promise across disciplines, out-of-sample generalizability is concerning. This is currently addressed by sharing multi-site data, but such centralization is challenging/infeasible to scale due to various limitations. Federated ML (FL) provides an alternative paradigm for accurate and generalizable ML, by only sharing numerical model updates. Here we present the largest FL study to-date, involving data from 71 sites across 6 continents, to generate an automatic tumor boundary detector for the rare disease of glioblastoma, reporting the largest such dataset in the literature (n = 6, 314). We demonstrate a 33% delineation improvement for the surgically targetable tumor, and 23% for the complete tumor extent, over a publicly trained model. We anticipate our study to: 1) enable more healthcare studies informed by large diverse data, ensuring meaningful results for rare diseases and underrepresented populations, 2) facilitate further analyses for glioblastoma by releasing our consensus model, and 3) demonstrate the FL effectiveness at such scale and task-complexity as a paradigm shift for multi-site collaborations, alleviating the need for data-sharing.

Cerebrovascular Reactivity Mapping Using Resting-State Functional MRI in Patients With Gliomas

BACKGROUND

Recently, a data-driven regression analysis method was developed to utilize the resting-state (rs) blood oxygenation level-dependent signal for cerebrovascular reactivity (CVR) mapping (rs-CVR), which was previously optimized by comparing with the CO₂ inhalation-based method in health subjects and patients with neurovascular diseases.

PURPOSE

To investigate the agreement of rs-CVR and the CVR mapping with breath-hold MRI (bh-CVR) in patients with gliomas.

STUDY TYPE

Retrospective.

POPULATION

Twenty-five patients (12 males, 13 females; mean age ± SD, 48 ± 13 years) with gliomas.

FIELD STRENGTH/SEQUENCE

Dynamic T2*-weighted gradient-echo echo-planar imaging during a breath-hold paradigm and during the rs on a 3-T scanner.

ASSESSMENT

rs-CVR with various frequency ranges and resting-state fluctuation amplitude (RSFA) were assessed. The agreement between each rs-based CVR measurement and bh-CVR was determined by voxel-wise correlation and Dice coefficient in the whole brain, gray matter, and the lesion region of interest (ROI).

STATISTICAL TESTS

Voxel-wise Pearson correlation, Dice coefficient, Fisher Z-transformation, repeated-measure analysis of variance and post hoc test with Bonferroni correction, and nonparametric repeated-measure Friedman test and post hoc test with Bonferroni correction were used. Significance was set at P < 0.05.

RESULTS

Compared with bh-CVR, the highest correlations were found at the frequency bands of 0.04-0.08 Hz and 0.02-0.04 Hz for rs-CVR in both whole brain and the lesion ROI. RSFA had significantly lower correlations than did rs-CVR of 0.02-0.04 Hz and a wider frequency range (0-0.1164 Hz). Significantly higher correlations and Dice coefficient were found in normal tissues than in the lesion ROI for all three methods.

DATA CONCLUSION

The optimal frequency ranges for rs-CVR are determined by comparing with bh-CVR in patients with gliomas. The rs-CVR method outperformed the RSFA. Significantly higher correlation and Dice coefficient between rs- and bh-CVR were found in normal tissue than in the lesion.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY STAGE: 2.

Improved generalized ComBat methods for harmonization of radiomic features

Radiomic approaches in precision medicine are promising, but variation associated with image acquisition factors can result in severe biases and low generalizability. Multicenter datasets used in these studies are often heterogeneous in multiple imaging parameters and/or have missing information, resulting in multimodal radiomic feature distributions. ComBat is a promising harmonization tool, but it only harmonizes by single/known variables and assumes standardized input data are normally distributed. We propose a procedure that sequentially harmonizes for multiple batch effects in an optimized order, called OPNested ComBat. Furthermore, we propose to address bimodality by employing a Gaussian Mixture Model (GMM) grouping considered as either a batch variable (OPNested + GMM) or as a protected clinical covariate (OPNested - GMM). Methods were evaluated on features extracted with CapTK and PyRadiomics from two public lung computed tomography (CT) datasets. We found that OPNested ComBat improved harmonization performance over standard ComBat. OPNested + GMM ComBat exhibited the best harmonization performance but the lowest predictive performance, while OPNested - GMM ComBat showed poorer harmonization performance, but the highest predictive performance. Our findings emphasize that improved harmonization performance is no guarantee of improved predictive performance, and that these methods show promise for superior standardization of datasets heterogeneous in multiple or unknown imaging parameters and greater generalizability.

The federated tumor segmentation (FeTS) tool: an open-source solution to further solid tumor research

Objective.De-centralized data analysis becomes an increasingly preferred option in the healthcare domain, as it alleviates the need for sharing primary patient data across collaborating institutions. This highlights the need for consistent harmonized data curation, pre-processing, and identification of regions of interest based on uniform criteria.Approach.Towards this end, this manuscript describes theFederatedTumorSegmentation (FeTS) tool, in terms of software architecture and functionality.Main results.The primary aim of the FeTS tool is to facilitate this harmonized processing and the generation of gold standard reference labels for tumor sub-compartments on brain magnetic resonance imaging, and further enable federated training of a tumor sub-compartment delineation model across numerous sites distributed across the globe, without the need to share patient data.Significance.Building upon existing open-source tools such as the Insight Toolkit and Qt, the FeTS tool is designed to enable training deep learning models targeting tumor delineation in either centralized or federated settings. The target audience of the FeTS tool is primarily the computational researcher interested in developing federated learning models, and interested in joining a global federation towards this effort. The tool is open sourced athttps://github.com/FETS-AI/Front-End.

The University of Pennsylvania glioblastoma (UPenn-GBM) cohort: advanced MRI, clinical, genomics, & radiomics

Glioblastoma is the most common aggressive adult brain tumor. Numerous studies have reported results from either private institutional data or publicly available datasets. However, current public datasets are limited in terms of: a) number of subjects, b) lack of consistent acquisition protocol, c) data quality, or d) accompanying clinical, demographic, and molecular information. Toward alleviating these limitations, we contribute the "University of Pennsylvania Glioblastoma Imaging, Genomics, and Radiomics" (UPenn-GBM) dataset, which describes the currently largest publicly available comprehensive collection of 630 patients diagnosed with de novo glioblastoma. The UPenn-GBM dataset includes (a) advanced multi-parametric magnetic resonance imaging scans acquired during routine clinical practice, at the University of Pennsylvania Health System, (b) accompanying clinical, demographic, and molecular information, (d) perfusion and diffusion derivative volumes, (e) computationally-derived and manually-revised expert annotations of tumor sub-regions, as well as (f) quantitative imaging (also known as radiomic) features corresponding to each of these regions. This collection describes our contribution towards repeatable, reproducible, and comparative quantitative studies leading to new predictive, prognostic, and diagnostic assessments.

Expert tumor annotations and radiomics for locally advanced breast cancer in DCE-MRI for ACRIN 6657/I-SPY1

Breast cancer is one of the most pervasive forms of cancer and its inherent intra- and inter-tumor heterogeneity contributes towards its poor prognosis. Multiple studies have reported results from either private institutional data or publicly available datasets. However, current public datasets are limited in terms of having consistency in: a) data quality, b) quality of expert annotation of pathology, and c) availability of baseline results from computational algorithms. To address these limitations, here we propose the enhancement of the I-SPY1 data collection, with uniformly curated data, tumor annotations, and quantitative imaging features. Specifically, the proposed dataset includes a) uniformly processed scans that are harmonized to match intensity and spatial characteristics, facilitating immediate use in computational studies, b) computationally-generated and manually-revised expert annotations of tumor regions, as well as c) a comprehensive set of quantitative imaging (also known as radiomic) features corresponding to the tumor regions. This collection describes our contribution towards repeatable, reproducible, and comparative quantitative studies leading to new predictive, prognostic, and diagnostic assessments.

The New Era of Salivaomics in Dentistry: Frontiers and Facts in the Early Diagnosis and Prevention of Oral Diseases and Cancer

Nowadays, with the development of new and highly sensitive, blood is not the only medium of choice for the diagnosis of several diseases and pathological conditions. Saliva is now considered a safe and non-invasive sample to study oral and systemic diseases, showing great diagnostic potential. According to several recent studies, saliva has emerged as an emerging biofluid for the early diagnosis of several diseases, indicated as a mirror of oral and systemic health and a valuable source of clinically relevant information. Indeed, several studies have observed that saliva is useful for detecting and diagnosing malignant tumours, human immunodeficiency virus, heart disease, and autoimmune diseases. The growing realisation that saliva is an inexhaustible source of information has led to the coining of the term ‘Salivaomics’, which includes five “omics” in connection with the main constituents of saliva: genome and epigenome, transcriptomics, metabolomics, lipidomics, proteomics and microbiota. All those may be changed by disease state, so they offer significant advantages in the early diagnosis and prognosis of oral diseases. The aim of the present review isto update and highlight the new frontiers of salivaomics in diagnosing and managing oral disorders, such as periodontitis, premalignant disorders, and oral squamous cell carcinoma (OSCC).

Radiomic Deformation and Textural Heterogeneity (R-DepTH) Descriptor to Characterize Tumor Field Effect: Application to Survival Prediction in Glioblastoma

The concept of tumor field effect implies that cancer is a systemic disease with its impact way beyond the visible tumor confines. For instance, in Glioblastoma (GBM), an aggressive brain tumor, the increase in intracranial pressure due to tumor burden often leads to brain herniation and poor outcomes. Our work is based on the rationale that highly aggressive tumors tend to grow uncontrollably, leading to pronounced biomechanical tissue deformations in the normal parenchyma, which when combined with local morphological differences in the tumor confines on MRI scans, will comprehensively capture tumor field effect. Specifically, we present an integrated MRI-based descriptor, radiomic-Deformation and Textural Heterogeneity (r-DepTH). This descriptor comprises measurements of the subtle perturbations in tissue deformations throughout the surrounding normal parenchyma due to mass effect. This involves non-rigidly aligning the patients' MRI scans to a healthy atlas via diffeomorphic registration. The resulting inverse mapping is used to obtain the deformation field magnitudes in the normal parenchyma. These measurements are then combined with a 3D texture descriptor, Co-occurrence of Local Anisotropic Gradient Orientations (COLLAGE), which captures the morphological heterogeneity and infiltration within the tumor confines, on MRI scans. In this work, we extensively evaluated r-DepTH for survival risk-stratification on a total of 207 GBM cases from 3 different cohorts (Cohort 1 ( n1 = 53 ), Cohort 2 ( n2 = 75 ), and Cohort 3 ( n3 = 79 )), where each of these three cohorts was used as a training set for our model separately, and the other two cohorts were used for testing, independently, for each training experiment. When employing Cohort 1 for training, r-DepTH yielded Concordance indices (C-indices) of 0.7 and 0.65, hazard ratios (HR) and Confidence Intervals (CI) of 10 (6 - 19) and 5 (3 - 8) on Cohorts 2 and 3, respectively. Similarly, training on Cohort 2 yielded C-indices of 0.6 and 0.7, HR and CI of 1 (0.7 - 2) and 3 (2 - 5) on Cohorts 1 and 3, respectively. Finally, training on Cohort 3 yielded C-indices of 0.75 and 0.63, HR and CI of 24 (10 - 57) and 12 (6 - 21) on Cohorts 1 and 2, respectively. Our results show that r-DepTH descriptor may serve as a comprehensive and a robust MRI-based prognostic marker of disease aggressiveness and survival in solid tumors.

Enhancing the REMBRANDT MRI collection with expert segmentation labels and quantitative radiomic features

Malignancy of the brain and CNS is unfortunately a common diagnosis. A large subset of these lesions tends to be high grade tumors which portend poor prognoses and low survival rates, and are estimated to be the tenth leading cause of death worldwide. The complex nature of the brain tissue environment in which these lesions arise offers a rich opportunity for translational research. Magnetic Resonance Imaging (MRI) can provide a comprehensive view of the abnormal regions in the brain, therefore, its applications in the translational brain cancer research is considered essential for the diagnosis and monitoring of disease. Recent years has seen rapid growth in the field of radiogenomics, especially in cancer, and scientists have been able to successfully integrate the quantitative data extracted from medical images (also known as radiomics) with genomics to answer new and clinically relevant questions. In this paper, we took raw MRI scans from the REMBRANDT data collection from public domain, and performed volumetric segmentation to identify subregions of the brain. Radiomic features were then extracted to represent the MRIs in a quantitative yet summarized format. This resulting dataset now enables further biomedical and integrative data analysis, and is being made public via the NeuroImaging Tools & Resources Collaboratory (NITRC) repository ( https://www.nitrc.org/projects/rembrandt_brain/ ).

Impact of deformable registration methods for prediction of recurrence free survival response to neoadjuvant chemotherapy in breast cancer: Results from the ISPY 1/ACRIN 6657 trial

PURPOSE

Image registration plays a vital role in spatially aligning multiple MRI scans for better longitudinal assessment of tumor morphological features. The objective was to evaluate the effect of registration accuracy of six established deformable registration methods(ANTs, DRAMMS, ART, NiftyReg, SSD-FFD, and NMI-FFD) on the predictive value of extracted radiomic features when modeling recurrence-free-survival(RFS) for women after neoadjuvant chemotherapy(NAC) for locally advanced breast cancer.

METHODS

130 women had DCE-MRI scans available from the first two visits in the ISPY1/ACRIN-6657 cohort. We calculated the transformation field from each of the different deformable registration methods, and used it to compute voxel-wise parametric-response-maps(PRM) for established four kinetic features.104-radiomic features were computed from each PRM map to characterize intra-tumor heterogeneity. We evaluated performance for RFS using Cox-regression, C-statistic, and Kaplan-Meier(KM) plots.

RESULTS

A baseline model(F1:Age, Race, and Hormone-receptor-status) had a 0.54 C-statistic, and model F2(baseline + functional-tumor-volume at early treatment visit(FTV₂)) had 0.63. The F2+ANTs had the highest C-statistic(0.72) with the smallest landmark differences(5.40±4.40mm) as compared to other models. The KM curve for model F2 gave p=0.004 for separation between women above and below the median hazard compared to the model F1(p=0.31). A models augmented with radiomic features, also achieved significant KM curve separation(p<0.001) except the F2+ART model.

CONCLUSION

Incorporating image registration in quantifying changes in tumor heterogeneity during NAC can improve prediction of RFS. Radiomic features of PRM maps derived from warping the DCE-MRI kinetic maps using ANTs registration method further improved the early prediction of RFS as compared to other methods.

Clinical measures, radiomics, and genomics offer synergistic value in AI-based prediction of overall survival in patients with glioblastoma

Multi-omic data, i.e., clinical measures, radiomic, and genetic data, capture multi-faceted tumor characteristics, contributing to a comprehensive patient risk assessment. Here, we investigate the additive value and independent reproducibility of integrated diagnostics in prediction of overall survival (OS) in isocitrate dehydrogenase (IDH)-wildtype GBM patients, by combining conventional and deep learning methods. Conventional radiomics and deep learning features were extracted from pre-operative multi-parametric MRI of 516 GBM patients. Support vector machine (SVM) classifiers were trained on the radiomic features in the discovery cohort (n = 404) to categorize patient groups of high-risk (OS < 6 months) vs all, and low-risk (OS ≥ 18 months) vs all. The trained radiomic model was independently tested in the replication cohort (n = 112) and a patient-wise survival prediction index was produced. Multivariate Cox-PH models were generated for the replication cohort, first based on clinical measures solely, and then by layering on radiomics and molecular information. Evaluation of the high-risk and low-risk classifiers in the discovery/replication cohorts revealed area under the ROC curves (AUCs) of 0.78 (95% CI 0.70-0.85)/0.75 (95% CI 0.64-0.79) and 0.75 (95% CI 0.65-0.84)/0.63 (95% CI 0.52-0.71), respectively. Cox-PH modeling showed a concordance index of 0.65 (95% CI 0.6-0.7) for clinical data improving to 0.75 (95% CI 0.72-0.79) for the combination of all omics. This study signifies the value of integrated diagnostics for improved prediction of OS in GBM.

Generalized ComBat harmonization methods for radiomic features with multi-modal distributions and multiple batch effects

Radiomic features have a wide range of clinical applications, but variability due to image acquisition factors can affect their performance. The harmonization tool ComBat is a promising solution but is limited by inability to harmonize multimodal distributions, unknown imaging parameters, and multiple imaging parameters. In this study, we propose two methods for addressing these limitations. We propose a sequential method that allows for harmonization of radiomic features by multiple imaging parameters (Nested ComBat). We also employ a Gaussian Mixture Model (GMM)-based method (GMM ComBat) where scans are split into groupings based on the shape of the distribution used for harmonization as a batch effect and subsequent harmonization by a known imaging parameter. These two methods were evaluated on features extracted with CapTK and PyRadiomics from two public lung computed tomography datasets. We found that Nested ComBat exhibited similar performance to standard ComBat in reducing the percentage of features with statistically significant differences in distribution attributable to imaging parameters. GMM ComBat improved harmonization performance over standard ComBat (− 11%, − 10% for Lung3/CAPTK, Lung3/PyRadiomics harmonizing by kernel resolution). Features harmonized with a variant of the Nested method and the GMM split method demonstrated similar c-statistics and Kaplan–Meier curves when used in survival analyses.

Non-Invasive Profiling of Advanced Prostate Cancer via Multi-Parametric Liquid Biopsy and Radiomic Analysis

Integrating liquid biopsies of circulating tumor cells (CTCs) and cell-free DNA (cfDNA) with other minimally invasive measures may yield more comprehensive disease profiles. We evaluated the feasibility of concurrent cellular and molecular analysis of CTCs and cfDNA combined with radiomic analysis of CT scans from patients with metastatic castration-resistant PC (mCRPC). CTCs from 22 patients were enumerated, stained for PC-relevant markers, and clustered based on morphometric and immunofluorescent features using machine learning. DNA from single CTCs, matched cfDNA, and buffy coats was sequenced using a targeted amplicon cancer hotspot panel. Radiomic analysis was performed on bone metastases identified on CT scans from the same patients. CTCs were detected in 77% of patients and clustered reproducibly. cfDNA sequencing had high sensitivity (98.8%) for germline variants compared to WBC. Shared and unique somatic variants in PC-related genes were detected in cfDNA in 45% of patients (MAF > 0.1%) and in CTCs in 92% of patients (MAF > 10%). Radiomic analysis identified a signature that strongly correlated with CTC count and plasma cfDNA level. Integration of cellular, molecular, and radiomic data in a multi-parametric approach is feasible, yielding complementary profiles that may enable more comprehensive non-invasive disease modeling and prediction.

Imaging Biomarkers of Glioblastoma Treatment Response: A Systematic Review and Meta-Analysis of Recent Machine Learning Studies

OBJECTIVE

Monitoring biomarkers using machine learning (ML) may determine glioblastoma treatment response. We systematically reviewed quality and performance accuracy of recently published studies.

METHODS

Following Preferred Reporting Items for Systematic Reviews and Meta-Analysis: Diagnostic Test Accuracy, we extracted articles from MEDLINE, EMBASE and Cochrane Register between 09/2018-01/2021. Included study participants were adults with glioblastoma having undergone standard treatment (maximal resection, radiotherapy with concomitant and adjuvant temozolomide), and follow-up imaging to determine treatment response status (specifically, distinguishing progression/recurrence from progression/recurrence mimics, the target condition). Using Quality Assessment of Diagnostic Accuracy Studies Two/Checklist for Artificial Intelligence in Medical Imaging, we assessed bias risk and applicability concerns. We determined test set performance accuracy (sensitivity, specificity, precision, F1-score, balanced accuracy). We used a bivariate random-effect model to determine pooled sensitivity, specificity, area-under the receiver operator characteristic curve (ROC-AUC). Pooled measures of balanced accuracy, positive/negative likelihood ratios (PLR/NLR) and diagnostic odds ratio (DOR) were calculated. PROSPERO registered (CRD42021261965).

RESULTS

Eighteen studies were included (1335/384 patients for training/testing respectively). Small patient numbers, high bias risk, applicability concerns (particularly confounding in reference standard and patient selection) and low level of evidence, allow limited conclusions from studies. Ten studies (10/18, 56%) included in meta-analysis gave 0.769 (0.649-0.858) sensitivity [pooled (95% CI)]; 0.648 (0.749-0.532) specificity; 0.706 (0.623-0.779) balanced accuracy; 2.220 (1.560-3.140) PLR; 0.366 (0.213-0.572) NLR; 6.670 (2.800-13.500) DOR; 0.765 ROC-AUC.

CONCLUSION

ML models using MRI features to distinguish between progression and mimics appear to demonstrate good diagnostic performance. However, study quality and design require improvement.

Differentiation of paediatric posterior fossa tumours by the multiregional and multiparametric MRI radiomics approach: a study on the selection of optimal multiple sequences and multiregions

OBJECTIVE

To evaluate the diagnostic performance of a radiomics model based on multiregional and multiparametric MRI to classify paediatric posterior fossa tumours (PPFTs), explore the contribution of different MR sequences and tumour subregions in tumour classification, and examine whether contrast-enhanced T₁ weighted (T1C) images have irreplaceable added value.

METHODS

This retrospective study of 136 PPFTs extracted 11,958 multiregional (enhanced, non-enhanced, and total tumour) features from multiparametric MRI (T₁- and T₂ weighted, T1C, fluid-attenuated inversion recovery, and diffusion-weighted images). These features were subjected to fast correlation-based feature selection and classified by a support vector machine based on different tasks. Diagnostic performances of multiregional and multiparametric MRI features, different sequences, and different tumoral regions were evaluated using multiclass and one-vs-rest strategies.

RESULTS

The established model achieved an overall area under the curve (AUC) of 0.977 in the validation cohort. The performance of PPFTs significantly improved after replacing T1C with apparent diffusion coefficient maps added into the plain scan sequences (AUC from 0.812 to 0.917). When oedema features were added to contrast-enhancing tumour volume, the performance did not significantly improve.

CONCLUSION

The radiomics model built by multiregional and multiparametric MRI features allows for the excellent distinction of different PPFTs and provides valuable references for the rational adoption of MR sequences.

ADVANCES IN KNOWLEDGE

This study emphasized that T1C has limited added value in predicting PPFTs and should be cautiously adopted. Selecting optimal MR sequences may help guide clinicians to better allocate acquisition sequences and reduce medical costs.

Optimization of Deep Learning Based Brain Extraction in MRI for Low Resource Environments

Brain extraction is an indispensable step in neuro-imaging with a direct impact on downstream analyses. Most such methods have been developed for non-pathologically affected brains, and hence tend to suffer in performance when applied on brains with pathologies, e.g., gliomas, multiple sclerosis, traumatic brain injuries. Deep Learning (DL) methodologies for healthcare have shown promising results, but their clinical translation has been limited, primarily due to these methods suffering from i) high computational cost, and ii) specific hardware requirements, e.g., DL acceleration cards. In this study, we explore the potential of mathematical optimizations, towards making DL methods amenable to application in low resource environments. We focus on both the qualitative and quantitative evaluation of such optimizations on an existing DL brain extraction method, designed for pathologically-affected brains and agnostic to the input modality. We conduct direct optimizations and quantization of the trained model (i.e., prior to inference on new data). Our results yield substantial gains, in terms of speedup, latency, through-put, and reduction in memory usage, while the segmentation performance of the initial and the optimized models remains stable, i.e., as quantified by both the Dice Similarity Coefficient and the Hausdorff Distance. These findings support post-training optimizations as a promising approach for enabling the execution of advanced DL methodologies on plain commercial-grade CPUs, and hence contributing to their translation in limited- and low- resource clinical environments.

Radiomics and radiogenomics in pediatric neuro-oncology: A review

The current era of advanced computing has allowed for the development and implementation of the field of radiomics. In pediatric neuro-oncology, radiomics has been applied in determination of tumor histology, identification of disseminated disease, prognostication, and molecular classification of tumors (ie, radiogenomics). The field also comes with many challenges, such as limitations in study sample sizes, class imbalance, generalizability of the methods, and data harmonization across imaging centers. The aim of this review paper is twofold: first, to summarize existing literature in radiomics of pediatric neuro-oncology; second, to distill the themes and challenges of the field and discuss future directions in both a clinical and technical context.

Incorporating Robustness to Imaging Physics into Radiomic Feature Selection for Breast Cancer Risk Estimation

Digital mammography has seen an explosion in the number of radiomic features used for risk-assessment modeling. However, having more features is not necessarily beneficial, as some features may be overly sensitive to imaging physics (contrast, noise, and image sharpness). To measure the effects of imaging physics, we analyzed the feature variation across imaging acquisition settings (kV, mAs) using an anthropomorphic phantom. We also analyzed the intra-woman variation (IWV), a measure of how much a feature varies between breasts with similar parenchymal patterns-a woman's left and right breasts. From 341 features, we identified "robust" features that minimized the effects of imaging physics and IWV. We also investigated whether robust features offered better case-control classification in an independent data set of 575 images, all with an overall BI-RADS® assessment of 1 (negative) or 2 (benign); 115 images (cases) were of women who developed cancer at least one year after that screening image, matched to 460 controls. We modeled cancer occurrence via logistic regression, using cross-validated area under the receiver-operating-characteristic curve (AUC) to measure model performance. Models using features from the most-robust quartile of features yielded an AUC = 0.59, versus 0.54 for the least-robust, with p < 0.005 for the difference among the quartiles.

Machine Learning Using Multiparametric Magnetic Resonance Imaging Radiomic Feature Analysis to Predict Ki-67 in World Health Organization Grade I Meningiomas

BACKGROUND

Although World Health Organization (WHO) grade I meningiomas are considered "benign" tumors, an elevated Ki-67 is one crucial factor that has been shown to influence tumor behavior and clinical outcomes. The ability to preoperatively discern Ki-67 would confer the ability to guide surgical strategy.

OBJECTIVE

In this study, we develop a machine learning (ML) algorithm using radiomic feature analysis to predict Ki-67 in WHO grade I meningiomas.

METHODS

A retrospective analysis was performed for a cohort of 306 patients who underwent surgical resection of WHO grade I meningiomas. Preoperative magnetic resonance imaging was used to perform radiomic feature extraction followed by ML modeling using least absolute shrinkage and selection operator wrapped with support vector machine through nested cross-validation on a discovery cohort (n = 230), to stratify tumors based on Ki-67 <5% and ≥5%. The final model was independently tested on a replication cohort (n = 76).

RESULTS

An area under the receiver operating curve (AUC) of 0.84 (95% CI: 0.78-0.90) with a sensitivity of 84.1% and specificity of 73.3% was achieved in the discovery cohort. When this model was applied to the replication cohort, a similar high performance was achieved, with an AUC of 0.83 (95% CI: 0.73-0.94), sensitivity and specificity of 82.6% and 85.5%, respectively. The model demonstrated similar efficacy when applied to skull base and nonskull base tumors.

CONCLUSION

Our proposed radiomic feature analysis can be used to stratify WHO grade I meningiomas based on Ki-67 with excellent accuracy and can be applied to skull base and nonskull base tumors with similar performance achieved.

Predicting Short-Term Survival after Gross Total or Near Total Resection in Glioblastomas by Machine Learning-Based Radiomic Analysis of Preoperative MRI

Radiomics, in combination with artificial intelligence, has emerged as a powerful tool for the development of predictive models in neuro-oncology. Our study aims to find an answer to a clinically relevant question: is there a radiomic profile that can identify glioblastoma (GBM) patients with short-term survival after complete tumor resection? A retrospective study of GBM patients who underwent surgery was conducted in two institutions between January 2019 and January 2020, along with cases from public databases. Cases with gross total or near total tumor resection were included. Preoperative structural multiparametric magnetic resonance imaging (mpMRI) sequences were pre-processed, and a total of 15,720 radiomic features were extracted. After feature reduction, machine learning-based classifiers were used to predict early mortality (<6 months). Additionally, a survival analysis was performed using the random survival forest (RSF) algorithm. A total of 203 patients were enrolled in this study. In the classification task, the naive Bayes classifier obtained the best results in the test data set, with an area under the curve (AUC) of 0.769 and classification accuracy of 80%. The RSF model allowed the stratification of patients into low- and high-risk groups. In the test data set, this model obtained values of C-Index = 0.61, IBS = 0.123 and integrated AUC at six months of 0.761. In this study, we developed a reliable predictive model of short-term survival in GBM by applying open-source and user-friendly computational means. These new tools will assist clinicians in adapting our therapeutic approach considering individual patient characteristics.

Benchmarking Various Radiomic Toolkit Features While Applying the Image Biomarker Standardization Initiative toward Clinical Translation of Radiomic Analysis

The image biomarkers standardization initiative (IBSI) was formed to address the standardization of extraction of quantifiable imaging metrics. Despite its effort, there remains a lack of consensus or established guidelines regarding radiomic feature terminology, the underlying mathematics and their implementation across various software programs. This creates a scenario where features extracted using different toolboxes cannot be used to build or validate the same model leading to a non-generalization of radiomic results. In this study, IBSI-established phantom and benchmark values were used to compare the variation of the radiomic features while using 6 publicly available software programs and 1 in-house radiomics pipeline. All IBSI-standardized features (11 classes, 173 in total) were extracted. The relative differences between the extracted feature values from the different software programs and the IBSI benchmark values were calculated to measure the inter-software agreement. To better understand the variations, features are further grouped into 3 categories according to their properties: 1) morphology, 2) statistic/histogram and 3)texture features. While a good agreement was observed for a majority of radiomics features across the various tested programs, relatively poor agreement was observed for morphology features. Significant differences were also found in programs that use different gray-level discretization approaches. Since these software programs do not include all IBSI features, the level of quantitative assessment for each category was analyzed using Venn and UpSet diagrams and quantified using two ad hoc metrics. Morphology features earned lowest scores for both metrics, indicating that morphological features are not consistently evaluated among software programs. We conclude that radiomic features calculated using different software programs may not be interchangeable. Further studies are needed to standardize the workflow of radiomic feature extraction.