Clinical implementation of artificial intelligence in neuroradiology with development of a novel workflow-efficient picture archiving and communication system-based automated brain tumor segmentation and radiomic feature extraction

Comparison of Volumetric and 2D Measurements and Longitudinal Trajectories in the Response Assessment of BRAF V600E-Mutant Pediatric Gliomas in the Pacific Pediatric Neuro-Oncology Consortium Clinical Trial

BACKGROUND AND PURPOSE

Response on imaging is widely used to evaluate treatment efficacy in clinical trials of pediatric gliomas. While conventional criteria rely on 2D measurements, volumetric analysis may provide a more comprehensive response assessment. There is sparse research on the role of volumetrics in pediatric gliomas. Our purpose was to compare 2D and volumetric analysis with the assessment of neuroradiologists using the Brain Tumor Reporting and Data System (BT-RADS) in BRAF V600E-mutant pediatric gliomas.

MATERIALS AND METHODS

Manual volumetric segmentations of whole and solid tumors were compared with 2D measurements in 31 participants (292 follow-up studies) in the Pacific Pediatric Neuro-Oncology Consortium 002 trial (NCT01748149). Two neuroradiologists evaluated responses using BT-RADS. Receiver operating characteristic analysis compared classification performance of 2D and volumetrics for partial response. Agreement between volumetric and 2D mathematically modeled longitudinal trajectories for 25 participants was determined using the model-estimated time to best response.

RESULTS

Of 31 participants, 20 had partial responses according to BT-RADS criteria. Receiver operating characteristic curves for the classification of partial responders at the time of first detection (median = 2 months) yielded an area under the curve of 0.84 (95% CI, 0.69-0.99) for 2D area, 0.91 (95% CI, 0.80-1.00) for whole-volume, and 0.92 (95% CI, 0.82-1.00) for solid volume change. There was no significant difference in the area under the curve between 2D and solid (P = .34) or whole volume (P = .39). There was no significant correlation in model-estimated time to best response (ρ = 0.39, P >.05) between 2D and whole-volume trajectories. Eight of the 25 participants had a difference of ≥90 days in transition from partial response to stable disease between their 2D and whole-volume modeled trajectories.

CONCLUSIONS

Although there was no overall difference between volumetrics and 2D in classifying partial response assessment using BT-RADS, further prospective studies will be critical to elucidate how the observed differences in tumor 2D and volumetric trajectories affect clinical decision-making and outcomes in some individuals.

Young Professionals in Neuroradiology: Opportunities, Challenges, and Future Directions

The Young Professionals Committee of the American Society of Neuroradiology identifies and serves the interests of young professionals in neuroradiology, defined as those still in training or within 5 years of its completion. Being a young professional is an exciting, dynamic, and demanding stage of one's professional career. As the landscape of neuroradiology practice changes, new opportunities and challenges occur for those in the early stage of their career. It is important to recognize and support the needs of young professionals because an investment in their professional development is an investment in the future of our specialty. In this article, we aimed to address the most notable developments relevant to current and future young professionals in neuroradiology as well as highlight the work done by the Young Professionals Committee of the American Society of Neuroradiology in serving the needs of these young professionals, focusing on early neuroradiology engagement, flexible work arrangements, private practice, social media, artificial intelligence, and international collaborations.

A large open access dataset of brain metastasis 3D segmentations on MRI with clinical and imaging information

Resection and whole brain radiotherapy (WBRT) are standard treatments for brain metastases (BM) but are associated with cognitive side effects. Stereotactic radiosurgery (SRS) uses a targeted approach with less side effects than WBRT. SRS requires precise identification and delineation of BM. While artificial intelligence (AI) algorithms have been developed for this, their clinical adoption is limited due to poor model performance in the clinical setting. The limitations of algorithms are often due to the quality of datasets used for training the AI network. The purpose of this study was to create a large, heterogenous, annotated BM dataset for training and validation of AI models. We present a BM dataset of 200 patients with pretreatment T1, T1 post-contrast, T2, and FLAIR MR images. The dataset includes contrast-enhancing and necrotic 3D segmentations on T1 post-contrast and peritumoral edema 3D segmentations on FLAIR. Our dataset contains 975 contrast-enhancing lesions, many of which are sub centimeter, along with clinical and imaging information. We used a streamlined approach to database-building through a PACS-integrated segmentation workflow.

Introduction to the Special Issue on "Role of Novel Imaging Technique in Brain Tumors"

In recent years, significant strides have been made in the field of neuro-oncology imaging, contributing to our understanding and management of brain tumors [...].

Radiomics Features Extracted From Pre- and Postprocedural Imaging in Early Prediction of Treatment Response in Patients Undergoing Transarterial Radioembolization of Hepatic Lesions: A Systematic Review, Meta-Analysis, and Quality Appraisal Study

INTRODUCTION

Transarterial radioembolization (TARE) is one of the most promising therapeutic options for hepatic masses. Radiomics features, which are quantitative numeric features extracted from medical images, are considered to have potential in predicting treatment response in TARE. This article aims to provide meta-analytic evidence and critically appraise the methodology of radiomics studies published in this regard.

METHODS

A systematic search was performed on PubMed, Scopus, Embase, and Web of Science. All relevant articles were retrieved, and the characteristics of the studies were extracted. The Radiomics Quality Score and Checklist for Evaluation of Radiomics Research were used to assess the methodologic quality of the studies. Pooled sensitivity, specificity, and area under the receiver operating characteristic curve in predicting objective response were determined.

RESULTS

The systematic review included 15 studies. The average Radiomics Quality Score of these studies was 11.4 ± 2.1, and the average Checklist for Evaluation of Radiomics Research score was 33± 6.7. There was a notable correlation (correlation coefficient = 0.73) between the two metrics. Adherence to quality measures differed considerably among the studies and even within different components of the same studies. The pooled sensitivity and specificity of the radiomics models in predicting complete or partial response were 83.5% (95% confidence interval 76%-88.9%) and 86.7% (95% confidence interval 78%-92%), respectively.

CONCLUSION

Radiomics models show great potential in predicting treatment response in TARE of hepatic lesions. However, the heterogeneity seen between the methodologic quality of studies may limit the generalizability of the results. Future initiatives should aim to develop radiomics signatures using multiple external datasets and adhere to quality measures in radiomics methodology.

Early prognostication of overall survival for pediatric diffuse midline gliomas using MRI radiomics and machine learning: a two-center study

Background

Diffuse midline gliomas (DMG) are aggressive pediatric brain tumors that are diagnosed and monitored through MRI. We developed an automatic pipeline to segment subregions of DMG and select radiomic features that predict patient overall survival (OS).

Methods

We acquired diagnostic and post-radiation therapy (RT) multisequence MRI (T1, T1ce, T2, T2 FLAIR) and manual segmentations from two centers of 53 (internal cohort) and 16 (external cohort) DMG patients. We pretrained a deep learning model on a public adult brain tumor dataset, and finetuned it to automatically segment tumor core (TC) and whole tumor (WT) volumes. PyRadiomics and sequential feature selection were used for feature extraction and selection based on the segmented volumes. Two machine learning models were trained on our internal cohort to predict patient 1-year survival from diagnosis. One model used only diagnostic tumor features and the other used both diagnostic and post-RT features.

Results

For segmentation, Dice score (mean [median]±SD) was 0.91 (0.94)±0.12 and 0.74 (0.83)±0.32 for TC, and 0.88 (0.91)±0.07 and 0.86 (0.89)±0.06 for WT for internal and external cohorts, respectively. For OS prediction, accuracy was 77% and 81% at time of diagnosis, and 85% and 78% post-RT for internal and external cohorts, respectively. Homogeneous WT intensity in baseline T2 FLAIR and larger post-RT TC/WT volume ratio indicate shorter OS.

Conclusions

Machine learning analysis of MRI radiomics has potential to accurately and non-invasively predict which pediatric patients with DMG will survive less than one year from the time of diagnosis to provide patient stratification and guide therapy.

Comparison of volumetric and 2D-based response methods in the PNOC-001 pediatric low-grade glioma clinical trial

Background

Although response in pediatric low-grade glioma (pLGG) includes volumetric assessment, more simplified 2D-based methods are often used in clinical trials. The study's purpose was to compare volumetric to 2D methods.

Methods

An expert neuroradiologist performed solid and whole tumor (including cyst and edema) volumetric measurements on MR images using a PACS-based manual segmentation tool in 43 pLGG participants (213 total follow-up images) from the Pacific Pediatric Neuro-Oncology Consortium (PNOC-001) trial. Classification based on changes in volumetric and 2D measurements of solid tumor were compared to neuroradiologist visual response assessment using the Brain Tumor Reporting and Data System (BT-RADS) criteria for a subset of 65 images using receiver operating characteristic (ROC) analysis. Longitudinal modeling of solid tumor volume was used to predict BT-RADS classification in 54 of the 65 images.

Results

There was a significant difference in ROC area under the curve between 3D solid tumor volume and 2D area (0.96 vs 0.78, P = .005) and between 3D solid and 3D whole volume (0.96 vs 0.84, P = .006) when classifying BT-RADS progressive disease (PD). Thresholds of 15-25% increase in 3D solid tumor volume had an 80% sensitivity in classifying BT-RADS PD included in their 95% confidence intervals. The longitudinal model of solid volume response had a sensitivity of 82% and a positive predictive value of 67% for detecting BT-RADS PD.

Conclusions

Volumetric analysis of solid tumor was significantly better than 2D measurements in classifying tumor progression as determined by BT-RADS criteria and will enable more comprehensive clinical management.

Application of novel PACS-based informatics platform to identify imaging based predictors of CDKN2A allelic status in glioblastomas

Gliomas with CDKN2A mutations are known to have worse prognosis but imaging features of these gliomas are unknown. Our goal is to identify CDKN2A specific qualitative imaging biomarkers in glioblastomas using a new informatics workflow that enables rapid analysis of qualitative imaging features with Visually AcceSAble Rembrandtr Images (VASARI) for large datasets in PACS. Sixty nine patients undergoing GBM resection with CDKN2A status determined by whole-exome sequencing were included. GBMs on magnetic resonance images were automatically 3D segmented using deep learning algorithms incorporated within PACS. VASARI features were assessed using FHIR forms integrated within PACS. GBMs without CDKN2A alterations were significantly larger (64 vs. 30%, p = 0.007) compared to tumors with homozygous deletion (HOMDEL) and heterozygous loss (HETLOSS). Lesions larger than 8 cm were four times more likely to have no CDKN2A alteration (OR: 4.3; 95% CI 1.5-12.1; p < 0.001). We developed a novel integrated PACS informatics platform for the assessment of GBM molecular subtypes and show that tumors with HOMDEL are more likely to have radiographic evidence of pial invasion and less likely to have deep white matter invasion or subependymal invasion. These imaging features may allow noninvasive identification of CDKN2A allele status.

A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network

Pediatric brain and spinal cancers remain the leading cause of cancer-related death in children. Advancements in clinical decision-support in pediatric neuro-oncology utilizing the wealth of radiology imaging data collected through standard care, however, has significantly lagged other domains. Such data is ripe for use with predictive analytics such as artificial intelligence (AI) methods, which require large datasets. To address this unmet need, we provide a multi-institutional, large-scale pediatric dataset of 23,101 multi-parametric MRI exams acquired through routine care for 1,526 brain tumor patients, as part of the Children's Brain Tumor Network. This includes longitudinal MRIs across various cancer diagnoses, with associated patient-level clinical information, digital pathology slides, as well as tissue genotype and omics data. To facilitate downstream analysis, treatment-naïve images for 370 subjects were processed and released through the NCI Childhood Cancer Data Initiative via the Cancer Data Service. Through ongoing efforts to continuously build these imaging repositories, our aim is to accelerate discovery and translational AI models with real-world data, to ultimately empower precision medicine for children.

PACS-Integrated Tools for Peritumoral Edema Volumetrics Provide Additional Information to RANO-BM-Based Assessment of Lung Cancer Brain Metastases after Stereotactic Radiotherapy: A Pilot Study

Stereotactic radiotherapy (SRT) is the standard of care treatment for brain metastases (METS) today. Nevertheless, there is limited understanding of how posttreatment lesional volumetric changes may assist prediction of lesional outcome. This is partly due to the paucity of volumetric segmentation tools. Edema alone can cause significant clinical symptoms and, therefore, needs independent study along with standard measurements of contrast-enhancing tumors. In this study, we aimed to compare volumetric changes of edema to RANO-BM-based measurements of contrast-enhancing lesion size. Patients with NSCLC METS ≥10 mm on post-contrast T1-weighted image and treated with SRT had measurements for up to seven follow-up scans using a PACS-integrated tool segmenting the peritumoral FLAIR hyperintense volume. Two-dimensional contrast-enhancing and volumetric edema changes were compared by creating treatment response curves. Fifty NSCLC METS were included in the study. The initial median peritumoral edema volume post-SRT relative to pre-SRT baseline was 37% (IQR 8-114%). Most of the lesions with edema volume reduction post-SRT experienced no increase in edema during the study. In over 50% of METS, the pattern of edema volume change was different than the pattern of contrast-enhancing lesion change at different timepoints, which was defined as incongruent. Lesions demonstrating incongruence at the first follow-up were more likely to progress subsequently. Therefore, edema assessment of METS post-SRT provides critical additional information to RANO-BM.

A Large Open Access Dataset of Brain Metastasis 3D Segmentations with Clinical and Imaging Feature Information

Resection and whole brain radiotherapy (WBRT) are the standards of care for the treatment of patients with brain metastases (BM) but are often associated with cognitive side effects. Stereotactic radiosurgery (SRS) involves a more targeted treatment approach and has been shown to avoid the side effects associated with WBRT. However, SRS requires precise identification and delineation of BM. While many AI algorithms have been developed for this purpose, their clinical adoption has been limited due to poor model performance in the clinical setting. Major reasons for non-generalizable algorithms are the limitations in the datasets used for training the AI network. The purpose of this study was to create a large, heterogenous, annotated BM dataset for training and validation of AI models to improve generalizability. We present a BM dataset of 200 patients with pretreatment T1, T1 post-contrast, T2, and FLAIR MR images. The dataset includes contrast-enhancing and necrotic 3D segmentations on T1 post-contrast and whole tumor (including peritumoral edema) 3D segmentations on FLAIR. Our dataset contains 975 contrast-enhancing lesions, many of which are sub centimeter, along with clinical and imaging feature information. We used a streamlined approach to database-building leveraging a PACS-integrated segmentation workflow.

Differential diagnosis of benign and malignant vertebral compression fractures: Comparison and correlation of radiomics and deep learning frameworks based on spinal CT and clinical characteristics

PURPOSE

Differentiating benign from malignant vertebral compression fractures (VCFs) is a diagnostic dilemma in clinical practice. To improve the accuracy and efficiency of diagnosis, we evaluated the performance of deep learning and radiomics methods based on computed tomography (CT) and clinical characteristics in differentiating between Osteoporosis VCFs (OVCFs) and malignant VCFs (MVCFs).

METHODS

We enrolled a total of 280 patients (155 with OVCFs and 125 with MVCFs) and randomly divided them into a training set (80%, n = 224) and a validation set (20%, n = 56). We developed three predictive models: a deep learning (DL) model, a radiomics (Rad) model, and a combined DL_Rad model, using CT and clinical characteristics data. The Inception_V3 served as the backbone of the DL model. The input data for the DL_Rad model consisted of the combined features of Rad and DCNN features. We calculated the receiver operating characteristic curve, area under the curve (AUC), and accuracy (ACC) to assess the performance of the models. Additionally, we calculated the correlation between Rad features and DCNN features.

RESULTS

For the training set, the DL_Rad model achieved the best results, with an AUC of 0.99 and ACC of 0.99, followed by the Rad model (AUC: 0.99, ACC: 0.97) and DL model (AUC: 0.99, ACC: 0.94). For the validation set, the DL_Rad model (with an AUC of 0.97 and ACC of 0.93) outperformed the Rad model (with an AUC: 0.93 and ACC: 0.91) and the DL model (with an AUC: 0.89 and ACC: 0.88). Rad features achieved better classifier performance than the DCNN features, and their general correlations were weak.

CONCLUSIONS

The Deep learnig model, Radiomics model, and Deep learning Radiomics model achieved promising results in discriminating MVCFs from OVCFs, and the DL_Rad model performed the best.

Evolution and implementation of radiographic response criteria in neuro-oncology

Radiographic response assessment in neuro-oncology is critical in clinical practice and trials. Conventional criteria, such as the MacDonald and response assessment in neuro-oncology (RANO) criteria, rely on bidimensional (2D) measurements of a single tumor cross-section. Although RANO criteria are established for response assessment in clinical trials, there is a critical need to address the complexity of brain tumor treatment response with multiple new approaches being proposed. These include volumetric analysis of tumor compartments, structured MRI reporting systems like the Brain Tumor Reporting and Data System, and standardized approaches to advanced imaging techniques to distinguish tumor response from treatment effects. In this review, we discuss the strengths and limitations of different neuro-oncology response criteria and summarize current research findings on the role of novel response methods in neuro-oncology clinical trials and practice.