Radiologic image-based statistical shape analysis of brain tumours

Landmark-free statistical shape modelling reveals effects of age and sex on whole muscle morphology among the triceps surae

The shape of skeletal muscle has important influences on muscle function, yet studies of three-dimensional shape variation are rarely performed. Analysis of muscle shape variation using traditional tools is limited by lack of anatomical landmarks, but modern landmark-free methods provide new opportunities to study complex shapes. We used generalized Procrustes surface analysis to characterize shape variation among the triceps surae: medial gastrocnemius (MG), lateral gastrocnemius (LG) and soleus (SOL), digitized using magnetic resonance imaging from 21 younger (8 females, 13 males; 24.6 ± 4.3 years) and 15 older (6 females; 9 males; 70.4 ± 2.4 years) physically active participants. In both gastrocnemii, the first principal component (PC) of shape variance was related to muscle width and thickness. The second PC was related to variation in the MG's insertion and variation in thickness along the LG long axis. In the SOL, the first PC was related to overall muscle thickness and length while the second PC captured variation in lateral margin thickness and curvature of the medial border. Muscle shape differed between young and older adults in MG and LG, while SOL shape differed between males and females. These findings demonstrate statistical shape modelling as a promising tool for disentangling multiple influences on skeletal muscle shape and provide important input for future biomechanical modelling investigations.

The efficacy of using a multiparametric magnetic resonance imaging-based radiomics model to distinguish glioma recurrence from pseudoprogression

OBJECTIVE

The early differential diagnosis of the postoperative recurrence or pseudoprogression (psPD) of a glioma is of great guiding significance for individualized clinical treatment. This study aimed to evaluate the ability of a multiparametric magnetic resonance imaging (MRI)-based radiomics model to distinguish between the postoperative recurrence and psPD of a glioma early on and in a noninvasive manner.

METHODS

A total of 52 patients with gliomas who attended the Hainan Provincial People's Hospital between 2000 and 2021 and met the inclusion criteria were selected for this study. 1137 and 1137 radiomic features were extracted from T1 enhanced and T2WI/FLAIR sequence images, respectively.After clearing some invalid information and LASSO screening, a total of 9 and 10 characteristic radiological features were extracted and randomly divided into the training set and the test set according to 7:3 ratio. Select-Kbest and minimum Absolute contraction and selection operator (LASSO) were used for feature selection. Support vector machine and logistic regression were used to form a multi-parameter model for training and prediction. The optimal sequence and classifier were selected according to the area under the curve (AUC) and accuracy.

RESULTS

Radiomic models 1, 2 and 3 based on T1WI, T2FLAIR and T1WI + T2T2FLAIR sequences have better performance in the identification of postoperative recurrence and false progression of T1 glioma. The performance of model 2 is more stable, and the performance of support vector machine classifier is more stable. The multiparameter model based on CE-T1 + T2WI/FLAIR sequence showed the best performance (AUC:0.96, sensitivity: 0.87, specificity: 0.94, accuracy: 0.89,95% CI:0.93-1).

CONCLUSION

The use of multiparametric MRI-based radiomics provides a noninvasive, stable, and accurate method for differentiating between the postoperative recurrence and psPD of a glioma, which allows for timely individualized clinical treatment.

Back to the Roots: Reconstructing Large and Complex Cranial Defects using an Image-based Statistical Shape Model

Designing implants for large and complex cranial defects is a challenging task, even for professional designers. Current efforts on automating the design process focused mainly on convolutional neural networks (CNN), which have produced state-of-the-art results on reconstructing synthetic defects. However, existing CNN-based methods have been difficult to translate to clinical practice in cranioplasty, as their performance on large and complex cranial defects remains unsatisfactory. In this paper, we present a statistical shape model (SSM) built directly on the segmentation masks of the skulls represented as binary voxel occupancy grids and evaluate it on several cranial implant design datasets. Results show that, while CNN-based approaches outperform the SSM on synthetic defects, they are inferior to SSM when it comes to large, complex and real-world defects. Experienced neurosurgeons evaluate the implants generated by the SSM to be feasible for clinical use after minor manual corrections. Datasets and the SSM model are publicly available at https://github.com/Jianningli/ssm .

Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment

This review delves into the most recent advancements in applying artificial intelligence (AI) within neuro-oncology, specifically emphasizing work on gliomas, a class of brain tumors that represent a significant global health issue. AI has brought transformative innovations to brain tumor management, utilizing imaging, histopathological, and genomic tools for efficient detection, categorization, outcome prediction, and treatment planning. Assessing its influence across all facets of malignant brain tumor management- diagnosis, prognosis, and therapy- AI models outperform human evaluations in terms of accuracy and specificity. Their ability to discern molecular aspects from imaging may reduce reliance on invasive diagnostics and may accelerate the time to molecular diagnoses. The review covers AI techniques, from classical machine learning to deep learning, highlighting current applications and challenges. Promising directions for future research include multimodal data integration, generative AI, large medical language models, precise tumor delineation and characterization, and addressing racial and gender disparities. Adaptive personalized treatment strategies are also emphasized for optimizing clinical outcomes. Ethical, legal, and social implications are discussed, advocating for transparency and fairness in AI integration for neuro-oncology and providing a holistic understanding of its transformative impact on patient care.

ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images

Statistical shape models (SSM) have been well-established as an excellent tool for identifying variations in the morphology of anatomy across the underlying population. Shape models use consistent shape representation across all the samples in a given cohort, which helps to compare shapes and identify the variations that can detect pathologies and help in formulating treatment plans. In medical imaging, computing these shape representations from CT/MRI scans requires time-intensive preprocessing operations, including but not limited to anatomy segmentation annotations, registration, and texture denoising. Deep learning models have demonstrated exceptional capabilities in learning shape representations directly from volumetric images, giving rise to highly effective and efficient Image-to-SSM networks. Nevertheless, these models are data-hungry and due to the limited availability of medical data, deep learning models tend to overfit. Offline data augmentation techniques, that use kernel density estimation based (KDE) methods for generating shape-augmented samples, have successfully aided Image-to-SSM networks in achieving comparable accuracy to traditional SSM methods. However, these augmentation methods focus on shape augmentation, whereas deep learning models exhibit image-based texture bias resulting in sub-optimal models. This paper introduces a novel strategy for on-the-fly data augmentation for the Image-to-SSM framework by leveraging data-dependent noise generation or texture augmentation. The proposed framework is trained as an adversary to the Image-to-SSM network, augmenting diverse and challenging noisy samples. Our approach achieves improved accuracy by encouraging the model to focus on the underlying geometry rather than relying solely on pixel values.

Classifying organisms and artefacts by their outline shapes

We often wish to classify objects by their shapes. Indeed, the study of shapes is an important part of many scientific fields, such as evolutionary biology, structural biology, image processing and archaeology. However, mathematical shape spaces are rather complicated and nonlinear. The most widely used methods of shape analysis, geometric morphometrics, treat the shapes as sets of points. Diffeomorphic methods consider the underlying curve rather than points, but have rarely been applied to real-world problems. Using a machine classifier, we tested the ability of several of these methods to describe and classify the shapes of a variety of organic and man-made objects. We find that one method, based on square-root velocity functions (SRVFs), outperforms all others, including a standard geometric morphometric method (eigenshapes), and that it is also superior to human experts using shape alone. When the SRVF approach is constrained to take account of homologous landmarks it can accurately classify objects of very different shapes. The SRVF method identifies a shortest path between shapes, and we show that this can be used to estimate the shapes of intermediate steps in evolutionary series. Diffeomorphic shape analysis methods, we conclude, now provide practical and effective solutions to many shape description and classification problems in the natural and human sciences.

SAFARI: shape analysis for AI-segmented images

BACKGROUND

Recent developments to segment and characterize the regions of interest (ROI) within medical images have led to promising shape analysis studies. However, the procedures to analyze the ROI are arbitrary and vary by study. A tool to translate the ROI to analyzable shape representations and features is greatly needed.

RESULTS

We developed SAFARI (shape analysis for AI-segmented images), an open-source R package with a user-friendly online tool kit for ROI labelling and shape feature extraction of segmented maps, provided by AI-algorithms or manual segmentation. We demonstrated that half of the shape features extracted by SAFARI were significantly associated with survival outcomes in a case study on 143 consecutive patients with stage I-IV lung cancer and another case study on 61 glioblastoma patients.

CONCLUSIONS

SAFARI is an efficient and easy-to-use toolkit for segmenting and analyzing ROI in medical images. It can be downloaded from the comprehensive R archive network (CRAN) and accessed at https://lce.biohpc.swmed.edu/safari/ .

Association testing for binary trees-A Markov branching process approach

We propose a new approach to test associations between binary trees and covariates. In this approach, binary-tree structured data are treated as sample paths of binary fission Markov branching processes (bMBP). We propose a generalized linear regression model and developed inference procedures for association testing, including variable selection and estimation of covariate effects. Simulation studies show that these procedures are able to accurately identify covariates that are associated with the binary tree structure by impacting the rate parameter of the bMBP. The problem of association testing on binary trees is motivated by modeling hierarchical clustering dendrograms of pixel intensities in biomedical images. By using semi-synthetic data generated from a real brain-tumor image, our simulation studies show that the bMBP model is able to capture the characteristics of dendrogram trees in brain-tumor images. Our final analysis of the glioblastoma multiforme brain-tumor data from The Cancer Imaging Archive identified multiple clinical and genetic variables that are potentially associated with brain-tumor heterogeneity.

Tangent functional canonical correlation analysis for densities and shapes, with applications to multimodal imaging data

It is quite common for functional data arising from imaging data to assume values in infinite-dimensional manifolds. Uncovering associations between two or more such nonlinear functional data extracted from the same object across medical imaging modalities can assist development of personalized treatment strategies. We propose a method for canonical correlation analysis between paired probability densities or shapes of closed planar curves, routinely used in biomedical studies, which combines a convenient linearization and dimension reduction of the data using tangent space coordinates. Leveraging the fact that the corresponding manifolds are submanifolds of unit Hilbert spheres, we describe how finite-dimensional representations of the functional data objects can be easily computed, which then facilitates use of standard multivariate canonical correlation analysis methods. We further construct and visualize canonical variate directions directly on the space of densities or shapes. Utility of the method is demonstrated through numerical simulations and performance on a magnetic resonance imaging dataset of glioblastoma multiforme brain tumors.

Exploration of Multiparameter Hematoma 3D Image Analysis for Predicting Outcome After Intracerebral Hemorrhage

BACKGROUND

Rapid diagnosis and proper management of intracerebral hemorrhage (ICH) play a crucial role in the outcome. Prediction of the outcome with a high degree of accuracy based on admission data including imaging information can potentially influence clinical decision-making practice.

METHODS

We conducted a retrospective multicenter study of consecutive ICH patients admitted between 2012-2017. Medical history, admission data, and initial head computed tomography (CT) scan were collected. CT scans were semiautomatically segmented for hematoma volume, hematoma density histograms, and sphericity index (SI). Discharge unfavorable outcomes were defined as death or severe disability (modified Rankin Scores 4-6). We compared (1) hematoma volume alone; (2) multiparameter imaging data including hematoma volume, location, density heterogeneity, SI, and midline shift; and (3) multiparameter imaging data with clinical information available on admission for ICH outcome prediction. Multivariate analysis and predictive modeling were used to determine the significance of hematoma characteristics on the outcome.

RESULTS

We included 430 subjects in this analysis. Models using automated hematoma segmentation showed incremental predictive accuracies for in-hospital mortality using hematoma volume only: area under the curve (AUC): 0.85 [0.76-0.93], multiparameter imaging data (hematoma volume, location, CT density, SI, and midline shift): AUC: 0.91 [0.86-0.97], and multiparameter imaging data plus clinical information on admission (Glasgow Coma Scale (GCS) score and age): AUC: 0.94 [0.89-0.99]. Similarly, severe disability predictive accuracy varied from AUC: 0.84 [0.76-0.93] for volume-only model to AUC: 0.88 [0.80-0.95] for imaging data models and AUC: 0.92 [0.86-0.98] for imaging plus clinical predictors.

CONCLUSIONS

Multiparameter models combining imaging and admission clinical data show high accuracy for predicting discharge unfavorable outcome after ICH.

Analysis of shape data: From landmarks to elastic curves

Proliferation of high-resolution imaging data in recent years has led to sub-stantial improvements in the two popular approaches for analyzing shapes of data objects based on landmarks and/or continuous curves. We provide an expository account of elastic shape analysis of parametric planar curves representing shapes of two-dimensional (2D) objects by discussing its differences, and its commonalities, to the landmark-based approach. Particular attention is accorded to the role of reparameterization of a curve, which in addition to rotation, scaling and translation, represents an important shape-preserving transformation of a curve. The transition to the curve-based approach moves the mathematical setting of shape analysis from finite-dimensional non-Euclidean spaces to infinite-dimensional ones. We discuss some of the challenges associated with the infinite-dimensionality of the shape space, and illustrate the use of geometry-based methods in the computation of intrinsic statistical summaries and in the definition of statistical models on a 2D imaging dataset consisting of mouse vertebrae. We conclude with an overview of the current state-of-the-art in the field.

Intracranial glioma xenograft model rapidly reestablishes blood-brain barrier integrity for longitudinal imaging of tumor progression using fluorescence molecular tomography and contrast agents

SIGNIFICANCE

The blood-brain barrier (BBB) is a major obstacle to detecting and treating brain tumors. Overcoming this challenge will facilitate the early and accurate detection of brain lesions and guide surgical resection of tumors.

AIM

We generated an orthotopic brain tumor model that simulates the pathophysiology of gliomas at early stages; determine the BBB integrity and breakdown over the time course of tumor progression using generic and cancer-targeted near-infrared (NIR) fluorescent molecular probes.

APPROACH

We developed an intracranial tumor xenograft model that rapidly reestablished BBB integrity and monitored tumor progression by bioluminescence imaging. Sham control mice were injected with phosphate-buffered saline only. Fluorescence molecular tomography (FMT) was used to quantify the uptake of tumor-targeted and passive NIR fluorescent imaging agents in orthotopic glioma (U87-GL-GFP PDE7B H217Q cells) tumor model. Cancer-induced and transient (with focused ultrasound, FUS) disruption of BBB integrity was monitored with NIR fluorescent dyes.

RESULTS

Stereotactic injection of 50,000 cells into mouse brain allowed rapid reestablishment of BBB integrity within a week, as determined by the inability of both tumor-targeted and generic NIR imaging agents to extravasate into the brain. Tumor-induced BBB disruption was observed 7 weeks after tumor implantation. FUS achieved a similar effect at any time point after reestablishing BBB integrity. While tumor uptake and retention of the passive NIR dye, indocyanine green, was negligible, both actively tumor-targeting agents exhibited selective accumulation in the tumor region. The tumor-targeting molecular probe that clears rapidly from nontumor brain tissue exhibits higher contrast than the analogous vascular-targeting agent and helps delineate tumors from sham control.

CONCLUSIONS

We highlight the utility of FMT imaging for longitudinal assessment of brain tumors and the interplay between the stages of BBB disruption and molecular probe retention in tumors, with potential application to other neurological diseases.

Machine learning and glioma imaging biomarkers

AIM

To review how machine learning (ML) is applied to imaging biomarkers in neuro-oncology, in particular for diagnosis, prognosis, and treatment response monitoring.

MATERIALS AND METHODS

The PubMed and MEDLINE databases were searched for articles published before September 2018 using relevant search terms. The search strategy focused on articles applying ML to high-grade glioma biomarkers for treatment response monitoring, prognosis, and prediction.

RESULTS

Magnetic resonance imaging (MRI) is typically used throughout the patient pathway because routine structural imaging provides detailed anatomical and pathological information and advanced techniques provide additional physiological detail. Using carefully chosen image features, ML is frequently used to allow accurate classification in a variety of scenarios. Rather than being chosen by human selection, ML also enables image features to be identified by an algorithm. Much research is applied to determining molecular profiles, histological tumour grade, and prognosis using MRI images acquired at the time that patients first present with a brain tumour. Differentiating a treatment response from a post-treatment-related effect using imaging is clinically important and also an area of active study (described here in one of two Special Issue publications dedicated to the application of ML in glioma imaging).

CONCLUSION

Although pioneering, most of the evidence is of a low level, having been obtained retrospectively and in single centres. Studies applying ML to build neuro-oncology monitoring biomarker models have yet to show an overall advantage over those using traditional statistical methods. Development and validation of ML models applied to neuro-oncology require large, well-annotated datasets, and therefore multidisciplinary and multi-centre collaborations are necessary.

Elastic Statistical Shape Analysis of Biological Structures with Case Studies: A Tutorial

We describe a recent framework for statistical shape analysis of curves and show its applicability to various biological datasets. The presented methods are based on a functional representation of shape called the square-root velocity function and a closely related elastic metric. The main benefit of this approach is its invariance to reparameterization (in addition to the standard shape-preserving transformations of translation, rotation and scale), and ability to compute optimal registrations (point correspondences) across objects. Building upon the defined distance between shapes, we additionally describe tools for computing sample statistics including the mean and covariance. Based on the covariance structure, one can also explore variability in shape samples via principal component analysis. Finally, the estimated mean and covariance can be used to define Wrapped Gaussian models on the shape space, which are easy to sample from. We present multiple case studies on various biological datasets including (1) leaf outlines, (2) internal carotid arteries, (3) Diffusion Tensor Magnetic Resonance Imaging fiber tracts, (4) Glioblastoma Multiforme tumors, and (5) vertebrae in mice. We additionally provide a MATLAB package that can be used to produce the results given in this manuscript.

Statistical Shape Analysis of Subthalamic Nucleus in Patients with Parkinson Disease

OBJECTIVE

Subthalamic nucleus (STN) is the most targeted localization in the treatment of Parkinson disease (PD) with deep brain stimulation. However, no studies have been found in the literature about possible shape changes of STN in the literature. We aimed to investigate possible shape changes in the STN and the relationship between shape changes and disease duration in PD patients by using statistical analysis.

METHODS

Patients who were diagnosed with idiopathic PD and controls were enrolled in this study. Age, sex, and disease duration of all cases were recorded. Turbo-spin-echo T2-weighted axial series parallel to the skull base in each case containing midbrain images were obtained, including the whole STN. Standard anatomic landmarks were selected and marked on each digital image using a special software in all cases. Statistical geometric shape and deformation analysis of STN was performed in 2 groups.

RESULTS

Forty-three patients with PD and 50 age/sex-matched controls were enrolled in this study. There were statistically significant left and right STN shape differences between the groups. Maximum deformation was seen in the dorsolateral parts of both STNs. General shape variability of the STNs was found on the left (0.096) and right (0.049).

CONCLUSIONS

Significant shape differences and remarkable deformation of STN are seen in patients with PD compared with controls. Maximum deformation was observed in the dorsolateral part of the STN, and with the increase in the duration of the PD, shape differences and deformations became more prominent.

Shape Features of the Lesion Habitat to Differentiate Brain Tumor Progression from Pseudoprogression on Routine Multiparametric MRI: A Multisite Study

BACKGROUND AND PURPOSE

Differentiating pseudoprogression, a radiation-induced treatment effect, from tumor progression on imaging is a substantial challenge in glioblastoma management. Unfortunately, guidelines set by the Response Assessment in Neuro-Oncology criteria are based solely on bidirectional diametric measurements of enhancement observed on T1WI and T2WI/FLAIR scans. We hypothesized that quantitative 3D shape features of the enhancing lesion on T1WI, and T2WI/FLAIR hyperintensities (together called the lesion habitat) can more comprehensively capture pathophysiologic differences across pseudoprogression and tumor recurrence, not appreciable on diametric measurements alone.

MATERIALS AND METHODS

A total of 105 glioblastoma studies from 2 institutions were analyzed, consisting of a training (n = 59) and an independent test (n = 46) cohort. For every study, expert delineation of the lesion habitat (T1WI enhancing lesion and T2WI/FLAIR hyperintense perilesional region) was obtained, followed by extraction of 30 shape features capturing 14 "global" contour characteristics and 16 "local" curvature measures for every habitat region. Feature selection was used to identify most discriminative features on the training cohort, which were evaluated on the test cohort using a support vector machine classifier.

RESULTS

The top 2 most discriminative features were identified as local features capturing total curvature of the enhancing lesion and curvedness of the T2WI/FLAIR hyperintense perilesional region. Using top features from the training cohort (training accuracy = 91.5%), we obtained an accuracy of 90.2% on the test set in distinguishing pseudoprogression from tumor progression.

CONCLUSIONS

Our preliminary results suggest that 3D shape attributes from the lesion habitat can differentially express across pseudoprogression and tumor progression and could be used to distinguish these radiographically similar pathologies.