Comparison of five cluster validity indices performance in brain [18 F]FET-PET image segmentation using k-means

Advances of artificial intelligence in clinical application and scientific research of neuro-oncology: Current knowledge and future perspectives

Brain tumors refer to the abnormal growths that occur within the brain's tissue, comprising both primary neoplasms and metastatic lesions. Timely detection, precise staging, suitable treatment, and standardized management are of significant clinical importance for extending the survival rates of brain tumor patients. Artificial intelligence (AI), a discipline within computer science, is leveraging its robust capacity for information identification and combination to revolutionize traditional paradigms of oncology care, offering substantial potential for precision medicine. This article provides an overview of the current applications of AI in brain tumors, encompassing the primary AI technologies, their working mechanisms and working workflow, the contributions of AI to brain tumor diagnosis and treatment, as well as the role of AI in brain tumor scientific research, particularly in drug innovation and revealing tumor microenvironment. Finally, the paper addresses the existing challenges, potential solutions, and the future application prospects. This review aims to enhance our understanding of the application of AI in brain tumors and provide valuable insights for forthcoming clinical applications and scientific inquiries.

The effect of harmonization on the variability of PET radiomic features extracted using various segmentation methods

PURPOSE

This study aimed to examine the robustness of positron emission tomography (PET) radiomic features extracted via different segmentation methods before and after ComBat harmonization in patients with non-small cell lung cancer (NSCLC).

METHODS

We included 120 patients (positive recurrence = 46 and negative recurrence = 74) referred for PET scanning as a routine part of their care. All patients had a biopsy-proven NSCLC. Nine segmentation methods were applied to each image, including manual delineation, K-means (KM), watershed, fuzzy-C-mean, region-growing, local active contour (LAC), and iterative thresholding (IT) with 40, 45, and 50% thresholds. Diverse image discretizations, both without a filter and with different wavelet decompositions, were applied to PET images. Overall, 6741 radiomic features were extracted from each image (749 radiomic features from each segmented area). Non-parametric empirical Bayes (NPEB) ComBat harmonization was used to harmonize the features. Linear Support Vector Classifier (LinearSVC) with L1 regularization For feature selection and Support Vector Machine classifier (SVM) with fivefold nested cross-validation was performed using StratifiedKFold with 'n_splits' set to 5 to predict recurrence in NSCLC patients and assess the impact of ComBat harmonization on the outcome.

RESULTS

From 749 extracted radiomic features, 206 (27%) and 389 (51%) features showed excellent reliability (ICC ≥ 0.90) against segmentation method variation before and after NPEB ComBat harmonization, respectively. Among all, 39 features demonstrated poor reliability, which declined to 10 after ComBat harmonization. The 64 fixed bin widths (without any filter) and wavelets (LLL)-based radiomic features set achieved the best performance in terms of robustness against diverse segmentation techniques before and after ComBat harmonization. The first-order and GLRLM and also first-order and NGTDM feature families showed the largest number of robust features before and after ComBat harmonization, respectively. In terms of predicting recurrence in NSCLC, our findings indicate that using ComBat harmonization can significantly enhance machine learning outcomes, particularly improving the accuracy of watershed segmentation, which initially had fewer reliable features than manual contouring. Following the application of ComBat harmonization, the majority of cases saw substantial increase in sensitivity and specificity.

CONCLUSION

Radiomic features are vulnerable to different segmentation methods. ComBat harmonization might be considered a solution to overcome the poor reliability of radiomic features.

A neural ordinary differential equation model for visualizing deep neural network behaviors in multi-parametric MRI-based glioma segmentation

PURPOSE

To develop a neural ordinary differential equation (ODE) model for visualizing deep neural network behavior during multi-parametric MRI-based glioma segmentation as a method to enhance deep learning explainability.

METHODS

By hypothesizing that deep feature extraction can be modeled as a spatiotemporally continuous process, we implemented a novel deep learning model, Neural ODE, in which deep feature extraction was governed by an ODE parameterized by a neural network. The dynamics of (1) MR images after interactions with the deep neural network and (2) segmentation formation can thus be visualized after solving the ODE. An accumulative contribution curve (ACC) was designed to quantitatively evaluate each MR image's utilization by the deep neural network toward the final segmentation results. The proposed Neural ODE model was demonstrated using 369 glioma patients with a 4-modality multi-parametric MRI protocol: T1, contrast-enhanced T1 (T1-Ce), T2, and FLAIR. Three Neural ODE models were trained to segment enhancing tumor (ET), tumor core (TC), and whole tumor (WT), respectively. The key MRI modalities with significant utilization by deep neural networks were identified based on ACC analysis. Segmentation results by deep neural networks using only the key MRI modalities were compared to those using all four MRI modalities in terms of Dice coefficient, accuracy, sensitivity, and specificity.

RESULTS

All Neural ODE models successfully illustrated image dynamics as expected. ACC analysis identified T1-Ce as the only key modality in ET and TC segmentations, while both FLAIR and T2 were key modalities in WT segmentation. Compared to the U-Net results using all four MRI modalities, the Dice coefficient of ET (0.784→0.775), TC (0.760→0.758), and WT (0.841→0.837) using the key modalities only had minimal differences without significance. Accuracy, sensitivity, and specificity results demonstrated the same patterns.

CONCLUSION

The Neural ODE model offers a new tool for optimizing the deep learning model inputs with enhanced explainability. The presented methodology can be generalized to other medical image-related deep-learning applications.

Exploratory Assessment of K-means Clustering to Classify 18F-Flutemetamol Brain PET as Positive or Negative

RATIONALE

We evaluated K-means clustering to classify amyloid brain PETs as positive or negative.

PATIENTS AND METHODS

Sixty-six participants (31 men, 35 women; age range, 52-81 years) were recruited through a multicenter observational study: 19 cognitively normal, 25 mild cognitive impairment, and 22 dementia (11 Alzheimer disease, 3 subcortical vascular cognitive impairment, and 8 Parkinson-Lewy Body spectrum disorder). As part of the neurocognitive and imaging evaluation, each participant had an 18F-flutemetamol (Vizamyl, GE Healthcare) brain PET. All studies were processed using Cortex ID software (General Electric Company, Boston, MA) to calculate SUV ratios in 19 regions of interest and clinically interpreted by 2 dual-certified radiologists/nuclear medicine physicians, using MIM software (MIM Software Inc, Cleveland, OH), blinded to the quantitative analysis, with final interpretation based on consensus. K-means clustering was retrospectively used to classify the studies from the quantitative data.

RESULTS

Based on clinical interpretation, 46 brain PETs were negative and 20 were positive for amyloid deposition. Of 19 cognitively normal participants, 1 (5%) had a positive 18F-flutemetamol brain PET. Of 25 participants with mild cognitive impairment, 9 (36%) had a positive 18F-flutemetamol brain PET. Of 22 participants with dementia, 10 (45%) had a positive 18F-flutemetamol brain PET; 7 of 11 participants with Alzheimer disease (64%), 1 of 3 participants with vascular cognitive impairment (33%), and 2 of 8 participants with Parkinson-Lewy Body spectrum disorder (25%) had a positive 18F-flutemetamol brain PET. Using clinical interpretation as the criterion standard, K-means clustering (K = 2) gave sensitivity of 95%, specificity of 98%, and accuracy of 97%.

CONCLUSIONS

K-means clustering may be a powerful algorithm for classifying amyloid brain PET.

Automatic glioma segmentation based on adaptive superpixel

Background

The automatic glioma segmentation is of great significance for clinical practice. This study aims to propose an automatic method based on superpixel for glioma segmentation from the T2 weighted Magnetic Resonance Imaging.

Methods

The proposed method mainly includes three steps. First, we propose an adaptive superpixel generation algorithm based on simple linear iterative clustering version with 0 parameter (ASLIC0). This algorithm can acquire a superpixel image with fewer superpixels and better fit the boundary of region of interest (ROI) by automatically selecting the optimal number of superpixels. Second, we compose a training set by calculating the statistical, texture, curvature and fractal features for each superpixel. Third, Support Vector Machine (SVM) is used to train classification model based on the features of the second step.

Results

The experimental results on Multimodal Brain Tumor Image Segmentation Benchmark 2017 (BraTS2017) show that the proposed method has good segmentation performance. The average Dice, Hausdorff distance, sensitivity, and specificity for the segmented tumor against the ground truth are 0.8492, 3.4697 pixels, 81.47, and 99.64%, respectively. The proposed method shows good stability on high- and low-grade glioma samples. Comparative experimental results show that the proposed method has superior performance.

Conclusions

This provides a close match to expert delineation across all grades of glioma, leading to a fast and reproducible method of glioma segmentation.