Brain tissue segmentation in MR images based on a hybrid of MRF and social algorithms

Trends in DNN Model Based Classification and Segmentation of Brain Tumor Detection

Background:

Due to the complexities of scrutinizing and diagnosing brain tumors from MR images, brain tumor analysis has become one of the most indispensable concerns. Characterization of a brain tumor before any treatment, such as radiotherapy, requires decisive treatment planning and accurate implementation. As a result, early detection of brain tumors is imperative for better clinical outcomes and subsequent patient survival.

Introduction:

Brain tumor segmentation is a crucial task in medical image analysis. Because of tumor heterogeneity and varied intensity patterns, manual segmentation takes a long time, limiting the use of accurate quantitative interventions in clinical practice. Automated computer-based brain tumor image processing has become more valuable with technological advancement. With various imaging and statistical analysis tools, deep learning algorithms offer a viable option to enable health care practitioners to rule out the disease and estimate the growth.

Methods:

This article presents a comprehensive evaluation of conventional machine learning models as well as evolving deep learning techniques for brain tumor segmentation and classification.

Conclusion:

In this manuscript, a hierarchical review has been presented for brain tumor segmentation and detection. It is found that the segmentation methods hold a wide margin of improvement in the context of the implementation of adaptive thresholding and segmentation methods, the feature training and mapping requires redundancy correction, the input data training needs to be more exhaustive and the detection algorithms are required to be robust in terms of handling online input data analysis/tumor detection.

Whole brain segmentation with full volume neural network

Whole brain segmentation is an important neuroimaging task that segments the whole brain volume into anatomically labeled regions-of-interest. Convolutional neural networks have demonstrated good performance in this task. Existing solutions, usually segment the brain image by classifying the voxels, or labeling the slices or the sub-volumes separately. Their representation learning is based on parts of the whole volume whereas their labeling result is produced by aggregation of partial segmentation. Learning and inference with incomplete information could lead to sub-optimal final segmentation result. To address these issues, we propose to adopt a full volume framework, which feeds the full volume brain image into the segmentation network and directly outputs the segmentation result for the whole brain volume. The framework makes use of complete information in each volume and can be implemented easily. An effective instance in this framework is given subsequently. We adopt the 3D high-resolution network (HRNet) for learning spatially fine-grained representations and the mixed precision training scheme for memory-efficient training. Extensive experiment results on a publicly available 3D MRI brain dataset show that our proposed model advances the state-of-the-art methods in terms of segmentation performance.

TumorGAN: A Multi-Modal Data Augmentation Framework for Brain Tumor Segmentation

The high human labor demand involved in collecting paired medical imaging data severely impedes the application of deep learning methods to medical image processing tasks such as tumor segmentation. The situation is further worsened when collecting multi-modal image pairs. However, this issue can be resolved through the help of generative adversarial networks, which can be used to generate realistic images. In this work, we propose a novel framework, named TumorGAN, to generate image segmentation pairs based on unpaired adversarial training. To improve the quality of the generated images, we introduce a regional perceptual loss to enhance the performance of the discriminator. We also develop a regional L1 loss to constrain the color of the imaged brain tissue. Finally, we verify the performance of TumorGAN on a public brain tumor data set, BraTS 2017. The experimental results demonstrate that the synthetic data pairs generated by our proposed method can practically improve tumor segmentation performance when applied to segmentation network training.

Segmentation of MR Brain Images Through Hidden Markov Random Field and Hybrid Metaheuristic Algorithm

Image segmentation is one of the most critical tasks in Magnetic Resonance (MR) images analysis. Since the performance of most current image segmentation methods is suffered by noise and intensity non-uniformity artifact (INU), a precise and artifact resistant method is desired. In this work, we propose a new segmentation method combining a new Hidden Markov Random Field (HMRF) model and a novel hybrid metaheuristic method based on Cuckoo search (CS) and Particle swarm optimization algorithms (PSO). The new model uses adaptive parameters to allow balancing between the segmented components of the model. In addition, to improve the quality of searching solutions in the Maximum a posteriori (MAP) estimation of the HMRF model, the hybrid metaheuristic algorithm is introduced. This algorithm takes into account both the advantages of CS and PSO algorithms in searching ability by cooperating them with the same population in a parallel way and with a solution selection mechanism. Since CS and PSO are performing exploration and exploitation in the search space, respectively, hybridizing them in an intelligent way can provide better solutions in terms of quality. Furthermore, initialization of the population is carefully taken into account to improve the performance of the proposed method. The whole algorithm is evaluated on benchmark images including both the simulated and real MR brain images. Experimental results show that the proposed method can achieve satisfactory performance for images with noise and intensity inhomogeneity, and provides better results than its considered competitors.

A Survey on Computer-Aided Diagnosis of Brain Disorders through MRI Based on Machine Learning and Data Mining Methodologies with an Emphasis on Alzheimer Disease Diagnosis and the Contribution of the Multimodal Fusion

Computer-aided diagnostic (CAD) systems use machine learning methods that provide a synergistic effect between the neuroradiologist and the computer, enabling an efficient and rapid diagnosis of the patient’s condition. As part of the early diagnosis of Alzheimer’s disease (AD), which is a major public health problem, the CAD system provides a neuropsychological assessment that helps mitigate its effects. The use of data fusion techniques by CAD systems has proven to be useful, they allow for the merging of information relating to the brain and its tissues from MRI, with that of other types of modalities. This multimodal fusion refines the quality of brain images by reducing redundancy and randomness, which contributes to improving the clinical reliability of the diagnosis compared to the use of a single modality. The purpose of this article is first to determine the main steps of the CAD system for brain magnetic resonance imaging (MRI). Then to bring together some research work related to the diagnosis of brain disorders, emphasizing AD. Thus the most used methods in the stages of classification and brain regions segmentation are described, highlighting their advantages and disadvantages. Secondly, on the basis of the raised problem, we propose a solution within the framework of multimodal fusion. In this context, based on quantitative measurement parameters, a performance study of multimodal CAD systems is proposed by comparing their effectiveness with those exploiting a single MRI modality. In this case, advances in information fusion techniques in medical imagery are accentuated, highlighting their advantages and disadvantages. The contribution of multimodal fusion and the interest of hybrid models are finally addressed, as well as the main scientific assertions made, in the field of brain disease diagnosis.

DCS-SVM: a novel semi-automated method for human brain MR image segmentation

In this paper, a novel method is proposed which appropriately segments magnetic resonance (MR) brain images into three main tissues. This paper proposes an extension of our previous work in which we suggested a combination of multiple classifiers (CMC)-based methods named dynamic classifier selection-dynamic local training local Tanimoto index (DCS-DLTLTI) for MR brain image segmentation into three main cerebral tissues. This idea is used here and a novel method is developed that tries to use more complex and accurate classifiers like support vector machine (SVM) in the ensemble. This work is challenging because the CMC-based methods are time consuming, especially on huge datasets like three-dimensional (3D) brain MR images. Moreover, SVM is a powerful method that is used for modeling datasets with complex feature space, but it also has huge computational cost for big datasets, especially those with strong interclass variability problems and with more than two classes such as 3D brain images; therefore, we cannot use SVM in DCS-DLTLTI. Therefore, we propose a novel approach named "DCS-SVM" to use SVM in DCS-DLTLTI to improve the accuracy of segmentation results. The proposed method is applied on well-known datasets of the Internet Brain Segmentation Repository (IBSR) and promising results are obtained.

Comparison of image intensity, local, and multi-atlas priors in brain tissue classification

PURPOSE

Automated and accurate tissue classification in three-dimensional brain magnetic resonance images is essential in volumetric morphometry or as a preprocessing step for diagnosing brain diseases. However, noise, intensity in homogeneity, and partial volume effects limit the classification accuracy of existing methods. This paper provides a comparative study on the contributions of three commonly used image information priors for tissue classification in normal brains: image intensity, local, and multi-atlas priors.

METHODS

We compared the effectiveness of the three priors by comparing the four methods modeling them: K-Means (KM), KM combined with a Markov Random Field (KM-MRF), multi-atlas segmentation (MAS), and the combination of KM, MRF, and MAS (KM-MRF-MAS). The key parameters and factors in each of the four methods are analyzed, and the performance of all the models is compared quantitatively and qualitatively on both simulated and real data.

RESULTS

The KM-MRF-MAS model that combines the three image information priors performs best.

CONCLUSIONS

The image intensity prior is insufficient to generate reasonable results for a few images. Introducing local and multi-atlas priors results in improved brain tissue classification. This study provides a general guide on what image information priors can be used for effective brain tissue classification.

A segmentation of brain MRI images utilizing intensity and contextual information by Markov random field

BACKGROUND AND OBJECTIVE

Image segmentation is a preliminary and fundamental step in computer aided magnetic resonance imaging (MRI) images analysis. But the performance of most current image segmentation methods is easily depreciated by noise in MRI images. A precise and anti-noise segmentation of MRI images is desired in modern medical image diagnosis.

METHODS

This paper presents a segmentation of MRI images which combines fuzzy clustering and Markov random field (MRF). In order to utilize gray level information sufficiently and alleviate noise disturbance, fuzzy clustering is carried out on the original image and the coarse scale image of multi-scale decomposition. The spatial constraints between neighboring pixels are modeled by a defined potential function in the MRF to reduce the effect of noise and increase the integrity of segmented regions. Spatial constraints and the gray level information refined by Fuzzy C-Means (FCM) algorithm are integrated by maximum a posteriori Markov random field (MAP-MRF). In the proposed method, the fuzzy clustering membership obtained from the original image and the coarse scale image is integrated into the single-site clique potential functions by MAP-MRF. The defined potential functions and the distance weight are introduced to model the neighborhood constraint with MRF.

RESULTS

The experiments are carried out on noised synthetic images, simulated brain MR images and real MR images. The experimental results show that the proposed method has strong robustness and satisfying performance. Meanwhile the method is compared with FCM, FGFCM and FLICM algorithms visually and statistically in the experiments. In the comparison, the proposed method has achieved the best results. In the statistical comparison, the proposed method has an average similarity index of 36.8%, 33.7%, 2.75% increase against FCM, FGFCM and FLICM.

CONCLUSIONS

This paper proposes a MRI segmentation method combining fuzzy clustering and Markov random field. The method is tested in the noised image databases and comparison experiments, which shows that it is a precise and robust MRI segmentation method.

SEGMENTATION OF BRAIN MRIs BY SUPPORT VECTOR MACHINE: DETECTION AND CHARACTERIZATION OF STROKES

The aim of our work is the segmentation of healthy and pathological brains to obtain brain structures and extract strokes. We used real magnetic resonance (MR) images weighted on diffusion. The brain was isolated, and the images were filtered by an anisotropic filter, and then segmented by support vector machines (SVMs). We first applied the method on synthetic images to test the performance of the algorithm and adjust the parameters. Then, we compared our results with those obtained by a cooperative approach proposed in a previous paper.

Robust volume assessment of brain tissues for 3-dimensional fourier transformation MRI via a novel multispectral technique

A new TRIO algorithm method integrating three different algorithms is proposed to perform brain MRI segmentation in the native coordinate space, with no need of transformation to a standard coordinate space or the probability maps for segmentation. The method is a simple voxel-based algorithm, derived from multispectral remote sensing techniques, and only requires minimal operator input to depict GM, WM, and CSF tissue clusters to complete classification of a 3D high-resolution multislice-multispectral MRI data. Results showed very high accuracy and reproducibility in classification of GM, WM, and CSF in multislice-multispectral synthetic MRI data. The similarity indexes, expressing overlap between classification results and the ground truth, were 0.951, 0.962, and 0.956 for GM, WM, and CSF classifications in the image data with 3% noise level and 0% non-uniformity intensity. The method particularly allows for classification of CSF with 0.994, 0.961 and 0.996 of accuracy, sensitivity and specificity in images data with 3% noise level and 0% non-uniformity intensity, which had seldom performed well in previous studies. As for clinical MRI data, the quantitative data of brain tissue volumes aligned closely with the brain morphometrics in three different study groups of young adults, elderly volunteers, and dementia patients. The results also showed very low rates of the intra- and extra-operator variability in measurements of the absolute volumes and volume fractions of cerebral GM, WM, and CSF in three different study groups. The mean coefficients of variation of GM, WM, and CSF volume measurements were in the range of 0.03% to 0.30% of intra-operator measurements and 0.06% to 0.45% of inter-operator measurements. In conclusion, the TRIO algorithm exhibits a remarkable ability in robust classification of multislice-multispectral brain MR images, which would be potentially applicable for clinical brain volumetric analysis and explicitly promising in cross-sectional and longitudinal studies of different subject groups.

An extension Gaussian mixture model for brain MRI segmentation

The segmentation of brain magnetic resonance (MR) images into gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF) has been an intensive studied area in the medical image analysis community. The Gaussian mixture model (GMM) is one of the most commonly used model to represent the intensity of different tissue types. However, as a histogram-based model, the spatial relationship between pixels is discarded in the GMM, making it sensitive to noise. Herein we present a new framework which aims to incorporate spatial information into the standard GMM, where each pixel is assigned its individual prior by leveraging its neighborhood information. Expectation maximization (EM) is modified to estimate the parameters of the proposed method. The method is validated on both synthetic and real brain MR images, showing its effectiveness in the segmentation task.

An effective method for segmentation of MR brain images using the ant colony optimization algorithm

Since segmentation of magnetic resonance images is one of the most important initial steps in brain magnetic resonance image processing, success in this part has a great influence on the quality of outcomes of subsequent steps. In the past few decades, numerous methods have been introduced for classification of such images, but typically they perform well only on a specific subset of images, do not generalize well to other image sets, and have poor computational performance. In this study, we provided a method for segmentation of magnetic resonance images of the brain that despite its simplicity has a high accuracy. We compare the performance of our proposed algorithm with similar evolutionary algorithms on a pixel-by-pixel basis. Our algorithm is tested across varying sets of magnetic resonance images and demonstrates high speed and accuracy. It should be noted that in initial steps, the algorithm is computationally intensive requiring a large number of calculations; however, in subsequent steps of the search process, the number is reduced with the segmentation focused only in the target area.