Nonlocal regularization for active appearance model: Application to medial temporal lobe segmentation

Automated segmentation of medial temporal lobe subregions on in vivo T1-weighted MRI in early stages of Alzheimer's disease

Medial temporal lobe (MTL) substructures are the earliest regions affected by neurofibrillary tangle pathology-and thus are promising biomarkers for Alzheimer's disease (AD). However, automatic segmentation of the MTL using only T1-weighted (T1w) magnetic resonance imaging (MRI) is challenging due to the large anatomical variability of the MTL cortex and the confound of the dura mater, which is commonly segmented as gray matter by state-of-the-art algorithms because they have similar intensity in T1w MRI. To address these challenges, we developed a novel atlas set, consisting of 15 cognitively normal older adults and 14 patients with mild cognitive impairment with a label explicitly assigned to the dura, that can be used by the multiatlas automated pipeline (Automatic Segmentation of Hippocampal Subfields [ASHS-T1]) for the segmentation of MTL subregions, including anterior/posterior hippocampus, entorhinal cortex (ERC), Brodmann areas (BA) 35 and 36, and parahippocampal cortex on T1w MRI. Cross-validation experiments indicated good segmentation accuracy of ASHS-T1 and that the dura can be reliably separated from the cortex (6.5% mislabeled as gray matter). Conversely, FreeSurfer segmented majority of the dura mater (62.4%) as gray matter and the degree of dura mislabeling decreased with increasing disease severity. To evaluate its clinical utility, we applied the pipeline to T1w images of 663 ADNI subjects and significant volume/thickness loss is observed in BA35, ERC, and posterior hippocampus in early prodromal AD and all subregions at later stages. As such, the publicly available new atlas and ASHS-T1 could have important utility in the early diagnosis and monitoring of AD and enhancing brain-behavior studies of these regions.

Multi-Template Mesiotemporal Lobe Segmentation: Effects of Surface and Volume Feature Modeling

Numerous neurological disorders are associated with atrophy of mesiotemporal lobe structures, including the hippocampus (HP), amygdala (AM), and entorhinal cortex (EC). Accurate segmentation of these structures is, therefore, necessary for understanding the disease process and patient management. Recent multiple-template segmentation algorithms have shown excellent performance in HP segmentation. Purely surface-based methods precisely describe structural boundary but their performance likely depends on a large template library, as segmentation suffers when the boundaries of template and individual MRI are not well aligned while volume-based methods are less dependent. So far only few algorithms attempted segmentation of entire mesiotemporal structures including the parahippocampus. We compared performance of surface- and volume-based approaches in segmenting the three mesiotemporal structures and assess the effects of different environments (i.e., size of templates, under pathology). We also proposed an algorithm that combined surface- with volume-derived similarity measures for optimal template selection. To further improve the method, we introduced two new modules: (1) a non-linear registration that is driven by volume-based intensities and features sampled on deformable template surfaces; (2) a shape averaging based on regional weighting using multi-scale global-to-local icosahedron sampling. Compared to manual segmentations, our approach, namely HybridMulti showed high accuracy in 40 healthy controls (mean Dice index for HP/AM/EC = 89.7/89.3/82.9%) and 135 patients with temporal lobe epilepsy (88.7/89.0/82.6%). This accuracy was comparable across two different datasets of 1.5T and 3T MRI. It resulted in the best performance among tested multi-template methods that were either based on volume or surface data alone in terms of accuracy and sensitivity to detect atrophy related to epilepsy. Moreover, unlike purely surface-based multi-template segmentation, HybridMulti could maintain accurate performance even with a 50% template library size.

Fully automatic segmentation and objective assessment of atrial scars for long-standing persistent atrial fibrillation patients using late gadolinium-enhanced MRI

PURPOSE

Atrial fibrillation (AF) is the most common heart rhythm disorder and causes considerable morbidity and mortality, resulting in a large public health burden that is increasing as the population ages. It is associated with atrial fibrosis, the amount and distribution of which can be used to stratify patients and to guide subsequent electrophysiology ablation treatment. Atrial fibrosis may be assessed noninvasively using late gadolinium-enhanced (LGE) magnetic resonance imaging (MRI) where scar tissue is visualized as a region of signal enhancement. However, manual segmentation of the heart chambers and of the atrial scar tissue is time consuming and subject to interoperator variability, particularly as image quality in AF is often poor. In this study, we propose a novel fully automatic pipeline to achieve accurate and objective segmentation of the heart (from MRI Roadmap data) and of scar tissue within the heart (from LGE MRI data) acquired in patients with AF.

METHODS

Our fully automatic pipeline uniquely combines: (a) a multiatlas-based whole heart segmentation (MA-WHS) to determine the cardiac anatomy from an MRI Roadmap acquisition which is then mapped to LGE MRI, and (b) a super-pixel and supervised learning based approach to delineate the distribution and extent of atrial scarring in LGE MRI. We compared the accuracy of the automatic analysis to manual ground truth segmentations in 37 patients with persistent long-standing AF.

RESULTS

Both our MA-WHS and atrial scarring segmentations showed accurate delineations of cardiac anatomy (mean Dice = 89%) and atrial scarring (mean Dice = 79%), respectively, compared to the established ground truth from manual segmentation. In addition, compared to the ground truth, we obtained 88% segmentation accuracy, with 90% sensitivity and 79% specificity. Receiver operating characteristic analysis achieved an average area under the curve of 0.91.

CONCLUSION

Compared with previously studied methods with manual interventions, our innovative pipeline demonstrated comparable results, but was computed fully automatically. The proposed segmentation methods allow LGE MRI to be used as an objective assessment tool for localization, visualization, and quantitation of atrial scarring and to guide ablation treatment.

The impact of automated hippocampal volumetry on diagnostic confidence in patients with suspected Alzheimer's disease: A European Alzheimer's Disease Consortium study

INTRODUCTION

Hippocampal volume is a core biomarker of Alzheimer's disease (AD). However, its contribution over the standard diagnostic workup is unclear.

METHODS

Three hundred fifty-six patients, under clinical evaluation for cognitive impairment, with suspected AD and Mini-Mental State Examination ≥20, were recruited across 17 European memory clinics. After the traditional diagnostic workup, diagnostic confidence of AD pathology (DCAD) was estimated by the physicians in charge. The latter were provided with the results of automated hippocampal volumetry in standardized format and DCAD was reassessed.

RESULTS

An increment of one interquartile range in hippocampal volume was associated with a mean change of DCAD of -8.0% (95% credible interval: [-11.5, -5.0]). Automated hippocampal volumetry showed a statistically significant impact on DCAD beyond the contributions of neuropsychology, ¹⁸F-fluorodeoxyglucose positron emission tomography/single-photon emission computed tomography, and cerebrospinal fluid markers (-8.5, CrI: [-11.5, -5.6]; -14.1, CrI: [-19.3, -8.8]; -10.6, CrI: [-14.6, -6.1], respectively).

DISCUSSION

There is a measurable effect of hippocampal volume on DCAD even when used on top of the traditional diagnostic workup.

Robust skull stripping using multiple MR image contrasts insensitive to pathology

Automatic skull-stripping or brain extraction of magnetic resonance (MR) images is often a fundamental step in many neuroimage processing pipelines. The accuracy of subsequent image processing relies on the accuracy of the skull-stripping. Although many automated stripping methods have been proposed in the past, it is still an active area of research particularly in the context of brain pathology. Most stripping methods are validated on T1-w MR images of normal brains, especially because high resolution T1-w sequences are widely acquired and ground truth manual brain mask segmentations are publicly available for normal brains. However, different MR acquisition protocols can provide complementary information about the brain tissues, which can be exploited for better distinction between brain, cerebrospinal fluid, and unwanted tissues such as skull, dura, marrow, or fat. This is especially true in the presence of pathology, where hemorrhages or other types of lesions can have similar intensities as skull in a T1-w image. In this paper, we propose a sparse patch based Multi-cONtrast brain STRipping method (MONSTR),2 where non-local patch information from one or more atlases, which contain multiple MR sequences and reference delineations of brain masks, are combined to generate a target brain mask. We compared MONSTR with four state-of-the-art, publicly available methods: BEaST, SPECTRE, ROBEX, and OptiBET. We evaluated the performance of these methods on 6 datasets consisting of both healthy subjects and patients with various pathologies. Three datasets (ADNI, MRBrainS, NAMIC) are publicly available, consisting of 44 healthy volunteers and 10 patients with schizophrenia. Other three in-house datasets, comprising 87 subjects in total, consisted of patients with mild to severe traumatic brain injury, brain tumors, and various movement disorders. A combination of T1-w, T2-w were used to skull-strip these datasets. We show significant improvement in stripping over the competing methods on both healthy and pathological brains. We also show that our multi-contrast framework is robust and maintains accurate performance across different types of acquisitions and scanners, even when using normal brains as atlases to strip pathological brains, demonstrating that our algorithm is applicable even when reference segmentations of pathological brains are not available to be used as atlases.

NEOCIVET: Towards accurate morphometry of neonatal gyrification and clinical applications in preterm newborns

Cerebral cortical folding becomes dramatically more complex in the fetal brain during the 3rd trimester of gestation; the process continues in a similar fashion in children who are born prematurely. To quantify this morphological development, it is necessary to extract the interface between gray matter and white matter, which is particularly challenging due to changing tissue contrast during brain maturation. We employed the well-established CIVET pipeline to extract this cortical surface, with point correspondence across subjects, using a surface-based spherical registration. We then developed a variant of the pipeline, called NEOCIVET, that quantified cortical folding using mean curvature and sulcal depth while addressing the well-known problems of poor and temporally-varying gray/white contrast as well as motion artifact in neonatal MRI. NEOCIVET includes: i) a tissue classification technique that analyzed multi-atlas texture patches using the nonlocal mean estimator and subsequently applied a label fusion approach based on a joint probability between templates, ii) neonatal template construction based on age-specific sub-groups, and iii) masking of non-interesting structures using label-fusion approaches. These techniques replaced modules that might be suboptimal for regional analysis of poor-contrast neonatal cortex. The proposed segmentation method showed more accurate results in subjects with various ages and with various degrees of motion compared to state-of-the-art methods. In the analysis of 158 preterm-born neonates, many with multiple scans (n=231; 26-40weeks postmenstrual age at scan), NEOCIVET identified increases in cortical folding over time in numerous cortical regions (mean curvature: +0.003/week; sulcal depth: +0.04mm/week) while folding did not change in major sulci that are known to develop early (corrected p<0.05). The proposed pipeline successfully mapped cortical structural development, supporting current models of cerebral morphogenesis, and furthermore, revealed impairment of cortical folding in extremely preterm newborns relative to relatively late preterm newborns, demonstrating its potential to provide biomarkers of prematurity-related developmental outcome.

An Optimized PatchMatch for multi-scale and multi-feature label fusion

Automatic segmentation methods are important tools for quantitative analysis of Magnetic Resonance Images (MRI). Recently, patch-based label fusion approaches have demonstrated state-of-the-art segmentation accuracy. In this paper, we introduce a new patch-based label fusion framework to perform segmentation of anatomical structures. The proposed approach uses an Optimized PAtchMatch Label fusion (OPAL) strategy that drastically reduces the computation time required for the search of similar patches. The reduced computation time of OPAL opens the way for new strategies and facilitates processing on large databases. In this paper, we investigate new perspectives offered by OPAL, by introducing a new multi-scale and multi-feature framework. During our validation on hippocampus segmentation we use two datasets: young adults in the ICBM cohort and elderly adults in the EADC-ADNI dataset. For both, OPAL is compared to state-of-the-art methods. Results show that OPAL obtained the highest median Dice coefficient (89.9% for ICBM and 90.1% for EADC-ADNI). Moreover, in both cases, OPAL produced a segmentation accuracy similar to inter-expert variability. On the EADC-ADNI dataset, we compare the hippocampal volumes obtained by manual and automatic segmentation. The volumes appear to be highly correlated that enables to perform more accurate separation of pathological populations.

Local manifold learning for multiatlas segmentation: application to hippocampal segmentation in healthy population and Alzheimer's disease

AIMS

Automated hippocampal segmentation is an important issue in many neuroscience studies.

METHODS

We presented and evaluated a novel segmentation method that utilized a manifold learning technique under the multiatlas-based segmentation scenario. A manifold representation of local patches for each voxel was achieved by applying an Isomap algorithm, which can then be used to obtain spatially local weights of atlases for label fusion. The obtained atlas weights potentially depended on all pairwise similarities of the population, which is in contrast to most existing label fusion methods that only rely on similarities between the target image and the atlases. The performance of the proposed method was evaluated for hippocampal segmentation and compared with two representative local weighted label fusion methods, that is, local majority voting and local weighted inverse distance voting, on an in-house dataset of 28 healthy adolescents (age range: 10-17 years) and two ADNI datasets of 100 participants (age range: 60-89 years). We also implemented hippocampal volumetric analysis and evaluated segmentation performance using atlases from a different dataset.

RESULTS

The median Dice similarities obtained by our proposed method were approximately 0.90 for healthy subjects and above 0.88 for two mixed diagnostic groups of ADNI subjects.

CONCLUSION

The experimental results demonstrated that the proposed method could obtain consistent and significant improvements over label fusion strategies that are implemented in the original space.

Prostate segmentation based on variant scale patch and local independent projection

Accurate segmentation of the prostate in computed tomography (CT) images is important in image-guided radiotherapy; however, difficulties remain associated with this task. In this study, an automatic framework is designed for prostate segmentation in CT images. We propose a novel image feature extraction method, namely, variant scale patch, which can provide rich image information in a low dimensional feature space. We assume that the samples from different classes lie on different nonlinear submanifolds and design a new segmentation criterion called local independent projection (LIP). In our method, a dictionary containing training samples is constructed. To utilize the latest image information, we use an online updated strategy to construct this dictionary. In the proposed LIP, locality is emphasized rather than sparsity; local anchor embedding is performed to determine the dictionary coefficients. Several morphological operations are performed to improve the achieved results. The proposed method has been evaluated based on 330 3-D images of 24 patients. Results show that the proposed method is robust and effective in segmenting prostate in CT images.

Magnetic Resonance Image Example-Based Contrast Synthesis

The performance of image analysis algorithms applied to magnetic resonance images is strongly influenced by the pulse sequences used to acquire the images. Algorithms are typically optimized for a targeted tissue contrast obtained from a particular implementation of a pulse sequence on a specific scanner. There are many practical situations, including multi-institution trials, rapid emergency scans, and scientific use of historical data, where the images are not acquired according to an optimal protocol or the desired tissue contrast is entirely missing. This paper introduces an image restoration technique that recovers images with both the desired tissue contrast and a normalized intensity profile. This is done using patches in the acquired images and an atlas containing patches of the acquired and desired tissue contrasts. The method is an example-based approach relying on sparse reconstruction from image patches. Its performance in demonstrated using several examples, including image intensity normalization, missing tissue contrast recovery, automatic segmentation, and multimodal registration. These examples demonstrate potential practical uses and also illustrate limitations of our approach.

A probabilistic patch-based label fusion model for multi-atlas segmentation with registration refinement: application to cardiac MR images

The evaluation of ventricular function is important for the diagnosis of cardiovascular diseases. It typically involves measurement of the left ventricular (LV) mass and LV cavity volume. Manual delineation of the myocardial contours is time-consuming and dependent on the subjective experience of the expert observer. In this paper, a multi-atlas method is proposed for cardiac magnetic resonance (MR) image segmentation. The proposed method is novel in two aspects. First, it formulates a patch-based label fusion model in a Bayesian framework. Second, it improves image registration accuracy by utilizing label information, which leads to improvement of segmentation accuracy. The proposed method was evaluated on a cardiac MR image set of 28 subjects. The average Dice overlap metric of our segmentation is 0.92 for the LV cavity, 0.89 for the right ventricular cavity and 0.82 for the myocardium. The results show that the proposed method is able to provide accurate information for clinical diagnosis.

Volumetric analysis of medial temporal lobe structures in brain development from childhood to adolescence

Puberty is an important stage of development as a child's sexual and physical characteristics mature because of hormonal changes. To better understand puberty-related effects on brain development, we investigated the magnetic resonance imaging (MRI) data of 306 subjects from 4 to 18 years of age. Subjects were grouped into before and during puberty groups according to their sexual maturity levels measured by the puberty scores. An appearance model-based automatic segmentation method with patch-based local refinement was employed to segment the MRI data and extract the volumes of medial temporal lobe (MTL) structures including the amygdala (AG), the hippocampus (HC), the entorhinal/perirhinal cortex (EPC), and the parahippocampal cortex (PHC). Our analysis showed age-related volumetric changes for the AG, HC, right EPC, and left PHC but only before puberty. After onset of puberty, these volumetric changes then correlate more with sexual maturity level, as measured by the puberty score. When normalized for brain volume, the volumes of the right HC decrease for boys; the volumes of the left HC increase for girls; and the volumes of the left and right PHC decrease for boys. These findings suggest that the rising levels of testosterone in boys and estrogen in girls might have opposite effects, especially for the HC and the PHC. Our findings on sex-specific and sexual maturity-related volumes may be useful in better understanding the MTL developmental differences and related learning, memory, and emotion differences between boys and girls during puberty.

Scoring by nonlocal image patch estimator for early detection of Alzheimer's disease

Detection of Alzheimer's disease (AD) at the first stages of the pathology is an important task to accelerate the development of new therapies and improve treatment. Compared to AD detection, the prediction of AD using structural MRI at the mild cognitive impairment (MCI) or pre-MCI stage is more complex because the associated anatomical changes are more subtle. In this study, we analyzed the capability of a recently proposed method, SNIPE (Scoring by Nonlocal Image Patch Estimator), to predict AD by analyzing entorhinal cortex (EC) and hippocampus (HC) scoring over the entire ADNI database (834 scans). Detection (AD vs. CN) and prediction (progressive — pMCI vs. stable — sMCI) efficiency of SNIPE were studied using volumetric and grading biomarkers. First, our results indicate that grading-based biomarkers are more relevant for prediction than volume-based biomarkers. Second, we show that HC-based biomarkers are more important than EC-based biomarkers for prediction. Third, we demonstrate that the results obtained by SNIPE are similar to or better than results obtained in an independent study using HC volume, cortical thickness, and tensor-based morphometry, individually and in combination. Fourth, a comparison of new patch-based methods shows that the nonlocal redundancy strategy involved in SNIPE obtained similar results to a new local sparse-based approach. Finally, we present the first results of patch-based morphometry to illustrate the progression of the pathology.