Segmentation of Infant Hippocampus Using Common Feature Representations Learned for Multimodal Longitudinal Data

Hippocampal Shape Maturation in Childhood and Adolescence

The hippocampus is a subcortical structure critical for learning and memory, and a thorough understanding of its neurodevelopment is important for studying these processes in health and disease. However, few studies have quantified the typical developmental trajectory of the structure in childhood and adolescence. This study examined the cross-sectional age-related changes and sex differences in hippocampal shape in a multisite, multistudy cohort of 1676 typically developing children (age 1-22 years) using a novel intrinsic brain mapping method based on Laplace-Beltrami embedding of surfaces. Significant age-related expansion was observed bilaterally and nonlinear growth was observed primarily in the right head and tail of the hippocampus. Sex differences were also observed bilaterally along the lateral and medial aspects of the surface, with females exhibiting relatively larger surface expansion than males. Additionally, the superior posterior lateral surface of the left hippocampus exhibited an age-sex interaction with females expanding faster than males. Shape analysis provides enhanced sensitivity to regional changes in hippocampal morphology over traditional volumetric approaches and allows for the localization of developmental effects. Our results further support evidence that hippocampal structures follow distinct maturational trajectories that may coincide with the development of learning and memory skills during critical periods of development.

A Novel Approach for Manual Segmentation of the Amygdala and Hippocampus in Neonate MRI

The gross anatomy of the infant brain at term is fairly similar to that of the adult brain, but structures are immature, and the brain undergoes rapid growth during the first 2 years of life. Neonate magnetic resonance (MR) images have different contrasts compared to adult images, and automated segmentation of brain magnetic resonance imaging (MRI) can thus be considered challenging as less software options are available. Despite this, most anatomical regions are identifiable and thus amenable to manual segmentation. In the current study, we developed a protocol for segmenting the amygdala and hippocampus in T2-weighted neonatal MR images. The participants were 31 healthy infants between 2 and 5 weeks of age. Intra-rater reliability was measured in 12 randomly selected MR images, where 6 MR images were segmented at 1-month intervals between the delineations, and another 6 MR images at 6-month intervals. The protocol was also tested by two independent raters in 20 randomly selected T2-weighted images, and finally with T1 images. Intraclass correlation coefficient (ICC) and Dice similarity coefficient (DSC) for intra-rater, inter-rater, and T1 vs. T2 comparisons were computed. Moreover, manual segmentations were compared to automated segmentations performed by iBEAT toolbox in 10 T2-weighted MR images. The intra-rater reliability was high ICC ≥ 0.91, DSC ≥ 0.89, the inter-rater reliabilities were satisfactory ICC ≥ 0.90, DSC ≥ 0.75 for hippocampus and DSC ≥ 0.52 for amygdalae. Segmentations for T1 vs. T2-weighted images showed high consistency ICC ≥ 0.90, DSC ≥ 0.74. The manual and iBEAT segmentations showed no agreement, DSC ≥ 0.39. In conclusion, there is a clear need to improve and develop the procedures for automated segmentation of infant brain MR images.

4D Multi-atlas Label Fusion using Longitudinal Images

Longitudinal reproducibility is an essential concern in automated medical image segmentation, yet has proven to be an elusive objective as manual brain structure tracings have shown more than 10% variability. To improve reproducibility, longitudinal segmentation (4D) approaches have been investigated to reconcile temporal variations with traditional 3D approaches. In the past decade, multi-atlas label fusion has become a state-of-the-art segmentation technique for 3D image and many efforts have been made to adapt it to a 4D longitudinal fashion. However, the previous methods were either limited by using application specified energy function (e.g., surface fusion and multi model fusion) or only considered temporal smoothness on two consecutive time points (t and t+1) under sparsity assumption. Therefore, a 4D multi-atlas label fusion theory for general label fusion purpose and simultaneously considering temporal consistency on all time points is appealing. Herein, we propose a novel longitudinal label fusion algorithm, called 4D joint label fusion (4DJLF), to incorporate the temporal consistency modeling via non-local patch-intensity covariance models. The advantages of 4DJLF include: (1) 4DJLF is under the general label fusion framework by simultaneously incorporating the spatial and temporal covariance on all longitudinal time points. (2) The proposed algorithm is a longitudinal generalization of a leading joint label fusion method (JLF) that has proven adaptable to a wide variety of applications. (3) The spatial temporal consistency of atlases is modeled in a probabilistic model inspired from both voting based and statistical fusion. The proposed approach improves the consistency of the longitudinal segmentation while retaining sensitivity compared with original JLF approach using the same set of atlases. The method is available online in open-source.

Consistent Multi-Atlas Hippocampus Segmentation for Longitudinal MR Brain Images with Temporal Sparse Representation

In this paper, we propose a novel multi-atlas based longitudinal label fusion method with temporal sparse representation technique to segment hippocampi at all time points simultaneously. First, we use groupwise longitudinal registration to simultaneously (1) estimate a group-mean image of a subject image sequence and (2) register its all time-point images to the estimated group-mean image consistently over time. Then, by registering all atlases with the group-mean image, we can align all atlases longitudinally consistently to each time point of the subject image sequence. Finally, we propose a longitudinal label fusion method to propagate all atlas labels to the subject image sequence by simultaneously labeling a set of temporally-corresponded voxels with a temporal consistency constraint on sparse representation. Experimental results demonstrate that our proposed method can achieve more accurate and consistent hippocampus segmentation than the state-of-the-art counterpart methods.