Multimodality multidimensional image analysis of cortical and subcortical plasticity in the rat brain

Smoothness-guided 3-D reconstruction of 2-D histological images

This paper tackles two problems: (1) the reconstruction of 3-D volumes from 2-D post-mortem slices (e.g., histology, autoradiography, immunohistochemistry) in the absence of external reference, and (2) the quantitative evaluation of the 3-D reconstruction. We note that the quality of a reconstructed volume is usually assessed by considering the smoothness of some reconstructed structures of interest (e.g., the gray-white matter surfaces in brain images). Here we propose to use smoothness as a means to drive the reconstruction process itself. From a pair-wise rigid reconstruction of the 2-D slices, we first extract the boundaries of structures of interest. Those are then smoothed with a min-max curvature flow confined to the 2-D planes in which the slices lie. Finally, for each slice, we estimate a linear or flexible transformation from the sparse displacement field computed from the flow, which we apply to the original 2-D slices to obtain a smooth volume. In addition, we present a co-occurrence matrix-based technique to quantify the smoothness of reconstructed volumes. We discuss and validate the application of both our reconstruction approach and the smoothness measure on synthetic examples as well as real histological data.

Evaluation of registration strategies for multi-modality images of rat brain slices

In neuroscience, small-animal studies frequently involve dealing with series of images from multiple modalities such as histology and autoradiography. The consistent and bias-free restacking of multi-modality image series is obligatory as a starting point for subsequent non-rigid registration procedures and for quantitative comparisons with positron emission tomography (PET) and other in vivo data. Up to now, consistency between 2D slices without cross validation using an inherent 3D modality is frequently presumed to be close to the true morphology due to the smooth appearance of the contours of anatomical structures. However, in multi-modality stacks consistency is difficult to assess. In this work, consistency is defined in terms of smoothness of neighboring slices within a single modality and between different modalities. Registration bias denotes the distortion of the registered stack in comparison to the true 3D morphology and shape. Based on these metrics, different restacking strategies of multi-modality rat brain slices are experimentally evaluated. Experiments based on MRI-simulated and real dual-tracer autoradiograms reveal a clear bias of the restacked volume despite quantitatively high consistency and qualitatively smooth brain structures. However, different registration strategies yield different inter-consistency metrics. If no genuine 3D modality is available, the use of the so-called SOP (slice-order preferred) or MOSOP (modality-and-slice-order preferred) strategy is recommended.

Piecewise affine registration of biological images for volume reconstruction

This manuscript tackles the reconstruction of 3-D volumes via mono-modal registration of series of 2-D biological images (histological sections, autoradiographs, cryosections, etc.). The process of acquiring these images typically induces composite transformations that we model as a number of rigid or affine local transformations embedded in an elastic one. We propose a registration approach closely derived from this model. Given a pair of input images, we first compute a dense similarity field between them with a block matching algorithm. We use as a similarity measure an extension of the classical correlation coefficient that improves the consistency of the field. A hierarchical clustering algorithm then automatically partitions the field into a number of classes from which we extract independent pairs of sub-images. Our clustering algorithm relies on the Earth mover's distribution metric and is additionally guided by robust least-square estimation of the transformations associated with each cluster. Finally, the pairs of sub-images are, independently, affinely registered and a hybrid affine/non-linear interpolation scheme is used to compose the output registered image. We investigate the behavior of our approach on several batches of histological data and discuss its sensitivity to parameters and noise.

Fusion of autoradiographs with an MR volume using 2-D and 3-D linear transformations

In the past years, the development of 3-D medical imaging has enabled the 3-D imaging of in vivo tissues, from an anatomical (MR, CT) or even functional (fMRI, PET, SPECT) point of view. However, despite immense technological progress, the resolution of these images is still short of the level of anatomical or functional details that in vitro imaging (e.g., histology, autoradiography) permits. The motivation of this work is to compare fMRI activations to activations observed in autoradiographic images from the same animals. We aim to fuse post-mortem autoradiographic data with a pre-mortem anatomical MR image. We first reconstruct a 3-D volume from the 2-D autoradiographic sections, coherent both in geometry and intensity. Then, this volume is fused with the MR image. This way, we ensure that the reconstructed 3-D volume can be superimposed onto the MR image that represents the reference anatomy. We demonstrate that this fusion can be achieved by using only simple global transformations (rigid and/or affine, 2-D and 3-D), while yielding very satisfactory results.