Segmentation-driven image registration- application to 4D DCE-MRI recordings of the moving kidneys

Variational Approach for Joint Kidney Segmentation and Registration from DCE-MRI Using Fuzzy Clustering with Shape Priors

The dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) technique has great potential in the diagnosis, therapy, and follow-up of patients with chronic kidney disease (CKD). Towards that end, precise kidney segmentation from DCE-MRI data becomes a prerequisite processing step. Exploiting the useful information about the kidney's shape in this step mandates a registration operation beforehand to relate the shape model coordinates to those of the image to be segmented. Imprecise alignment of the shape model induces errors in the segmentation results. In this paper, we propose a new variational formulation to jointly segment and register DCE-MRI kidney images based on fuzzy c-means clustering embedded within a level-set (LSet) method. The image pixels' fuzzy memberships and the spatial registration parameters are simultaneously updated in each evolution step to direct the LSet contour toward the target kidney. Results on real medical datasets of 45 subjects demonstrate the superior performance of the proposed approach, reporting a Dice similarity coefficient of 0.94 ± 0.03, Intersection-over-Union of 0.89 ± 0.05, and 2.2 ± 2.3 in 95-percentile of Hausdorff distance. Extensive experiments show that our approach outperforms several state-of-the-art LSet-based methods as well as two UNet-based deep neural models trained for the same task in terms of accuracy and consistency.

Level-Set-Based Kidney Segmentation from DCE-MRI Using Fuzzy Clustering with Population-Based and Subject-Specific Shape Statistics

The segmentation of dynamic contrast-enhanced magnetic resonance images (DCE-MRI) of the kidney is a fundamental step in the early and noninvasive detection of acute renal allograft rejection. In this paper, a new and accurate DCE‑MRI kidney segmentation method is proposed. In this method, fuzzy c-means (FCM) clustering is embedded into a level set method, with the fuzzy memberships being iteratively updated during the level set contour evolution. Moreover, population‑based shape (PB-shape) and subject-specific shape (SS-shape) statistics are both exploited. The PB-shape model is trained offline from ground-truth kidney segmentations of various subjects, whereas the SS-shape model is trained on the fly using the segmentation results that are obtained for a specific subject. The proposed method was evaluated on the real medical datasets of 45 subjects and reports a Dice similarity coefficient (DSC) of 0.953 ± 0.018, an intersection-over-union (IoU) of 0.91 ± 0.033, and 1.10 ± 1.4 in the 95-percentile of Hausdorff distance (HD95). Extensive experiments confirm the superiority of the proposed method over several state-of-the-art level set methods, with an average improvement of 0.7 in terms of HD95. It also offers an HD95 improvement of 9.5 and 3.8 over two deep neural networks based on the U-Net architecture. The accuracy improvements have been experimentally found to be more prominent on low-contrast and noisy images.

Kidney segmentation from DCE-MRI converging level set methods, fuzzy clustering and Markov random field modeling

Early diagnosis of transplanted kidney function requires precise Kidney segmentation from Dynamic Contrast-Enhanced Magnetic Resonance Imaging images as a preliminary step. In this regard, this paper aims to propose an automated and accurate DCE-MRI kidney segmentation method integrating fuzzy c-means (FCM) clustering and Markov random field modeling into a level set formulation. The fuzzy memberships, kidney's shape prior model, and spatial interactions modeled using a second-order MRF guide the LS contour evolution towards the target kidney. Several experiments on real medical data of 45 subjects have shown that the proposed method can achieve high and consistent segmentation accuracy regardless of where the LS contour was initialized. It achieves an accuracy of 0.956 ± 0.019 in Dice similarity coefficient (DSC) and 1.15 ± 1.46 in 95% percentile of Hausdorff distance (HD95). Our quantitative comparisons confirm the superiority of the proposed method over several LS methods with an average improvement of more than 0.63 in terms of HD95. It also offers HD95 improvements of 9.62 and 3.94 over two deep neural networks based on the U-Net model. The accuracy improvements are experimentally found to be more profound on low-contrast images as well as DCE-MRI images with high noise levels.

Manifold-based respiratory phase estimation enables motion and distortion correction of free-breathing cardiac diffusion tensor MRI

PURPOSE

For in vivo cardiac DTI, breathing motion and B₀ field inhomogeneities produce misalignment and geometric distortion in diffusion-weighted (DW) images acquired with conventional single-shot EPI. We propose using a dimensionality reduction method to retrospectively estimate the respiratory phase of DW images and facilitate both distortion correction (DisCo) and motion compensation.

METHODS

Free-breathing electrocardiogram-triggered whole left-ventricular cardiac DTI using a second-order motion-compensated spin echo EPI sequence and alternating directionality of phase encoding blips was performed on 11 healthy volunteers. The respiratory phase of each DW image was estimated after projecting the DW images into a 2D space with Laplacian eigenmaps. DisCo and motion compensation were applied to the respiratory sorted DW images. The results were compared against conventional breath-held T₂ half-Fourier single shot turbo spin echo. Cardiac DTI parameters including fractional anisotropy, mean diffusivity, and helix angle transmurality were compared with and without DisCo.

RESULTS

The left-ventricular geometries after DisCo and motion compensation resulted in significantly improved alignment of DW images with T₂ reference. DisCo reduced the distance between the left-ventricular contours by 13.2% ± 19.2%, P < .05 (2.0 ± 0.4 for DisCo and 2.4 ± 0.5 mm for uncorrected). DisCo DTI parameter maps yielded no significant differences (mean diffusivity: 1.55 ± 0.13 × 10^-3 mm² /s and 1.53 ± 0.13 × 10^-3 mm² /s, P = .09; fractional anisotropy: 0.375 ± 0.041 and 0.379 ± 0.045, P = .11; helix angle transmurality: 1.00% ± 0.10°/% and 0.99% ± 0.12°/%, P = .44), although the orientation of individual tensors differed.

CONCLUSION

Retrospective respiratory phase estimation with LE-based DisCo and motion compensation in free-breathing cardiac DTI resulting in significantly reduced geometric distortion and improved alignment within and across slices.

A cascade-network framework for integrated registration of liver DCE-MR images

Registration of hepatic dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) is an important task for evaluation of transarterial chemoembolization (TACE) or radiofrequency ablation by quantifying enhancing viable residue tumor against necrosis. However, intensity changes due to contrast agents combined with spatial deformations render technical challenges for accurate registration of DCE-MRI, and traditional deformable registration methods using mutual information are often computationally intensive in order to tolerate such intensity enhancement and shape deformation variability. To address this problem, we propose a cascade network framework composed of a de-enhancement network (DE-Net) and a registration network (Reg-Net) to first remove contrast enhancement effects and then register the liver images in different phases. In experiments, we used DCE-MRI series of 97 patients from Renji Hospital of Shanghai Jiaotong University and registered the arterial phase and the portal venous phase images onto the pre-contrast phases. The performance of the cascade network framework was compared with that of the traditional registration method SyN in the ANTs toolkit and Reg-Net without DE-Net. The results showed that the proposed method achieved comparable registration performance with SyN but significantly improved the efficiency.

Modeling dynamic radial contrast enhanced MRI with linear time invariant systems for motion correction in quantitative assessment of kidney function

Early identification of kidney function deterioration is essential to determine which newborn patients with congenital kidney disease should be considered for surgical intervention as opposed to observation. Kidney function can be measured by fitting a tracer kinetic (TK) model onto a series of Dynamic Contrast Enhanced (DCE) MR images and estimating the filtration rate parameter from the model. Unfortunately, breathing and large bulk motion events due to patient movement in the scanner create outliers and misalignments that introduce large errors in the TK model parameter estimates even when using a motion-robust dynamic radial VIBE sequence for DCE-MR imaging. The misalignments between the series of volumes are difficult to correct using standard registration due to 1) the large differences in geometry and contrast between volumes of the dynamic sequence and 2) the requirement of fast dynamic imaging to achieve high temporal resolution and motion deteriorates image quality. These difficulties reduce the accuracy and stability of registration over the dynamic sequence. An alternative registration approach is to generate noise and motion free templates of the original data from the TK model and use them to register each volume to its contrast-matched template. However, the TK models used to characterize DCE-MRI are tissue specific, non-linear and sensitive to the same motion and sampling artifacts that hinder registration in the first place. Hence, these can only be applied to register accurately pre-segmented regions of interest, such as kidneys, and might converge to local minima under the presence of large artifacts. Here we introduce a novel linear time invariant (LTI) model to characterize DCE-MR data for different tissue types within a volume. We approximate the LTI model as a sparse sum of first order LTI functions to introduce robustness to motion and sampling artifacts. Hence, this model is well suited for registration of the entire field of view of DCE-MR data with artifacts and outliers. We incorporate this LTI model into a registration framework and evaluate it on both synthetic data and data from 20 children. For each subject, we reconstructed the sequence of DCE-MR images, detected corrupted volumes acquired during motion, aligned the sequence of volumes and recovered the corrupted volumes using the LTI model. The results show that our approach correctly aligned the volumes, provided the most stable registration in time and improved the tracer kinetic model fit.

Image registration in dynamic renal MRI-current status and prospects

Magnetic resonance imaging (MRI) modalities have achieved an increasingly important role in the clinical work-up of chronic kidney diseases (CKD). This comprises among others assessment of hemodynamic parameters by arterial spin labeling (ASL) or dynamic contrast-enhanced (DCE-) MRI. Especially in the latter, images or volumes of the kidney are acquired over time for up to several minutes. Therefore, they are hampered by motion, e.g., by pulsation, peristaltic, or breathing motion. This motion can hinder subsequent image analysis to estimate hemodynamic parameters like renal blood flow or glomerular filtration rate (GFR). To overcome motion artifacts in time-resolved renal MRI, a wide range of strategies have been proposed. Renal image registration approaches could be grouped into (1) image acquisition techniques, (2) post-processing methods, or (3) a combination of image acquisition and post-processing approaches. Despite decades of progress, the translation in clinical practice is still missing. The aim of the present article is to discuss the existing literature on renal image registration techniques and show today’s limitations of the proposed techniques that hinder clinical translation. This paper includes transformation, criterion function, and search types as traditional components and emerging registration technologies based on deep learning. The current trend points towards faster registrations and more accurate results. However, a standardized evaluation of image registration in renal MRI is still missing.

Renal Functional MRI and Its Application

Renal function varies according to the nature and stage of diseases. Renal functional magnetic resonance imaging (fMRI), a technique considered superior to the most common method used to estimate the glomerular filtration rate, allows for noninvasive, accurate measurements of renal structures and functions in both animals and humans. It has become increasingly prevalent in research and clinical applications. In recent years, renal fMRI has developed rapidly with progress in MRI hardware and emerging postprocessing algorithms. Function-related imaging markers can be acquired via renal fMRI, encompassing water molecular diffusion, perfusion, and oxygenation. This review focuses on the progression and challenges of the main renal fMRI methods, including dynamic contrast-enhanced MRI, blood oxygen level-dependent MRI, diffusion-weighted imaging, diffusion tensor imaging, arterial spin labeling, fat fraction imaging, and their recent clinical applications.

LEVEL OF EVIDENCE

5 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018;48:863-881.

Kidney segmentation in ultrasound, magnetic resonance and computed tomography images: A systematic review

BACKGROUND AND OBJECTIVE

Segmentation is an essential step in computer-aided diagnosis and treatment planning of kidney diseases. In recent years, several researchers proposed multiple techniques to segment the kidney in medical images from distinct imaging acquisition systems, namely ultrasound, magnetic resonance, and computed tomography. This article aims to present a systematic review of the different methodologies developed for kidney segmentation.

METHODS

With this work, it is intended to analyze and categorize the different kidney segmentation algorithms, establishing a comparison between them and discussing the most appropriate methods for each modality. For that, articles published between 2010 and 2016 were analyzed. The search was performed in Scopus and Web of Science using the expressions "kidney segmentation" and "renal segmentation".

RESULTS

A total of 1528 articles were retrieved from the databases, and 95 articles were selected for this review. After analysis of the selected articles, the reviewed segmentation techniques were categorized according to their theoretical approach.

CONCLUSIONS

Based on the performed analysis, it was possible to identify segmentation approaches based on distinct image processing classes that can be used to accurately segment the kidney in images of different imaging modalities. Nevertheless, further research on kidney segmentation must be conducted to overcome the current drawbacks of the state-of-the-art methods. Moreover, a standardization of the evaluation database and metrics is needed to allow a direct comparison between methods.

Modified dixon-based renal dynamic contrast-enhanced MRI facilitates automated registration and perfusion analysis

Purpose

Renal dynamic contrast‐enhanced (DCE) MRI provides information on renal perfusion and filtration. However, clinical implementation is hampered by challenges in postprocessing as a result of misalignment of the kidneys due to respiration. We propose to perform automated image registration using the fat‐only images derived from a modified Dixon reconstruction of a dual‐echo acquisition because these provide consistent contrast over the dynamic series.

Methods

DCE data of 10 hypertensive patients was used. Dual‐echo images were acquired at 1.5 T with temporal resolution of 3.9 s during contrast agent injection. Dixon fat, water, and in‐phase and opposed‐phase (OP) images were reconstructed. Postprocessing was automated. Registration was performed both to fat images and OP images for comparison. Perfusion and filtration values were extracted from a two‐compartment model fit.

Results

Automatic registration to fat images performed better than automatic registration to OP images with visible contrast enhancement. Median vertical misalignment of the kidneys was 14 mm prior to registration, compared to 3 mm and 5 mm with registration to fat images and OP images, respectively (P = 0.03). Mean perfusion values and MR‐based glomerular filtration rates (GFR) were 233 ± 64 mL/100 mL/min and 60 ± 36 mL/minute, respectively, based on fat‐registered images. MR‐based GFR correlated with creatinine‐based GFR (P = 0.04) for fat‐registered images. For unregistered and OP‐registered images, this correlation was not significant.

Conclusion

Absence of contrast changes on Dixon fat images improves registration in renal DCE MRI and enables automated postprocessing, resulting in a more accurate estimation of GFR. Magn Reson Med 80:66–76, 2018. © 2017 The Authors Magnetic Resonance in Medicine published by Wiley Periodicals, Inc. on behalf of International Society for Magnetic Resonance in Medicine. This is an open access article under the terms of the Creative Commons Attribution NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.

Temporal Subtraction of Serial CT Images with Large Deformation Diffeomorphic Metric Mapping in the Identification of Bone Metastases

Purpose To determine the improvement of radiologist efficiency and performance in the detection of bone metastases at serial follow-up computed tomography (CT) by using a temporal subtraction (TS) technique based on an advanced nonrigid image registration algorithm. Materials and Methods This retrospective study was approved by the institutional review board, and informed consent was waived. CT image pairs (previous and current scans of the torso) in 60 patients with cancer (primary lesion location: prostate, n = 14; breast, n = 16; lung, n = 20; liver, n = 10) were included. These consisted of 30 positive cases with a total of 65 bone metastases depicted only on current images and confirmed by two radiologists who had access to additional imaging examinations and clinical courses and 30 matched negative control cases (no bone metastases). Previous CT images were semiautomatically registered to current CT images by the algorithm, and TS images were created. Seven radiologists independently interpreted CT image pairs to identify newly developed bone metastases without and with TS images with an interval of at least 30 days. Jackknife free-response receiver operating characteristics (JAFROC) analysis was conducted to assess observer performance. Reading time was recorded, and usefulness was evaluated with subjective scores of 1-5, with 5 being extremely useful and 1 being useless. Significance of these values was tested with the Wilcoxon signed-rank test. Results The subtraction images depicted various types of bone metastases (osteolytic, n = 28; osteoblastic, n = 26; mixed osteolytic and blastic, n = 11) as temporal changes. The average reading time was significantly reduced (384.3 vs 286.8 seconds; Wilcoxon signed rank test, P = .028). The average figure-of-merit value increased from 0.758 to 0.835; however, this difference was not significant (JAFROC analysis, P = .092). The subjective usefulness survey response showed a median score of 5 for use of the technique (range, 3-5). Conclusion TS images obtained from serial CT scans using nonrigid registration successfully depicted newly developed bone metastases and showed promise for their efficient detection. ^© RSNA, 2017 Online supplemental material is available for this article.

Workflow sensitivity of post-processing methods in renal DCE-MRI

OBJECTIVE

Estimation of renal filtration using dynamic contrast-enhanced imaging (DCE-MRI) requires a series of analysis steps. The possible number of distinct post-processing chains is large and grows rapidly with increasing number of processing steps or options. In this study we introduce a framework for systematic evaluation of the post-processing chains. The framework is later used to highlight the workflow processing chain sensitivity towards accuracy in estimation of glomerular filtration rate (GFR).

METHODS

Twenty healthy volunteers underwent DCE-MRI examinations as well as iohexol clearance for reference GFR measurements. In total, 692 different combinations of post-processing steps were explored for analysis, including options for kidney segmentation, B1 inhomogeneity correction, placement of arterial input function, gadolinium concentration estimation as well as handling of motion-corrupted volumes and breathing motion. The evaluation of various processing chains is presented using a classification tree framework and random forest ensemble learning.

RESULTS

Among the processing steps subject to testing, methods for calculating the gadolinium concentration as well as B1 inhomogeneity correction had the largest impact on accuracy of GFR estimations. Different segmentation methods did not play an important role in the post-processing of the MR data except from one processing chain where the automated segmentation outperformed the manual segmentation.

CONCLUSION

The proposed classification trees were efficiently used as a statistical tool for visualization and communication of results to distinguish between important and less influential processing steps in renal DCE-MRI. We also identified several crucial factors in the processing chain.

Pieces-of-parts for supervoxel segmentation with global context: Application to DCE-MRI tumour delineation

Rectal tumour segmentation in dynamic contrast-enhanced MRI (DCE-MRI) is a challenging task, and an automated and consistent method would be highly desirable to improve the modelling and prediction of patient outcomes from tissue contrast enhancement characteristics - particularly in routine clinical practice. A framework is developed to automate DCE-MRI tumour segmentation, by introducing: perfusion-supervoxels to over-segment and classify DCE-MRI volumes using the dynamic contrast enhancement characteristics; and the pieces-of-parts graphical model, which adds global (anatomic) constraints that further refine the supervoxel components that comprise the tumour. The framework was evaluated on 23 DCE-MRI scans of patients with rectal adenocarcinomas, and achieved a voxelwise area-under the receiver operating characteristic curve (AUC) of 0.97 compared to expert delineations. Creating a binary tumour segmentation, 21 of the 23 cases were segmented correctly with a median Dice similarity coefficient (DSC) of 0.63, which is close to the inter-rater variability of this challenging task. A second study is also included to demonstrate the method's generalisability and achieved a DSC of 0.71. The framework achieves promising results for the underexplored area of rectal tumour segmentation in DCE-MRI, and the methods have potential to be applied to other DCE-MRI and supervoxel segmentation problems.

An open source software for analysis of dynamic contrast enhanced magnetic resonance images: UMMPerfusion revisited

Background

Perfusion imaging has become an important image based tool to derive the physiological information in various applications, like tumor diagnostics and therapy, stroke, (cardio-) vascular diseases, or functional assessment of organs. However, even after 20 years of intense research in this field, perfusion imaging still remains a research tool without a broad clinical usage. One problem is the lack of standardization in technical aspects which have to be considered for successful quantitative evaluation; the second problem is a lack of tools that allow a direct integration into the diagnostic workflow in radiology.

Results

Five compartment models, namely, a one compartment model (1CP), a two compartment exchange (2CXM), a two compartment uptake model (2CUM), a two compartment filtration model (2FM) and eventually the extended Toft’s model (ETM) were implemented as plugin for the DICOM workstation OsiriX. Moreover, the plugin has a clean graphical user interface and provides means for quality management during the perfusion data analysis. Based on reference test data, the implementation was validated against a reference implementation. No differences were found in the calculated parameters.

Conclusion

We developed open source software to analyse DCE-MRI perfusion data. The software is designed as plugin for the DICOM Workstation OsiriX. It features a clean GUI and provides a simple workflow for data analysis while it could also be seen as a toolbox providing an implementation of several recent compartment models to be applied in research tasks. Integration into the infrastructure of a radiology department is given via OsiriX. Results can be saved automatically and reports generated automatically during data analysis ensure certain quality control.