Discontinuity Preserving Liver MR Registration with 3D Active Contour Motion Segmentation

Adaptive approach for tracking movements of biological targets: application to robot-based intervention for prostate cancer

Introduction

In this paper, we introduce an advanced robotic system integrated with an adaptive optimization algorithm, tailored for Brachytherapy in prostate cancer treatment. The primary innovation of the system is the algorithm itself, designed to dynamically adjust needle trajectories in response to the real-time movements of the prostate gland during the local intervention.

Methods

The system employs real-time position data extracted from Magnetic Resonance Imaging (MRI) to ensure precise targeting of the prostate, adapting to its constant motion and deformation. This precision is crucial in Brachytherapy, where the accurate placement of radioactive seeds directly impacts the efficacy of the treatment and minimizes damage to surrounding safe tissues.

Results

Our results demonstrate a marked improvement in the accuracy of radiation seed placement, directly correlating to more effective radiation delivery. The adaptive nature of the algorithm significantly reduces the number of needle insertions, leading to a less invasive treatment experience for patients. This reduction in needle insertions also contributes to lower risks of infection and shorter recovery times.

Discussion

This novel robotic system, enhanced by the adaptive optimization algorithm, improves the coverage of targets reached by a traditional combinatorial approach by approximately 15% with fewer required needles. The improved precision and reduced invasiveness highlight the potential of this system to enhance the overall effectiveness and patient experience in prostate cancer Brachytherapy.

A segmentation-informed deep learning framework to register dynamic two-dimensional magnetic resonance images of the vocal tract during speech

Objective

Dynamic magnetic resonance (MR) imaging enables visualisation of articulators during speech. There is growing interest in quantifying articulator motion in two-dimensional MR images of the vocal tract, to better understand speech production and potentially inform patient management decisions. Image registration is an established way to achieve this quantification. Recently, segmentation-informed deformable registration frameworks have been developed and have achieved state-of-the-art accuracy. This work aims to adapt such a framework and optimise it for estimating displacement fields between dynamic two-dimensional MR images of the vocal tract during speech.

Methods

A deep-learning-based registration framework was developed and compared with current state-of-the-art registration methods and frameworks (two traditional methods and three deep-learning-based frameworks, two of which are segmentation informed). The accuracy of the methods and frameworks was evaluated using the Dice coefficient (DSC), average surface distance (ASD) and a metric based on velopharyngeal closure. The metric evaluated if the fields captured a clinically relevant and quantifiable aspect of articulator motion.

Results

The segmentation-informed frameworks achieved higher DSCs and lower ASDs and captured more velopharyngeal closures than the traditional methods and the framework that was not segmentation informed. All segmentation-informed frameworks achieved similar DSCs and ASDs. However, the proposed framework captured the most velopharyngeal closures.

Conclusions

A framework was successfully developed and found to more accurately estimate articulator motion than five current state-of-the-art methods and frameworks.

Significance

The first deep-learning-based framework specifically for registering dynamic two-dimensional MR images of the vocal tract during speech has been developed and evaluated.

A Spatial-Motion-Segmentation Algorithm by Fusing EDPA and Motion Compensation

Motion segmentation is one of the fundamental steps for detection, tracking, and recognition, and it can separate moving objects from the background. In this paper, we propose a spatial-motion-segmentation algorithm by fusing the events-dimensionality-preprocessing algorithm (EDPA) and the volume of warped events (VWE). The EDPA consists of depth estimation, linear interpolation, and coordinate normalization to obtain an extra dimension (Z) of events. The VWE is conducted by accumulating the warped events (i.e., motion compensation), and the iterative-clustering algorithm is introduced to maximize the contrast (i.e., variance) in the VWE. We established our datasets by utilizing the event-camera simulator (ESIM), which can simulate high-frame-rate videos that are decomposed into frames to generate a large amount of reliable events data. Exterior and interior scenes were segmented in the first part of the experiments. We present the sparrow search algorithm-based gradient ascent (SSA-Gradient Ascent). The SSA-Gradient Ascent, gradient ascent, and particle swarm optimization (PSO) were evaluated in the second part. In Motion Flow 1, the SSA-Gradient Ascent was 0.402% higher than the basic variance value, and 52.941% faster than the basic convergence rate. In Motion Flow 2, the SSA-Gradient Ascent still performed better than the others. The experimental results validate the feasibility of the proposed algorithm.

ECSU-Net: An Embedded Clustering Sliced U-Net Coupled With Fusing Strategy for Efficient Intervertebral Disc Segmentation and Classification

Automatic vertebra segmentation from computed tomography (CT) image is the very first and a decisive stage in vertebra analysis for computer-based spinal diagnosis and therapy support system. However, automatic segmentation of vertebra remains challenging due to several reasons, including anatomic complexity of spine, unclear boundaries of the vertebrae associated with spongy and soft bones. Based on 2D U-Net, we have proposed an Embedded Clustering Sliced U-Net (ECSU-Net). ECSU-Net comprises of three modules named segmentation, intervertebral disc extraction (IDE) and fusion. The segmentation module follows an instance embedding clustering approach, where our three sliced sub-nets use axis of CT images to generate a coarse 2D segmentation along with embedding space with the same size of the input slices. Our IDE module is designed to classify vertebra and find the inter-space between two slices of segmented spine. Our fusion module takes the coarse segmentation (2D) and outputs the refined 3D results of vertebra. A novel adaptive discriminative loss (ADL) function is introduced to train the embedding space for clustering. In the fusion strategy, three modules are integrated via a learnable weight control component, which adaptively sets their contribution. We have evaluated classical and deep learning methods on Spineweb dataset-2. ECSU-Net has provided comparable performance to previous neural network based algorithms achieving the best segmentation dice score of 95.60% and classification accuracy of 96.20%, while taking less time and computation resources.

An Unsupervised Learning-Based Multi-Organ Registration Method for 3D Abdominal CT Images

Medical image registration is an essential technique to achieve spatial consistency geometric positions of different medical images obtained from single- or multi-sensor, such as computed tomography (CT), magnetic resonance (MR), and ultrasound (US) images. In this paper, an improved unsupervised learning-based framework is proposed for multi-organ registration on 3D abdominal CT images. First, the explored coarse-to-fine recursive cascaded network (RCN) modules are embedded into a basic U-net framework to achieve more accurate multi-organ registration results from 3D abdominal CT images. Then, a topology-preserving loss is added in the total loss function to avoid a distortion of the predicted transformation field. Four public databases are selected to validate the registration performances of the proposed method. The experimental results show that the proposed method is superior to some existing traditional and deep learning-based methods and is promising to meet the real-time and high-precision clinical registration requirements of 3D abdominal CT images.

Sliding motion compensated low-rank plus sparse (SMC-LS) reconstruction for high spatiotemporal free-breathing liver 4D DCE-MRI

Liver dynamic contrast-enhanced MRI (DCE-MRI) requires high spatiotemporal resolution and large field of view to clearly visualize all relevant enhancement phases and detect early-stage liver lesions. The low-rank plus sparse (L + S) reconstruction outperforms standard sparsity-only-based reconstruction through separation of low-rank background component (L) and sparse dynamic components (S). However, the L + S decomposition is sensitive to respiratory motion so that image quality is compromised when breathing occurs during long time data acquisition. To enable high quality reconstruction for free-breathing liver 4D DCE-MRI, this paper presents a novel method called SMC-LS, which incorporates Sliding Motion Compensation into the standard L + S reconstruction. The global superior-inferior displacement of the internal abdominal organs is inferred directly from the undersampled raw data and then used to correct the breathing induced sliding motion which is the dominant component of respiratory motion. With sliding motion compensation, the reconstructed temporal frames are roughly registered before applying the standard L + S decomposition. The proposed method has been validated using free-breathing liver 4D MRI phantom data, free-breathing liver 4D DCE-MRI phantom data, and in vivo free breathing liver 4D MRI dataset. Results demonstrated that SMC-LS reconstruction can effectively reduce motion blurring artefacts and preserve both spatial structures and temporal variations at a sub-second temporal frame rate for free-breathing whole-liver 4D DCE-MRI.