Recurrent inference machines as inverse problem solvers for MR relaxometry

A model-based MR parameter mapping network robust to substantial variations in acquisition settings

Deep learning methods show great potential for the efficient and precise estimation of quantitative parameter maps from multiple magnetic resonance (MR) images. Current deep learning-based MR parameter mapping (MPM) methods are mostly trained and tested using data with specific acquisition settings. However, scan protocols usually vary with centers, scanners, and studies in practice. Thus, deep learning methods applicable to MPM with varying acquisition settings are highly required but still rarely investigated. In this work, we develop a model-based deep network termed MMPM-Net for robust MPM with varying acquisition settings. A deep learning-based denoiser is introduced to construct the regularization term in the nonlinear inversion problem of MPM. The alternating direction method of multipliers is used to solve the optimization problem and then unrolled to construct MMPM-Net. The variation in acquisition parameters can be addressed by the data fidelity component in MMPM-Net. Extensive experiments are performed on R2 mapping and R1 mapping datasets with substantial variations in acquisition settings, and the results demonstrate that the proposed MMPM-Net method outperforms other state-of-the-art MR parameter mapping methods both qualitatively and quantitatively.

SIMPLEX: Multiple phase-cycled bSSFP quantitative magnetization transfer imaging with physic-guided simulation learning of neural network

Most quantitative magnetization transfer (qMT) imaging methods require acquiring additional quantitative maps (such as T1) for data fitting. A method based on multiple phase-cycled bSSFP was recently proposed to enable high-resolution 3D qMT imaging based on least square fitting without any extra acquisition, and thus has high potential for simplifying the qMT procedure. However, the quantification of qMT parameters with this method was suboptimal, limiting its potential for clinical application despite its simpler protocol and higher spatial resolution. To improve the fitting of qMT data obtained with multiple phase-cycled bSSFP, we propose SIMulation-based Physics-guided Learning of neural network for qMT parameters EXtraction, or SIMPLEX. In contrast to previous deep learning supervised approaches for quantitative MR that require the acquisition of input data and corresponding ground truth for training, we leveraged the MR signal model to generate training samples without expensive data curation. The network was trained exclusively with simulation data by predicting the simulation parameters. The same network was applied directly to in-vivo data without additional training. The approach was verified with both simulation and in-vivo data. SIMPLEX showed a decrease in fitting mean squared error for all simulation data compared to the existing least-square fitting method. The in-vivo experiment revealed that the network performed well with the real in vivo data unseen during training. For all experiments, we observed that SIMPLEX consistently improved the quantification quality of the qMT parameters whilst being more robust to noise compared to the prior technique. The proposed SIMPLEX will expedite the routine clinical application of qMT by providing qMT parameters (exchange rate, pool fraction) as well as T1, T2, and ΔB0 maps simultaneously with high spatial resolution, better reliability, and reduced processing time.

QOCT-Net: A Physics-Informed Neural Network for Intravascular Optical Coherence Tomography Attenuation Imaging

Intravascular optical coherence tomography (IVOCT) provides high-resolution, depth-resolved images of coronary arterial microstructure by acquiring backscattered light. Quantitative attenuation imaging is important for accurate characterization of tissue components and identification of vulnerable plaques. In this work, we proposed a deep learning method for IVOCT attenuation imaging based on the multiple scattering model of light transport. A physics-informed deep network named Quantitative OCT Network (QOCT-Net) was designed to recover pixel-level optical attenuation coefficients directly from standard IVOCT B-scan images. The network was trained and tested on simulation and in vivo datasets. Results showed superior attenuation coefficient estimates both visually and based on quantitative image metrics. The structural similarity, energy error depth and peak signal-to-noise ratio are improved by at least 7%, 5% and 12.4%, respectively, compared with the state-of-the-art non-learning methods. This method potentially enables high-precision quantitative imaging for tissue characterization and vulnerable plaque identification.

dtiRIM: A generalisable deep learning method for diffusion tensor imaging

Diffusion weighted MRI is an indispensable tool for routine patient screening and diagnostics of pathology. Recently, several deep learning methods have been proposed to quantify diffusion parameters, but poor generalisation to new data prevents broader use of these methods, as they require retraining of the neural network for each new scan protocol. In this work, we present the dtiRIM, a new deep learning method for Diffusion Tensor Imaging (DTI) based on the Recurrent Inference Machines. Thanks to its ability to learn how to solve inverse problems and to use the diffusion tensor model to promote data consistency, the dtiRIM can generalise to variations in the acquisition settings. This enables a single trained network to produce high quality tensor estimates for a variety of cases. We performed extensive validation of our method using simulation and in vivo data, and compared it to the Iterated Weighted Linear Least Squares (IWLLS), the approach of the state-of-the-art MRTrix3 software, and to an implementation of the Maximum Likelihood Estimator (MLE). Our results show that dtiRIM predictions present low dependency on tissue properties, anatomy and scanning parameters, with results comparable to or better than both IWLLS and MLE. Further, we demonstrate that a single dtiRIM model can be used for a diversity of data sets without significant loss in quality, representing, to our knowledge, the first generalisable deep learning based solver for DTI.

A unified model for reconstruction and R2* mapping of accelerated 7T data using the quantitative recurrent inference machine

Quantitative MRI (qMRI) acquired at the ultra-high field of 7 Tesla has been used in visualizing and analyzing subcortical structures. qMRI relies on the acquisition of multiple images with different scan settings, leading to extended scanning times. Data redundancy and prior information from the relaxometry model can be exploited by deep learning to accelerate the imaging process. We propose the quantitative Recurrent Inference Machine (qRIM), with a unified forward model for joint reconstruction and R₂^*-mapping from sparse data, embedded in a Recurrent Inference Machine (RIM), an iterative inverse problem-solving network. To study the dependency of the proposed extension of the unified forward model to network architecture, we implemented and compared a quantitative End-to-End Variational Network (qE2EVN). Experiments were performed with high-resolution multi-echo gradient echo data of the brain at 7T of a cohort study covering the entire adult life span. The error in reconstructed R₂^* from undersampled data relative to reference data significantly decreased for the unified model compared to sequential image reconstruction and parameter fitting using the RIM. With increasing acceleration factor, an increasing reduction in the reconstruction error was observed, pointing to a larger benefit for sparser data. Qualitatively, this was following an observed reduction of image blurriness in R₂^*-maps. In contrast, when using the U-Net as network architecture, a negative bias in R₂^* in selected regions of interest was observed. Compressed Sensing rendered accurate, but less precise estimates of R₂^*. The qE2EVN showed slightly inferior reconstruction quality compared to the qRIM but better quality than the U-Net and Compressed Sensing. Subcortical maturation over age measured by a linearly increasing interquartile range of R₂^* in the striatum was preserved up to an acceleration factor of 9. With the integrated prior of the unified forward model, the proposed qRIM can exploit the redundancy among repeated measurements and shared information between tasks, facilitating relaxometry in accelerated MRI.

To shift or to rotate? Comparison of acquisition strategies for multi-slice super-resolution magnetic resonance imaging

Multi-slice (MS) super-resolution reconstruction (SRR) methods have been proposed to improve the trade-off between resolution, signal-to-noise ratio and scan time in magnetic resonance imaging. MS-SRR consists in the estimation of an isotropic high-resolution image from a series of anisotropic MS images with a low through-plane resolution, where the anisotropic low-resolution images can be acquired according to different acquisition schemes. However, it is yet unclear how these schemes compare in terms of statistical performance criteria, especially for regularized MS-SRR. In this work, the estimation performance of two commonly adopted MS-SRR acquisition schemes based on shifted and rotated MS images respectively are evaluated in a Bayesian framework. The maximum a posteriori estimator, which introduces regularization by incorporating prior knowledge in a statistically well-defined way, is put forward as the estimator of choice and its accuracy, precision, and Bayesian mean squared error (BMSE) are used as performance criteria. Analytic calculations as well as Monte Carlo simulation experiments show that the rotated scheme outperforms the shifted scheme in terms of precision, accuracy, and BMSE. Furthermore, the superior performance of the rotated scheme is confirmed in real data experiments and in retrospective simulation experiments with and without inter-image motion. Results show that the rotated scheme allows regularized MS-SRR with a higher accuracy and precision than the shifted scheme, besides being more resilient to motion.