Simultaneous NODDI and GFA parameter map generation from subsampled q-space imaging using deep learning

DIMOND: DIffusion Model OptimizatioN with Deep Learning

Diffusion magnetic resonance imaging is an important tool for mapping tissue microstructure and structural connectivity non-invasively in the in vivo human brain. Numerous diffusion signal models are proposed to quantify microstructural properties. Nonetheless, accurate estimation of model parameters is computationally expensive and impeded by image noise. Supervised deep learning-based estimation approaches exhibit efficiency and superior performance but require additional training data and may be not generalizable. A new DIffusion Model OptimizatioN framework using physics-informed and self-supervised Deep learning entitled "DIMOND" is proposed to address this problem. DIMOND employs a neural network to map input image data to model parameters and optimizes the network by minimizing the difference between the input acquired data and synthetic data generated via the diffusion model parametrized by network outputs. DIMOND produces accurate diffusion tensor imaging results and is generalizable across subjects and datasets. Moreover, DIMOND outperforms conventional methods for fitting sophisticated microstructural models including the kurtosis and NODDI model. Importantly, DIMOND reduces NODDI model fitting time from hours to minutes, or seconds by leveraging transfer learning. In summary, the self-supervised manner, high efficacy, and efficiency of DIMOND increase the practical feasibility and adoption of microstructure and connectivity mapping in clinical and neuroscientific applications.

Developing an AI-empowered head-only ultra-high-performance gradient MRI system for high spatiotemporal neuroimaging

Recent advances in neuroscience requires high-resolution MRI to decipher the structural and functional details of the brain. Developing a high-performance gradient system is an ongoing effort in the field to facilitate high spatial and temporal encoding. Here, we proposed a head-only gradient system NeuroFrontier, dedicated for neuroimaging with an ultra-high gradient strength of 650 mT/m and 600 T/m/s. The proposed system features in 1) ultra-high power of 7MW achieved by running two gradient power amplifiers using a novel paralleling method; 2) a force/torque balanced gradient coil design with a two-step mechanical structure that allows high-efficiency and flexible optimization of the peripheral nerve stimulation; 3) a high-density integrated RF system that is miniaturized and customized for the head-only system; 4) an AI-empowered compressed sensing technique that enables ultra-fast acquisition of high-resolution images and AI-based acceleration in q-t space for diffusion MRI (dMRI); and 5) a prospective head motion correction technique that effectively corrects motion artifacts in real-time with 3D optical tracking. We demonstrated the potential advantages of the proposed system in imaging resolution, speed, and signal-to-noise ratio for 3D structural MRI (sMRI), functional MRI (fMRI) and dMRI in neuroscience applications of submillimeter layer-specific fMRI and dMRI. We also illustrated the unique strength of this system for dMRI-based microstructural mapping, e.g., enhanced lesion contrast at short diffusion-times or high b-values, and improved estimation accuracy for cellular microstructures using diffusion-time-dependent dMRI or for neurite microstructures using q-space approaches.

Learning ADC maps from accelerated radial k-space diffusion-weighted MRI in mice using a deep CNN-transformer model

PURPOSE

To accelerate radially sampled diffusion weighted spin-echo (Rad-DW-SE) acquisition method for generating high quality ADC maps.

METHODS

A deep learning method was developed to generate accurate ADC maps from accelerated DWI data acquired with the Rad-DW-SE method. The deep learning method integrates convolutional neural networks (CNNs) with vision transformers to generate high quality ADC maps from accelerated DWI data, regularized by a monoexponential ADC model fitting term. A model was trained on DWI data of 147 mice and evaluated on DWI data of 36 mice, with acceleration factors of 4× and 8× compared to the original acquisition parameters.

RESULTS

Ablation studies and experimental results have demonstrated that the proposed deep learning model generates higher quality ADC maps from accelerated DWI data than alternative deep learning methods under comparison when their performance is quantified in whole images as well as in regions of interest, including tumors, kidneys, and muscles.

CONCLUSIONS

The deep learning method with integrated CNNs and transformers provides an effective means to accurately compute ADC maps from accelerated DWI data acquired with the Rad-DW-SE method.

Towards Accurate Microstructure Estimation via 3D Hybrid Graph Transformer

Deep learning has drawn increasing attention in microstructure estimation with undersampled diffusion MRI (dMRI) data. A representative method is the hybrid graph transformer (HGT), which achieves promising performance by integrating q -space graph learning and x -space transformer learning into a unified framework. However, this method overlooks the 3D spatial information as it relies on training with 2D slices. To address this limitation, we propose 3D hybrid graph transformer (3D-HGT), an advanced microstructure estimation model capable of making full use of 3D spatial information and angular information. To tackle the large computation burden associated with 3D x -space learning, we propose an efficient q -space learning model based on simplified graph neural networks. Furthermore, we propose a 3D x -space learning module based on the transformer. Extensive experiments on data from the human connectome project show that our 3D-HGT outperforms state-of-the-art methods, including HGT, in both quantitative and qualitative evaluations.

Validation of deep learning techniques for quality augmentation in diffusion MRI for clinical studies

The objective of this study is to evaluate the efficacy of deep learning (DL) techniques in improving the quality of diffusion MRI (dMRI) data in clinical applications. The study aims to determine whether the use of artificial intelligence (AI) methods in medical images may result in the loss of critical clinical information and/or the appearance of false information. To assess this, the focus was on the angular resolution of dMRI and a clinical trial was conducted on migraine, specifically between episodic and chronic migraine patients. The number of gradient directions had an impact on white matter analysis results, with statistically significant differences between groups being drastically reduced when using 21 gradient directions instead of the original 61. Fourteen teams from different institutions were tasked to use DL to enhance three diffusion metrics (FA, AD and MD) calculated from data acquired with 21 gradient directions and a b-value of 1000 s/mm2. The goal was to produce results that were comparable to those calculated from 61 gradient directions. The results were evaluated using both standard image quality metrics and Tract-Based Spatial Statistics (TBSS) to compare episodic and chronic migraine patients. The study results suggest that while most DL techniques improved the ability to detect statistical differences between groups, they also led to an increase in false positive. The results showed that there was a constant growth rate of false positives linearly proportional to the new true positives, which highlights the risk of generalization of AI-based tasks when assessing diverse clinical cohorts and training using data from a single group. The methods also showed divergent performance when replicating the original distribution of the data and some exhibited significant bias. In conclusion, extreme caution should be exercised when using AI methods for harmonization or synthesis in clinical studies when processing heterogeneous data in clinical studies, as important information may be altered, even when global metrics such as structural similarity or peak signal-to-noise ratio appear to suggest otherwise.

Artificial intelligence for diffusion MRI-based tissue microstructure estimation in the human brain: an overview

Artificial intelligence (AI) has made significant advances in the field of diffusion magnetic resonance imaging (dMRI) and other neuroimaging modalities. These techniques have been applied to various areas such as image reconstruction, denoising, detecting and removing artifacts, segmentation, tissue microstructure modeling, brain connectivity analysis, and diagnosis support. State-of-the-art AI algorithms have the potential to leverage optimization techniques in dMRI to advance sensitivity and inference through biophysical models. While the use of AI in brain microstructures has the potential to revolutionize the way we study the brain and understand brain disorders, we need to be aware of the pitfalls and emerging best practices that can further advance this field. Additionally, since dMRI scans rely on sampling of the q-space geometry, it leaves room for creativity in data engineering in such a way that it maximizes the prior inference. Utilization of the inherent geometry has been shown to improve general inference quality and might be more reliable in identifying pathological differences. We acknowledge and classify AI-based approaches for dMRI using these unifying characteristics. This article also highlighted and reviewed general practices and pitfalls involving tissue microstructure estimation through data-driven techniques and provided directions for building on them.

Using mesoscopic tract-tracing data to guide the estimation of fiber orientation distributions in the mouse brain from diffusion MRI

Diffusion MRI (dMRI) tractography is the only tool for non-invasive mapping of macroscopic structural connectivity over the entire brain. Although it has been successfully used to reconstruct large white matter tracts in the human and animal brains, the sensitivity and specificity of dMRI tractography remained limited. In particular, the fiber orientation distributions (FODs) estimated from dMRI signals, key to tractography, may deviate from histologically measured fiber orientation in crossing fibers and gray matter regions. In this study, we demonstrated that a deep learning network, trained using mesoscopic tract-tracing data from the Allen Mouse Brain Connectivity Atlas, was able to improve the estimation of FODs from mouse brain dMRI data. Tractography results based on the network generated FODs showed improved specificity while maintaining sensitivity comparable to results based on FOD estimated using a conventional spherical deconvolution method. Our result is a proof-of-concept of how mesoscale tract-tracing data can guide dMRI tractography and enhance our ability to characterize brain connectivity.

Neural network algorithms predict new diffusion MRI data for multi-compartmental analysis of brain microstructure in a clinical setting

High angular resolution diffusion imaging (HARDI) is a promising method for advanced analysis of brain microstructure. However, comprehensive HARDI analysis requires multiple acquisitions of diffusion images (multi-shell HARDI), which is time consuming and often impractical in clinical settings. This study aimed to establish neural network models that can predict new diffusion datasets from clinically feasible brain diffusion MRI for multi-shell HARDI. The development included 2 algorithms: multi-layer perceptron (MLP) and convolutional neural network (CNN). Both followed a voxel-based approach for model training (70%), validation (15%), and testing (15%). The investigations involved 2 multi-shell HARDI datasets: 1) 11 healthy subjects from the Human Connectome Project (HCP); and 2) 10 local subjects with multiple sclerosis (MS). To assess outcomes, we conducted neurite orientation dispersion and density imaging using both predicted and original data and compared their orientation dispersion index (ODI) and neurite density index (NDI) in different brain tissues with 2 measures: peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). Results showed that both models achieved robust predictions, which provided competitive ODI and NDI, especially in brain white matter. The CNN outperformed MLP with the HCP data on both PSNR (p < 0.001) and SSIM (p < 0.01). With the MS data, the models performed similarly. Overall, the optimized neural networks can help generate non-acquired brain diffusion MRI, which will make advanced HARDI analysis possible in clinical practice following further validation. Enabling detailed characterization of brain microstructure will allow enhanced understanding of brain function in both health and disease.

dtiRIM: A generalisable deep learning method for diffusion tensor imaging

Diffusion weighted MRI is an indispensable tool for routine patient screening and diagnostics of pathology. Recently, several deep learning methods have been proposed to quantify diffusion parameters, but poor generalisation to new data prevents broader use of these methods, as they require retraining of the neural network for each new scan protocol. In this work, we present the dtiRIM, a new deep learning method for Diffusion Tensor Imaging (DTI) based on the Recurrent Inference Machines. Thanks to its ability to learn how to solve inverse problems and to use the diffusion tensor model to promote data consistency, the dtiRIM can generalise to variations in the acquisition settings. This enables a single trained network to produce high quality tensor estimates for a variety of cases. We performed extensive validation of our method using simulation and in vivo data, and compared it to the Iterated Weighted Linear Least Squares (IWLLS), the approach of the state-of-the-art MRTrix3 software, and to an implementation of the Maximum Likelihood Estimator (MLE). Our results show that dtiRIM predictions present low dependency on tissue properties, anatomy and scanning parameters, with results comparable to or better than both IWLLS and MLE. Further, we demonstrate that a single dtiRIM model can be used for a diversity of data sets without significant loss in quality, representing, to our knowledge, the first generalisable deep learning based solver for DTI.

Deep learning prediction of diffusion MRI data with microstructure-sensitive loss functions

Deep learning prediction of diffusion MRI (DMRI) data relies on the utilization of effective loss functions. Existing losses typically measure the signal-wise differences between the predicted and target DMRI data without considering the quality of derived diffusion scalars that are eventually utilized for quantification of tissue microstructure. Here, we propose two novel loss functions, called microstructural loss and spherical variance loss, to explicitly consider the quality of both the predicted DMRI data and derived diffusion scalars. We apply these loss functions to the prediction of multi-shell data and enhancement of angular resolution. Evaluation based on infant and adult DMRI data indicates that both microstructural loss and spherical variance loss improve the quality of derived diffusion scalars.

A microstructure estimation Transformer inspired by sparse representation for diffusion MRI

Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are typically multi-compartmental models with mathematically complex and highly non-linear forms. Resolving microstructures from these models with conventional optimization techniques is prone to estimation errors and requires dense sampling in the q-space with a long scan time. Deep learning based approaches have been proposed to overcome these limitations. Motivated by the superior performance of the Transformer in feature extraction than the convolutional structure, in this work, we present a learning-based framework based on Transformer, namely, a Microstructure Estimation Transformer with Sparse Coding (METSC) for dMRI-based microstructural parameter estimation. To take advantage of the Transformer while addressing its limitation in large training data requirement, we explicitly introduce an inductive bias-model bias into the Transformer using a sparse coding technique to facilitate the training process. Thus, the METSC is composed with three stages, an embedding stage, a sparse representation stage, and a mapping stage. The embedding stage is a Transformer-based structure that encodes the signal in a high-level space to ensure the core voxel of a patch is represented effectively. In the sparse representation stage, a dictionary is constructed by solving a sparse reconstruction problem that unfolds the Iterative Hard Thresholding (IHT) process. The mapping stage is essentially a decoder that computes the microstructural parameters from the output of the second stage, based on the weighted sum of normalized dictionary coefficients where the weights are also learned. We tested our framework on two dMRI models with downsampled q-space data, including the intravoxel incoherent motion (IVIM) model and the neurite orientation dispersion and density imaging (NODDI) model. The proposed method achieved up to 11.25 folds of acceleration while retaining high fitting accuracy for NODDI fitting, reducing the mean squared error (MSE) up to 70% compared with the previous q-space learning approach. METSC outperformed the other state-of-the-art learning-based methods, including the model-free and model-based methods. The network also showed robustness against noise and generalizability across different datasets. The superior performance of METSC indicates its potential to improve dMRI acquisition and model fitting in clinical applications.

Accelerating Cardiac Diffusion Tensor Imaging With a U-Net Based Model: Toward Single Breath-Hold

BACKGROUND

In vivo cardiac diffusion tensor imaging (cDTI) characterizes myocardial microstructure. Despite its potential clinical impact, considerable technical challenges exist due to the inherent low signal-to-noise ratio.

PURPOSE

To reduce scan time toward one breath-hold by reconstructing diffusion tensors for in vivo cDTI with a fitting-free deep learning approach.

STUDY TYPE

Retrospective.

POPULATION

A total of 197 healthy controls, 547 cardiac patients.

FIELD STRENGTH/SEQUENCE

A 3 T, diffusion-weighted stimulated echo acquisition mode single-shot echo-planar imaging sequence.

ASSESSMENT

A U-Net was trained to reconstruct the diffusion tensor elements of the reference results from reduced datasets that could be acquired in 5, 3 or 1 breath-hold(s) (BH) per slice. Fractional anisotropy (FA), mean diffusivity (MD), helix angle (HA), and sheetlet angle (E2A) were calculated and compared to the same measures when using a conventional linear-least-square (LLS) tensor fit with the same reduced datasets. A conventional LLS tensor fit with all available data (12 ± 2.0 [mean ± sd] breath-holds) was used as the reference baseline.

STATISTICAL TESTS

Wilcoxon signed rank/rank sum and Kruskal-Wallis tests. Statistical significance threshold was set at P = 0.05. Intersubject measures are quoted as median [interquartile range].

RESULTS

For global mean or median results, both the LLS and U-Net methods with reduced datasets present a bias for some of the results. For both LLS and U-Net, there is a small but significant difference from the reference results except for LLS: MD 5BH (P = 0.38) and MD 3BH (P = 0.09). When considering direct pixel-wise errors the U-Net model outperformed significantly the LLS tensor fit for reduced datasets that can be acquired in three or just one breath-hold for all parameters.

DATA CONCLUSION

Diffusion tensor prediction with a trained U-Net is a promising approach to minimize the number of breath-holds needed in clinical cDTI studies.

EVIDENCE LEVEL

4 TECHNICAL EFFICACY: Stage 1.

White Matter Characteristics of Damage Along Fiber Tracts in Patients with Type 2 Diabetes Mellitus

Purpose

The white matter (WM) of the brain of type 2 diabetes mellitus (T2DM) patients is susceptible to neurodegenerative processes, but the specific types and positions of microstructural lesions along the fiber tracts remain unclear.

Methods

In this study 61 T2DM patients and 61 healthy controls were recruited and underwent diffusion spectrum imaging (DSI). The results were reconstructed with diffusion tensor imaging (DTI) and neurite orientation dispersion and density imaging (NODDI). WM microstructural abnormalities were identified using tract-based spatial statistics (TBSS). Pointwise WM tract differences were detected through automatic fiber quantification (AFQ). The relationships between WM tract abnormalities and clinical characteristics were explored with partial correlation analysis.

Results

TBSS revealed widespread WM lesions in T2DM patients with decreased fractional anisotropy and axial diffusivity and an increased orientation dispersion index (ODI). The AFQ results showed microstructural abnormalities in T2DM patients in specific portions of the right superior longitudinal fasciculus (SLF), right arcuate fasciculus (ARC), left anterior thalamic radiation (ATR), and forceps major (FMA). In the right ARC of T2DM patients, an aberrant ODI was positively correlated with fasting insulin and insulin resistance, and an abnormal intracellular volume fraction was negatively correlated with fasting blood glucose. Additionally, negative associations were found between blood pressure and microstructural abnormalities in the right ARC, left ATR, and FMA in T2DM patients.

Conclusion

Using AFQ, together with DTI and NODDI, various kinds of microstructural alterations in the right SLF, right ARC, left ATR, and FMA can be accurately identified and may be associated with insulin and glucose status and blood pressure in T2DM patients.

Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data

Advanced contemporary diffusion models for tissue microstructure often require diffusion MRI (DMRI) data with sufficiently dense sampling in the diffusion wavevector space for reliable model fitting, which might not always be feasible in practice. A potential remedy to this problem is by using deep learning techniques to predict high-quality diffusion microstructural indices from sparsely sampled data. However, existing methods are either agnostic to the data geometry in the diffusion wavevector space ( q -space) or limited to leveraging information from only local neighborhoods in the physical coordinate space ( x -space). Here, we propose a hybrid graph transformer (HGT) to explicitly consider the q -space geometric structure with a graph neural network (GNN) and make full use of spatial information with a novel residual dense transformer (RDT). The RDT consists of multiple densely connected transformer layers and a residual connection to facilitate model training. Extensive experiments on the data from the Human Connectome Project (HCP) demonstrate that our method significantly improves the quality of microstructural estimations over existing state-of-the-art methods.

Diffusion tensor estimation with transformer neural networks

Diffusion tensor imaging (DTI) is a widely used method for studying brain white matter development and degeneration. However, standard DTI estimation methods depend on a large number of high-quality measurements. This would require long scan times and can be particularly difficult to achieve with certain patient populations such as neonates. Here, we propose a method that can accurately estimate the diffusion tensor from only six diffusion-weighted measurements. Our method achieves this by learning to exploit the relationships between the diffusion signals and tensors in neighboring voxels. Our model is based on transformer networks, which represent the state of the art in modeling the relationship between signals in a sequence. In particular, our model consists of two such networks. The first network estimates the diffusion tensor based on the diffusion signals in a neighborhood of voxels. The second network provides more accurate tensor estimations by learning the relationships between the diffusion signals as well as the tensors estimated by the first network in neighboring voxels. Our experiments with three datasets show that our proposed method achieves highly accurate estimations of the diffusion tensor and is significantly superior to three competing methods. Estimations produced by our method with six diffusion-weighted measurements are comparable with those of standard estimation methods with 30-88 diffusion-weighted measurements. Hence, our method promises shorter scan times and more reliable assessment of brain white matter, particularly in non-cooperative patients such as neonates and infants.

The Influence of College Students' Innovation and Entrepreneurship Intention in the Art Field of Art Film and Television Appreciation by Deep Learning Under Entrepreneurial Psychology

There are many films and televisions (FATs) on the Internet, but the quality is uneven. This study explores the ability of college students to screen good films and resist bad films in television works in such a large environment. In the deep learning model of FAT, the ability of college students to think about the ideas expressed and the degree of influence on college students' values are analyzed. Based on this conceptual basis, a questionnaire is designed for the intention and influencing factors of college students' FAT innovation and entrepreneurship. It reflects the influence of concentration on FAT learning, the cognitive level of deep learning, the ability to process deep learning ideas, the feeling of the teaching process, and the process of self-learning, which all positively impact college students' FAT entrepreneurial intentions. The importance of innovative deep learning is highlighted, which proves that a good deep learning course guidance method can improve students' interest and ability and provide a reference for relevant colleges and universities to cultivate pertinent talents of the field of FAT.

SDnDTI: Self-supervised deep learning-based denoising for diffusion tensor MRI

Diffusion tensor magnetic resonance imaging (DTI) is a widely adopted neuroimaging method for the in vivo mapping of brain tissue microstructure and white matter tracts. Nonetheless, the noise in the diffusion-weighted images (DWIs) decreases the accuracy and precision of DTI derived microstructural parameters and leads to prolonged acquisition time for achieving improved signal-to-noise ratio (SNR). Deep learning-based image denoising using convolutional neural networks (CNNs) has superior performance but often requires additional high-SNR data for supervising the training of CNNs, which reduces the feasibility of supervised learning-based denoising in practice. In this work, we develop a self-supervised deep learning-based method entitled "SDnDTI" for denoising DTI data, which does not require additional high-SNR data for training. Specifically, SDnDTI divides multi-directional DTI data into many subsets of six DWI volumes and transforms DWIs from each subset to along the same diffusion-encoding directions through the diffusion tensor model, generating multiple repetitions of DWIs with identical image contrasts but different noise observations. SDnDTI removes noise by first denoising each repetition of DWIs using a deep 3-dimensional CNN with the average of all repetitions with higher SNR as the training target, following the same approach as normal supervised learning based denoising methods, and then averaging CNN-denoised images for achieving higher SNR. The denoising efficacy of SDnDTI is demonstrated in terms of the similarity of output images and resultant DTI metrics compared to the ground truth generated using substantially more DWI volumes on two datasets with different spatial resolutions, b-values and numbers of input DWI volumes provided by the Human Connectome Project (HCP) and the Lifespan HCP in Aging. The SDnDTI results preserve image sharpness and textural details and substantially improve upon those from the raw data. The results of SDnDTI are comparable to those from supervised learning-based denoising and outperform those from state-of-the-art conventional denoising algorithms including BM4D, AONLM and MPPCA. By leveraging domain knowledge of diffusion MRI physics, SDnDTI makes it easier to use CNN-based denoising methods in practice and has the potential to benefit a wider range of research and clinical applications that require accelerated DTI acquisition and high-quality DTI data for mapping of tissue microstructure, fiber tracts and structural connectivity in the living human brain.

Jointly estimating parametric maps of multiple diffusion models from undersampled q-space data: A comparison of three deep learning approaches

PURPOSE

While advanced diffusion techniques have been found valuable in many studies, their clinical availability has been hampered partly due to their long scan times. Moreover, each diffusion technique can only extract a few relevant microstructural features. Using multiple diffusion methods may help to better understand the brain microstructure, which requires multiple expensive model fittings. In this work, we compare deep learning (DL) approaches to jointly estimate parametric maps of multiple diffusion representations/models from highly undersampled q-space data.

METHODS

We implement three DL approaches to jointly estimate parametric maps of diffusion tensor imaging (DTI), diffusion kurtosis imaging (DKI), neurite orientation dispersion and density imaging (NODDI), and multi-compartment spherical mean technique (SMT). A per-voxel q-space deep learning (1D-qDL), a per-slice convolutional neural network (2D-CNN), and a 3D-patch-based microstructure estimation with sparse coding using a separable dictionary (MESC-SD) network are considered.

RESULTS

The accuracy of estimated diffusion maps depends on the q-space undersampling, the selected network architecture, and the region and the parameter of interest. The smallest errors are observed for the MESC-SD network architecture (less than 10 % normalized RMSE in most brain regions).

CONCLUSION

Our experiments show that DL methods are very efficient tools to simultaneously estimate several diffusion maps from undersampled q-space data. These methods can significantly reduce both the scan ( ∼ 6-fold) and processing times ( ∼ 25-fold) for estimating advanced parametric diffusion maps while achieving a reasonable accuracy.

High-fidelity approximation of grid- and shell-based sampling schemes from undersampled DSI using compressed sensing: Post mortem validation

While many useful microstructural indices, as well as orientation distribution functions, can be obtained from multi-shell dMRI data, there is growing interest in exploring the richer set of microstructural features that can be extracted from the full ensemble average propagator (EAP). The EAP can be readily computed from diffusion spectrum imaging (DSI) data, at the cost of a very lengthy acquisition. Compressed sensing (CS) has been used to make DSI more practical by reducing its acquisition time. CS applied to DSI (CS-DSI) attempts to reconstruct the EAP from significantly undersampled q-space data. We present a post mortem validation study where we evaluate the ability of CS-DSI to approximate not only fully sampled DSI but also multi-shell acquisitions with high fidelity. Human brain samples are imaged with high-resolution DSI at 9.4T and with polarization-sensitive optical coherence tomography (PSOCT). The latter provides direct measurements of axonal orientations at microscopic resolutions, allowing us to evaluate the mesoscopic orientation estimates obtained from diffusion MRI, in terms of their angular error and the presence of spurious peaks. We test two fast, dictionary-based, L2-regularized algorithms for CS-DSI reconstruction. We find that, for a CS acceleration factor of R=3, i.e., an acquisition with 171 gradient directions, one of these methods is able to achieve both low angular error and low number of spurious peaks. With a scan length similar to that of high angular resolution multi-shell acquisition schemes, this CS-DSI approach is able to approximate both fully sampled DSI and multi-shell data with high accuracy. Thus it is suitable for orientation reconstruction and microstructural modeling techniques that require either grid- or shell-based acquisitions. We find that the signal-to-noise ratio (SNR) of the training data used to construct the dictionary can have an impact on the accuracy of CS-DSI, but that there is substantial robustness to loss of SNR in the test data. Finally, we show that, as the CS acceleration factor increases beyond R=3, the accuracy of these reconstruction methods degrade, either in terms of the angular error, or in terms of the number of spurious peaks. Our results provide useful benchmarks for the future development of even more efficient q-space acceleration techniques.

Upstream Machine Learning in Radiology

Machine learning (ML) and Artificial intelligence (AI) has the potential to dramatically improve radiology practice at multiple stages of the imaging pipeline. Most of the attention has been garnered by applications focused on improving the end of the pipeline: image interpretation. However, this article reviews how AI/ML can be applied to improve upstream components of the imaging pipeline, including exam modality selection, hardware design, exam protocol selection, data acquisition, image reconstruction, and image processing. A breadth of applications and their potential for impact is shown across multiple imaging modalities, including ultrasound, computed tomography, and MRI.

Deep learning-based parameter estimation in fetal diffusion-weighted MRI

Diffusion-weighted magnetic resonance imaging (DW-MRI) of fetal brain is challenged by frequent fetal motion and signal to noise ratio that is much lower than non-fetal imaging. As a result, accurate and robust parameter estimation in fetal DW-MRI remains an open problem. Recently, deep learning techniques have been successfully used for DW-MRI parameter estimation in non-fetal subjects. However, none of those prior works has addressed the fetal brain because obtaining reliable fetal training data is challenging. To address this problem, in this work we propose a novel methodology that utilizes fetal scans as well as scans from prematurely-born infants. High-quality newborn scans are used to estimate accurate maps of the parameter of interest. These parameter maps are then used to generate DW-MRI data that match the measurement scheme and noise distribution that are characteristic of fetal data. In order to demonstrate the effectiveness and reliability of the proposed data generation pipeline, we used the generated data to train a convolutional neural network (CNN) to estimate color fractional anisotropy (CFA). We evaluated the trained CNN on independent sets of fetal data in terms of reconstruction accuracy, precision, and expert assessment of reconstruction quality. Results showed significantly lower reconstruction error (n=100,p<0.001) and higher reconstruction precision (n=20,p<0.001) for the proposed machine learning pipeline compared with standard estimation methods. Expert assessments on 20 fetal test scans showed significantly better overall reconstruction quality (p<0.001) and more accurate reconstruction of 11 regions of interest (p<0.001) with the proposed method.

Learning to estimate the fiber orientation distribution function from diffusion-weighted MRI

Estimation of white matter fiber orientation distribution function (fODF) is the essential first step for reliable brain tractography and connectivity analysis. Most of the existing fODF estimation methods rely on sub-optimal physical models of the diffusion signal or mathematical simplifications, which can impact the estimation accuracy. In this paper, we propose a data-driven method that avoids some of these pitfalls. Our proposed method is based on a multilayer perceptron that learns to map the diffusion-weighted measurements, interpolated onto a fixed spherical grid in the q space, to the target fODF. Importantly, we also propose methods for synthesizing reliable simulated training data. We show that the model can be effectively trained with simulated or real training data. Our phantom experiments show that the proposed method results in more accurate fODF estimation and tractography than several competing methods including the multi-tensor model, Bayesian estimation, spherical deconvolution, and two other machine learning techniques. On real data, we compare our method with other techniques in terms of accuracy of estimating the ground-truth fODF. The results show that our method is more accurate than other methods, and that it performs better than the competing methods when applied to under-sampled diffusion measurements. We also compare our method with the Sparse Fascicle Model in terms of expert ratings of the accuracy of reconstruction of several commissural, projection, association, and cerebellar tracts. The results show that the tracts reconstructed with the proposed method are rated significantly higher by three independent experts. Our study demonstrates the potential of data-driven methods for improving the accuracy and robustness of fODF estimation.

Deep Learning and Its Application to Function Approximation for MR in Medicine: An Overview

This article presents an overview of deep learning (DL) and its applications to function approximation for MR in medicine. The aim of this article is to help readers develop various applications of DL. DL has made a large impact on the literature of many medical sciences, including MR. However, its technical details are not easily understandable for non-experts of machine learning (ML).The first part of this article presents an overview of DL and its related technologies, such as artificial intelligence (AI) and ML. AI is explained as a function that can receive many inputs and produce many outputs. ML is a process of fitting the function to training data. DL is a kind of ML, which uses a composite of many functions to approximate the function of interest. This composite function is called a deep neural network (DNN), and the functions composited into a DNN are called layers. This first part also covers the underlying technologies required for DL, such as loss functions, optimization, initialization, linear layers, non-linearities, normalization, recurrent neural networks, regularization, data augmentation, residual connections, autoencoders, generative adversarial networks, model and data sizes, and complex-valued neural networks.The second part of this article presents an overview of the applications of DL in MR and explains how functions represented as DNNs are applied to various applications, such as RF pulse, pulse sequence, reconstruction, motion correction, spectroscopy, parameter mapping, image synthesis, and segmentation.

Q-space Conditioned Translation Networks for Directional Synthesis of Diffusion Weighted Images from Multi-modal Structural MRI

Current deep learning approaches for diffusion MRI modeling circumvent the need for densely-sampled diffusion-weighted images (DWIs) by directly predicting microstructural indices from sparsely-sampled DWIs. However, they implicitly make unrealistic assumptions of static q-space sampling during training and reconstruction. Further, such approaches can restrict downstream usage of variably sampled DWIs for usages including the estimation of microstructural indices or tractography. We propose a generative adversarial translation framework for high-quality DWI synthesis with arbitrary q-space sampling given commonly acquired structural images (e.g., B0, T1, T2). Our translation network linearly modulates its internal representations conditioned on continuous q-space information, thus removing the need for fixed sampling schemes. Moreover, this approach enables downstream estimation of high-quality microstructural maps from arbitrarily subsampled DWIs, which may be particularly important in cases with sparsely sampled DWIs. Across several recent methodologies, the proposed approach yields improved DWI synthesis accuracy and fidelity with enhanced downstream utility as quantified by the accuracy of scalar microstructure indices estimated from the synthesized images. Code is available at https://github.com/mengweiren/q-space-conditioned-dwi-synthesis.

SPHERIOUSLY? The challenges of estimating sphere radius non-invasively in the human brain from diffusion MRI

The Soma and Neurite Density Imaging (SANDI) three-compartment model was recently proposed to disentangle cylindrical and spherical geometries, attributed to neurite and soma compartments, respectively, in brain tissue. There are some recent advances in diffusion-weighted MRI signal encoding and analysis (including the use of multiple so-called 'b-tensor' encodings and analysing the signal in the frequency-domain) that have not yet been applied in the context of SANDI. In this work, using: (i) ultra-strong gradients; (ii) a combination of linear, planar, and spherical b-tensor encodings; and (iii) analysing the signal in the frequency domain, three main challenges to robust estimation of sphere size were identified: First, the Rician noise floor in magnitude-reconstructed data biases estimates of sphere properties in a non-uniform fashion. It may cause overestimation or underestimation of the spherical compartment size and density. This can be partly ameliorated by accounting for the noise floor in the estimation routine. Second, even when using the strongest diffusion-encoding gradient strengths available for human MRI, there is an empirical lower bound on the spherical signal fraction and radius that can be detected and estimated robustly. For the experimental setup used here, the lower bound on the sphere signal fraction was approximately 10%. We employed two different ways of establishing the lower bound for spherical radius estimates in white matter. The first, examining power-law relationships between the DW-signal and diffusion weighting in empirical data, yielded a lower bound of 7μm, while the second, pure Monte Carlo simulations, yielded a lower limit of 3μm and in this low radii domain, there is little differentiation in signal attenuation. Third, if there is sensitivity to the transverse intra-cellular diffusivity in cylindrical structures, e.g., axons and cellular projections, then trying to disentangle two diffusion-time-dependencies using one experimental parameter (i.e., change in frequency-content of the encoding waveform) makes spherical radii estimates particularly challenging. We conclude that due to the aforementioned challenges spherical radii estimates may be biased when the corresponding sphere signal fraction is low, which must be considered.

A machine learning-based method for estimating the number and orientations of major fascicles in diffusion-weighted magnetic resonance imaging

Accurate modeling of diffusion-weighted magnetic resonance imaging measurements is necessary for accurate brain connectivity analysis. Existing methods for estimating the number and orientations of fascicles in an imaging voxel either depend on non-convex optimization techniques that are sensitive to initialization and measurement noise, or are prone to predicting spurious fascicles. In this paper, we propose a machine learning-based technique that can accurately estimate the number and orientations of fascicles in a voxel. Our method can be trained with either simulated or real diffusion-weighted imaging data. Our method estimates the angle to the closest fascicle for each direction in a set of discrete directions uniformly spread on the unit sphere. This information is then processed to extract the number and orientations of fascicles in a voxel. On realistic simulated phantom data with known ground truth, our method predicts the number and orientations of crossing fascicles more accurately than several classical and machine learning methods. It also leads to more accurate tractography. On real data, our method is better than or compares favorably with other methods in terms of robustness to measurement down-sampling and also in terms of expert quality assessment of tractography results.

Prospective Deployment of Deep Learning in MRI: A Framework for Important Considerations, Challenges, and Recommendations for Best Practices

Artificial intelligence algorithms based on principles of deep learning (DL) have made a large impact on the acquisition, reconstruction, and interpretation of MRI data. Despite the large number of retrospective studies using DL, there are fewer applications of DL in the clinic on a routine basis. To address this large translational gap, we review the recent publications to determine three major use cases that DL can have in MRI, namely, that of model-free image synthesis, model-based image reconstruction, and image or pixel-level classification. For each of these three areas, we provide a framework for important considerations that consist of appropriate model training paradigms, evaluation of model robustness, downstream clinical utility, opportunities for future advances, as well recommendations for best current practices. We draw inspiration for this framework from advances in computer vision in natural imaging as well as additional healthcare fields. We further emphasize the need for reproducibility of research studies through the sharing of datasets and software. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY STAGE: 2.

SuperDTI: Ultrafast DTI and fiber tractography with deep learning

PURPOSE

To develop a deep learning-based reconstruction framework for ultrafast and robust diffusion tensor imaging and fiber tractography.

METHODS

SuperDTI was developed to learn the nonlinear relationship between DWIs and the corresponding diffusion tensor parameter maps. It bypasses the tensor fitting procedure, which is highly susceptible to noises and motions in DWIs. The network was trained and tested using data sets from the Human Connectome Project and patients with ischemic stroke. Results from SuperDTI were compared against widely used methods for tensor parameter estimation and fiber tracking.

RESULTS

Using training and testing data acquired using the same protocol and scanner, SuperDTI was shown to generate fractional anisotropy and mean diffusivity maps, as well as fiber tractography, from as few as six raw DWIs, with a quantification error of less than 5% in all white-matter and gray-matter regions of interest. It was robust to noises and motions in the testing data. Furthermore, the network trained using healthy volunteer data showed no apparent reduction in lesion detectability when directly applied to stroke patient data.

CONCLUSIONS

Our results demonstrate the feasibility of superfast DTI and fiber tractography using deep learning with as few as six DWIs directly, bypassing tensor fitting. Such a significant reduction in scan time may allow the inclusion of DTI into the clinical routine for many potential applications.

Simultaneous multi-slice image reconstruction using regularized image domain split slice-GRAPPA for diffusion MRI

The main goal of this work is to improve the quality of simultaneous multi-slice (SMS) reconstruction for diffusion MRI. We accomplish this by developing an image domain method that reaps the benefits of both SENSE and GRAPPA-type approaches and enables image regularization in an optimization framework. We propose a new approach termed regularized image domain split slice-GRAPPA (RI-SSG), which establishes an optimization framework for SMS reconstruction. Within this framework, we use a robust forward model to take advantage of both the SENSE model with explicit sensitivity estimations and the SSG model with implicit kernel relationship among coil images. The proposed approach also allows combining of coil images to increase the SNR and enables image domain regularization on estimated coil-combined single slices. We compare the performance of RI-SSG with that of SENSE and SSG using in-vivo diffusion EPI datasets with simulated and actual SMS acquisitions collected on a 3T MR scanner. Reconstructed diffusion-weighted images (DWIs) and the resulting diffusion tensor imaging (DTI) and neurite orientation dispersion and density imaging (NODDI) maps are analyzed to evaluate the quantitative and qualitative performance of the three methods. The DWIs reconstructed by RI-SSG are closer to the single-band ground truth images than SENSE and SSG. Specifically, the proposed RI-SSG reduces the normalized root-mean-square-error (nRMSE) against ground truth images by ∼5% and increases the structural similarity index (SSIM) by ∼4% compared to SSG. All three methods produce similar fractional anisotropy (FA) maps using DTI representation, but mean diffusivity (MD) and fiber orientation estimates using RI-SSG are closer to the reference than SENSE and SSG. RI-SSG results in NODDI maps with noticeably smaller errors than those of SENSE and SSG and improves the accuracy of the mean value of orientation dispersion index (ODI) by ∼5% and the mean value of intracellular volume fraction by ∼7% in regions of interest in brain white matter compared to SSG.

Non-iterative image reconstruction from sparse magnetic resonance imaging radial data without priors

The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based. They are iterative algorithms that optimize objective functions with spatial and/or temporal constraints. This paper proposes a non-iterative algorithm to estimate the un-measured data and then to reconstruct the image with the efficient filtered backprojection algorithm. The feasibility of the proposed method is demonstrated with a patient magnetic resonance imaging study. The proposed method is also compared with the state-of-the-art iterative compressed-sensing image reconstruction method using the total-variation optimization norm.

Rapid Knee MRI Acquisition and Analysis Techniques for Imaging Osteoarthritis

Osteoarthritis (OA) of the knee is a major source of disability that has no known treatment or cure. Morphological and compositional MRI is commonly used for assessing the bone and soft tissues in the knee to enhance the understanding of OA pathophysiology. However, it is challenging to extend these imaging methods and their subsequent analysis techniques to study large population cohorts due to slow and inefficient imaging acquisition and postprocessing tools. This can create a bottleneck in assessing early OA changes and evaluating the responses of novel therapeutics. The purpose of this review article is to highlight recent developments in tools for enhancing the efficiency of knee MRI methods useful to study OA. Advances in efficient MRI data acquisition and reconstruction tools for morphological and compositional imaging, efficient automated image analysis tools, and hardware improvements to further drive efficient imaging are discussed in this review. For each topic, we discuss the current challenges as well as potential future opportunities to alleviate these challenges. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY STAGE: 3.

Deep learning-based method for reducing residual motion effects in diffusion parameter estimation

PURPOSE

Conventional motion-correction techniques for diffusion MRI can introduce motion-level-dependent bias in derived metrics. To address this challenge, a deep learning-based technique was developed to minimize such residual motion effects.

METHODS

The data-rejection approach was adopted in which motion-corrupted data are discarded before model-fitting. A deep learning-based parameter estimation algorithm, using a hierarchical convolutional neural network (H-CNN), was combined with motion assessment and corrupted volume rejection. The method was designed to overcome the limitations of existing methods of this kind that produce parameter estimations whose quality depends strongly on a proportion of the data discarded. Evaluation experiments were conducted for the estimation of diffusion kurtosis and diffusion-tensor-derived measures at both the individual and group levels. The performance was compared with the robust approach of iteratively reweighted linear least squares (IRLLS) after motion correction with and without outlier replacement.

RESULTS

Compared with IRLLS, the H-CNN-based technique is minimally sensitive to motion effects. It was tested at severe motion levels when 70% to 90% of the data are rejected and when random motion is present. The technique had a stable performance independent of the numbers and schemes of data rejection. A further test on a data set from children with attention-deficit hyperactivity disorder shows the technique can potentially ameliorate spurious group-level difference caused by head motion.

CONCLUSION

This method shows great potential for reducing residual motion effects in motion-corrupted diffusion-weighted-imaging data, bringing benefits that include reduced bias in derived metrics in individual scans and reduced motion-level-dependent bias in population studies employing diffusion MRI.

DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning

Diffusion tensor magnetic resonance imaging (DTI) is unsurpassed in its ability to map tissue microstructure and structural connectivity in the living human brain. Nonetheless, the angular sampling requirement for DTI leads to long scan times and poses a critical barrier to performing high-quality DTI in routine clinical practice and large-scale research studies. In this work we present a new processing framework for DTI entitled DeepDTI that minimizes the data requirement of DTI to six diffusion-weighted images (DWIs) required by conventional voxel-wise fitting methods for deriving the six unique unknowns in a diffusion tensor using data-driven supervised deep learning. DeepDTI maps the input non-diffusion-weighted (b ​= ​0) image and six DWI volumes sampled along optimized diffusion-encoding directions, along with T1-weighted and T2-weighted image volumes, to the residuals between the input and high-quality output b = 0 image and DWI volumes using a 10-layer three-dimensional convolutional neural network (CNN). The inputs and outputs of DeepDTI are uniquely formulated, which not only enables residual learning to boost CNN performance but also enables tensor fitting of resultant high-quality DWIs to generate orientational DTI metrics for tractography. The very deep CNN used by DeepDTI leverages the redundancy in local and non-local spatial information and across diffusion-encoding directions and image contrasts in the data. The performance of DeepDTI was systematically quantified in terms of the quality of the output images, DTI metrics, DTI-based tractography and tract-specific analysis results. We demonstrate rotationally-invariant and robust estimation of DTI metrics from DeepDTI that are comparable to those obtained with two b ​= ​0 images and 21 DWIs for the primary eigenvector derived from DTI and two b ​= ​0 images and 26-30 DWIs for various scalar metrics derived from DTI, achieving 3.3-4.6 × ​acceleration, and twice as good as those of a state-of-the-art denoising algorithm at the group level. The twenty major white-matter tracts can be accurately identified from the tractography of DeepDTI results. The mean distance between the core of the major white-matter tracts identified from DeepDTI results and those from the ground-truth results using 18 ​b ​= ​0 images and 90 DWIs measures around 1-1.5 ​mm. DeepDTI leverages domain knowledge of diffusion MRI physics and power of deep learning to render DTI, DTI-based tractography, major white-matter tracts identification and tract-specific analysis more feasible for a wider range of neuroscientific and clinical studies.

Estimating Tissue Microstructure with Undersampled Diffusion Data via Graph Convolutional Neural Networks

Advanced diffusion models for tissue microstructure are widely employed to study brain disorders. However, these models usually require diffusion MRI (DMRI) data with densely sampled q-space, which is prohibitive in clinical settings. This problem can be resolved by using deep learning techniques, which learn the mapping between sparsely sampled q-space data and the high-quality diffusion microstructural indices estimated from densely sampled data. However, most existing methods simply view the input DMRI data as a vector without considering data structure in the q-space. In this paper, we propose to overcome this limitation by representing DMRI data using graphs and utilizing graph convolutional neural networks to estimate tissue microstructure. Our method makes full use of the q-space angular neighboring information to improve estimation accuracy. Experimental results based on data from the Baby Connectome Project demonstrate that our method outperforms state-of-the-art methods both qualitatively and quantitatively.

Extracting diffusion tensor fractional anisotropy and mean diffusivity from 3-direction DWI scans using deep learning

PURPOSE

To develop and evaluate machine-learning methods that reconstruct fractional anisotropy (FA) values and mean diffusivities (MD) from 3-direction diffusion MRI (dMRI) acquisitions.

METHODS

Two machine-learning models were implemented to map undersampled dMRI signals with high-quality FA and MD maps that were reconstructed from fully sampled DTI scans. The first model was a previously described multilayer perceptron (MLP), which maps signals and FA/MD values from a single voxel. The second was a convolutional neural network U-Net model, which maps dMRI slices to full FA/MD maps. Each method was trained on dMRI brain scans (N = 46), and reconstruction accuracies were compared with conventional linear-least-squares (LLS) reconstructions.

RESULTS

In an independent testing cohort (N = 20), 3-direction U-Net reconstructions had significantly lower absolute FA error than both 3-direction MLP (U-Net_3-dir : 0.06 ± 0.01 vs. MLP_3-dir : 0.08 ± 0.01, P < 1 × 10^-5 ) and 6-direction LLS (LLS_6-dir : 0.09 ± 0.03, P = 1 × 10^-5 ). The MD errors were not significantly different among 3-direction MLP (0.06 ± 0.01 × 10^-3 mm² /s), 3-direction U-Net (0.06 ± 0.01 × 10^-3 mm² /s), and 6-direction LLS (0.07 ± 0.02 × 10^-3 mm² /s, P > .1).

CONCLUSION

The proposed U-Net model reconstructed FA from 3-direction dMRI scans with improved accuracy compared with both a previously described MLP approach and LLS fitting from 6-direction scans. The MD reconstruction accuracies did not differ significantly between reconstructions.

MTE-NODDI: Multi-TE NODDI for disentangling non-T2-weighted signal fractions from compartment-specific T2 relaxation times

Neurite orientation dispersion and density imaging (NODDI) has become a popular diffusion MRI technique for investigating microstructural alternations during brain development, maturation and aging in health and disease. However, the NODDI model of diffusion does not explicitly account for compartment-specific T2 relaxation and its model parameters are usually estimated from data acquired with a single echo time (TE). Thus, the NODDI-derived measures, such as the intra-neurite signal fraction, also known as the neurite density index, could be T2-weighted and TE-dependent. This may confound the interpretation of studies as one cannot disentangle differences in diffusion from those in T2 relaxation. To address this challenge, we propose a multi-TE NODDI (MTE-NODDI) technique, inspired by recent studies exploiting the synergy between diffusion and T2 relaxation. MTE-NODDI could give robust estimates of the non-T2-weighted signal fractions and compartment-specific T2 values, as demonstrated by both simulation and in vivo data experiments. Results showed that the estimated non-T2 weighted intra-neurite fraction and compartment-specific T2 values in white matter were consistent with previous studies. The T2-weighted intra-neurite fractions from the original NODDI were found to be overestimated compared to their non-T2-weighted estimates; the overestimation increases with TE, consistent with the reported intra-neurite T2 being larger than extra-neurite T2. Finally, the inclusion of the free water compartment reduces the estimation error in intra-neurite T2 in the presence of cerebrospinal fluid contamination. With the ability to disentangle non-T2-weighted signal fractions from compartment-specific T2 relaxation, MTE-NODDI could help improve the interpretability of future neuroimaging studies, especially those in brain development, maturation and aging.