1
|
Lao G, Feng R, Qi H, Lv Z, Liu Q, Liu C, Zhang Y, Wei H. Coordinate-based neural representation enabling zero-shot learning for fast 3D multiparametric quantitative MRI. Med Image Anal 2025; 102:103530. [PMID: 40069978 DOI: 10.1016/j.media.2025.103530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2024] [Revised: 01/26/2025] [Accepted: 02/24/2025] [Indexed: 04/15/2025]
Abstract
Quantitative magnetic resonance imaging (qMRI) offers tissue-specific physical parameters with significant potential for neuroscience research and clinical practice. However, lengthy scan times for 3D multiparametric qMRI acquisition limit its clinical utility. Here, we propose SUMMIT, an innovative imaging methodology that includes data acquisition and an unsupervised reconstruction for simultaneous multiparametric qMRI. SUMMIT first encodes multiple important quantitative properties into highly undersampled k-space. It further leverages implicit neural representation incorporated with a dedicated physics model to reconstruct the desired multiparametric maps without needing external training datasets. SUMMIT delivers co-registered T1, T2, T2∗, and subvoxel quantitative susceptibility mapping. Extensive simulations, phantom, and in vivo brain imaging demonstrate SUMMIT's high accuracy. Notably, SUMMIT uniquely unravels microstructural alternations in patients with white matter hyperintense lesions with high sensitivity and specificity. Additionally, the proposed unsupervised approach for qMRI reconstruction also introduces a novel zero-shot learning paradigm for multiparametric imaging applicable to various medical imaging modalities.
Collapse
Affiliation(s)
- Guoyan Lao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ruimin Feng
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Haikun Qi
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, China
| | - Zhenfeng Lv
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, China
| | - Qiangqiang Liu
- Department of Neurosurgery, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Chunlei Liu
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA, USA
| | - Yuyao Zhang
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Hongjiang Wei
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China; National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
2
|
Demuth S, Paris J, Faddeenkov I, De Sèze J, Gourraud PA. Clinical applications of deep learning in neuroinflammatory diseases: A scoping review. Rev Neurol (Paris) 2025; 181:135-155. [PMID: 38772806 DOI: 10.1016/j.neurol.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Revised: 03/26/2024] [Accepted: 04/09/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND Deep learning (DL) is an artificial intelligence technology that has aroused much excitement for predictive medicine due to its ability to process raw data modalities such as images, text, and time series of signals. OBJECTIVES Here, we intend to give the clinical reader elements to understand this technology, taking neuroinflammatory diseases as an illustrative use case of clinical translation efforts. We reviewed the scope of this rapidly evolving field to get quantitative insights about which clinical applications concentrate the efforts and which data modalities are most commonly used. METHODS We queried the PubMed database for articles reporting DL algorithms for clinical applications in neuroinflammatory diseases and the radiology.healthairegister.com website for commercial algorithms. RESULTS The review included 148 articles published between 2018 and 2024 and five commercial algorithms. The clinical applications could be grouped as computer-aided diagnosis, individual prognosis, functional assessment, the segmentation of radiological structures, and the optimization of data acquisition. Our review highlighted important discrepancies in efforts. The segmentation of radiological structures and computer-aided diagnosis currently concentrate most efforts with an overrepresentation of imaging. Various model architectures have addressed different applications, relatively low volume of data, and diverse data modalities. We report the high-level technical characteristics of the algorithms and synthesize narratively the clinical applications. Predictive performances and some common a priori on this topic are finally discussed. CONCLUSION The currently reported efforts position DL as an information processing technology, enhancing existing modalities of paraclinical investigations and bringing perspectives to make innovative ones actionable for healthcare.
Collapse
Affiliation(s)
- S Demuth
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France.
| | - J Paris
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - I Faddeenkov
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France
| | - J De Sèze
- Inserm U1119 : biopathologie de la myéline, neuroprotection et stratégies thérapeutiques, University of Strasbourg, 1, rue Eugène-Boeckel - CS 60026, 67084 Strasbourg, France; Department of Neurology, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France; Inserm CIC 1434 Clinical Investigation Center, University Hospital of Strasbourg, 1, avenue Molière, 67200 Strasbourg, France
| | - P-A Gourraud
- Inserm U1064, CR2TI - Center for Research in Transplantation and Translational Immunology, Nantes University, 44000 Nantes, France; "Data clinic", Department of Public Health, University Hospital of Nantes, Nantes, France
| |
Collapse
|
3
|
Zhou Y, Liu L, Xu S, Ye Y, Zhang R, Zhang M, Sun J, Huang P. Validation of deep-learning accelerated quantitative susceptibility mapping for deep brain nuclei. Front Neurosci 2025; 19:1522227. [PMID: 39911700 PMCID: PMC11794186 DOI: 10.3389/fnins.2025.1522227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2024] [Accepted: 01/10/2025] [Indexed: 02/07/2025] Open
Abstract
Purpose To test the feasibility and consistency of a deep-learning (DL) accelerated QSM method for deep brain nuclei evaluation. Methods Participants were scanned with both parallel imaging (PI)-QSM and DL-QSM methods. The PI- and DL-QSM scans had identical imaging parameters other than acceleration factors (AF). The DL-QSM employed Poisson disk style under-sampling scheme and a previously developed cascaded CNN based reconstruction model, with acquisition time of 4:35, 3:15, and 2:11 for AF of 3, 4, and 5, respectively. For PI-QSM acquisition, the AF was 2 and the acquisition time was 6:46. The overall image similarity was assessed between PI- and DL-QSM images using the structural similarity index (SSIM) and peak signal-to-noise ratio (PSNR). QSM values from 7 deep brain nuclei were extracted and agreements between images with different Afs were assessed. Finally, the correlations between age and QSM values in the selected deep brain nuclei were evaluated. Results 59 participants were recruited. Compared to PI-QSM images, the mean SSIM of DL images were 0.87, 0.86, and 0.85 for AF of 3, 4, and 5. The mean PSNR were 44.56, 44.53, and 44.23. Susceptibility values from DL-QSM were highly consistent with routine PI-QSM images, with differences of less than 5% at the group level. Furthermore, the associations between age and QSM values could be consistently revealed. Conclusion DL-QSM could be used for measuring susceptibility values of deep brain nucleus. An AF up to 5 did not significantly impact the correlation between age and susceptibility in deep brain nuclei.
Collapse
Affiliation(s)
- Ying Zhou
- Taizhou Central Hospital (Taizhou University Hospital), Taizhou, China
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Lingyun Liu
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Shan Xu
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | | | - Ruiting Zhang
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Minming Zhang
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Jianzhong Sun
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Peiyu Huang
- The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| |
Collapse
|
4
|
Ekanayake M, Pawar K, Chen Z, Egan G, Chen Z. PixCUE: Joint Uncertainty Estimation and Image Reconstruction in MRI using Deep Pixel Classification. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01250-3. [PMID: 39633210 DOI: 10.1007/s10278-024-01250-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 08/27/2024] [Accepted: 08/27/2024] [Indexed: 12/07/2024]
Abstract
Deep learning (DL) models are effective in leveraging latent representations from MR data, emerging as state-of-the-art solutions for accelerated MRI reconstruction. However, challenges arise due to the inherent uncertainties associated with undersampling in k-space, coupled with the over- or under-parameterized and opaque nature of DL models. Addressing uncertainty has thus become a critical issue in DL MRI reconstruction. Monte Carlo (MC) inference techniques are commonly employed to estimate uncertainty, involving multiple reconstructions of the same scan to compute variance as a measure of uncertainty. Nevertheless, these methods entail significant computational expenses, requiring multiple inferences through the DL model. In this context, we propose a novel approach to uncertainty estimation during MRI reconstruction using a pixel classification framework. Our method, PixCUE (Pixel Classification Uncertainty Estimation), generates both the reconstructed image and an uncertainty map in a single forward pass through the DL model. We validate the efficacy of this approach by demonstrating that PixCUE-generated uncertainty maps exhibit a strong correlation with reconstruction errors across various MR imaging sequences and under diverse adversarial conditions. We present an empirical relationship between uncertainty estimations using PixCUE and established reconstruction metrics such as NMSE, PSNR, and SSIM. Furthermore, we establish a correlation between the estimated uncertainties from PixCUE and the conventional MC method. Our findings affirm that PixCUE reliably estimates uncertainty in MRI reconstruction with minimal additional computational cost.
Collapse
Affiliation(s)
- Mevan Ekanayake
- Monash Biomedical Imaging, Monash University, Clayton, VIC, 3800, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Clayton, VIC, 3800, Australia
| | - Kamlesh Pawar
- Monash Biomedical Imaging, Monash University, Clayton, VIC, 3800, Australia
| | - Zhifeng Chen
- Monash Biomedical Imaging, Monash University, Clayton, VIC, 3800, Australia
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, VIC, 3800, Australia
| | - Gary Egan
- Monash Biomedical Imaging, Monash University, Clayton, VIC, 3800, Australia
- School of Psychological Sciences, Monash University, Clayton, VIC, 3800, Australia
| | - Zhaolin Chen
- Monash Biomedical Imaging, Monash University, Clayton, VIC, 3800, Australia.
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, VIC, 3800, Australia.
| |
Collapse
|
5
|
Bi X, Liu X, Chen Z, Chen H, Du Y, Chen H, Huang X, Liu F. Complex-valued image reconstruction for compressed sensing MRI using hierarchical constraint. Magn Reson Imaging 2024; 115:110267. [PMID: 39454694 DOI: 10.1016/j.mri.2024.110267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 10/18/2024] [Accepted: 10/19/2024] [Indexed: 10/28/2024]
Abstract
In Magnetic Resonance Imaging (MRI), the sequential acquisition of raw complex-valued image data in Fourier space, also known as k-space, results in extended examination times. To speed up the MRI scans, k-space data are usually undersampled and processed using numerical techniques such as compressed sensing (CS). While the majority of CS-MRI algorithms primarily focus on magnitude images due to their significant diagnostic value, the phase components of complex-valued MRI images also hold substantial importance for clinical diagnosis, including neurodegenerative diseases. In this work, complex-valued MRI reconstruction is studied with a focus on the simultaneous reconstruction of both magnitude and phase images. The proposed algorithm is based on the nonsubsampled contourlet transform (NSCT) technique, which offers shift invariance in images. Instead of directly transforming the complex-valued image into the NSCT domain, we introduce a wavelet transform within the NSCT domain, reducing the size of the sparsity of coefficients. This two-level hierarchical constraint (HC) enforces sparse representation of complex-valued images for CS-MRI implementation. The proposed HC is seamlessly integrated into a proximal algorithm simultaneously. Additionally, to effectively minimize the artifacts caused by sub-sampling, thresholds related to different sub-bands in the HC are applied through an alternating optimization process. Experimental results show that the novel method outperforms existing CS-MRI techniques in phase-regularized complex-valued image reconstructions.
Collapse
Affiliation(s)
- Xue Bi
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, China; School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia.
| | - Xinwen Liu
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia.
| | - Zhifeng Chen
- Monash Biomedical Imaging Center, Monash University, Clayton, VIC, Australia; Department of Data Science, Faculty of IT, Monash University, Clayton, VIC, Australia
| | - Hongli Chen
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia.
| | - Yajun Du
- School of Computer and Software Engineering, Xihua University, Chengdu, China; Yibin Wite Rui'an Technology Co., LTD, Yibin, China.
| | - Huizu Chen
- Department of Radiology, West China Second University Hospital, Sichuan University,Chengdu, China
| | - Xiaoli Huang
- School of Electrical Engineering and Electronic Information, Xihua University, Chengdu, China.
| | - Feng Liu
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia.
| |
Collapse
|
6
|
Paluru N, Susan Mathew R, Yalavarthy PK. DF-QSM: Data Fidelity based Hybrid Approach for Improved Quantitative Susceptibility Mapping of the Brain. NMR IN BIOMEDICINE 2024; 37:e5163. [PMID: 38649140 DOI: 10.1002/nbm.5163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 01/22/2024] [Accepted: 03/11/2024] [Indexed: 04/25/2024]
Abstract
Quantitative Susceptibility Mapping (QSM) is an advanced magnetic resonance imaging (MRI) technique to quantify the magnetic susceptibility of the tissue under investigation. Deep learning methods have shown promising results in deconvolving the susceptibility distribution from the measured local field obtained from the MR phase. Although existing deep learning based QSM methods can produce high-quality reconstruction, they are highly biased toward training data distribution with less scope for generalizability. This work proposes a hybrid two-step reconstruction approach to improve deep learning based QSM reconstruction. The susceptibility map prediction obtained from the deep learning methods has been refined in the framework developed in this work to ensure consistency with the measured local field. The developed method was validated on existing deep learning and model-based deep learning methods for susceptibility mapping of the brain. The developed method resulted in improved reconstruction for MRI volumes obtained with different acquisition settings, including deep learning models trained on constrained (limited) data settings.
Collapse
Affiliation(s)
- Naveen Paluru
- Department of Computational and Data Sciences, Indian Institute of Science, Bangalore, Karnataka, India
| | - Raji Susan Mathew
- School of Data Science, Indian Institute of Science Education and Research, Thiruvananthapuram, Kerala, India
| | - Phaneendra K Yalavarthy
- Department of Computational and Data Sciences, Indian Institute of Science, Bangalore, Karnataka, India
| |
Collapse
|
7
|
Wang S, Wu R, Jia S, Diakite A, Li C, Liu Q, Zheng H, Ying L. Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning. Magn Reson Med 2024; 92:496-518. [PMID: 38624162 DOI: 10.1002/mrm.30105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/19/2024] [Accepted: 03/20/2024] [Indexed: 04/17/2024]
Abstract
Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ruoyou Wu
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Sen Jia
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Alou Diakite
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Cheng Li
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Leslie Ying
- Department of Biomedical Engineering and Department of Electrical Engineering, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
8
|
Zhang J, Spincemaille P, Zhang H, Nguyen TD, Li C, Li J, Kovanlikaya I, Sabuncu MR, Wang Y. LARO: Learned acquisition and reconstruction optimization to accelerate quantitative susceptibility mapping. Neuroimage 2023; 268:119886. [PMID: 36669747 PMCID: PMC10021353 DOI: 10.1016/j.neuroimage.2023.119886] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 12/12/2022] [Accepted: 01/16/2023] [Indexed: 01/19/2023] Open
Abstract
Quantitative susceptibility mapping (QSM) involves acquisition and reconstruction of a series of images at multi-echo time points to estimate tissue field, which prolongs scan time and requires specific reconstruction technique. In this paper, we present our new framework, called Learned Acquisition and Reconstruction Optimization (LARO), which aims to accelerate the multi-echo gradient echo (mGRE) pulse sequence for QSM. Our approach involves optimizing a Cartesian multi-echo k-space sampling pattern with a deep reconstruction network. Next, this optimized sampling pattern was implemented in an mGRE sequence using Cartesian fan-beam k-space segmenting and ordering for prospective scans. Furthermore, we propose to insert a recurrent temporal feature fusion module into the reconstruction network to capture signal redundancies along echo time. Our ablation studies show that both the optimized sampling pattern and proposed reconstruction strategy help improve the quality of the multi-echo image reconstructions. Generalization experiments show that LARO is robust on the test data with new pathologies and different sequence parameters. Our code is available at https://github.com/Jinwei1209/LARO-QSM.git.
Collapse
Affiliation(s)
- Jinwei Zhang
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Pascal Spincemaille
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Hang Zhang
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA; Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
| | - Thanh D Nguyen
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Chao Li
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA; Department of Applied Physics, Cornell University, Ithaca, NY, USA
| | - Jiahao Li
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Ilhami Kovanlikaya
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Mert R Sabuncu
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA; Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
| | - Yi Wang
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA.
| |
Collapse
|
9
|
Yang Q, Ma L, Zhou Z, Bao J, Yang Q, Huang H, Cai S, He H, Chen Z, Zhong J, Cai C. Rapid high-fidelity T 2 * mapping using single-shot overlapping-echo acquisition and deep learning reconstruction. Magn Reson Med 2023; 89:2157-2170. [PMID: 36656132 DOI: 10.1002/mrm.29585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 12/07/2022] [Accepted: 12/29/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE To develop and evaluate a single-shot quantitative MRI technique called GRE-MOLED (gradient-echo multiple overlapping-echo detachment) for rapid T 2 * $$ {T}_2^{\ast } $$ mapping. METHODS In GRE-MOLED, multiple echoes with different TEs are generated and captured in a single shot of the k-space through MOLED encoding and EPI readout. A deep neural network, trained by synthetic data, was employed for end-to-end parametric mapping from overlapping-echo signals. GRE-MOLED uses pure GRE acquisition with a single echo train to deliver T 2 * $$ {T}_2^{\ast } $$ maps less than 90 ms per slice. The self-registered B0 information modulated in image phase was utilized for distortion-corrected parametric mapping. The proposed method was evaluated in phantoms, healthy volunteers, and task-based FMRI experiments. RESULTS The quantitative results of GRE-MOLED T 2 * $$ {T}_2^{\ast } $$ mapping demonstrated good agreement with those obtained from the multi-echo GRE method (Pearson's correlation coefficient = 0.991 and 0.973 for phantom and in vivo brains, respectively). High intrasubject repeatability (coefficient of variation <1.0%) were also achieved in scan-rescan test. Enabled by deep learning reconstruction, GRE-MOLED showed excellent robustness to geometric distortion, noise, and random subject motion. Compared to the conventional FMRI approach, GRE-MOLED also achieved a higher temporal SNR and BOLD sensitivity in task-based FMRI. CONCLUSION GRE-MOLED is a new real-time technique for T 2 * $$ {T}_2^{\ast } $$ quantification with high efficiency and quality, and it has the potential to be a better quantitative BOLD detection method.
Collapse
Affiliation(s)
- Qinqin Yang
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Lingceng Ma
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Zihan Zhou
- The Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Jianfeng Bao
- Department of Magnetic Resonance Imaging, The First Affiliated Hospital of Zhengzhou University, Zhengzhou University, Zhengzhou, Henan, China
| | - Qizhi Yang
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Haitao Huang
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Shuhui Cai
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Hongjian He
- The Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Zhong Chen
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| | - Jianhui Zhong
- The Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, China.,Department of Imaging Sciences, University of Rochester, Rochester, New York, USA
| | - Congbo Cai
- Department of Electronic Science, Xiamen University, Xiamen, Fujian, China
| |
Collapse
|
10
|
Ouyang B, Yang Q, Wang X, He H, Ma L, Yang Q, Zhou Z, Cai S, Chen Z, Wu Z, Zhong J, Cai C. Single-shot T 2 mapping via multi-echo-train multiple overlapping-echo detachment planar imaging and multitask deep learning. Med Phys 2022; 49:7095-7107. [PMID: 35765150 DOI: 10.1002/mp.15820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Revised: 05/02/2022] [Accepted: 06/13/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Quantitative magnetic resonance imaging provides robust biomarkers in clinics. Nevertheless, the lengthy scan time reduces imaging throughput and increases the susceptibility of imaging results to motion. In this context, a single-shot T2 mapping method based on multiple overlapping-echo detachment (MOLED) planar imaging was presented, but the relatively small echo time range limits its accuracy, especially in tissues with large T2 . PURPOSE In this work we proposed a novel single-shot method, Multi-Echo-Train Multiple OverLapping-Echo Detachment (METMOLED) planar imaging, to accommodate a large range of T2 quantification without additional measurements to rectify signal degeneration arisen from refocusing pulse imperfection. METHODS Multiple echo-train techniques were integrated into the MOLED sequence to capture larger TE information. Maps of T2 , B1 , and spin density were reconstructed synchronously from acquired METMOLED data via multitask deep learning. A typical U-Net was trained with 3000/600 synthetic data with geometric/brain patterns to learn the mapping relationship between METMOLED signals and quantitative maps. The refocusing pulse imperfection was settled through the inherent information of METMOLED data and auxiliary tasks. RESULTS Experimental results on the digital brain (structural similarity (SSIM) index = 0.975/0.991/0.988 for MOLED/METMOLED-2/METMOLED-3, hyphenated number denotes the number of echo-trains), physical phantom (the slope of linear fitting with reference T2 map = 1.047/1.017/1.006 for MOLED/METMOLED-2/METMOLED-3), and human brain (Pearson's correlation coefficient (PCC) = 0.9581/0.9760/0.9900 for MOLED/METMOLED-2/METMOLED-3) demonstrated that the METMOLED improved the quantitative accuracy and the tissue details in contrast to the MOLED. These improvements were more pronounced in tissues with large T2 and in application scenarios with high temporal resolution (PCC = 0.8692/0.9465/0.9743 for MOLED/METMOLED-2/METMOLED-3). Moreover, the METMOLED could rectify the signal deviations induced by the non-ideal slice profiles of refocusing pulses without additional measurements. A preliminary measurement also demonstrated that the METMOLED is highly repeatable (mean coefficient of variation (CV) = 1.65%). CONCLUSIONS METMOLED breaks the restriction of echo-train length to TE and implements unbiased T2 estimates in an extensive range. Furthermore, it corrects the effect of refocusing pulse inaccuracy without additional measurements or signal post-processing, thus retaining its single-shot characteristic. This technique would be beneficial for accurate T2 quantification.
Collapse
Affiliation(s)
- Binyu Ouyang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Qizhi Yang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Xiaoyin Wang
- Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, 310058, China
| | - Hongjian He
- Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, 310058, China
| | - Lingceng Ma
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Qinqin Yang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Zihan Zhou
- Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, 310058, China
| | - Shuhui Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Zhong Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| | - Zhigang Wu
- MSC Clinical and Technical Solutions, Philips Healthcare, Shenzhen, Guangdong, 518005, China
| | - Jianhui Zhong
- Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Hangzhou, Zhejiang, 310058, China.,Department of Imaging Sciences, University of Rochester, Rochester, New York, 14642, USA
| | - Congbo Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, Fujian, 361005, China
| |
Collapse
|
11
|
Duan C, Xiong Y, Cheng K, Xiao S, Lyu J, Wang C, Bian X, Zhang J, Zhang D, Chen L, Zhou X, Lou X. Accelerating susceptibility-weighted imaging with deep learning by complex-valued convolutional neural network (ComplexNet): validation in clinical brain imaging. Eur Radiol 2022; 32:5679-5687. [PMID: 35182203 DOI: 10.1007/s00330-022-08638-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 12/15/2021] [Accepted: 01/11/2022] [Indexed: 11/30/2022]
Abstract
OBJECTIVES Susceptibility-weighted imaging (SWI) is crucial for the characterization of intracranial hemorrhage and mineralization, but has the drawback of long acquisition times. We aimed to propose a deep learning model to accelerate SWI, and evaluate the clinical feasibility of this approach. METHODS A complex-valued convolutional neural network (ComplexNet) was developed to reconstruct high-quality SWI from highly accelerated k-space data. ComplexNet can leverage the inherently complex-valued nature of SWI data and learn richer representations by using complex-valued network. SWI data were acquired from 117 participants who underwent clinical brain MRI examination between 2019 and 2021, including patients with tumor, stroke, hemorrhage, traumatic brain injury, etc. Reconstruction quality was evaluated using quantitative image metrics and image quality scores, including overall image quality, signal-to-noise ratio, sharpness, and artifacts. RESULTS The average reconstruction time of ComplexNet was 19 ms per section (1.33 s per participant). ComplexNet achieved significantly improved quantitative image metrics compared to a conventional compressed sensing method and a real-valued network with acceleration rates of 5 and 8 (p < 0.001). Meanwhile, there was no significant difference between fully sampled and ComplexNet approaches in terms of overall image quality and artifacts (p > 0.05) at both acceleration rates. Furthermore, ComplexNet showed comparable diagnostic performance to the fully sampled SWI for visualizing a wide range of pathology, including hemorrhage, cerebral microbleeds, and brain tumor. CONCLUSIONS ComplexNet can effectively accelerate SWI while providing superior performance in terms of overall image quality and visualization of pathology for routine clinical brain imaging. KEY POINTS • The complex-valued convolutional neural network (ComplexNet) allowed fast and high-quality reconstruction of highly accelerated SWI data, with an average reconstruction time of 19 ms per section. • ComplexNet achieved significantly improved quantitative image metrics compared to a conventional compressed sensing method and a real-valued network with acceleration rates of 5 and 8 (p < 0.001). • ComplexNet showed comparable diagnostic performance to the fully sampled SWI for visualizing a wide range of pathology, including hemorrhage, cerebral microbleeds, and brain tumor.
Collapse
Affiliation(s)
- Caohui Duan
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Yongqin Xiong
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Kun Cheng
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Sa Xiao
- Department of Neurosurgery, Chinese PLA General Hospital, 28 Fuxing Road, Beijing, 100853, People's Republic of China
| | - Jinhao Lyu
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Cheng Wang
- Department of Neurosurgery, Chinese PLA General Hospital, 28 Fuxing Road, Beijing, 100853, People's Republic of China
| | - Xiangbing Bian
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Jing Zhang
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Dekang Zhang
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China
| | - Ling Chen
- Department of Neurosurgery, Chinese PLA General Hospital, 28 Fuxing Road, Beijing, 100853, People's Republic of China
| | - Xin Zhou
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Wuhan, 430071, People's Republic of China
| | - Xin Lou
- Department of Radiology, Chinese PLA General Hospital, Beijing, 100853, People's Republic of China.
| |
Collapse
|