1
|
Wang S, Wu R, Jia S, Diakite A, Li C, Liu Q, Zheng H, Ying L. Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning. Magn Reson Med 2024; 92:496-518. [PMID: 38624162 DOI: 10.1002/mrm.30105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/19/2024] [Accepted: 03/20/2024] [Indexed: 04/17/2024]
Abstract
Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ruoyou Wu
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Sen Jia
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Alou Diakite
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Cheng Li
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Leslie Ying
- Department of Biomedical Engineering and Department of Electrical Engineering, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
2
|
Monga A, Singh D, de Moura HL, Zhang X, Zibetti MVW, Regatte RR. Emerging Trends in Magnetic Resonance Fingerprinting for Quantitative Biomedical Imaging Applications: A Review. Bioengineering (Basel) 2024; 11:236. [PMID: 38534511 DOI: 10.3390/bioengineering11030236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Revised: 02/21/2024] [Accepted: 02/22/2024] [Indexed: 03/28/2024] Open
Abstract
Magnetic resonance imaging (MRI) stands as a vital medical imaging technique, renowned for its ability to offer high-resolution images of the human body with remarkable soft-tissue contrast. This enables healthcare professionals to gain valuable insights into various aspects of the human body, including morphology, structural integrity, and physiological processes. Quantitative imaging provides compositional measurements of the human body, but, currently, either it takes a long scan time or is limited to low spatial resolutions. Undersampled k-space data acquisitions have significantly helped to reduce MRI scan time, while compressed sensing (CS) and deep learning (DL) reconstructions have mitigated the associated undersampling artifacts. Alternatively, magnetic resonance fingerprinting (MRF) provides an efficient and versatile framework to acquire and quantify multiple tissue properties simultaneously from a single fast MRI scan. The MRF framework involves four key aspects: (1) pulse sequence design; (2) rapid (undersampled) data acquisition; (3) encoding of tissue properties in MR signal evolutions or fingerprints; and (4) simultaneous recovery of multiple quantitative spatial maps. This paper provides an extensive literature review of the MRF framework, addressing the trends associated with these four key aspects. There are specific challenges in MRF for all ranges of magnetic field strengths and all body parts, which can present opportunities for further investigation. We aim to review the best practices in each key aspect of MRF, as well as for different applications, such as cardiac, brain, and musculoskeletal imaging, among others. A comprehensive review of these applications will enable us to assess future trends and their implications for the translation of MRF into these biomedical imaging applications.
Collapse
Affiliation(s)
- Anmol Monga
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Dilbag Singh
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Hector L de Moura
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Xiaoxia Zhang
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Marcelo V W Zibetti
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| | - Ravinder R Regatte
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA
| |
Collapse
|
3
|
Tian R, Uecker M, Davids M, Thielscher A, Buckenmaier K, Holder O, Steffen T, Scheffler K. Accelerated 2D Cartesian MRI with an 8-channel local B 0 coil array combined with parallel imaging. Magn Reson Med 2024; 91:443-465. [PMID: 37867407 DOI: 10.1002/mrm.29799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 06/26/2023] [Accepted: 06/30/2023] [Indexed: 10/24/2023]
Abstract
PURPOSE In MRI, the magnetization of nuclear spins is spatially encoded with linear gradients and radiofrequency receivers sensitivity profiles to produce images, which inherently leads to a long scan time. Cartesian MRI, as widely adopted for clinical scans, can be accelerated with parallel imaging and rapid magnetic field modulation during signal readout. Here, by using an 8-channel localB 0 $$ {\mathrm{B}}_0 $$ coil array, the modulation scheme optimized for sampling efficiency is investigated to speed up 2D Cartesian scans. THEORY AND METHODS An 8-channel localB 0 $$ {\mathrm{B}}_0 $$ coil array is made to carry sinusoidal currents during signal readout to accelerate 2D Cartesian scans. An MRI sampling theory based on reproducing kernel Hilbert space is exploited to visualize the efficiency of nonlinear encoding in arbitrary sampling duration. A field calibration method using current monitors for localB 0 $$ {\mathrm{B}}_0 $$ coils and the ESPIRiT algorithm is proposed to facilitate image reconstruction. Image acceleration with various modulation field shapes, aliasing control, and distinct modulation frequencies are scrutinized to find an optimized modulation scheme. A safety evaluation is conducted. In vivo 2D Cartesian scans are accelerated by the localB 0 $$ {\mathrm{B}}_0 $$ coils. RESULTS For 2D Cartesian MRI, the optimal modulation field by this localB 0 $$ {\mathrm{B}}_0 $$ array converges to a nearly linear gradient field. With the field calibration technique, it accelerates the in vivo scans (i.e., proved safe) by threefold and eightfold free of visible artifacts, without and with SENSE, respectively. CONCLUSION The nonlinear encoding analysis tool, the field calibration method, the safety evaluation procedures, and the in vivo reconstructed scans make significant steps to push MRI speed further with the localB 0 $$ {\mathrm{B}}_0 $$ coil array.
Collapse
Affiliation(s)
- Rui Tian
- High-Field MR center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Martin Uecker
- Institute of Biomedical Imaging, Graz University of Technology, Graz, Austria
- Institute for Diagnostic and Interventional Radiology, University Medical Center Göttingen, Göttingen, Germany
- German Centre for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
- BioTechMed-Graz, Graz, Austria
| | - Mathias Davids
- A. A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Axel Thielscher
- Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
- Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and Research, Copenhagen University Hospital Amager and Hvidovre, Hvidovre, Denmark
| | - Kai Buckenmaier
- High-Field MR center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Oliver Holder
- High-Field MR center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Theodor Steffen
- High-Field MR center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Klaus Scheffler
- High-Field MR center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- Department for Biomedical Magnetic Resonance, University of Tübingen, Tübingen, Germany
| |
Collapse
|
4
|
Jaubert O, Montalt‐Tordera J, Knight D, Arridge S, Steeden J, Muthurangu V. HyperSLICE: HyperBand optimized spiral for low-latency interactive cardiac examination. Magn Reson Med 2024; 91:266-279. [PMID: 37799087 PMCID: PMC10953456 DOI: 10.1002/mrm.29855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Revised: 08/15/2023] [Accepted: 08/15/2023] [Indexed: 10/07/2023]
Abstract
PURPOSE Interactive cardiac MRI is used for fast scan planning and MR-guided interventions. However, the requirement for real-time acquisition and near-real-time visualization constrains the achievable spatio-temporal resolution. This study aims to improve interactive imaging resolution through optimization of undersampled spiral sampling and leveraging of deep learning for low-latency reconstruction (deep artifact suppression). METHODS A variable density spiral trajectory was parametrized and optimized via HyperBand to provide the best candidate trajectory for rapid deep artifact suppression. Training data consisted of 692 breath-held CINEs. The developed interactive sequence was tested in simulations and prospectively in 13 subjects (10 for image evaluation, 2 during catheterization, 1 during exercise). In the prospective study, the optimized framework-HyperSLICE- was compared with conventional Cartesian real-time and breath-hold CINE imaging in terms quantitative and qualitative image metrics. Statistical differences were tested using Friedman chi-squared tests with post hoc Nemenyi test (p < 0.05). RESULTS In simulations the normalized RMS error, peak SNR, structural similarity, and Laplacian energy were all statistically significantly higher using optimized spiral compared to radial and uniform spiral sampling, particularly after scan plan changes (structural similarity: 0.71 vs. 0.45 and 0.43). Prospectively, HyperSLICE enabled a higher spatial and temporal resolution than conventional Cartesian real-time imaging. The pipeline was demonstrated in patients during catheter pull back, showing sufficiently fast reconstruction for interactive imaging. CONCLUSION HyperSLICE enables high spatial and temporal resolution interactive imaging. Optimizing the spiral sampling enabled better overall image quality and superior handling of image transitions compared with radial and uniform spiral trajectories.
Collapse
Affiliation(s)
- Olivier Jaubert
- UCL Center for Translational Cardiovascular ImagingUniversity College LondonLondonUK
| | | | - Daniel Knight
- UCL Center for Translational Cardiovascular ImagingUniversity College LondonLondonUK
- Department of CardiologyRoyal Free London NHS Foundation TrustLondonUK
| | - Simon Arridge
- Department of Computer ScienceUniversity College LondonLondonUK
| | - Jennifer Steeden
- UCL Center for Translational Cardiovascular ImagingUniversity College LondonLondonUK
| | - Vivek Muthurangu
- UCL Center for Translational Cardiovascular ImagingUniversity College LondonLondonUK
| |
Collapse
|
5
|
Singh D, Monga A, de Moura HL, Zhang X, Zibetti MVW, Regatte RR. Emerging Trends in Fast MRI Using Deep-Learning Reconstruction on Undersampled k-Space Data: A Systematic Review. Bioengineering (Basel) 2023; 10:1012. [PMID: 37760114 PMCID: PMC10525988 DOI: 10.3390/bioengineering10091012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/22/2023] [Accepted: 08/24/2023] [Indexed: 09/29/2023] Open
Abstract
Magnetic Resonance Imaging (MRI) is an essential medical imaging modality that provides excellent soft-tissue contrast and high-resolution images of the human body, allowing us to understand detailed information on morphology, structural integrity, and physiologic processes. However, MRI exams usually require lengthy acquisition times. Methods such as parallel MRI and Compressive Sensing (CS) have significantly reduced the MRI acquisition time by acquiring less data through undersampling k-space. The state-of-the-art of fast MRI has recently been redefined by integrating Deep Learning (DL) models with these undersampled approaches. This Systematic Literature Review (SLR) comprehensively analyzes deep MRI reconstruction models, emphasizing the key elements of recently proposed methods and highlighting their strengths and weaknesses. This SLR involves searching and selecting relevant studies from various databases, including Web of Science and Scopus, followed by a rigorous screening and data extraction process using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. It focuses on various techniques, such as residual learning, image representation using encoders and decoders, data-consistency layers, unrolled networks, learned activations, attention modules, plug-and-play priors, diffusion models, and Bayesian methods. This SLR also discusses the use of loss functions and training with adversarial networks to enhance deep MRI reconstruction methods. Moreover, we explore various MRI reconstruction applications, including non-Cartesian reconstruction, super-resolution, dynamic MRI, joint learning of reconstruction with coil sensitivity and sampling, quantitative mapping, and MR fingerprinting. This paper also addresses research questions, provides insights for future directions, and emphasizes robust generalization and artifact handling. Therefore, this SLR serves as a valuable resource for advancing fast MRI, guiding research and development efforts of MRI reconstruction for better image quality and faster data acquisition.
Collapse
Affiliation(s)
- Dilbag Singh
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| | | | | | | | | | - Ravinder R. Regatte
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| |
Collapse
|
6
|
Shimron E, Perlman O. AI in MRI: Computational Frameworks for a Faster, Optimized, and Automated Imaging Workflow. Bioengineering (Basel) 2023; 10:bioengineering10040492. [PMID: 37106679 PMCID: PMC10135995 DOI: 10.3390/bioengineering10040492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 04/12/2023] [Accepted: 04/18/2023] [Indexed: 04/29/2023] Open
Abstract
Over the last decade, artificial intelligence (AI) has made an enormous impact on a wide range of fields, including science, engineering, informatics, finance, and transportation [...].
Collapse
Affiliation(s)
- Efrat Shimron
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| |
Collapse
|
7
|
Wang G, Fessler JA. Efficient Approximation of Jacobian Matrices Involving a Non-Uniform Fast Fourier Transform (NUFFT). IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING 2023; 9:43-54. [PMID: 37090025 PMCID: PMC10118239 DOI: 10.1109/tci.2023.3240081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
There is growing interest in learning Fourier domain sampling strategies (particularly for magnetic resonance imaging, MRI) using optimization approaches. For non-Cartesian sampling, the system models typically involve non-uniform fast Fourier transform (NUFFT) operations. Commonly used NUFFT algorithms contain frequency domain interpolation, which is not differentiable with respect to the sampling pattern, complicating the use of gradient methods. This paper describes an efficient and accurate approach for computing approximate gradients involving NUFFTs. Multiple numerical experiments validate the improved accuracy and efficiency of the proposed approximation. As an application to computational imaging, the NUFFT Jacobians were used to optimize non-Cartesian MRI sampling trajectories via data-driven stochastic optimization. Specifically, the sampling patterns were learned with respect to various model-based image reconstruction (MBIR) algorithms. The proposed approach enables sampling optimization for image sizes that are infeasible with standard auto-differentiation methods due to memory limits. The synergistic acquisition and reconstruction design leads to remarkably improved image quality. In fact, we show that model-based image reconstruction methods with suitably optimized imaging parameters can perform nearly as well as CNN-based methods.
Collapse
Affiliation(s)
- Guanhua Wang
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109 USA
| | | |
Collapse
|
8
|
Radhakrishna CG, Ciuciu P. Jointly Learning Non-Cartesian k-Space Trajectories and Reconstruction Networks for 2D and 3D MR Imaging through Projection. Bioengineering (Basel) 2023; 10:bioengineering10020158. [PMID: 36829652 PMCID: PMC9952463 DOI: 10.3390/bioengineering10020158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 01/17/2023] [Accepted: 01/18/2023] [Indexed: 01/27/2023] Open
Abstract
Compressed sensing in magnetic resonance imaging essentially involves the optimization of (1) the sampling pattern in k-space under MR hardware constraints and (2) image reconstruction from undersampled k-space data. Recently, deep learning methods have allowed the community to address both problems simultaneously, especially in the non-Cartesian acquisition setting. This work aims to contribute to this field by tackling some major concerns in existing approaches. Particularly, current state-of-the-art learning methods seek hardware compliant k-space sampling trajectories by enforcing the hardware constraints through additional penalty terms in the training loss. Through ablation studies, we rather show the benefit of using a projection step to enforce these constraints and demonstrate that the resulting k-space trajectories are more flexible under a projection-based scheme, which results in superior performance in reconstructed image quality. In 2D studies, our novel method trajectories present an improved image reconstruction quality at a 20-fold acceleration factor on the fastMRI data set with SSIM scores of nearly 0.92-0.95 in our retrospective studies as compared to the corresponding Cartesian reference and also see a 3-4 dB gain in PSNR as compared to earlier state-of-the-art methods. Finally, we extend the algorithm to 3D and by comparing optimization as learning-based projection schemes, we show that data-driven joint learning-based method trajectories outperform model-based methods such as SPARKLING through a 2 dB gain in PSNR and 0.02 gain in SSIM.
Collapse
Affiliation(s)
- Chaithya Giliyar Radhakrishna
- Neurospin, Commissariat à L’énergie Atomique et Aux Énergies Alternatives (CEA), Centre National de la Recherche Scientifique (CNRS), Université Paris-Saclay, 91191 Gif-sur-Yvette, France
- Inria, Models and Inference for Neuroimaging Data (MIND), 91120 Palaiseau, France
| | - Philippe Ciuciu
- Neurospin, Commissariat à L’énergie Atomique et Aux Énergies Alternatives (CEA), Centre National de la Recherche Scientifique (CNRS), Université Paris-Saclay, 91191 Gif-sur-Yvette, France
- Inria, Models and Inference for Neuroimaging Data (MIND), 91120 Palaiseau, France
- Correspondence:
| |
Collapse
|
9
|
Singh NM, Harrod JB, Subramanian S, Robinson M, Chang K, Cetin-Karayumak S, Dalca AV, Eickhoff S, Fox M, Franke L, Golland P, Haehn D, Iglesias JE, O’Donnell LJ, Ou Y, Rathi Y, Siddiqi SH, Sun H, Westover MB, Whitfield-Gabrieli S, Gollub RL. How Machine Learning is Powering Neuroimaging to Improve Brain Health. Neuroinformatics 2022; 20:943-964. [PMID: 35347570 PMCID: PMC9515245 DOI: 10.1007/s12021-022-09572-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/07/2022] [Indexed: 12/31/2022]
Abstract
This report presents an overview of how machine learning is rapidly advancing clinical translational imaging in ways that will aid in the early detection, prediction, and treatment of diseases that threaten brain health. Towards this goal, we aresharing the information presented at a symposium, "Neuroimaging Indicators of Brain Structure and Function - Closing the Gap Between Research and Clinical Application", co-hosted by the McCance Center for Brain Health at Mass General Hospital and the MIT HST Neuroimaging Training Program on February 12, 2021. The symposium focused on the potential for machine learning approaches, applied to increasingly large-scale neuroimaging datasets, to transform healthcare delivery and change the trajectory of brain health by addressing brain care earlier in the lifespan. While not exhaustive, this overview uniquely addresses many of the technical challenges from image formation, to analysis and visualization, to synthesis and incorporation into the clinical workflow. Some of the ethical challenges inherent to this work are also explored, as are some of the regulatory requirements for implementation. We seek to educate, motivate, and inspire graduate students, postdoctoral fellows, and early career investigators to contribute to a future where neuroimaging meaningfully contributes to the maintenance of brain health.
Collapse
Affiliation(s)
- Nalini M. Singh
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Jordan B. Harrod
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Sandya Subramanian
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Mitchell Robinson
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Ken Chang
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Suheyla Cetin-Karayumak
- Department of Psychiatry, Brigham and Women’s Hospital and Harvard Medical School, Boston, 02115 USA
| | | | - Simon Eickhoff
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany ,Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7) Research Centre Jülich, Jülich, Germany
| | - Michael Fox
- Center for Brain Circuit Therapeutics, Department of Neurology, Psychiatry, and Radiology, Brigham and Women’s Hospital and Harvard Medical School, 02115 Boston, USA
| | - Loraine Franke
- University of Massachusetts Boston, Boston, MA 02125 USA
| | - Polina Golland
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Daniel Haehn
- University of Massachusetts Boston, Boston, MA 02125 USA
| | - Juan Eugenio Iglesias
- Centre for Medical Image Computing, University College London, London, UK ,Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, 02114 USA ,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Lauren J. O’Donnell
- Department of Radiology, Brigham and Women’s Hospital and Harvard Medical School, MA 02115 Boston, USA
| | - Yangming Ou
- Department of Radiology, Boston Children’s Hospital, Harvard Medical School, Boston, MA 02115 USA
| | - Yogesh Rathi
- Department of Psychiatry, Brigham and Women’s Hospital and Harvard Medical School, Boston, 02115 USA
| | - Shan H. Siddiqi
- Department of Psychiatry, Brigham and Women’s Hospital and Harvard Medical School, Boston, 02115 USA
| | - Haoqi Sun
- Department of Neurology and McCance Center for Brain Health / Harvard Medical School, Massachusetts General Hospital, Boston, 02114 USA
| | - M. Brandon Westover
- Department of Neurology and McCance Center for Brain Health / Harvard Medical School, Massachusetts General Hospital, Boston, 02114 USA
| | | | - Randy L. Gollub
- Department of Psychiatry and Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA 02114 USA
| |
Collapse
|
10
|
Zibetti MVW, Knoll F, Regatte RR. Alternating Learning Approach for Variational Networks and Undersampling Pattern in Parallel MRI Applications. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING 2022; 8:449-461. [PMID: 35795003 PMCID: PMC9252023 DOI: 10.1109/tci.2022.3176129] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
This work proposes an alternating learning approach to learn the sampling pattern (SP) and the parameters of variational networks (VN) in accelerated parallel magnetic resonance imaging (MRI). We investigate four variations of the learning approach, that alternates between improving the SP, using bias-accelerated subset selection, and improving parameters of the VN, using ADAM. The variations include the use of monotone or non-monotone alternating steps and systematic reduction of learning rates. The algorithms learn an effective pair to be used in future scans, including an SP that captures fewer k-space samples in which the generated undersampling artifacts are removed by the VN reconstruction. The quality of the VNs and SPs obtained by the proposed approaches is compared against different methods, including other kinds of joint learning methods and state-of-art reconstructions, on two different datasets at various acceleration factors (AF). We observed improvements visually and in three different figures of merit commonly used in deep learning (RMSE, SSIM, and HFEN) on AFs from 2 to 20 with brain and knee joint datasets when compared to the other approaches. The improvements ranged from 1% to 62% over the next best approach tested with VNs. The proposed approach has shown stable performance, obtaining similar learned SPs under different initial training conditions. We observe that the improvement is not only due to the learned sampling density, it is also due to the learned position of samples in k-space. The proposed approach was able to learn effective pairs of SPs and reconstruction VNs, improving 3D Cartesian accelerated parallel MRI applications.
Collapse
Affiliation(s)
- Marcelo V W Zibetti
- Department of Radiology of the New York University Grossman School of Medicine, New York, NY 10016 USA
| | - Florian Knoll
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University of Erlangen-Nurnberg, Erlangen, Germany
| | - Ravinder R Regatte
- Department of Radiology of the New York University Grossman School of Medicine, New York, NY 10016 USA
| |
Collapse
|