1
|
Ilicak E, Saritas EU, Çukur T. Automated Parameter Selection for Accelerated MRI Reconstruction via Low-Rank Modeling of Local k-Space Neighborhoods. Z Med Phys 2023; 33:203-219. [PMID: 35216887 PMCID: PMC10311279 DOI: 10.1016/j.zemedi.2022.02.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 01/04/2022] [Accepted: 02/01/2022] [Indexed: 11/26/2022]
Abstract
PURPOSE Image quality in accelerated MRI rests on careful selection of various reconstruction parameters. A common yet tedious and error-prone practice is to hand-tune each parameter to attain visually appealing reconstructions. Here, we propose a parameter tuning strategy to automate hybrid parallel imaging (PI) - compressed sensing (CS) reconstructions via low-rank modeling of local k-space neighborhoods (LORAKS) supplemented with sparsity regularization in wavelet and total variation (TV) domains. METHODS For low-rank regularization, we leverage a soft-thresholding operation based on singular values for matrix rank selection in LORAKS. For sparsity regularization, we employ Stein's unbiased risk estimate criterion to select the wavelet regularization parameter and local standard deviation of reconstructions to select the TV regularization parameter. Comprehensive demonstrations are presented on a numerical brain phantom and in vivo brain and knee acquisitions. Quantitative assessments are performed via PSNR, SSIM and NMSE metrics. RESULTS The proposed hybrid PI-CS method improves reconstruction quality compared to PI-only techniques, and it achieves on par image quality to reconstructions with brute-force optimization of reconstruction parameters. These results are prominent across several different datasets and the range of examined acceleration rates. CONCLUSION A data-driven parameter tuning strategy to automate hybrid PI-CS reconstructions is presented. The proposed method achieves reliable reconstructions of accelerated multi-coil MRI datasets without the need for exhaustive hand-tuning of reconstruction parameters.
Collapse
Affiliation(s)
- Efe Ilicak
- Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey.
| | - Emine Ulku Saritas
- National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey; Department of Electrical and Electronics Engineering, Bilkent University, Ankara, Turkey; Neuroscience Program, Bilkent University, Ankara, Turkey
| | - Tolga Çukur
- National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey; Department of Electrical and Electronics Engineering, Bilkent University, Ankara, Turkey; Neuroscience Program, Bilkent University, Ankara, Turkey
| |
Collapse
|
2
|
Zhang J, Han L, Sun J, Wang Z, Xu W, Chu Y, Xia L, Jiang M. Compressed sensing based dynamic MR image reconstruction by using 3D-total generalized variation and tensor decomposition: k-t TGV-TD. BMC Med Imaging 2022; 22:101. [PMID: 35624425 PMCID: PMC9137209 DOI: 10.1186/s12880-022-00826-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 05/18/2022] [Indexed: 11/10/2022] Open
Abstract
PURPOSE Compressed Sensing Magnetic Resonance Imaging (CS-MRI) is a promising technique to accelerate dynamic cardiac MR imaging (DCMRI). For DCMRI, the CS-MRI usually exploits image signal sparsity and low-rank property to reconstruct dynamic images from the undersampled k-space data. In this paper, a novel CS algorithm is investigated to improve dynamic cardiac MR image reconstruction quality under the condition of minimizing the k-space recording. METHODS The sparse representation of 3D cardiac magnetic resonance data is implemented by synergistically integrating 3D total generalized variation (3D-TGV) algorithm and high order singular value decomposition (HOSVD) based Tensor Decomposition, termed k-t TGV-TD method. In the proposed method, the low rank structure of the 3D dynamic cardiac MR data is performed with the HOSVD method, and the localized image sparsity is achieved by the 3D-TGV method. Moreover, the Fast Composite Splitting Algorithm (FCSA) method, combining the variable splitting with operator splitting techniques, is employed to solve the low-rank and sparse problem. Two different cardiac MR datasets (cardiac perfusion and cine MR datasets) are used to evaluate the performance of the proposed method. RESULTS Compared with the state-of-art methods, such as k-t SLR, 3D-TGV, HOSVD based tensor decomposition and low-rank plus sparse method, the proposed k-t TGV-TD method can offer improved reconstruction accuracy in terms of higher peak SNR (PSNR) and structural similarity index (SSIM). The proposed k-t TGV-TD method can achieve significantly better and stable reconstruction results than state-of-the-art methods in terms of both PSNR and SSIM, especially for cardiac perfusion MR dataset. CONCLUSIONS This work proved that the k-t TGV-TD method was an effective sparse representation way for DCMRI, which was capable of significantly improving the reconstruction accuracy with different acceleration factors.
Collapse
Affiliation(s)
- Jucheng Zhang
- Department of Clinical Engineering, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, 310019, People's Republic of China
| | - Lulu Han
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, People's Republic of China.,Zhejiang Aerospace HengJia Data Technology Co., Ltd., Jiaxing, People's Republic of China
| | - Jianzhong Sun
- Department of Radiology, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, 310027, People's Republic of China
| | - Zhikang Wang
- Department of Clinical Engineering, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, 310019, People's Republic of China
| | - Wenlong Xu
- Department of Biomedical Engineering, China Jiliang University, Hangzhou, 310018, People's Republic of China
| | - Yonghua Chu
- Department of Clinical Engineering, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, 310019, People's Republic of China
| | - Ling Xia
- Department of Biomedical Engineering, Zhejiang University, Hangzhou, 310027, People's Republic of China
| | - Mingfeng Jiang
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, People's Republic of China.
| |
Collapse
|
3
|
Töger J, Andersen M, Haglund O, Kylkilahti TM, Lundgaard I, Markenroth Bloch K. Real‐time imaging of respiratory effects on cerebrospinal fluid flow in small diameter passageways. Magn Reson Med 2022; 88:770-786. [PMID: 35403247 PMCID: PMC9324219 DOI: 10.1002/mrm.29248] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 03/01/2022] [Accepted: 03/08/2022] [Indexed: 12/03/2022]
Abstract
Purpose Respiration‐related CSF flow through the cerebral aqueduct may be useful for elucidating physiology and pathophysiology of the glymphatic system, which has been proposed as a mechanism of brain waste clearance. Therefore, we aimed to (1) develop a real‐time (CSF) flow imaging method with high spatial and sufficient temporal resolution to capture respiratory effects, (2) validate the method in a phantom setup and numerical simulations, and (3) apply the method in vivo and quantify its repeatability and correlation with different respiratory conditions. Methods A golden‐angle radial flow sequence (reconstructed temporal resolution 168 ms, spatial resolution 0.6 mm) was implemented on a 7T MRI scanner and reconstructed using compressed sensing. A phantom setup mimicked simultaneous cardiac and respiratory flow oscillations. The effect of temporal resolution and vessel diameter was investigated numerically. Healthy volunteers (n = 10) were scanned at four different respiratory conditions, including repeat scans. Results Phantom data show that the developed sequence accurately quantifies respiratory oscillations (ratio real‐time/reference QR = 0.96 ± 0.02), but underestimates the rapid cardiac oscillations (ratio QC = 0.46 ± 0.14). Simulations suggest that QC can be improved by increasing temporal resolution. In vivo repeatability was moderate to very strong for cranial and caudal flow (intraclass correlation coefficient range: 0.55–0.99) and weak to strong for net flow (intraclass correlation coefficient range: 0.48–0.90). Net flow was influenced by respiratory condition (p < 0.01). Conclusions The presented real‐time flow MRI method can quantify respiratory‐related variations of CSF flow in the cerebral aqueduct, but it underestimates rapid cardiac oscillations. In vivo, the method showed good repeatability and a relationship between flow and respiration.
Collapse
Affiliation(s)
- Johannes Töger
- Department of Clinical Sciences Lund, Diagnostic Radiology Lund University, Skåne University Hospital Lund Sweden
| | - Mads Andersen
- Philips Healthcare Copenhagen Denmark
- Lund University, Lund University Bioimaging Center Lund Sweden
| | - Olle Haglund
- Department of Medical Radiation Physics Lund University Lund Sweden
| | - Tekla Maria Kylkilahti
- Department of Experimental Medical Science Lund University Lund Sweden
- Wallenberg Centre for Molecular Medicine Lund University Lund Sweden
| | - Iben Lundgaard
- Department of Experimental Medical Science Lund University Lund Sweden
- Wallenberg Centre for Molecular Medicine Lund University Lund Sweden
| | | |
Collapse
|
4
|
Gu H, Yaman B, Ugurbil K, Moeller S, Akcakaya M. Compressed Sensing MRI with ℓ 1-Wavelet Reconstruction Revisited Using Modern Data Science Tools. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3596-3600. [PMID: 34892016 PMCID: PMC8918052 DOI: 10.1109/embc46164.2021.9630985] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Deep learning (DL) has emerged as a powerful tool for improving the reconstruction quality of accelerated MRI. These methods usually show enhanced performance compared to conventional methods, such as compressed sensing (CS) and parallel imaging. However, in most scenarios, CS is implemented with two or three empirically-tuned hyperparameters, while a plethora of advanced data science tools are used in DL. In this work, we revisit ℓ1 -wavelet CS for accelerated MRI using modern data science tools. By using tools like algorithm unrolling and end-to-end training with stochastic gradient descent over large databases that DL algorithms utilize, and combining these with conventional concepts like wavelet sub-band processing and reweighted ℓ1 minimization, we show that ℓ1-wavelet CS can be fine-tuned to a level comparable to DL methods. While DL uses hundreds of thousands of parameters, the proposed optimized ℓ1-wavelet CS with sub-band training and reweighting uses only 128 parameters, and employs a fully-explainable convex reconstruction model.
Collapse
|
5
|
Dwork N, O'Connor D, Baron CA, Johnson EMI, Kerr AB, Pauly JM, Larson PEZ. Utilizing the Wavelet Transform's Structure in Compressed Sensing. SIGNAL, IMAGE AND VIDEO PROCESSING 2021; 15:1407-1414. [PMID: 34531930 PMCID: PMC8439112 DOI: 10.1007/s11760-021-01872-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 01/11/2021] [Accepted: 02/08/2021] [Indexed: 06/13/2023]
Abstract
Compressed sensing has empowered quality image reconstruction with fewer data samples than previously thought possible. These techniques rely on a sparsifying linear transformation. The Daubechies wavelet transform is commonly used for this purpose. In this work, we take advantage of the structure of this wavelet transform and identify an affine transformation that increases the sparsity of the result. After inclusion of this affine transformation, we modify the resulting optimization problem to comply with the form of the Basis Pursuit Denoising problem. Finally, we show theoretically that this yields a lower bound on the error of the reconstruction and present results where solving this modified problem yields images of higher quality for the same sampling patterns using both magnetic resonance and optical images.
Collapse
Affiliation(s)
- Nicholas Dwork
- University of California, San Francisco, Department of Radiology and Biomedical Imaging
| | - Daniel O'Connor
- Department of Mathematics and Statistics, University of San Francisco
| | | | | | - Adam B Kerr
- Stanford University, Center for Cognitive and Neurobiological Imaging
| | - John M Pauly
- Stanford University, Department of Electrical Engineering
| | - Peder E Z Larson
- University of California, San Francisco, Department of Radiology and Biomedical Imaging
| |
Collapse
|
6
|
Chung H, Cha E, Sunwoo L, Ye JC. Two-stage deep learning for accelerated 3D time-of-flight MRA without matched training data. Med Image Anal 2021; 71:102047. [PMID: 33895617 DOI: 10.1016/j.media.2021.102047] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Revised: 03/18/2021] [Accepted: 03/19/2021] [Indexed: 10/21/2022]
Abstract
Time-of-flight magnetic resonance angiography (TOF-MRA) is one of the most widely used non-contrast MR imaging methods to visualize blood vessels, but due to the 3-D volume acquisition highly accelerated acquisition is necessary. Accordingly, high quality reconstruction from undersampled TOF-MRA is an important research topic for deep learning. However, most existing deep learning works require matched reference data for supervised training, which are often difficult to obtain. By extending the recent theoretical understanding of cycleGAN from the optimal transport theory, here we propose a novel two-stage unsupervised deep learning approach, which is composed of the multi-coil reconstruction network along the coronal plane followed by a multi-planar refinement network along the axial plane. Specifically, the first network is trained in the square-root of sum of squares (SSoS) domain to achieve high quality parallel image reconstruction, whereas the second refinement network is designed to efficiently learn the characteristics of highly-activated blood flow using double-headed projection discriminator. Extensive experiments demonstrate that the proposed learning process without matched reference exceeds performance of state-of-the-art compressed sensing (CS)-based method and provides comparable or even better results than supervised learning approaches.
Collapse
Affiliation(s)
- Hyungjin Chung
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Eunju Cha
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
| | - Leonard Sunwoo
- Department of Radiology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea.
| | - Jong Chul Ye
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea.
| |
Collapse
|
7
|
Hel-Or Y, Ben-Artzi G. The Role of Redundant Bases and Shrinkage Functions in Image Denoising. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2021; 30:3778-3792. [PMID: 33729939 DOI: 10.1109/tip.2021.3065226] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Wavelet denoising is a classical and effective approach for reducing noise in images and signals. Suggested in 1994, this approach is carried out by rectifying the coefficients of a noisy image, in the transform domain, using a set of shrinkage functions (SFs). A plethora of papers deals with the optimal shape of the SFs and the transform used. For example, it is widely known that applying SFs in a redundant basis improves the results. However, it is barely known that the shape of the SFs should be changed when the transform used is redundant. In this paper, we introduce a complete picture of the interrelations between the transform used, the optimal shrinkage functions, and the domains in which they are optimized. We suggest three schemes for optimizing the SFs and provide bounds of the remaining noise, in each scheme, with respect to the other alternatives. In particular, we show that for subband optimization, where each SF is optimized independently for a particular band, optimizing the SFs in the spatial domain is always better than or equal to optimizing the SFs in the transform domain. Furthermore, for redundant bases, we provide the expected denoising gain that can be achieved, relative to the unitary basis, as a function of the redundancy rate.
Collapse
|
8
|
Yaman B, Hosseini SAH, Moeller S, Ellermann J, Uğurbil K, Akçakaya M. Self-supervised learning of physics-guided reconstruction neural networks without fully sampled reference data. Magn Reson Med 2020; 84:3172-3191. [PMID: 32614100 PMCID: PMC7811359 DOI: 10.1002/mrm.28378] [Citation(s) in RCA: 127] [Impact Index Per Article: 25.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Revised: 05/21/2020] [Accepted: 05/22/2020] [Indexed: 12/25/2022]
Abstract
PURPOSE To develop a strategy for training a physics-guided MRI reconstruction neural network without a database of fully sampled data sets. METHODS Self-supervised learning via data undersampling (SSDU) for physics-guided deep learning reconstruction partitions available measurements into two disjoint sets, one of which is used in the data consistency (DC) units in the unrolled network and the other is used to define the loss for training. The proposed training without fully sampled data is compared with fully supervised training with ground-truth data, as well as conventional compressed-sensing and parallel imaging methods using the publicly available fastMRI knee database. The same physics-guided neural network is used for both proposed SSDU and supervised training. The SSDU training is also applied to prospectively two-fold accelerated high-resolution brain data sets at different acceleration rates, and compared with parallel imaging. RESULTS Results on five different knee sequences at an acceleration rate of 4 shows that the proposed self-supervised approach performs closely with supervised learning, while significantly outperforming conventional compressed-sensing and parallel imaging, as characterized by quantitative metrics and a clinical reader study. The results on prospectively subsampled brain data sets, in which supervised learning cannot be used due to lack of ground-truth reference, show that the proposed self-supervised approach successfully performs reconstruction at high acceleration rates (4, 6, and 8). Image readings indicate improved visual reconstruction quality with the proposed approach compared with parallel imaging at acquisition acceleration. CONCLUSION The proposed SSDU approach allows training of physics-guided deep learning MRI reconstruction without fully sampled data, while achieving comparable results with supervised deep learning MRI trained on fully sampled data.
Collapse
Affiliation(s)
- Burhaneddin Yaman
- Department of Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| | - Seyed Amir Hossein Hosseini
- Department of Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| | - Steen Moeller
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| | - Jutta Ellermann
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| | - Kâmil Uğurbil
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| | - Mehmet Akçakaya
- Department of Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN
| |
Collapse
|
9
|
Dar SUH, Özbey M, Çatlı AB, Çukur T. A Transfer‐Learning Approach for Accelerated MRI Using Deep Neural Networks. Magn Reson Med 2020; 84:663-685. [DOI: 10.1002/mrm.28148] [Citation(s) in RCA: 67] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2019] [Revised: 11/12/2019] [Accepted: 12/06/2019] [Indexed: 01/31/2023]
Affiliation(s)
- Salman Ul Hassan Dar
- Department of Electrical and Electronics Engineering Bilkent University Ankara Turkey
- National Magnetic Resonance Research Center (UMRAM) Bilkent University Ankara Turkey
| | - Muzaffer Özbey
- Department of Electrical and Electronics Engineering Bilkent University Ankara Turkey
- National Magnetic Resonance Research Center (UMRAM) Bilkent University Ankara Turkey
| | - Ahmet Burak Çatlı
- Department of Electrical and Electronics Engineering Bilkent University Ankara Turkey
- National Magnetic Resonance Research Center (UMRAM) Bilkent University Ankara Turkey
| | - Tolga Çukur
- Department of Electrical and Electronics Engineering Bilkent University Ankara Turkey
- National Magnetic Resonance Research Center (UMRAM) Bilkent University Ankara Turkey
- Neuroscience Program Sabuncu Brain Research Center Bilkent University Ankara Turkey
| |
Collapse
|