1
|
Zhou Z, Hu P, Qi H. Stop moving: MR motion correction as an opportunity for artificial intelligence. MAGMA (NEW YORK, N.Y.) 2024:10.1007/s10334-023-01144-5. [PMID: 38386151 DOI: 10.1007/s10334-023-01144-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 12/09/2023] [Accepted: 12/19/2023] [Indexed: 02/23/2024]
Abstract
Subject motion is a long-standing problem of magnetic resonance imaging (MRI), which can seriously deteriorate the image quality. Various prospective and retrospective methods have been proposed for MRI motion correction, among which deep learning approaches have achieved state-of-the-art motion correction performance. This survey paper aims to provide a comprehensive review of deep learning-based MRI motion correction methods. Neural networks used for motion artifacts reduction and motion estimation in the image domain or frequency domain are detailed. Furthermore, besides motion-corrected MRI reconstruction, how estimated motion is applied in other downstream tasks is briefly introduced, aiming to strengthen the interaction between different research areas. Finally, we identify current limitations and point out future directions of deep learning-based MRI motion correction.
Collapse
Affiliation(s)
- Zijian Zhou
- School of Biomedical Engineering, ShanghaiTech University, 4th Floor, BME Building, 393 Middle Huaxia Road, Pudong District, Shanghai, 201210, China
- Shanghai Clinical Research and Trial Center, ShanghaiTech University, Shanghai, China
| | - Peng Hu
- School of Biomedical Engineering, ShanghaiTech University, 4th Floor, BME Building, 393 Middle Huaxia Road, Pudong District, Shanghai, 201210, China.
- Shanghai Clinical Research and Trial Center, ShanghaiTech University, Shanghai, China.
| | - Haikun Qi
- School of Biomedical Engineering, ShanghaiTech University, 4th Floor, BME Building, 393 Middle Huaxia Road, Pudong District, Shanghai, 201210, China.
- Shanghai Clinical Research and Trial Center, ShanghaiTech University, Shanghai, China.
| |
Collapse
|
2
|
Razumov A, Rogov O, Dylov DV. Optimal MRI undersampling patterns for ultimate benefit of medical vision tasks. Magn Reson Imaging 2023; 103:37-47. [PMID: 37423471 DOI: 10.1016/j.mri.2023.06.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/30/2023] [Accepted: 06/29/2023] [Indexed: 07/11/2023]
Abstract
Compressed sensing is commonly concerned with optimizing the image quality after a partial undersampling of the measurable k-space to accelerate MRI. In this article, we propose to change the focus from the quality of the reconstructed image to the quality of the downstream image analysis outcome. Specifically, we propose to optimize the patterns according to how well a sought-after pathology could be detected or localized in the reconstructed images. We find the optimal undersampling patterns in k-space that maximize target value functions of interest in commonplace medical vision problems (reconstruction, segmentation, and classification) and propose a new iterative gradient sampling routine universally suitable for these tasks. We validate the proposed MRI acceleration paradigm on three classical medical datasets, demonstrating a noticeable improvement of the target metrics at the high acceleration factors (for the segmentation problem at ×16 acceleration, we report up to 12% improvement in Dice score over the other undersampling patterns).
Collapse
Affiliation(s)
- Artem Razumov
- Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Oleg Rogov
- Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Dmitry V Dylov
- Skolkovo Institute of Science and Technology, Moscow, Russia.
| |
Collapse
|
3
|
Polak D, Hossbach J, Splitthoff DN, Clifford B, Lo WC, Tabari A, Lang M, Huang SY, Conklin J, Wald LL, Cauley S. Motion guidance lines for robust data consistency-based retrospective motion correction in 2D and 3D MRI. Magn Reson Med 2023; 89:1777-1790. [PMID: 36744619 PMCID: PMC10518424 DOI: 10.1002/mrm.29534] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 10/06/2022] [Accepted: 10/31/2022] [Indexed: 02/07/2023]
Abstract
PURPOSE To develop a robust retrospective motion-correction technique based on repeating k-space guidance lines for improving motion correction in Cartesian 2D and 3D brain MRI. METHODS The motion guidance lines are inserted into the standard sequence orderings for 2D turbo spin echo and 3D MPRAGE to inform a data consistency-based motion estimation and reconstruction, which can be guided by a low-resolution scout. The extremely limited number of required guidance lines are repeated during each echo train and discarded in the final image reconstruction. Thus, integration within a standard k-space acquisition ordering ensures the expected image quality/contrast and motion sensitivity of that sequence. RESULTS Through simulation and in vivo 2D multislice and 3D motion experiments, we demonstrate that respectively 2 or 4 optimized motion guidance lines per shot enables accurate motion estimation and correction. Clinically acceptable reconstruction times are achieved through fully separable on-the-fly motion optimizations (˜1 s/shot) using standard scanner GPU hardware. CONCLUSION The addition of guidance lines to scout accelerated motion estimation facilitates robust retrospective motion correction that can be effectively introduced without perturbing standard clinical protocols and workflows.
Collapse
Affiliation(s)
- Daniel Polak
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Siemens Healthcare GmbH, Erlangen, Germany
| | | | | | | | | | - Azadeh Tabari
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Min Lang
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Susie Y. Huang
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - John Conklin
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Lawrence L. Wald
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Stephen Cauley
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Chen Z, Pawar K, Ekanayake M, Pain C, Zhong S, Egan GF. Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging-State-of-the-Art and Challenges. J Digit Imaging 2023; 36:204-230. [PMID: 36323914 PMCID: PMC9984670 DOI: 10.1007/s10278-022-00721-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 09/09/2022] [Accepted: 10/17/2022] [Indexed: 11/06/2022] Open
Abstract
Magnetic resonance imaging (MRI) provides excellent soft-tissue contrast for clinical diagnoses and research which underpin many recent breakthroughs in medicine and biology. The post-processing of reconstructed MR images is often automated for incorporation into MRI scanners by the manufacturers and increasingly plays a critical role in the final image quality for clinical reporting and interpretation. For image enhancement and correction, the post-processing steps include noise reduction, image artefact correction, and image resolution improvements. With the recent success of deep learning in many research fields, there is great potential to apply deep learning for MR image enhancement, and recent publications have demonstrated promising results. Motivated by the rapidly growing literature in this area, in this review paper, we provide a comprehensive overview of deep learning-based methods for post-processing MR images to enhance image quality and correct image artefacts. We aim to provide researchers in MRI or other research fields, including computer vision and image processing, a literature survey of deep learning approaches for MR image enhancement. We discuss the current limitations of the application of artificial intelligence in MRI and highlight possible directions for future developments. In the era of deep learning, we highlight the importance of a critical appraisal of the explanatory information provided and the generalizability of deep learning algorithms in medical imaging.
Collapse
Affiliation(s)
- Zhaolin Chen
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia.
- Department of Data Science and AI, Monash University, Melbourne, VIC, Australia.
| | - Kamlesh Pawar
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
| | - Mevan Ekanayake
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Cameron Pain
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Shenjun Zhong
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- National Imaging Facility, Brisbane, QLD, Australia
| | - Gary F Egan
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
5
|
Solomon O, Patriat R, Braun H, Palnitkar TE, Moeller S, Auerbach EJ, Ugurbil K, Sapiro G, Harel N. Motion robust magnetic resonance imaging via efficient Fourier aggregation. Med Image Anal 2023; 83:102638. [PMID: 36257133 DOI: 10.1016/j.media.2022.102638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 09/13/2022] [Accepted: 09/15/2022] [Indexed: 02/04/2023]
Abstract
We present a method for suppressing motion artifacts in anatomical magnetic resonance acquisitions. Our proposed technique, termed MOTOR-MRI, can recover and salvage images which are otherwise heavily corrupted by motion induced artifacts and blur which renders them unusable. Contrary to other techniques, MOTOR-MRI operates on the reconstructed images and not on k-space data. It relies on breaking the standard acquisition protocol into several shorter ones (while maintaining the same total acquisition time) and subsequent efficient aggregation in Fourier space of locally sharp and consistent information among them, producing a sharp and motion mitigated image. We demonstrate the efficacy of the technique on T2-weighted turbo spin echo magnetic resonance brain scans with severe motion corruption from both 3 T and 7 T scanners and show significant qualitative and quantitative improvement in image quality. MOTOR-MRI can operate independently, or in conjunction with additional motion correction methods.
Collapse
Affiliation(s)
- Oren Solomon
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America.
| | - Rémi Patriat
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Henry Braun
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Tara E Palnitkar
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Steen Moeller
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Edward J Auerbach
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Kamil Ugurbil
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, NC, United States of America; Department of Biomedical Engineering, Duke University, NC, United States of America; Department of Computer Science, Duke University, NC, United States of America; Department of Mathematics, Duke University, NC, United States of America
| | - Noam Harel
- Department of Radiology, Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States of America; Department of Neurosurgery, University of Minnesota, Minneapolis, MN, United States of America
| |
Collapse
|
6
|
Stacked U-Nets with self-assisted priors towards robust correction of rigid motion artifact in brain MRI. Neuroimage 2022; 259:119411. [PMID: 35753594 DOI: 10.1016/j.neuroimage.2022.119411] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 05/12/2022] [Accepted: 06/22/2022] [Indexed: 11/23/2022] Open
Abstract
Magnetic Resonance Imaging (MRI) is sensitive to motion caused by patient movement due to the relatively long data acquisition time. This could cause severe degradation of image quality and therefore affect the overall diagnosis. In this paper, we develop an efficient retrospective 2D deep learning method called stacked U-Nets with self-assisted priors to address the problem of rigid motion artifacts in 3D brain MRI. The proposed work exploits the usage of additional knowledge priors from the corrupted images themselves without the need for additional contrast data. The proposed network learns the missed structural details through sharing auxiliary information from the contiguous slices of the same distorted subject. We further design a refinement stacked U-Nets that facilitates preserving the spatial image details and improves the pixel-to-pixel dependency. To perform network training, simulation of MRI motion artifacts is inevitable. The proposed network is optimized by minimizing the loss of structural similarity (SSIM) using the synthesized motion-corrupted images from 83 real motion-free subjects. We present an intensive analysis using various types of image priors: the proposed self-assisted priors and priors from other image contrast of the same subject. The experimental analysis proves the effectiveness and feasibility of our self-assisted priors since it does not require any further data scans. The overall image quality of the motion-corrected images via the proposed motion correction network significantly improves SSIM from 71.66% to 95.03% and declines the mean square error from 99.25 to 29.76. These results indicate the high similarity of the brain's anatomical structure in the corrected images compared to the motion-free data. The motion-corrected results of both the simulated and real motion data showed the potential of the proposed motion correction network to be feasible and applicable in clinical practices.
Collapse
|
7
|
Polak D, Splitthoff DN, Clifford B, Lo WC, Huang SY, Conklin J, Wald LL, Setsompop K, Cauley S. Scout accelerated motion estimation and reduction (SAMER). Magn Reson Med 2022; 87:163-178. [PMID: 34390505 PMCID: PMC8616778 DOI: 10.1002/mrm.28971] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 06/29/2021] [Accepted: 07/26/2021] [Indexed: 01/03/2023]
Abstract
PURPOSE To demonstrate a navigator/tracking-free retrospective motion estimation technique that facilitates clinically acceptable reconstruction time. METHODS Scout accelerated motion estimation and reduction (SAMER) uses a single 3-5 s, low-resolution scout scan and a novel sequence reordering to independently determine motion states by minimizing the data-consistency error in a SENSE plus motion forward model. This eliminates time-consuming alternating optimization as no updates to the imaging volume are required during the motion estimation. The SAMER approach was assessed quantitatively through extensive simulation and was evaluated in vivo across multiple motion scenarios and clinical imaging contrasts. Finally, SAMER was synergistically combined with advanced encoding (Wave-CAIPI) to facilitate rapid motion-free imaging. RESULTS The highly accelerated scout provided sufficient information to achieve accurate motion trajectory estimation (accuracy ~0.2 mm or degrees). The novel sequence reordering improved the stability of the motion parameter estimation and image reconstruction while preserving the clinical imaging contrast. Clinically acceptable computation times for the motion estimation (~4 s/shot) are demonstrated through a fully separable (non-alternating) motion search across the shots. Substantial artifact reduction was demonstrated in vivo as well as corresponding improvement in the quantitative error metric. Finally, the extension of SAMER to Wave-encoding enabled rapid high-quality imaging at up to R = 9-fold acceleration. CONCLUSION SAMER significantly improved the computational scalability for retrospective motion estimation and correction.
Collapse
Affiliation(s)
- Daniel Polak
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA.,Siemens Healthcare GmbH, Erlangen, Germany
| | | | | | | | - Susie Y. Huang
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA.,Harvard Medical School, Boston, Massachusetts, USA.,Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - John Conklin
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA.,Harvard Medical School, Boston, Massachusetts, USA
| | - Lawrence L. Wald
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA.,Harvard Medical School, Boston, Massachusetts, USA.,Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Kawin Setsompop
- Department of Radiology, Stanford School of Medicine, Stanford, California, USA
| | - Stephen Cauley
- Department of Radiology, A. A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA.,Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
8
|
Sui Y, Afacan O, Jaimes C, Gholipour A, Warfield SK. Gradient-Guided Isotropic MRI Reconstruction from Anisotropic Acquisitions. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING 2021; 7:1240-1253. [PMID: 35252479 PMCID: PMC8896514 DOI: 10.1109/tci.2021.3128745] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
The trade-off between image resolution, signal-to-noise ratio (SNR), and scan time in any magnetic resonance imaging (MRI) protocol is inevitable and unavoidable. Super-resolution reconstruction (SRR) has been shown effective in mitigating these factors, and thus, has become an important approach in addressing the current limitations of MRI. In this work, we developed a novel, image-based MRI SRR approach based on anisotropic acquisition schemes, which utilizes a new gradient guidance regularization method that guides the high-resolution (HR) reconstruction via a spatial gradient estimate. Further, we designed an analytical solution to propagate the spatial gradient fields from the low-resolution (LR) images to the HR image space and exploited these gradient fields over multiple scales with a dynamic update scheme for more accurate edge localization in the reconstruction. We also established a forward model of image formation and inverted it along with the proposed gradient guidance. The proposed SRR method allows subject motion between volumes and is able to incorporate various acquisition schemes where the LR images are acquired with arbitrary orientations and displacements, such as orthogonal and through-plane origin-shifted scans. We assessed our proposed approach on simulated data as well as on the data acquired on a Siemens 3T MRI scanner containing 45 MRI scans from 14 subjects. Our experimental results demonstrate that our approach achieved superior reconstructions compared to state-of-the-art methods, both in terms of local spatial smoothness and edge preservation, while, in parallel, at reduced, or at the same cost as scans delivered with direct HR acquisition.
Collapse
Affiliation(s)
- Yao Sui
- Harvard Medical School and Boston Children's Hospital, Boston, Massachusetts, United States
| | - Onur Afacan
- Harvard Medical School and Boston Children's Hospital, Boston, Massachusetts, United States
| | - Camilo Jaimes
- Harvard Medical School and Boston Children's Hospital, Boston, Massachusetts, United States
| | - Ali Gholipour
- Harvard Medical School and Boston Children's Hospital, Boston, Massachusetts, United States
| | - Simon K Warfield
- Harvard Medical School and Boston Children's Hospital, Boston, Massachusetts, United States
| |
Collapse
|
9
|
Hucker P, Dacko M, Zaitsev M. Combining prospective and retrospective motion correction based on a model for fast continuous motion. Magn Reson Med 2021; 86:1284-1298. [PMID: 33829538 DOI: 10.1002/mrm.28783] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Revised: 03/05/2021] [Accepted: 03/06/2021] [Indexed: 11/08/2022]
Abstract
PURPOSE Prospective motion correction (PMC) and retrospective motion correction (RMC) have different advantages and limitations. The present work aims to combine the advantages of both for rigid body motion, aiming at correcting for faster motions than was previously achievable. Additionally, it provides insights into the effects of motion on pulse sequences and MR signals with a goal of further improving motion correction in the future. METHODS The effective encoding trajectory and a global phase offset in a moving object are calculated based on complete gradient waveforms of an arbitrary sequence and a continuous motion model. These data are used to feed the forward signal model, which is then used in iterative image reconstruction to suppress the artifacts still present after the PMC. RESULTS Verification experiments with a rotation phantom and in vivo were performed. Predictions of simulated motion artifacts for PMC based on sequence waveforms are very accurate. The performance at combined PMC+RMC is limited by Nyquist violations in the sampled k-space and can be compensated by oversampling. CONCLUSION The combined correction results in better images than pure PMC in the presence of fast motion. The predictions of artifacts are very accurate, allowing for comparing sequences or protocols in simulations. The observed artifacts due to Nyquist violations are expected to be corrected by utilizing parallel imaging.
Collapse
Affiliation(s)
- Patrick Hucker
- Center for Diagnostic and Therapeutic Radiology, Medical Physics, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Michael Dacko
- Center for Diagnostic and Therapeutic Radiology, Medical Physics, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Maxim Zaitsev
- Center for Diagnostic and Therapeutic Radiology, Medical Physics, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.,High Field Magnetic Resonance Center, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
10
|
Learning a Gradient Guidance for Spatially Isotropic MRI Super-Resolution Reconstruction. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2020; 12262:136-146. [PMID: 33163994 DOI: 10.1007/978-3-030-59713-9_14] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
In MRI practice, it is inevitable to appropriately balance between image resolution, signal-to-noise ratio (SNR), and scan time. It has been shown that super-resolution reconstruction (SRR) is effective to achieve such a balance, and has obtained better results than direct high-resolution (HR) acquisition, for certain contrasts and sequences. The focus of this work was on constructing images with spatial resolution higher than can be practically obtained by direct Fourier encoding. A novel learning approach was developed, which was able to provide an estimate of the spatial gradient prior from the low-resolution (LR) inputs for the HR reconstruction. By incorporating the anisotropic acquisition schemes, the learning model was trained over the LR images themselves only. The learned gradients were integrated as prior knowledge into a gradient-guided SRR model. A closed-form solution to the SRR model was developed to obtain the HR reconstruction. Our approach was assessed on the simulated data as well as the data acquired on a Siemens 3T MRI scanner containing 45 MRI scans from 15 subjects. The experimental results demonstrated that our approach led to superior SRR over state-of-the-art methods, and obtained better images at lower or the same cost in scan time than direct HR acquisition.
Collapse
|
11
|
Simultaneous feedback control for joint field and motion correction in brain MRI. Neuroimage 2020; 226:117286. [PMID: 32992003 DOI: 10.1016/j.neuroimage.2020.117286] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 07/21/2020] [Accepted: 08/14/2020] [Indexed: 11/23/2022] Open
Abstract
T2*-weighted gradient-echo sequences count among the most widely used techniques in neuroimaging and offer rich magnitude and phase contrast. The susceptibility effects underlying this contrast scale with B0, making T2*-weighted imaging particularly interesting at high field. High field also benefits baseline sensitivity and thus facilitates high-resolution studies. However, enhanced susceptibility effects and high target resolution come with inherent challenges. Relying on long echo times, T2*-weighted imaging not only benefits from enhanced local susceptibility effects but also suffers from increased field fluctuations due to moving body parts and breathing. High resolution, in turn, renders neuroimaging particularly vulnerable to motion of the head. This work reports the implementation and characterization of a system that aims to jointly address these issues. It is based on the simultaneous operation of two control loops, one for field stabilization and one for motion correction. The key challenge with this approach is that the two loops both operate on the magnetic field in the imaging volume and are thus prone to mutual interference and potential instability. This issue is addressed at the levels of sensing, timing, and control parameters. Performance assessment shows the resulting system to be stable and exhibit adequate loop decoupling, precision, and bandwidth. Simultaneous field and motion control is then demonstrated in examples of T2*-weighted in vivo imaging at 7T.
Collapse
|
12
|
Lee DH, Lee DW, Kwon JI, Woo CW, Kim ST, Kim JK, Kim KW, Woo DC. Retrospective Brain Motion Correction in Glutamate Chemical Exchange Saturation Transfer (GluCEST) MRI. Mol Imaging Biol 2020; 21:1064-1070. [PMID: 30989439 DOI: 10.1007/s11307-019-01352-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
PURPOSE To evaluate the feasibility of motion correction in glutamate chemical exchange saturation transfer (GluCEST) imaging, using a rat model of epileptic seizure. PROCEDURES Epileptic seizure was induced in six male Wistar rats by intraperitoneal injection of kainic acid (KA). CEST data were obtained using a 7.0 T Bruker MRI scanner before and 3 h after KA injection. Retrospective motion correction was performed in CEST images using a gradient-based motion correction (GradMC) algorithm. GluCEST signals in the hippocampal regions were quantitatively evaluated with and without motion correction. RESULTS Calculated GluCEST signals differed significantly between the pre-KA injection group, regardless of motion-correction implementation, and the post-KA injection group with motion correction (3.662 ± 1.393 % / 3.726 ± 1.982 % for pre-KA injection group with/without motion correction vs. 6.996 ± 1.684 % for post-KA injection group with motion correction; all P < 0.05). CONCLUSIONS Our results clearly show that GradMC can be used in CEST imaging for efficient correction of seizure-like motion. The GradMC can be further implemented in various CEST imaging techniques to increase the accuracy of analysis.
Collapse
Affiliation(s)
- Dong-Hoon Lee
- Faculty of Health Sciences and Brain and Mind Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Do-Wan Lee
- Center for Bioimaging of New Drug Development, Asan Medical Center, Asan Institute for Life Sciences, Seoul, Republic of Korea
| | - Jae-Im Kwon
- MR Core Laboratory, Convergence Medicine Research Center, Asan Medical Center, Asan Institute for Life Sciences, Seoul, Republic of Korea
| | - Chul-Woong Woo
- MR Core Laboratory, Convergence Medicine Research Center, Asan Medical Center, Asan Institute for Life Sciences, Seoul, Republic of Korea
| | - Sang-Tae Kim
- MR Core Laboratory, Convergence Medicine Research Center, Asan Medical Center, Asan Institute for Life Sciences, Seoul, Republic of Korea
| | - Jeong Kon Kim
- Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Kyung Won Kim
- Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Dong-Cheol Woo
- MR Core Laboratory, Convergence Medicine Research Center, Asan Medical Center, Asan Institute for Life Sciences, Seoul, Republic of Korea. .,Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
13
|
Usman M, Latif S, Asim M, Lee BD, Qadir J. Retrospective Motion Correction in Multishot MRI using Generative Adversarial Network. Sci Rep 2020; 10:4786. [PMID: 32179823 PMCID: PMC7075875 DOI: 10.1038/s41598-020-61705-9] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Accepted: 03/02/2020] [Indexed: 11/09/2022] Open
Abstract
Multishot Magnetic Resonance Imaging (MRI) is a promising data acquisition technique that can produce a high-resolution image with relatively less data acquisition time than the standard spin echo. The downside of multishot MRI is that it is very sensitive to subject motion and even small levels of motion during the scan can produce artifacts in the final magnetic resonance (MR) image, which may result in a misdiagnosis. Numerous efforts have focused on addressing this issue; however, all of these proposals are limited in terms of how much motion they can correct and require excessive computational time. In this paper, we propose a novel generative adversarial network (GAN)-based conjugate gradient SENSE (CG-SENSE) reconstruction framework for motion correction in multishot MRI. First CG-SENSE reconstruction is employed to reconstruct an image from the motion-corrupted k-space data and then the GAN-based proposed framework is applied to correct the motion artifacts. The proposed method has been rigorously evaluated on synthetically corrupted data on varying degrees of motion, numbers of shots, and encoding trajectories. Our analyses (both quantitative as well as qualitative/visual analysis) establish that the proposed method is robust and reduces several-fold the computational time reported by the current state-of-the-art technique.
Collapse
Affiliation(s)
- Muhammad Usman
- Information Technology University (ITU)-Punjab, Lahore, 54700, Pakistan.,Center for Artificial Intelligence in Medicine and Imaging, HealthHub Co. Ltd., Seoul, 06524, South Korea.,Department of Computer Science & Engineering, Seoul National University, Seoul, 08826, South Korea
| | - Siddique Latif
- University of Southern Queensland, Springfield, 4300, Australia.,Distributed Sensing Systems Group, Data61, CSIRO, Pullenvale Queensland, 4069, Australia
| | - Muhammad Asim
- Information Technology University (ITU)-Punjab, Lahore, 54700, Pakistan
| | | | - Junaid Qadir
- Information Technology University (ITU)-Punjab, Lahore, 54700, Pakistan
| |
Collapse
|
14
|
Cordero-Grande L, Ferrazzi G, Teixeira RPAG, O'Muircheartaigh J, Price AN, Hajnal JV. Motion-corrected MRI with DISORDER: Distributed and incoherent sample orders for reconstruction deblurring using encoding redundancy. Magn Reson Med 2020; 84. [PMID: 31898832 PMCID: PMC7392051 DOI: 10.1002/mrm.28157] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Revised: 11/30/2019] [Accepted: 12/11/2019] [Indexed: 11/11/2022]
Abstract
PURPOSE To enable rigid body motion-tolerant parallel volumetric magnetic resonance imaging by retrospective head motion correction on a variety of spatiotemporal scales and imaging sequences. THEORY AND METHODS Tolerance against rigid body motion is based on distributed and incoherent sampling orders for boosting a joint retrospective motion estimation and reconstruction framework. Motion resilience stems from the encoding redundancy in the data, as generally provided by the coil array. Hence, it does not require external sensors, navigators or training data, so the methodology is readily applicable to sequences using 3D encodings. RESULTS Simulations are performed showing full inter-shot corrections for usual levels of in vivo motion, large number of shots, standard levels of noise and moderate acceleration factors. Feasibility of inter- and intra-shot corrections is shown under controlled motion in vivo. Practical efficacy is illustrated by high-quality results in most corrupted of 208 volumes from a series of 26 clinical pediatric examinations collected using standard protocols. CONCLUSIONS The proposed framework addresses the rigid motion problem in volumetric anatomical brain scans with sufficient encoding redundancy which has enabled reliable pediatric examinations without sedation.
Collapse
Affiliation(s)
- Lucilio Cordero-Grande
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Biomedical Engineering Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Giulio Ferrazzi
- Biomedical Engineering Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Rui Pedro A G Teixeira
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Biomedical Engineering Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Jonathan O'Muircheartaigh
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Anthony N Price
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Biomedical Engineering Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Joseph V Hajnal
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Biomedical Engineering Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| |
Collapse
|
15
|
Tamada D, Kromrey ML, Ichikawa S, Onishi H, Motosugi U. Motion Artifact Reduction Using a Convolutional Neural Network for Dynamic Contrast Enhanced MR Imaging of the Liver. Magn Reson Med Sci 2019; 19:64-76. [PMID: 31061259 PMCID: PMC7067907 DOI: 10.2463/mrms.mp.2018-0156] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
Purpose: To improve the quality of images obtained via dynamic contrast enhanced MRI (DCE-MRI), which contain motion artifacts and blurring using a deep learning approach. Materials and Methods: A multi-channel convolutional neural network-based method is proposed for reducing the motion artifacts and blurring caused by respiratory motion in images obtained via DCE-MRI of the liver. The training datasets for the neural network included images with and without respiration-induced motion artifacts or blurring, and the distortions were generated by simulating the phase error in k-space. Patient studies were conducted using a multi-phase T1-weighted spoiled gradient echo sequence for the liver, which contained breath-hold failures occurring during data acquisition. The trained network was applied to the acquired images to analyze the filtering performance, and the intensities and contrast ratios before and after denoising were compared via Bland–Altman plots. Results: The proposed network was found to be significantly reducing the magnitude of the artifacts and blurring induced by respiratory motion, and the contrast ratios of the images after processing via the network were consistent with those of the unprocessed images. Conclusion: A deep learning-based method for removing motion artifacts in images obtained via DCE-MRI of the liver was demonstrated and validated.
Collapse
Affiliation(s)
- Daiki Tamada
- Department of Radiology, University of Yamanashi
| | | | | | | | | |
Collapse
|
16
|
Weller DS, Wang L, Mugler JP, Meyer CH. Motion-compensated reconstruction of magnetic resonance images from undersampled data. Magn Reson Imaging 2019; 55:36-45. [PMID: 30213754 PMCID: PMC6242755 DOI: 10.1016/j.mri.2018.09.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2018] [Revised: 08/16/2018] [Accepted: 09/08/2018] [Indexed: 02/03/2023]
Abstract
Magnetic resonance imaging of patients who find difficulty lying still or holding their breath can be challenging. Unresolved intra-frame motion yields blurring artifacts and limits spatial resolution. To correct for intra-frame non-rigid motion, such as in pediatric body imaging, this paper describes a multi-scale technique for joint estimation of the motion occurring during the acquisition and of the desired uncorrupted image. This technique regularizes the motion coefficients to enforce invertibility and minimize numerical instability. This multi-scale approach takes advantage of variable-density sampling patterns used in accelerated imaging to resolve large motion from a coarse scale. The resulting method improves image quality for a set of two-dimensional reconstructions from data simulated with independently generated deformations, with statistically significant increases in both peak signal to error ratio and structural similarity index. These improvements are consistent across varying undersampling factors and severities of motion and take advantage of the variable density sampling pattern.
Collapse
Affiliation(s)
| | - Luonan Wang
- University of Virginia, Charlottesville, VA 22904, USA.
| | - John P Mugler
- University of Virginia School of Medicine, Charlottesville, VA 22908, USA.
| | - Craig H Meyer
- University of Virginia School of Medicine, Charlottesville, VA 22908, USA.
| |
Collapse
|
17
|
Wallace TE, Afacan O, Waszak M, Kober T, Warfield SK. Head motion measurement and correction using FID navigators. Magn Reson Med 2018; 81:258-274. [PMID: 30058216 DOI: 10.1002/mrm.27381] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2017] [Revised: 04/18/2018] [Accepted: 05/08/2018] [Indexed: 11/09/2022]
Abstract
PURPOSE To develop a novel framework for rapid, intrinsic head motion measurement in MRI using FID navigators (FIDnavs) from a multichannel head coil array. METHODS FIDnavs encode substantial rigid-body motion information; however, current implementations require patient-specific training with external tracking data to extract quantitative positional changes. In this work, a forward model of FIDnav signals was calibrated using simulated movement of a reference image within a model of the spatial coil sensitivities. A FIDnav module was inserted into a nonselective 3D FLASH sequence, and rigid-body motion parameters were retrospectively estimated every readout time using nonlinear optimization to solve the inverse problem posed by the measured FIDnavs. This approach was tested in simulated data and in 7 volunteers, scanned at 3T with a 32-channel head coil array, performing a series of directed motion paradigms. RESULTS FIDnav motion estimates achieved mean absolute errors of 0.34 ± 0.49 mm and 0.52 ± 0.61° across all subjects and scans, relative to ground-truth motion measurements provided by an electromagnetic tracking system. Retrospective correction with FIDnav motion estimates resulted in substantial improvements in quantitative image quality metrics across all scans with intentional head motion. CONCLUSIONS Quantitative rigid-body motion information can be effectively estimated using the proposed FIDnav-based approach, which represents a practical method for retrospective motion compensation in less cooperative patient populations.
Collapse
Affiliation(s)
- Tess E Wallace
- Computational Radiology Laboratory, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Onur Afacan
- Computational Radiology Laboratory, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts
| | - Maryna Waszak
- Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland.,Department of Radiology, University Hospital (CHUV), Lausanne, Switzerland.,LTS5, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Tobias Kober
- Advanced Clinical Imaging Technology, Siemens Healthcare AG, Lausanne, Switzerland.,Department of Radiology, University Hospital (CHUV), Lausanne, Switzerland.,LTS5, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Simon K Warfield
- Computational Radiology Laboratory, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
18
|
Haskell MW, Cauley SF, Wald LL. TArgeted Motion Estimation and Reduction (TAMER): Data Consistency Based Motion Mitigation for MRI Using a Reduced Model Joint Optimization. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1253-1265. [PMID: 29727288 PMCID: PMC6633918 DOI: 10.1109/tmi.2018.2791482] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
We introduce a data consistency based retrospective motion correction method, TArgeted Motion Estimation and Reduction (TAMER), to correct for patient motion in Magnetic Resonance Imaging (MRI). Specifically, a motion free image and motion trajectory are jointly estimated by minimizing the data consistency error of a SENSE forward model including rigid-body subject motion. In order to efficiently solve this large non-linear optimization problem, we employ reduced modeling in the parallel imaging formulation by assessing only a subset of target voxels at each step of the motion search. With this strategy we are able to effectively capture the tight coupling between the image voxel values and motion parameters. We demonstrate in simulations TAMER's ability to find similar search directions compared to a full model, with an average error of 22%, vs. 73% error when using previously proposed alternating methods. The reduced model decreased the computation time fold compared to a full image volume evaluation. In phantom experiments, our method successfully mitigates both translation and rotation artifacts, reducing image RMSE compared to a motion-free gold standard from 21% to 14% in a translating phantom, and from 17% to 10% in a rotating phantom. Qualitative image improvements are seen in human imaging of moving subjects compared to conventional reconstruction. Finally, we compare in vivo image results of our method to the state-of-the-art.
Collapse
|
19
|
Chang HH, Li CY, Gallogly AH. Brain MR Image Restoration Using an Automatic Trilateral Filter With GPU-Based Acceleration. IEEE Trans Biomed Eng 2018; 65:400-413. [DOI: 10.1109/tbme.2017.2772853] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
20
|
Aranovitch A, Haeberlin M, Gross S, Dietrich BE, Wilm BJ, Brunner DO, Schmid T, Luechinger R, Pruessmann KP. Prospective motion correction with NMR markers using only native sequence elements. Magn Reson Med 2017; 79:2046-2056. [PMID: 28840611 DOI: 10.1002/mrm.26877] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2017] [Revised: 07/27/2017] [Accepted: 07/29/2017] [Indexed: 12/20/2022]
Abstract
PURPOSE To develop a method of tracking active NMR markers that requires no alterations of common imaging sequences and can be used for prospective motion correction (PMC) in brain MRI. METHODS Localization of NMR markers is achieved by acquiring short signal snippets in rapid succession and evaluating them jointly. To spatially encode the markers, snippets are timed such that signal phase is accrued during sequence intervals with suitably diverse gradient actuation. For motion tracking and PMC in brain imaging, the markers are mounted on a lightweight headset. PMC is then demonstrated with high-resolution T2 *- and T1 -weighted imaging sequences in the presence of instructed as well as residual unintentional head motion. RESULTS With both unaltered sequences, motion tracking was achieved with precisions on the order of 10 µm and 0.01° and temporal resolution of 48 and 39 ms, respectively. On this basis, PMC improved image quality significantly throughout. CONCLUSION The proposed approach permits high-precision motion tracking and PMC with standard imaging sequences. It does so without altering sequence design and thus overcomes a key hindrance to routine motion tracking with NMR markers. Magn Reson Med 79:2046-2057, 2018. © 2017 International Society for Magnetic Resonance in Medicine.
Collapse
Affiliation(s)
- Alexander Aranovitch
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Maximilian Haeberlin
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Simon Gross
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Benjamin E Dietrich
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Bertram J Wilm
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - David O Brunner
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Thomas Schmid
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Roger Luechinger
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| | - Klaas P Pruessmann
- Institute for Biomedical Engineering, ETH Zurich and University of Zurich, Zurich, Switzerland
| |
Collapse
|
21
|
Cordero-Grande L, Hughes EJ, Hutter J, Price AN, Hajnal JV. Three-dimensional motion corrected sensitivity encoding reconstruction for multi-shot multi-slice MRI: Application to neonatal brain imaging. Magn Reson Med 2017. [PMID: 28626962 PMCID: PMC5811842 DOI: 10.1002/mrm.26796] [Citation(s) in RCA: 84] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
PURPOSE To introduce a methodology for the reconstruction of multi-shot, multi-slice magnetic resonance imaging able to cope with both within-plane and through-plane rigid motion and to describe its application in structural brain imaging. THEORY AND METHODS The method alternates between motion estimation and reconstruction using a common objective function for both. Estimates of three-dimensional motion states for each shot and slice are gradually refined by improving on the fit of current reconstructions to the partial k-space information from multiple coils. Overlapped slices and super-resolution allow recovery of through-plane motion and outlier rejection discards artifacted shots. The method is applied to T2 and T1 brain scans acquired in different views. RESULTS The procedure has greatly diminished artifacts in a database of 1883 neonatal image volumes, as assessed by image quality metrics and visual inspection. Examples showing the ability to correct for motion and robustness against damaged shots are provided. Combination of motion corrected reconstructions for different views has shown further artifact suppression and resolution recovery. CONCLUSION The proposed method addresses the problem of rigid motion in multi-shot multi-slice anatomical brain scans. Tests on a large collection of potentially corrupted datasets have shown a remarkable image quality improvement. Magn Reson Med 79:1365-1376, 2018. © 2017 The Authors Magnetic Resonance in Medicine published by Wiley Periodicals, Inc. on behalf of International Society for Magnetic Resonance in Medicine. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
Collapse
Affiliation(s)
- Lucilio Cordero-Grande
- Centre for the Developing Brain and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, King's Health Partners, St. Thomas' Hospital, London, UK
| | - Emer J Hughes
- Centre for the Developing Brain and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, King's Health Partners, St. Thomas' Hospital, London, UK
| | - Jana Hutter
- Centre for the Developing Brain and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, King's Health Partners, St. Thomas' Hospital, London, UK
| | - Anthony N Price
- Centre for the Developing Brain and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, King's Health Partners, St. Thomas' Hospital, London, UK
| | - Joseph V Hajnal
- Centre for the Developing Brain and Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, King's Health Partners, St. Thomas' Hospital, London, UK
| |
Collapse
|
22
|
Chang HH, Chang YN. CUDA-based acceleration and BPN-assisted automation of bilateral filtering for brain MR image restoration. Med Phys 2017; 44:1420-1436. [PMID: 28196280 DOI: 10.1002/mp.12157] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2016] [Revised: 02/02/2017] [Accepted: 02/08/2017] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Bilateral filters have been substantially exploited in numerous magnetic resonance (MR) image restoration applications for decades. Due to the deficiency of theoretical basis on the filter parameter setting, empirical manipulation with fixed values and noise variance-related adjustments has generally been employed. The outcome of these strategies is usually sensitive to the variation of the brain structures and not all the three parameter values are optimal. This article is in an attempt to investigate the optimal setting of the bilateral filter, from which an accelerated and automated restoration framework is developed. METHODS To reduce the computational burden of the bilateral filter, parallel computing with the graphics processing unit (GPU) architecture is first introduced. The NVIDIA Tesla K40c GPU with the compute unified device architecture (CUDA) functionality is specifically utilized to emphasize thread usages and memory resources. To correlate the filter parameters with image characteristics for automation, optimal image texture features are subsequently acquired based on the sequential forward floating selection (SFFS) scheme. Subsequently, the selected features are introduced into the back propagation network (BPN) model for filter parameter estimation. Finally, the k-fold cross validation method is adopted to evaluate the accuracy of the proposed filter parameter prediction framework. RESULTS A wide variety of T1-weighted brain MR images with various scenarios of noise levels and anatomic structures were utilized to train and validate this new parameter decision system with CUDA-based bilateral filtering. For a common brain MR image volume of 256 × 256 × 256 pixels, the speed-up gain reached 284. Six optimal texture features were acquired and associated with the BPN to establish a "high accuracy" parameter prediction system, which achieved a mean absolute percentage error (MAPE) of 5.6%. Automatic restoration results on 2460 brain MR images received an average relative error in terms of peak signal-to-noise ratio (PSNR) less than 0.1%. In comparison with many state-of-the-art filters, the proposed automation framework with CUDA-based bilateral filtering provided more favorable results both quantitatively and qualitatively. CONCLUSIONS Possessing unique characteristics and demonstrating exceptional performances, the proposed CUDA-based bilateral filter adequately removed random noise in multifarious brain MR images for further study in neurosciences and radiological sciences. It requires no prior knowledge of the noise variance and automatically restores MR images while preserving fine details. The strategy of exploiting the CUDA to accelerate the computation and incorporating texture features into the BPN to completely automate the bilateral filtering process is achievable and validated, from which the best performance is reached.
Collapse
Affiliation(s)
- Herng-Hua Chang
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, Taipei, 10617, Taiwan
| | - Yu-Ning Chang
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, Taipei, 10617, Taiwan
| |
Collapse
|
23
|
Cruz G, Atkinson D, Henningsson M, Botnar RM, Prieto C. Highly efficient nonrigid motion-corrected 3D whole-heart coronary vessel wall imaging. Magn Reson Med 2016; 77:1894-1908. [PMID: 27221073 PMCID: PMC5412916 DOI: 10.1002/mrm.26274] [Citation(s) in RCA: 72] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2015] [Revised: 04/20/2016] [Accepted: 04/20/2016] [Indexed: 12/25/2022]
Abstract
Purpose To develop a respiratory motion correction framework to accelerate free‐breathing three‐dimensional (3D) whole‐heart coronary lumen and coronary vessel wall MRI. Methods We developed a 3D flow‐independent approach for vessel wall imaging based on the subtraction of data with and without T2‐preparation prepulses acquired interleaved with image navigators. The proposed method corrects both datasets to the same respiratory position using beat‐to‐beat translation and bin‐to‐bin nonrigid corrections, producing coregistered, motion‐corrected coronary lumen and coronary vessel wall images. The proposed method was studied in 10 healthy subjects and was compared with beat‐to‐beat translational correction (TC) and no motion correction for the left and right coronary arteries. Additionally, the coronary lumen images were compared with a 6‐mm diaphragmatic navigator gated and tracked scan. Results No significant differences (P > 0.01) were found between the proposed method and the gated and tracked scan for coronary lumen, despite an average improvement in scan efficiency to 96% from 59%. Significant differences (P < 0.01) were found in right coronary artery vessel wall thickness, right coronary artery vessel wall sharpness, and vessel wall visual score between the proposed method and TC. Conclusion The feasibility of a highly efficient motion correction framework for simultaneous whole‐heart coronary lumen and vessel wall has been demonstrated. Magn Reson Med 77:1894–1908, 2017. © 2016 International Society for Magnetic Resonance in Medicine
Collapse
Affiliation(s)
- Gastão Cruz
- King's College London, Division of Imaging Sciences and Biomedical Engineering, London, United Kingdom
| | - David Atkinson
- Centre for Medical Imaging, University College London, London, United Kingdom
| | - Markus Henningsson
- King's College London, Division of Imaging Sciences and Biomedical Engineering, London, United Kingdom
| | - Rene M Botnar
- King's College London, Division of Imaging Sciences and Biomedical Engineering, London, United Kingdom.,Pontificia Universidad Católica de Chile, Escuela de Ingeniería, Santiago, Chile
| | - Claudia Prieto
- King's College London, Division of Imaging Sciences and Biomedical Engineering, London, United Kingdom.,Pontificia Universidad Católica de Chile, Escuela de Ingeniería, Santiago, Chile
| |
Collapse
|