1
|
Garay J, Dunstan J, Uribe S, Sahli Costabal F. Physics-informed neural networks for parameter estimation in blood flow models. Comput Biol Med 2024; 178:108706. [PMID: 38879935 DOI: 10.1016/j.compbiomed.2024.108706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 05/31/2024] [Accepted: 06/03/2024] [Indexed: 06/18/2024]
Abstract
BACKGROUND Physics-informed neural networks (PINNs) have emerged as a powerful tool for solving inverse problems, especially in cases where no complete information about the system is known and scatter measurements are available. This is especially useful in hemodynamics since the boundary information is often difficult to model, and high-quality blood flow measurements are generally hard to obtain. METHODS In this work, we use the PINNs methodology for estimating reduced-order model parameters and the full velocity field from scatter 2D noisy measurements in the aorta. Two different flow regimes, stationary and transient were studied. RESULTS We show robust and relatively accurate parameter estimations when using the method with simulated data, while the velocity reconstruction accuracy shows dependence on the measurement quality and the flow pattern complexity. Comparison with a Kalman filter approach shows similar results when the number of parameters to be estimated is low to medium. For a higher number of parameters, only PINNs were capable of achieving good results. CONCLUSION The method opens a door to deep-learning-driven methods in the simulations of complex coupled physical systems.
Collapse
Affiliation(s)
- Jeremías Garay
- Department of Mechanical and Metallurgical Engineering, Pontificia Universidad Católica de Chile, Chile; Center of Biomedical Imaging, Pontificia Universidad Católica de Chile, Chile; Millennium Institute for Intelligent Healthcare Engineering (iHealth), Chile
| | - Jocelyn Dunstan
- Department of Computer Science, Pontificia Universidad Católica de Chile, Chile; Institute for Mathematical and Computational Engineering, Pontificia Universidad Católica de Chile, Chile; Millennium Institute for Foundational Research on Data (IMFD), Chile
| | - Sergio Uribe
- Center of Biomedical Imaging, Pontificia Universidad Católica de Chile, Chile; Millennium Institute for Intelligent Healthcare Engineering (iHealth), Chile; Department of Medical Imaging and Radiation Sciences, Monash University, Australia; Department of Radiology, Pontificia Universidad Católica de Chile, Chile
| | - Francisco Sahli Costabal
- Department of Mechanical and Metallurgical Engineering, Pontificia Universidad Católica de Chile, Chile; Millennium Institute for Intelligent Healthcare Engineering (iHealth), Chile; Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Chile.
| |
Collapse
|
2
|
Kontogiannis A, Juniper MP. Physics-Informed Compressed Sensing for PC-MRI: An Inverse Navier-Stokes Problem. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2022; 32:281-294. [PMID: 37015556 DOI: 10.1109/tip.2022.3228172] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
We formulate a physics-informed compressed sensing (PICS) method for the reconstruction of velocity fields from noisy and sparse phase-contrast magnetic resonance signals. The method solves an inverse Navier-Stokes boundary value problem, which permits us to jointly reconstruct and segment the velocity field, and at the same time infer hidden quantities such as the hydrodynamic pressure and the wall shear stress. Using a Bayesian framework, we regularize the problem by introducing a priori information about the unknown parameters in the form of Gaussian random fields. This prior information is updated using the Navier-Stokes problem, an energy-based segmentation functional, and by requiring that the reconstruction is consistent with the $k$ -space signals. We create an algorithm that solves this inverse problem, and test it for noisy and sparse $k$ -space signals of the flow through a converging nozzle. We find that the method is capable of reconstructing and segmenting the velocity fields from sparsely-sampled (15% $k$ -space coverage), low ( $\sim 10$ ) signal-to-noise ratio (SNR) signals, and that the reconstructed velocity field compares well with that derived from fully-sampled (100% $k$ -space coverage) high ( $> 40$ ) SNR signals of the same flow.
Collapse
|
3
|
Shit S, Zimmermann J, Ezhov I, Paetzold JC, Sanches AF, Pirkl C, Menze BH. SRflow: Deep learning based super-resolution of 4D-flow MRI data. Front Artif Intell 2022; 5:928181. [PMID: 36034591 PMCID: PMC9411720 DOI: 10.3389/frai.2022.928181] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 07/11/2022] [Indexed: 11/13/2022] Open
Abstract
Exploiting 4D-flow magnetic resonance imaging (MRI) data to quantify hemodynamics requires an adequate spatio-temporal vector field resolution at a low noise level. To address this challenge, we provide a learned solution to super-resolve in vivo 4D-flow MRI data at a post-processing level. We propose a deep convolutional neural network (CNN) that learns the inter-scale relationship of the velocity vector map and leverages an efficient residual learning scheme to make it computationally feasible. A novel, direction-sensitive, and robust loss function is crucial to learning vector-field data. We present a detailed comparative study between the proposed super-resolution and the conventional cubic B-spline based vector-field super-resolution. Our method improves the peak-velocity to noise ratio of the flow field by 10 and 30% for in vivo cardiovascular and cerebrovascular data, respectively, for 4 × super-resolution over the state-of-the-art cubic B-spline. Significantly, our method offers 10x faster inference over the cubic B-spline. The proposed approach for super-resolution of 4D-flow data would potentially improve the subsequent calculation of hemodynamic quantities.
Collapse
Affiliation(s)
- Suprosanna Shit
- Department of Informatics, Technical University of Munich, Munich, Germany
- Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland
- *Correspondence: Suprosanna Shit
| | - Judith Zimmermann
- Department of Informatics, Technical University of Munich, Munich, Germany
| | - Ivan Ezhov
- Department of Informatics, Technical University of Munich, Munich, Germany
| | | | - Augusto F. Sanches
- Institute of Neuroradiology, University Hospital LMU Munich, Munich, Germany
| | - Carolin Pirkl
- Department of Informatics, Technical University of Munich, Munich, Germany
| | - Bjoern H. Menze
- Department of Quantitative Biomedicine, University of Zurich, Zurich, Switzerland
| |
Collapse
|
4
|
Garay J, Mella H, Sotelo J, Cárcamo C, Uribe S, Bertoglio C, Mura J. Assessment of 4D flow MRI's quality by verifying its Navier-Stokes compatibility. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2022; 38:e3603. [PMID: 35434919 PMCID: PMC9285816 DOI: 10.1002/cnm.3603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 03/24/2022] [Accepted: 04/09/2022] [Indexed: 06/14/2023]
Abstract
4D Flow Magnetic Resonance Imaging (MRI) is the state-of-the-art technique to comprehensively measure the complex spatio-temporal and multidirectional patterns of blood flow. However, it is subject to artifacts such as noise and aliasing, which due to the 3D and dynamic structure is difficult to detect in clinical practice. In this work, a new mathematical and computational model to determine the quality of 4D Flow MRI is presented. The model is derived by assuming the true velocity satisfies the incompressible Navier-Stokes equations and that can be decomposed by the measurements u→meas plus an extra field w→ . Therefore, a non-linear problem with w→ as unknown arises, which serves as a measure of data quality. A stabilized finite element formulation tailored to this problem is proposed and analyzed. Then, extensive numerical examples-using synthetic 4D Flow MRI data as well as real measurements on experimental phantom and subjects-illustrate the ability to use w→ for assessing the quality of 4D Flow MRI measurements over space and time.
Collapse
Affiliation(s)
- Jeremías Garay
- Bernoulli InstituteUniversity of GroningenGroningenThe Netherlands
| | - Hernán Mella
- Biomedical Imaging CenterPontificia Universidad Católica de ChileSantiagoChile
- Millennium Nucleus in Cardiovascular Magnetic Resonance, Cardio MRSantiagoChile
- Department of Electrical EngineeringPontificia Universidad Católica de ChileSantiagoChile
| | - Julio Sotelo
- Biomedical Imaging CenterPontificia Universidad Católica de ChileSantiagoChile
- Millennium Nucleus in Cardiovascular Magnetic Resonance, Cardio MRSantiagoChile
- School of Biomedical EngineeringUniversidad de ValparaisoValparaisoChile
- Millennium Institute for Intelligent Healthcare Engineering, iHEALTHSantiagoChile
| | - Cristian Cárcamo
- Bernoulli InstituteUniversity of GroningenGroningenThe Netherlands
- Department of Mathematical EngineeringUniversidad de ConcepciónConcepciónChile
| | - Sergio Uribe
- Biomedical Imaging CenterPontificia Universidad Católica de ChileSantiagoChile
- Millennium Nucleus in Cardiovascular Magnetic Resonance, Cardio MRSantiagoChile
- Millennium Institute for Intelligent Healthcare Engineering, iHEALTHSantiagoChile
- Institute for Biological and Medical Engineering, Schools of Engineering, Medicine and Biological SciencesPontificia Universidad Católica de ChileSantiagoChile
- Department of Radiology, Schools of MedicinePontificia Universidad Católica de ChileSantiagoChile
| | | | - Joaquín Mura
- Millennium Nucleus in Cardiovascular Magnetic Resonance, Cardio MRSantiagoChile
- Department of Mechanical EngineeringUniversidad Técnica Federico Santa MaríaSantiagoChile
| |
Collapse
|
5
|
Mella H, Mura J, Sotelo J, Uribe S. A comprehensive comparison between shortest-path HARP refinement, SinMod, and DENSEanalysis processing tools applied to CSPAMM and DENSE images. Magn Reson Imaging 2021; 83:14-26. [PMID: 34242693 DOI: 10.1016/j.mri.2021.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 03/26/2021] [Accepted: 07/03/2021] [Indexed: 10/20/2022]
Abstract
We addressed comprehensively the performance of Shortest-Path HARP Refinement (SP-HR), SinMod, and DENSEanalysis using 2D slices of synthetic CSPAMM and DENSE images with realistic contrasts obtained from 3D phantoms. The three motion estimation techniques were interrogated under ideal and no-ideal conditions (with MR induced artifacts, noise, and through-plane motion), considering several resolutions and noise levels. Under noisy conditions, and for isotropic pixel sizes of 1.5 mm and 3.0 mm in CSPAMM and DENSE images respectively, the nRMSE obtained for the circumferential and radial strain components were 10.7 ± 10.8% and 25.5 ± 14.8% using SP-HR, 11.9 ± 2.5% and 29.3 ± 6.5% using SinMod, and 6.4 ± 2.0% and 18.2 ± 4.6% using DENSEanalysis. Overall, the results showed that SP-HR tends to fail for large tissue motions, whereas SinMod and DENSEanalysis gave accurate displacement and strain field estimations, being the last which performed the best.
Collapse
Affiliation(s)
- Hernán Mella
- Department of Electrical Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile; Biomedical Imaging Centre, Pontificia Universidad Católica de Chile, Santiago, Chile; Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile.
| | - Joaquín Mura
- Department of Mechanical Engineering, Universidad Técnica Federico Santa María, Santiago, Chile; Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile.
| | - Julio Sotelo
- School of Biomedical Engineering, Universidad de Valparaíso, Valparaíso, Chile; Biomedical Imaging Centre, Pontificia Universidad Católica de Chile, Santiago, Chile; Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile.
| | - Sergio Uribe
- Department of Radiology, School of Medicine, Pontificia Universidad Católica de Chile, Santiago, Chile; Biomedical Imaging Centre, Pontificia Universidad Católica de Chile, Santiago, Chile; Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile.
| |
Collapse
|
6
|
Mella H, Mura J, Wang H, Taylor MD, Chabiniok R, Tintera J, Sotelo J, Uribe S. HARP-I: A Harmonic Phase Interpolation Method for the Estimation of Motion From Tagged MR Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1240-1252. [PMID: 33434127 DOI: 10.1109/tmi.2021.3051092] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
We proposed a novel method called HARP-I, which enhances the estimation of motion from tagged Magnetic Resonance Imaging (MRI). The harmonic phase of the images is unwrapped and treated as noisy measurements of reference coordinates on a deformed domain, obtaining motion with high accuracy using Radial Basis Functions interpolations. Results were compared against Shortest Path HARP Refinement (SP-HR) and Sine-wave Modeling (SinMod), two harmonic image-based techniques for motion estimation from tagged images. HARP-I showed a favorable similarity with both methods under noise-free conditions, whereas a more robust performance was found in the presence of noise. Cardiac strain was better estimated using HARP-I at almost any motion level, giving strain maps with less artifacts. Additionally, HARP-I showed better temporal consistency as a new method was developed to fix phase jumps between frames. In conclusion, HARP-I showed to be a robust method for the estimation of motion and strain under ideal and non-ideal conditions.
Collapse
|
7
|
Fathi MF, Perez-Raya I, Baghaie A, Berg P, Janiga G, Arzani A, D'Souza RM. Super-resolution and denoising of 4D-Flow MRI using physics-Informed deep neural nets. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105729. [PMID: 33007592 DOI: 10.1016/j.cmpb.2020.105729] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Accepted: 08/23/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE Time resolved three-dimensional phase contrast magnetic resonance imaging (4D-Flow MRI) has been used to non-invasively measure blood velocities in the human vascular system. However, issues such as low spatio-temporal resolution, acquisition noise, velocity aliasing, and phase-offset artifacts have hampered its clinical application. In this research, we developed a purely data-driven method for super-resolution and denoising of 4D-Flow MRI. METHODS The flow velocities, pressure, and the MRI image magnitude are modeled as a patient-specific deep neural net (DNN). For training, 4D-Flow MRI images in the complex Cartesian space are used to impose data-fidelity. Physics of fluid flow is imposed through regularization. Creative loss function terms have been introduced to handle noise and super-resolution. The trained patient-specific DNN can be sampled to generate noise-free high-resolution flow images. The proposed method has been implemented using the TensorFlow DNN library and tested on numerical phantoms and validated in-vitro using high-resolution particle image velocitmetry (PIV) and 4D-Flow MRI experiments on transparent models subjected to pulsatile flow conditions. RESULTS In case of numerical phantoms, we were able to increase spatial resolution by a factor of 100 and temporal resolution by a factor of 5 compared to the simulated 4D-Flow MRI. There is an order of magnitude reduction of velocity normalized root mean square error (vNRMSE). In case of the in-vitro validation tests with PIV as reference, there is similar improvement in spatio-temporal resolution. Although the vNRMSE is reduced by 50%, the method is unable to negate a systematic bias with respect to the reference PIV that is introduced by the 4D-Flow MRI measurement. CONCLUSIONS This work has demonstrated the feasibility of using the readily available machinery of deep learning to enhance 4D-Flow MRI using a purely data-driven method. Unlike current state-of-the-art methods, the proposed method is agnostic to geometry and boundary conditions and therefore eliminates the need for tedious tasks such as accurate image segmentation for geometry, image registration, and estimation of boundary flow conditions. Arbitrary regions of interest can be selected for processing. This work will lead to user-friendly analysis tools that will enable quantitative hemodynamic analysis of vascular diseases in a clinical setting.
Collapse
Affiliation(s)
- Mojtaba F Fathi
- Dept. of Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI, USA
| | - Isaac Perez-Raya
- Dept. of Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI, USA
| | - Ahmadreza Baghaie
- Dept. of Electrical and Computer Engineering, New York Institute of Technology, Long Island, NY, USA
| | - Philipp Berg
- Lab. of Fluid Dynamics and Technical Flows, University of Magdeburg, Germany; Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany
| | - Gabor Janiga
- Lab. of Fluid Dynamics and Technical Flows, University of Magdeburg, Germany; Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany
| | - Amirhossein Arzani
- Dept. of Mechanical Engineering, Northern Arizona University, Flagstaff, AZ, USA
| | - Roshan M D'Souza
- Dept. of Mechanical Engineering, University of Wisconsin-Milwaukee, Milwaukee, WI, USA.
| |
Collapse
|