1
|
Jeng GS, Chen PS, Hsieh MY, Liu Z, Langdon J, Ahn S, Staib LH, Stendahl JC, Thorn S, Sinusas AJ, Duncan JS, O’Donnell M. Coordinate-Independent 3-D Ultrasound Principal Stretch and Direction Imaging. IEEE Trans Biomed Eng 2024; 71:3312-3323. [PMID: 38941195 PMCID: PMC11637688 DOI: 10.1109/tbme.2024.3420220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/30/2024]
Abstract
OBJECTIVE In clinical ultrasound, current 2-D strain imaging faces challenges in quantifying three orthogonal normal strain components. This requires separate image acquisitions based on the pixel-dependent cardiac coordinate system, leading to additional computations and estimation discrepancies due to probe orientation. Most systems lack shear strain information, as displaying all components is challenging to interpret. METHODS This paper presents a 3-D high-spatial-resolution, coordinate-independent strain imaging approach based on principal stretch and axis estimation. All strain components are transformed into three principal stretches along three normal principal axes, enabling direct visualization of the primary deformation. We devised an efficient 3-D speckle tracking method with tilt filtering, incorporating randomized searching in a two-pass tracking framework and rotating the phase of the 3-D correlation function for robust filtering. The proposed speckle tracking approach significantly improves estimates of displacement gradients related to the axial displacement component. Non-axial displacement gradient estimates are enhanced using a correlation-weighted least-squares method constrained by tissue incompressibility. RESULTS Simulated and in vivo canine cardiac datasets were evaluated to estimate Lagrangian strains from end-diastole to end-systole. The proposed speckle tracking method improves displacement estimation by a factor of 4.3 to 10.5 over conventional 1-pass processing. Maximum principal axis/direction imaging enables better detection of local disease regions than conventional strain imaging. CONCLUSION Coordinate-independent tracking can identify myocardial abnormalities with high accuracy. SIGNIFICANCE This study offers enhanced accuracy and robustness in strain imaging compared to current methods.
Collapse
Affiliation(s)
- Geng-Shi Jeng
- Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Po-Syun Chen
- Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Min-Yen Hsieh
- Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Zhao Liu
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University, New Haven, CT USA
| | - Jonathan Langdon
- Department of Radiology & Biomedical Imaging, Yale University, New Haven, CT USA
| | - Shawn Ahn
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University, New Haven, CT USA
| | - Lawrence H. Staib
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University, New Haven, CT USA
| | - John C. Stendahl
- Departments of Medicine (Cardiology), Radiology & Biomedical Imaging and Biomedical Engineering, Yale University, New Haven, CT USA
| | - Stephanie Thorn
- Departments of Medicine (Cardiology), Radiology & Biomedical Imaging and Biomedical Engineering, Yale University, New Haven, CT USA
| | - Albert J. Sinusas
- Departments of Medicine (Cardiology), Radiology & Biomedical Imaging and Biomedical Engineering, Yale University, New Haven, CT USA
| | - James S. Duncan
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University, New Haven, CT USA
| | - Matthew O’Donnell
- Department of Bioengineering, University of Washington, Seattle, WA USA
| |
Collapse
|
2
|
Ahn SS, Ta K, Thorn SL, Onofrey JA, Melvinsdottir IH, Lee S, Langdon J, Sinusas AJ, Duncan JS. Co-attention spatial transformer network for unsupervised motion tracking and cardiac strain analysis in 3D echocardiography. Med Image Anal 2023; 84:102711. [PMID: 36525845 PMCID: PMC9812938 DOI: 10.1016/j.media.2022.102711] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 10/15/2022] [Accepted: 11/29/2022] [Indexed: 12/13/2022]
Abstract
Myocardial ischemia/infarction causes wall-motion abnormalities in the left ventricle. Therefore, reliable motion estimation and strain analysis using 3D+time echocardiography for localization and characterization of myocardial injury is valuable for early detection and targeted interventions. Previous unsupervised cardiac motion tracking methods rely on heavily-weighted regularization functions to smooth out the noisy displacement fields in echocardiography. In this work, we present a Co-Attention Spatial Transformer Network (STN) for improved motion tracking and strain analysis in 3D echocardiography. Co-Attention STN aims to extract inter-frame dependent features between frames to improve the motion tracking in otherwise noisy 3D echocardiography images. We also propose a novel temporal constraint to further regularize the motion field to produce smooth and realistic cardiac displacement paths over time without prior assumptions on cardiac motion. Our experimental results on both synthetic and in vivo 3D echocardiography datasets demonstrate that our Co-Attention STN provides superior performance compared to existing methods. Strain analysis from Co-Attention STNs also correspond well with the matched SPECT perfusion maps, demonstrating the clinical utility for using 3D echocardiography for infarct localization.
Collapse
Affiliation(s)
- Shawn S Ahn
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA.
| | - Kevinminh Ta
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Stephanie L Thorn
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT, USA
| | - John A Onofrey
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Inga H Melvinsdottir
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT, USA
| | - Supum Lee
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT, USA
| | - Jonathan Langdon
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Albert J Sinusas
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | - James S Duncan
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA; Department of Electrical Engineering, Yale University, New Haven, CT, USA.
| |
Collapse
|
3
|
Lu A, Ahn SS, Ta K, Parajuli N, Stendahl JC, Liu Z, Boutagy NE, Jeng GS, Staib LH, O'Donnell M, Sinusas AJ, Duncan JS. Learning-Based Regularization for Cardiac Strain Analysis via Domain Adaptation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:2233-2245. [PMID: 33872145 PMCID: PMC8442959 DOI: 10.1109/tmi.2021.3074033] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Reliable motion estimation and strain analysis using 3D+ time echocardiography (4DE) for localization and characterization of myocardial injury is valuable for early detection and targeted interventions. However, motion estimation is difficult due to the low-SNR that stems from the inherent image properties of 4DE, and intelligent regularization is critical for producing reliable motion estimates. In this work, we incorporated the notion of domain adaptation into a supervised neural network regularization framework. We first propose a semi-supervised Multi-Layered Perceptron (MLP) network with biomechanical constraints for learning a latent representation that is shown to have more physiologically plausible displacements. We extended this framework to include a supervised loss term on synthetic data and showed the effects of biomechanical constraints on the network's ability for domain adaptation. We validated the semi-supervised regularization method on in vivo data with implanted sonomicrometers. Finally, we showed the ability of our semi-supervised learning regularization approach to identify infarct regions using estimated regional strain maps with good agreement to manually traced infarct regions from postmortem excised hearts.
Collapse
|
4
|
Jeng GS, Li ML, Kim M, Yoon SJ, Pitre JJ, Li DS, Pelivanov I, O’Donnell M. Real-time interleaved spectroscopic photoacoustic and ultrasound (PAUS) scanning with simultaneous fluence compensation and motion correction. Nat Commun 2021; 12:716. [PMID: 33514737 PMCID: PMC7846772 DOI: 10.1038/s41467-021-20947-5] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 12/22/2020] [Indexed: 02/06/2023] Open
Abstract
For over two decades photoacoustic imaging has been tested clinically, but successful human trials have been limited. To enable quantitative clinical spectroscopy, the fundamental issues of wavelength-dependent fluence variations and inter-wavelength motion must be overcome. Here we propose a real-time, spectroscopic photoacoustic/ultrasound (PAUS) imaging approach using a compact, 1-kHz rate wavelength-tunable laser. Instead of illuminating tissue over a large area, the fiber-optic delivery system surrounding an US array sequentially scans a narrow laser beam, with partial PA image reconstruction for each laser pulse. The final image is then formed by coherently summing partial images. This scheme enables (i) automatic compensation for wavelength-dependent fluence variations in spectroscopic PA imaging and (ii) motion correction of spectroscopic PA frames using US speckle tracking in real-time systems. The 50-Hz video rate PAUS system is demonstrated in vivo using a murine model of labelled drug delivery.
Collapse
Affiliation(s)
- Geng-Shi Jeng
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA ,grid.260539.b0000 0001 2059 7017Institute of Electronics, National Chiao Tung University, Hsinchu, Taiwan
| | - Meng-Lin Li
- grid.38348.340000 0004 0532 0580Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan ,grid.38348.340000 0004 0532 0580Institute of Photonics Technologies, National Tsing Hua University, Hsinchu, Taiwan
| | - MinWoo Kim
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - Soon Joon Yoon
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - John J. Pitre
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - David S. Li
- grid.34477.330000000122986657Department of Chemical Engineering, University of Washington, Seattle, WA USA
| | - Ivan Pelivanov
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| | - Matthew O’Donnell
- grid.34477.330000000122986657Department of Bioengineering, University of Washington, Seattle, WA USA
| |
Collapse
|