1
|
Ren J, Li J, Liu C, Chen S, Liang L, Liu Y. Deep Learning With Physics-Embedded Neural Network for Full Waveform Ultrasonic Brain Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2332-2346. [PMID: 38329866 DOI: 10.1109/tmi.2024.3363144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/10/2024]
Abstract
The convenience, safety, and affordability of ultrasound imaging make it a vital non-invasive diagnostic technique for examining soft tissues. However, significant differences in acoustic impedance between the skull and soft tissues hinder the successful application of traditional ultrasound for brain imaging. In this study, we propose a physics-embedded neural network with deep learning based full waveform inversion (PEN-FWI), which can achieve reliable quantitative imaging of brain tissues. The network consists of two fundamental components: forward convolutional neural network (FCNN) and inversion sub-neural network (ISNN). The FCNN explores the nonlinear mapping relationship between the brain model and the wavefield, replacing the tedious wavefield calculation process based on the finite difference method. The ISNN implements the mapping from the wavefield to the model. PEN-FWI includes three iterative steps, each embedding the F CNN into the ISNN, ultimately achieving tomography from wavefield to brain models. Simulation and laboratory tests indicate that PEN-FWI can produce high-quality imaging of the skull and soft tissues, even starting from a homogeneous water model. PEN-FWI can achieve excellent imaging of clot models with constant uniform distribution of velocity, randomly Gaussian distribution of velocity, and irregularly shaped randomly distributed velocity. Robust differentiation can also be achieved for brain slices of various tissues and skulls, resulting in high-quality imaging. The imaging time for a horizontal cross-sectional imag e of the brain is only 1.13 seconds. This algorithm can effectively promote ultrasound-based brain tomography and provide feasible solutions in other fields.
Collapse
|
2
|
Yang Y, Duan H, Zheng Y. Improved Transcranial Plane-Wave Imaging With Learned Speed-of-Sound Maps. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2191-2201. [PMID: 38271172 DOI: 10.1109/tmi.2024.3358307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
Although transcranial ultrasound plane-wave imaging (PWI) has promising clinical application prospects, studies have shown that variable speed-of-sound (SoS) would seriously damage the quality of ultrasound images. The mismatch between the conventional constant velocity assumption and the actual SoS distribution leads to the general blurring of ultrasound images. The optimization scheme for reconstructing transcranial ultrasound image is often solved using iterative methods like full-waveform inversion. These iterative methods are computationally expensive and based on prior magnetic resonance imaging (MRI) or computed tomography (CT) information. In contrast, the multi-stencils fast marching (MSFM) method can produce accurate time travel maps for the skull with heterogeneous acoustic speed. In this study, we first propose a convolutional neural network (CNN) to predict SoS maps of the skull from PWI channel data. Then, use these maps to correct the travel time to reduce transcranial aberration. To validate the performance of the proposed method, numerical, phantom and intact human skull studies were conducted using a linear array transducer (L11-5v, 128 elements, pitch = 0.3 mm). Numerical simulations demonstrate that for point targets, the lateral resolution of MSFM-restored images increased by 65%, and the center position shift decreased by 89%. For the cyst targets, the eccentricity of the fitting ellipse decreased by 75%, and the center position shift decreased by 58%. In the phantom study, the lateral resolution of MSFM-restored images was increased by 49%, and the position shift was reduced by 1.72 mm. This pipeline, termed AutoSoS, thus shows the potential to correct distortions in real-time transcranial ultrasound imaging, as demonstrated by experiments on the intact human skull.
Collapse
|
3
|
Mi J, Liu C, Chen H, Qian Y, Zhu J, Zhang Y, Liang Y, Wang L, Ta D. Light on Alzheimer's disease: from basic insights to preclinical studies. Front Aging Neurosci 2024; 16:1363458. [PMID: 38566826 PMCID: PMC10986738 DOI: 10.3389/fnagi.2024.1363458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Accepted: 03/04/2024] [Indexed: 04/04/2024] Open
Abstract
Alzheimer's disease (AD), referring to a gradual deterioration in cognitive function, including memory loss and impaired thinking skills, has emerged as a substantial worldwide challenge with profound social and economic implications. As the prevalence of AD continues to rise and the population ages, there is an imperative demand for innovative imaging techniques to help improve our understanding of these complex conditions. Photoacoustic (PA) imaging forms a hybrid imaging modality by integrating the high-contrast of optical imaging and deep-penetration of ultrasound imaging. PA imaging enables the visualization and characterization of tissue structures and multifunctional information at high resolution and, has demonstrated promising preliminary results in the study and diagnosis of AD. This review endeavors to offer a thorough overview of the current applications and potential of PA imaging on AD diagnosis and treatment. Firstly, the structural, functional, molecular parameter changes associated with AD-related brain imaging captured by PA imaging will be summarized, shaping the diagnostic standpoint of this review. Then, the therapeutic methods aimed at AD is discussed further. Lastly, the potential solutions and clinical applications to expand the extent of PA imaging into deeper AD scenarios is proposed. While certain aspects might not be fully covered, this mini-review provides valuable insights into AD diagnosis and treatment through the utilization of innovative tissue photothermal effects. We hope that it will spark further exploration in this field, fostering improved and earlier theranostics for AD.
Collapse
Affiliation(s)
- Jie Mi
- Yiwu Research Institute, Fudan University, Yiwu, China
| | - Chao Liu
- Yiwu Research Institute, Fudan University, Yiwu, China
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai, China
| | - Honglei Chen
- Yiwu Research Institute, Fudan University, Yiwu, China
| | - Yan Qian
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai, China
| | - Jingyi Zhu
- Department of Biomedical Engineering, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Yachao Zhang
- Medical Ultrasound Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, China
| | - Yizhi Liang
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou, China
| | - Lidai Wang
- Department of Biomedical Engineering, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Dean Ta
- Yiwu Research Institute, Fudan University, Yiwu, China
- Department of Electronic Engineering, Fudan University, Shanghai, China
| |
Collapse
|
4
|
Tian Z, Olmstead M, Jing Y, Han A. Transcranial Phase Correction Using Pulse-Echo Ultrasound and Deep Learning: A 2-D Numerical Study. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:117-126. [PMID: 38060357 PMCID: PMC10858766 DOI: 10.1109/tuffc.2023.3340597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
Phase aberration caused by human skulls severely degrades the quality of transcranial ultrasound images, posing a major challenge in the practical application of transcranial ultrasound techniques in adults. Aberration can be corrected if the skull profile (i.e., thickness distribution) and speed of sound (SOS) are known. However, accurately estimating the skull profile and SOS using ultrasound with a physics-based approach is challenging due to the complexity of the interaction between ultrasound and the skull. A deep learning approach is proposed herein to estimate the skull profile and SOS using ultrasound radiofrequency (RF) signals backscattered from the skull. A numerical study was performed to test the approach's feasibility. Realistic numerical skull models were constructed from computed tomography (CT) scans of five ex vivo human skulls in this numerical study. Acoustic simulations were performed on 3595 skull segments to generate array-based ultrasound backscattered signals. A deep learning model was developed and trained to estimate skull thickness and SOS from RF channel data. The trained model was shown to be highly accurate. The mean absolute error (MAE) was 0.15 mm (2% error) for thickness estimation and 13 m/s (0.5% error) for SOS estimation. The Pearson correlation coefficient between the estimated and ground-truth values was 0.99 for thickness and 0.95 for SOS. Aberration correction performed using deep-learning-estimated skull thickness and SOS values yielded significantly improved beam focusing (e.g., narrower beams) and transcranial imaging quality (e.g., improved spatial resolution and reduced artifacts) compared with no aberration correction. The results demonstrate the feasibility of the proposed approach for transcranial phase aberration correction.
Collapse
|
5
|
Jiang C, Li B, Xie L, Liu C, Xu K, Zhan Y, Ta D. Ray theory-based compounded plane wave ultrasound imaging for aberration corrected transcranial imaging: Phantom experiments and simulations. ULTRASONICS 2023; 135:107124. [PMID: 37541030 DOI: 10.1016/j.ultras.2023.107124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 07/25/2023] [Accepted: 07/26/2023] [Indexed: 08/06/2023]
Abstract
Compounded plane wave imaging (CPWI) allows high-frame-rate measurement and has been one of the most promising modalities for real-time brain imaging. However, ultrasonic brain imaging using the CPWI modality is usually performed with a worn thin or removal of the skull layer. Otherwise, the skull layer is expected to distort the ultrasonic wavefronts and significantly decrease intracranial imaging quality. The motivation of this study is to investigate a CPWI method for transcranial brain imaging with the skull layer. A coordinate transformation ray-tracing (CTRT) approach was proposed to track the distorted ultrasonic wavefronts and calculate the time delays for the ultrasound plane wave passing through the skull layer. With an accurate correction for the time delays in beamforming, the CTRT-based CPWI could achieve high-quality intracranial images with the presence of skulls. The proposed CTRT-based CPWI method was verified using a simplified three-layer transcranial model. The full-wave simulation demonstrated that CTRT could accurately (i.e., relative percentage error less than0.18%) track the distorted transmitting wavefront through skull. Compared with the CPWI without aberration correction, the CTRT-based CPWI provided high-quality intracranial imaging and could accurately localize intracranial point scatterers; specifically, positioning error decreases from 0.5 mm to 0.1 mm on average in the axial direction and from 0.7 mm to 0.1 mm on average in the lateral direction. As the compounded angles increased in the CTRT-based CPWI, the contrast improved by 16.2 dB on average for the region of interest, and the array performance indicator (representing resolution) decreased by 4.0 on average for the intracranial point scatterers. The CTRT is of low computational cost compared with full wave simulation. This study suggested that the proposed CTRT-based CPWI might have the potential for real-time and non-invasive transcranial aberration-corrected imaging.
Collapse
Affiliation(s)
- Chen Jiang
- Micro-nano System Center, School of Information Science and Technology, Fudan University, 200438, Shanghai, China
| | - Boyi Li
- Academy for Engineering and Technology, Fudan University, 200433, Shanghai, China
| | - Linru Xie
- Academy for Engineering and Technology, Fudan University, 200433, Shanghai, China
| | - Chengcheng Liu
- Academy for Engineering and Technology, Fudan University, 200433, Shanghai, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, 201203, Shanghai, China
| | - Kailiang Xu
- Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, 200438, Shanghai, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, 201203, Shanghai, China.
| | - Yiqiang Zhan
- Micro-nano System Center, School of Information Science and Technology, Fudan University, 200438, Shanghai, China
| | - Dean Ta
- Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, 200438, Shanghai, China; State Key Laboratory of Integrated Chips and Systems, Fudan University, 201203, Shanghai, China.
| |
Collapse
|
6
|
Ali R, Brevett T, Zhuang L, Bendjador H, Podkowa AS, Hsieh SS, Simson W, Sanabria SJ, Herickhoff CD, Dahl JJ. Aberration correction in diagnostic ultrasound: A review of the prior field and current directions. Z Med Phys 2023; 33:267-291. [PMID: 36849295 PMCID: PMC10517407 DOI: 10.1016/j.zemedi.2023.01.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 12/17/2022] [Accepted: 01/09/2023] [Indexed: 02/27/2023]
Abstract
Medical ultrasound images are reconstructed with simplifying assumptions on wave propagation, with one of the most prominent assumptions being that the imaging medium is composed of a constant sound speed. When the assumption of a constant sound speed are violated, which is true in most in vivoor clinical imaging scenarios, distortion of the transmitted and received ultrasound wavefronts appear and degrade the image quality. This distortion is known as aberration, and the techniques used to correct for the distortion are known as aberration correction techniques. Several models have been proposed to understand and correct for aberration. In this review paper, aberration and aberration correction are explored from the early models and correction techniques, including the near-field phase screen model and its associated correction techniques such as nearest-neighbor cross-correlation, to more recent models and correction techniques that incorporate spatially varying aberration and diffractive effects, such as models and techniques that rely on the estimation of the sound speed distribution in the imaging medium. In addition to historical models, future directions of ultrasound aberration correction are proposed.
Collapse
Affiliation(s)
- Rehman Ali
- Department of Imaging Sciences, University of Rochester Medical Center, Rochester, NY, USA
| | - Thurston Brevett
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Louise Zhuang
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Hanna Bendjador
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Anthony S Podkowa
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Scott S Hsieh
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Walter Simson
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Sergio J Sanabria
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA; University of Deusto/ Ikerbasque Basque Foundation for Science, Bilbao, Spain
| | - Carl D Herickhoff
- Department of Biomedical Engineering, University of Memphis, TN, USA
| | - Jeremy J Dahl
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA.
| |
Collapse
|
7
|
Wang L, Wang H, Liang L, Li J, Zeng Z, Liu Y. Physics-informed neural networks for transcranial ultrasound wave propagation. ULTRASONICS 2023; 132:107026. [PMID: 37137219 DOI: 10.1016/j.ultras.2023.107026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 04/09/2023] [Accepted: 04/24/2023] [Indexed: 05/05/2023]
Abstract
Transcranial ultrasound imaging has been playing an increasingly important role in the non-invasive treatment of brain disorders. However, the conventional mesh-based numerical wave solvers, which are an integral part of imaging algorithms, suffer from limitations such as high computational cost and discretization error in predicting the wavefield passing through the skull. In this paper, we explore the use of physics-informed neural networks (PINNs) for predicting the transcranial ultrasound wave propagation. The wave equation, two sets of time snapshots data and a boundary condition (BC) are embedded as physical constraints in the loss function during training. The proposed approach has been validated by solving the two-dimensional (2D) acoustic wave equation under three increasingly complex spatially varying velocity models. Our cases demonstrate that due to the meshless nature of PINNs, they can be flexibly applied to different wave equations and types of BCs. By adding physics constraints to the loss function, PINNs can predict wavefields far outside the training data, providing ideas for improving the generalization capability of existing deep learning methods. The proposed approach offers exciting perspectives because of the powerful framework and simple implementation. We conclude with a summary of the strengths, limitations and further research directions of this work.
Collapse
Affiliation(s)
- Linfeng Wang
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
| | - Hao Wang
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
| | - Lin Liang
- Schlumberger-Doll Research, One Hampshire St, Cambridge, MA 02139, USA
| | - Jian Li
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
| | - Zhoumo Zeng
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China
| | - Yang Liu
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin 300072, China.
| |
Collapse
|
8
|
Tong J, Wang X, Ren J, Lin M, Li J, Sun H, Yin F, Liang L, Liu Y. Transcranial Ultrasound Imaging With Decomposition Descent Learning-Based Full Waveform Inversion. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:3297-3307. [PMID: 36288231 DOI: 10.1109/tuffc.2022.3217512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Noninvasive brain diagnosis is extremely important because of its efficiency, low cost, and painless nature in the prediction of stroke, cerebral hemorrhage, and other brain research. At present, achieving full 3-D quantitative ultrasonic imaging of the human brain is a cutting-edge challenge due to the complex structures of the human brain and the strong scattering caused by the skulls. In this article, we achieved quantitative ultrasonic imaging of inside-brain anomalies with our proposed method, the decomposition descent learning-based full waveform inversion (DDL-FWI). The proposed method adopts a linear residual decomposing technique to greatly alleviate the computation burden in fast inversion tomography (FIT) with enhanced convergence guaranteed by residual functions. Testing results in both simulation and laboratory experiments demonstrated that our method can achieve high-quality quantitative imaging of brain soft tissues and skulls even starting from homogeneous water background in 2-D, and this method is capable of reconstructing both complex brain tissues and clots in 2-D and 3-D cases using either clean or noisy signals, with a robust 3-D clot resolution as small as 18 mm and 2-D reconstruction speed in 11.20 s. Combined with advanced ultrasonic hardware, DDL-FWI can be easily trained and used for brain imaging efficiently that frees patients from harmful influences from traditional imaging techniques, e.g., ionization radiations from X-ray computed tomography (CT).
Collapse
|
9
|
Mozaffarzadeh M, Verschuur DJE, Verweij MD, de Jong N, Renaud G. Accelerated 2-D Real-Time Refraction-Corrected Transcranial Ultrasound Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:2599-2610. [PMID: 35797321 DOI: 10.1109/tuffc.2022.3189600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In a recent study, we proposed a technique to correct aberration caused by the skull and reconstruct a transcranial B-mode image with a refraction-corrected synthetic aperture imaging (SAI) scheme. Given a sound speed map, the arrival times were calculated using a fast marching technique (FMT), which solves the Eikonal equation and, therefore, is computationally expensive for real-time imaging. In this article, we introduce a two-point ray tracing method, based on Fermat's principle, for fast calculation of the travel times in the presence of a layered aberrator in front of the ultrasound probe. The ray tracing method along with the reconstruction technique is implemented on a graphical processing unite (GPU). The point spread function (PSF) in a wire phantom image reconstructed with the FMT and the GPU implementation was studied with numerical synthetic data and experiments with a bone-mimicking plate and a sagittally cut human skull. The numerical analysis showed that the error on travel times is less than 10% of the ultrasound temporal period at 2.5 MHz. As a result, the lateral resolution was not significantly degraded compared with images reconstructed with FMT-calculated travel times. The results using the synthetic, bone-mimicking plate, and skull dataset showed that the GPU implementation causes a lateral/axial localization error of 0.10/0.20, 0.15/0.13, and 0.26/0.32 mm compared with a reference measurement (no aberrator in front of the ultrasound probe), respectively. For an imaging depth of 70 mm, the proposed GPU implementation allows reconstructing 19 frames/s with full synthetic aperture (96 transmission events) and 32 frames/s with multiangle plane wave imaging schemes (with 11 steering angles) for a pixel size of [Formula: see text]. Finally, refraction-corrected power Doppler imaging is demonstrated with a string phantom and a bone-mimicking plate placed between the probe and the moving string. The proposed approach achieves a suitable frame rate for clinical scanning while maintaining the image quality.
Collapse
|