1
|
Rauby B, Xing P, Poree J, Gasse M, Provost J. Pruning Sparse Tensor Neural Networks Enables Deep Learning for 3D Ultrasound Localization Microscopy. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2025; 34:2367-2378. [PMID: 40126968 DOI: 10.1109/tip.2025.3552198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/26/2025]
Abstract
Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Mapping the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of frames, typically acquired over a few minutes. ULM acquisition times can be reduced by increasing the microbubble concentration, but requires more advanced algorithms to detect them individually. Several deep learning approaches have been proposed for this task, but they remain limited to 2D imaging, in part due to the associated large memory requirements. Herein, we propose the use of sparse tensor neural networks to enable deep learning-based 3D ULM by improving memory scalability with increased dimensionality. We study several approaches to efficiently convert ultrasound data into a sparse format and study the impact of the associated loss of information. When applied in 2D, the sparse formulation reduces the memory requirements by a factor 2 at the cost of a small reduction of performance when compared against dense networks. In 3D, the proposed approach reduces memory requirements by two order of magnitude while largely outperforming conventional ULM in high concentration settings. We show that Sparse Tensor Neural Networks in 3D ULM allow for the same benefits as dense deep learning based method in 2D ULM i.e. the use of higher concentration in silico and reduced acquisition time.
Collapse
|
2
|
Lin BZ, Fan AC, Wang Y, Lowerison MR, Dong Z, You Q, Sekaran NVC, Llano D, Borden M, Song P. Combined Nanodrops Imaging and Ultrasound Localization Microscopy for Detecting Intracerebral Hemorrhage. ULTRASOUND IN MEDICINE & BIOLOGY 2025; 51:707-714. [PMID: 39837748 DOI: 10.1016/j.ultrasmedbio.2025.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/26/2024] [Revised: 12/25/2024] [Accepted: 01/07/2025] [Indexed: 01/23/2025]
Abstract
OBJECTIVE Advanced imaging methods are crucial for understanding stroke mechanisms and discovering effective treatments to reduce bleeding and enhance recovery. In pre-clinical in vivo stroke imaging, MRI, CT and optical imaging are commonly used to evaluate stroke outcomes in rodent models. However, MRI and CT have limited spatial resolution for rodent brains, and optical imaging is hindered by limited imaging depth of penetration. Here we introduce a novel contrast-enhanced ultrasound imaging method to overcome these challenges and characterize intracerebral hemorrhage with unique insights. METHODS We combined microbubble-based ultrasound localization microscopy (ULM) and nanodrop (ND)-based vessel leakage imaging to achieve simultaneous microvascular imaging and hemorrhage detection. ULM maps brain-wide cerebral vasculature with high spatial resolution and identifies microvascular impairments around hemorrhagic areas. NDs are sub-micron liquid-core particles that can extravasate due to blood-brain barrier breakdown, serving as positive contrast agents to detect hemorrhage sites. RESULTS Our findings demonstrate that NDs could effectively accumulate in the hemorrhagic site and reveal the location of the bleeding areas upon activation by focused ultrasound beams. ULM further reveals the microvascular damage manifested in the form of reduced vascularity and decreased blood flow velocity across areas affected by the hemorrhagic stroke. CONCLUSION The results demonstrate that sequential ULM combined with ND imaging is a useful imaging tool for basic in vivo research in stroke with rodent models where brain-wide detection of active bleeding and microvascular impairment are essential.
Collapse
Affiliation(s)
- Bing-Ze Lin
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | | | - Yike Wang
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Matthew R Lowerison
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Zhijie Dong
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Qi You
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Nathiya Vaithiyalingam Chandra Sekaran
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Molecular and Integrative Physiology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Neuroscience Program, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Daniel Llano
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Molecular and Integrative Physiology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Neuroscience Program, University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Mark Borden
- Department of Mechanical Engineering, University of Colorado, Boulder, CO, USA
| | - Pengfei Song
- Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA; Department of Bioengineering, University of Illinois Urbana-Champaign, Urbana, IL, USA; Neuroscience Program, University of Illinois Urbana-Champaign, Urbana, IL, USA.
| |
Collapse
|
3
|
Huang C, Lok UW, Zhang J, Zhu XY, Krier JD, Stern A, Knoll KM, Petersen KE, Robinson KA, Hesley GK, Bentall AJ, Atwell TD, Rule AD, Lerman LO, Chen S. Optimizing in vivodata acquisition for robust clinical microvascular imaging using ultrasound localization microscopy. Phys Med Biol 2025; 70:10.1088/1361-6560/adc0de. [PMID: 40086078 PMCID: PMC12010384 DOI: 10.1088/1361-6560/adc0de] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2024] [Accepted: 03/14/2025] [Indexed: 03/16/2025]
Abstract
Objective. Ultrasound localization microscopy (ULM) enables microvascular imaging at spatial resolutions beyond the acoustic diffraction limit, offering significant clinical potentials. However, ULM performance relies heavily on microbubble (MB) signal sparsity, the number of detected MBs, and signal-to-noise ratio (SNR), all of which vary in clinical scenarios involving bolus MB injections. These sources of variations underscore the need to optimize MB dosage, data acquisition timing, and imaging settings in order to standardize and optimize ULM of microvasculature. This pilot study aims to investigate the temporal changes in MB signals during bolus injections in both pig and human models to optimize data acquisition for clinical ULM.Approach.Quantitative indices, mainly including individual MB SNR, normalized cross-correlation (NCC) of the MB signal with the point-spread function, and the number of localizable MBs, were developed to evaluate MB signal quality and guide the selection of acquisition timing. The effects of transmitted voltage and dosage on signal quality for MB localization were also explored.Main results. In both pig and human studies, MB localization quality (primarily indicated by NCC) reached a minimum at peak MB concentration, then improved as MB counts decreased during the wash-out phase. An optimal acquisition window was identified by balancing localization quality (empirically, NCC > 0.57) and MB concentration. In the pig model, a relatively short time window (approximately 10 s) for optimal acquisition was identified during the rapid wash-out phase, highlighting the need for real-time MB signal monitoring during data acquisition. The slower wash-out phase in humans allowed for a more flexible imaging window of 1-2 min, while trade-offs were observed between localization quality and MB density (or acquisition length) at different wash-out phase timings. Guided by these findings, robust ULM imaging was achieved in both pig and human kidneys using a short period of data acquisition (3.6 s and 9.6 s of data), demonstrating its feasibility in clinical practice.Significance.This study provides insights into optimizing data acquisition for consistent and reproducible ULM, paving the way for its standardization and broader clinical applications.
Collapse
Affiliation(s)
- Chengwu Huang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - U-Wai Lok
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Jingke Zhang
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Xiang Yang Zhu
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - James D. Krier
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - Amy Stern
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Kate M. Knoll
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Kendra E. Petersen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Kathryn A. Robinson
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Gina K. Hesley
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Andrew J. Bentall
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - Thomas D. Atwell
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| | - Andrew D. Rule
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - Lilach O. Lerman
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
| | - Shigao Chen
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
| |
Collapse
|
4
|
Chandragiri SS, Nyul-Toth A, Negri S, Patai R, Gulej R, Csik B, Shanmugarama S, Vali Kordestan K, Nagykaldi M, Mukli P, Ungvari A, Yabluchanskiy A, Ungvari Z, Tarantini S, Csiszar A. Functional ultrasound imaging reveals microvascular rarefaction, decreased cerebral blood flow, and impaired neurovascular coupling in a mouse model of paclitaxel-induced chemobrain. GeroScience 2025:10.1007/s11357-025-01624-7. [PMID: 40131589 DOI: 10.1007/s11357-025-01624-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2025] [Accepted: 03/15/2025] [Indexed: 03/27/2025] Open
Abstract
Chemotherapy-induced cognitive impairment (CICI), often referred to as "chemobrain," significantly affects the quality of life in cancer survivors. Although traditionally attributed to neuronal toxicity, emerging evidence suggests a key role of cerebrovascular dysfunction in its pathogenesis. We hypothesized that paclitaxel (PTX, Taxol) treatment induces long-term cerebrovascular dysfunction, including microvascular rarefaction, impaired neurovascular coupling (NVC), and altered cerebral blood flow (CBF), which contribute to CICI. Using a clinically relevant PTX treatment regimen in non-tumor-bearing mice, we evaluated the long-term effects of PTX on cerebrovascular health. Ultrasound localization microscopy (ULM) and functional ultrasound imaging (fUS) were employed to assess microvascular density, CBF, and NVC. PTX treatment resulted in a significant reduction in microvascular density in the cerebral cortex and hippocampus, key regions involved in cognitive function. PTX significantly reduced blood velocity in the middle cerebral artery. Moreover, PTX impaired NVC responses, as evidenced by a diminished CBF increase in response to whisker stimulation, indicative of impaired reactive hyperemia. In conclusion, these findings demonstrate that PTX induces long-lasting cerebrovascular dysfunction, including microvascular rarefaction, impaired NVC, and altered CBF dynamics, which likely contribute to CICI. This study underscores the critical role of cerebrovascular health in cognitive function and highlights the potential of targeting cerebrovascular pathways as a therapeutic approach for mitigating chemotherapy-induced cognitive deficits.
Collapse
Affiliation(s)
- Siva Sai Chandragiri
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Adam Nyul-Toth
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Sharon Negri
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Roland Patai
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Rafal Gulej
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Boglarka Csik
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Santny Shanmugarama
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Kiana Vali Kordestan
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Mark Nagykaldi
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Peter Mukli
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
| | - Anna Ungvari
- Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary.
| | - Andriy Yabluchanskiy
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
- Department of Health Promotion Sciences, College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- The Peggy and Charles Stephenson Cancer Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Zoltan Ungvari
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
- Department of Health Promotion Sciences, College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- The Peggy and Charles Stephenson Cancer Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Stefano Tarantini
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College, Health Sciences Division/Institute of Preventive Medicine and Public Health, Semmelweis University, Budapest, Hungary
- Department of Health Promotion Sciences, College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- The Peggy and Charles Stephenson Cancer Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Anna Csiszar
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- The Peggy and Charles Stephenson Cancer Center, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral College/Institute of Translational Medicine, Semmelweis University, Budapest, Hungary
| |
Collapse
|
5
|
Arthur L, Voulgaridou V, Papageorgiou G, Lu W, McDougall SR, Sboros V. Super-resolution ultrasound imaging of ischaemia flow: An in silico study. J Theor Biol 2025; 599:112018. [PMID: 39647660 DOI: 10.1016/j.jtbi.2024.112018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Revised: 10/29/2024] [Accepted: 12/01/2024] [Indexed: 12/10/2024]
Abstract
Super-resolution ultrasound (SRU) is a new ultrasound imaging mode that promises to facilitate the detection of microvascular disease by providing new vascular bio-markers that are directly linked to microvascular pathophysiology, thereby augmenting current knowledge and potentially enabling new treatment. Such a capability can be developed through thorough understanding as articulated by means of mathematical models. In this study, a 2D numerical flow model is adopted for generating flow adaptation in response to ischaemia, in order to determine the ability of SRU to register the resulting flow perturbations. The flow model results demonstrate that variations in flow behaviour in response to locally induced ischaemia can be significant throughout the entire vascular bed. Measured velocities have variations that are dependent on the location of ischaemia, with median values ranging between 2-7 mms-1. Moreover, the distinction between healthy and ischaemic networks are recorded accurately in the SRU results showing excellent agreement between SRU maps and the model. Up to 7-fold spatial resolution improvement to conventional contrast ultrasound was achieved in microbubble localisation while the detection precision and recall was consistently above 98%. The microbubble tracking precision was of a similar accuracy, whereas the recall was reduced (77%) under varying ischaemic impacted flow. Further, regions with velocities up to 30 mms-1 are in excellent agreement with SRU maps, while at regions that include a proportion of higher velocities, the median velocity values are within 1.28%-3.32% of the ground-truth. In conclusion, SRU is a highly promising methodology for the direct measurement of microvascular flow dynamics and may provide a valuable tool for the understanding and subsequent modelling of behaviour in the vascular bed.
Collapse
Affiliation(s)
- Lachlan Arthur
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, United Kingdom.
| | - Vasiliki Voulgaridou
- Translational Healthcare Technologies Team, Centre for Inflammation Research, University of Edinburgh, Edinburgh, EH16 4TJ, Scotland, United Kingdom.
| | - Georgios Papageorgiou
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, United Kingdom.
| | - Weiping Lu
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, United Kingdom.
| | - Steven R McDougall
- School of Energy, Geoscience, Infrastructure and Society, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, United Kingdom.
| | - Vassilis Sboros
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, Scotland, United Kingdom.
| |
Collapse
|
6
|
Chen X, Lowerison MR, Shin Y, Wang Y, Dong Z, You Q, Song P. Improved Microbubble Tracking for Super-Resolution Ultrasound Localization Microscopy using a Bi-Directional Long Short-term Memory Neural Network. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2025.02.10.637352. [PMID: 39990416 PMCID: PMC11844412 DOI: 10.1101/2025.02.10.637352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 02/25/2025]
Abstract
Ultrasound localization microscopy (ULM) enabled high-accuracy measurements of microvessel flow beyond the resolution limit of conventional ultrasound imaging by utilizing contrast microbubbles (MBs) as point targets. Robust tracking of MBs is an essential task for fast and high-quality ULM image reconstruction. Existing MB tracking methods suffer from challenging imaging scenarios such as high-density MB distributions, fast blood flow, and complex flow dynamics. Here we present a deep learning-based MB pairing and tracking method based on a bi-directional long short-term memory neural network for ULM. The proposed method integrates multiparametric MB characteristics to facilitate more robust and accurate MB pairing and tracking. The method was validated on a simulation data set, a tissue-mimicking flow phantom, and in vivo on a mouse and rat brain.
Collapse
Affiliation(s)
- Xi Chen
- Department of Electrical and Computer Engineering, Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61820 USA
| | | | - YiRang Shin
- Department of Electrical and Computer Engineering, Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61820 USA
| | - Yike Wang
- Department of Electrical and Computer Engineering, Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61820 USA
| | - Zhijie Dong
- Department of Electrical and Computer Engineering, Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61820 USA
| | - Qi You
- Department of Bioengineering, Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, IL 61820 USA
| | - Pengfei Song
- Department of Biomedical Engineering, Duke University, Durham, NC 27708 USA
| |
Collapse
|
7
|
Leconte A, Poree J, Rauby B, Wu A, Ghigo N, Xing P, Lee S, Bourquin C, Ramos-Palacios G, Sadikot AF, Provost J. A Tracking Prior to Localization Workflow for Ultrasound Localization Microscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2025; 44:698-710. [PMID: 39250374 DOI: 10.1109/tmi.2024.3456676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Abstract
Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting in detecting microbubbles (MB) in the frames before pairing them to generate tracks. While conventional LAT methods perform well at low concentrations, they suffer from longer acquisition times and degraded localization and tracking accuracy at higher concentrations, leading to biased angiogram reconstruction and velocity estimation. In this study, we propose a novel approach to address these challenges by reversing the current workflow. The proposed method, Tracking-and-Localization (TAL), relies on first tracking the MB and then performing localization. Through comprehensive benchmarking using both in silico and in vivo experiments and employing various metrics to quantify ULM angiography and velocity maps, we demonstrate that the TAL method consistently outperforms the reference LAT workflow. Moreover, when applied to DULM, TAL successfully extracts velocity variations along the cardiac cycle with improved repeatability. The findings of this work highlight the effectiveness of the TAL approach in overcoming the limitations of conventional LAT methods, providing enhanced ULM angiography and velocity imaging.
Collapse
|
8
|
Li J, Chen L, Wang R, Zhu J, Li A, Li J, Li Z, Luo W, Bai W, Ying T, Wei C, Sun D, Zheng Y. Ultrasound localization microscopy in the diagnosis of breast tumors and prediction of relevant histologic biomarkers associated with prognosis in humans: the protocol for a prospective, multicenter study. BMC Med Imaging 2025; 25:13. [PMID: 39780089 PMCID: PMC11715691 DOI: 10.1186/s12880-024-01535-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Accepted: 12/16/2024] [Indexed: 01/11/2025] Open
Abstract
BACKGROUND Benign and malignant breast tumors differ in their microvasculature morphology and distribution. Histologic biomarkers of malignant breast tumors are also correlated with the microvasculature. There is a lack of imaging technology for evaluating the microvasculature. Ultrasound localization microscopy (ULM) can provide detailed microvascular architecture at super-resolution. The objective of this trial is to explore the role of ULM in distinguishing benign from malignant breast tumors and to explore the correlations between ULM qualitative and quantitative parameters and histologic biomarkers in malignant breast tumors. METHODS/DESIGN This prospective and multicenter study will include 83 patients with breast tumors that will undergo ULM. 55 patients will be assigned to the malignant group, and 28 patients will be assigned to the benign group. The primary outcome is the differences in the qualitative parameters (microvasculature morphology, distribution, and flow direction) between benign and malignant breast tumors on ULM. Secondary outcomes include (1) differences in the quantitative parameters (microvasculature density, tortuosity, diameter, and flow velocity) between benign and malignant breast tumors based on ULM; (2) diagnostic performance of the qualitative parameters in distinguishing benign and malignant breast tumors; (3) diagnostic performance of the quantitative parameters in distinguishing benign and malignant breast tumors; (4) relationships between the qualitative parameters and histologic biomarkers in malignant breast tumors; (5) relationships between the quantitative parameters and histologic biomarkers in malignant breast tumors; and (6) the evaluation of inter-reader and intra-reader reproducibility. DISCUSSION Detecting vascularity in breast tumors is of great significance to differentiate benign from malignant tumors and to predict histologic biomarkers. These histologic biomarkers, such as ER, PR, HER2 and Ki67, are closely related to prognosis evaluation. This trial will provide maximum information about the microvasculature of breast tumors and thereby will help with the formulation of subsequent differential diagnosis and the prediction of histologic biomarkers. TRIAL REGISTRATION NUMBER/DATE Chinese Clinical Trial Registry ChiCTR2100048361/6th/July/2021. This study is a part of that clinical trial.
Collapse
Affiliation(s)
- Jia Li
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Lei Chen
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Ronghui Wang
- Department of Ultrasound, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Jiang Zhu
- Department of Ultrasound, Women's Hospital, Zhejiang University School of Medicine, Hangzhou, 310006, China
- Zhejiang Provincial Key Laboratory of Precision Diagnosis and Therapy for Major Gynecological Diseases, Women's Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, 310006, China
| | - Ao Li
- Department of Ultrasound, the First Affiliated Hospital of Nanjing Medical University, Nanjing, 210029, China
| | - Jianchun Li
- Cancer Center, Department of Ultrasound Medicine, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, 310014, China
| | - Zhaojun Li
- Department of Ultrasound, Shanghai General Hospital, Shanghai Jiaotong University School of Medicine, Shanghai, 200080, China
| | - Wen Luo
- Department of Ultrasound, Xijing Hospital, Fourth Military Medical University, Xi'an, 710032, China
| | - Wenkun Bai
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Tao Ying
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Cong Wei
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China.
| | - Di Sun
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China.
| | - Yuanyi Zheng
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China.
| |
Collapse
|
9
|
Xing P, Perrot V, Dominguez-Vargas AU, Porée J, Quessy S, Dancause N, Provost J. 3D ultrasound localization microscopy of the nonhuman primate brain. EBioMedicine 2025; 111:105457. [PMID: 39708427 PMCID: PMC11730257 DOI: 10.1016/j.ebiom.2024.105457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 10/18/2024] [Accepted: 11/04/2024] [Indexed: 12/23/2024] Open
Abstract
BACKGROUND Haemodynamic changes occur in stroke and neurodegenerative diseases. Developing imaging techniques allowing the in vivo visualisation and quantification of cerebral blood flow would help better understand the underlying mechanism of these cerebrovascular diseases. METHODS 3D ultrasound localization microscopy (ULM) is a recently developed technology that can map the microvasculature of the brain at large depth and has been mainly used until now in rodents. In this study, we tested the feasibility of 3D ULM of the nonhuman primate (NHP) brain with a single 256-channel programmable ultrasound scanner. FINDINGS We achieved a highly resolved vascular map of the macaque brain at large depth (down to 3 cm) in presence of craniotomy and durectomy using an 8-MHz multiplexed matrix probe. We were able to distinguish vessels as small as 26.9 μm. We also demonstrated that transcranial imaging of the macaque brain at similar depth was feasible using a 3-MHz probe and achieved a resolution of 60 μm. INTERPRETATION This work paves the way to clinical applications of 3D ULM. In particular, transcranial 3D ULM in humans could become a tool for the non-invasive study and monitoring of the brain cerebrovascular changes occurring in neurological diseases. FUNDING This work was supported by the New Frontier in Research Fund (NFRFE-2022-00590), by the Canada Foundation for Innovation under grant 38095, by the Natural Sciences and Engineering Research Council of Canada (NSERC) under discovery grant RGPIN-2020-06786, by Brain Canada under grant PSG2019, and by the Canadian Institutes of Health Research (CIHR) under grant PJT-156047 and MPI-452530. Computing support was provided by the Digital Research Alliance of Canada.
Collapse
Affiliation(s)
- Paul Xing
- Department of Engineering Physics, Polytechnique Montréal, Montreal, Canada
| | - Vincent Perrot
- Department of Engineering Physics, Polytechnique Montréal, Montreal, Canada
| | | | - Jonathan Porée
- Department of Engineering Physics, Polytechnique Montréal, Montreal, Canada
| | - Stephan Quessy
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montreal, Canada
| | - Numa Dancause
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montreal, Canada; Centre Interdisciplinaire de Recherche sur le Cerveau et l'apprentissage (CIRCA), Université de Montréal, Montreal, Canada
| | - Jean Provost
- Department of Engineering Physics, Polytechnique Montréal, Montreal, Canada; Montreal Heart Institute, Montreal, Canada.
| |
Collapse
|
10
|
Liu J, Liang M, Ma J, Jiang L, Chu H, Guo C, Yu J, Zong Y, Wan M. Microbubble tracking based on partial smoothing-based adaptive generalized labelled Multi-Bernoulli filter for super-resolution imaging. ULTRASONICS 2025; 145:107455. [PMID: 39332248 DOI: 10.1016/j.ultras.2024.107455] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 09/02/2024] [Accepted: 09/03/2024] [Indexed: 09/29/2024]
Abstract
Super-resolution ultrasound (SRUS) can image the vasculature at microscopic resolution according to microbubble (MB) localization, with velocity vector maps obtained based on MB tracking information. High MB concentrations can reduce the acquisition time of SRUS imaging, however adjacent and intersecting vessels are difficult to distinguish, thus decreasing resolution. Low acquisition frame rates affect the precision of flow velocity estimation. This study proposes a partial smoothing-based adaptive generalized labeled multi-Bernoulli filter (SAGLMB) to precisely track the MB motion at different flow velocities. SAGLMB employs a generalized labelled multi-Bernoulli filter (GLMB) for MB trajectory allocation to separate adjacent and intersecting vessels. Furthermore, the nonlinear motion of MB was predicted by an unscented Kalman filter, and a cardinalized probability hypothesis density filter was applied to suppress clutter interference. Finally, the trajectories were smoothed by unscented Rauch-Tung-Striebel to improve the resolution of the SRUS image. The simulation results demonstrate that SAGLMB outperforms the conventional bipartite graph-based tracking at high MB concentrations, achieving at least an 8.55 % improvement in the correctly paired precision, with 3 times increase in the structural similarity index measure. Moreover, SAGLMB can obtain more precise flow velocity estimations with a 4 times improvement than the conventional method. The SRUS results of rabbit kidney show that the proposed method significantly improves resolution of adjacent and intersecting vessels at higher MB concentrations and maintains this performance as the acquisition frame rate decreases. Furthermore, the rat brain microvascular network was reconstructed with 9.21 μm (λ/11.1) resolution. Therefore, SAGLMB can achieve robust SRUS imaging at high concentrations and low acquisition frame rates.
Collapse
Affiliation(s)
- Jiacheng Liu
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Meiling Liang
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Jinxuan Ma
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Liyuan Jiang
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Hanbing Chu
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Chao Guo
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Jianjun Yu
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China
| | - Yujin Zong
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China.
| | - Mingxi Wan
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of life Science and Technology, Xi'an Jiaotong University, Xi'an, PR China.
| |
Collapse
|
11
|
Bonciani G, Guidi F, Tortoli P, Giangrossi C, Dallai A, Boni E, Ramalli A. A Heterogeneous Ultrasound Open Scanner for the Real-Time Implementation of Computationally Demanding Imaging Methods. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2025; 72:100-108. [PMID: 39365713 DOI: 10.1109/tuffc.2024.3474091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/06/2024]
Abstract
Ultrasound (US) open scanners have recently boosted the development and validation of novel imaging techniques. They are usually split into hardware- or software-oriented systems, depending on whether they process the echo data using embedded field programmable gate arrays (FPGAs)/digital signal processors (DSPs) or a graphics processing unit (GPU) on a host personal computer (PC). The goal of this work was to realize a high-performance heterogeneous open scanner capable of leveraging the strengths of both hardware- and software-oriented systems. The elaboration power of the 256-channel ultrasound advanced open platform (ULA-OP 256) was further enhanced by embedding a compact co-processing (CP) GPU system-on-module (SoM). By carefully avoiding latencies and overheads through low-level optimization work, an efficient peripheral component interconnect express (PCIe) communication interface was established between the GPU and the processing devices onboard the ULA-OP 256. As a proof of concept of the enhanced system, the high frame rate (HFR) color flow mapping (CFM) technique was implemented on the GPU SoM and tested. Compared to a previous DSP-based implementation, higher real-time frame rates were achieved together with unprecedented flexibility in setting crucial parameters such as the ensemble length (EL). For example, by setting EL =64 and a continuous-time high-pass filter (HPF), the flow was investigated with high temporal and spatial resolution in the femoral vein bifurcation (frame rate =1.1 kHz) and carotid artery bulb (4.3 kHz), highlighting the flow disturbances due to valve aperture and secondary velocity components, respectively. The results of this work promote the development of other computational-expensive processing algorithms in real time and may inspire the next generation of the US high-performance heterogeneous scanners.
Collapse
|
12
|
Ren J, Li J, Chen S, Liu Y, Ta D. Unveiling the potential of ultrasound in brain imaging: Innovations, challenges, and prospects. ULTRASONICS 2025; 145:107465. [PMID: 39305556 DOI: 10.1016/j.ultras.2024.107465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2024] [Revised: 07/30/2024] [Accepted: 09/08/2024] [Indexed: 11/12/2024]
Abstract
Within medical imaging, ultrasound serves as a crucial tool, particularly in the realms of brain imaging and disease diagnosis. It offers superior safety, speed, and wider applicability compared to Magnetic Resonance Imaging (MRI) and X-ray Computed Tomography (CT). Nonetheless, conventional transcranial ultrasound applications in adult brain imaging face challenges stemming from the significant acoustic impedance contrast between the skull bone and soft tissues. Recent strides in ultrasound technology encompass a spectrum of advancements spanning tissue structural imaging, blood flow imaging, functional imaging, and image enhancement techniques. Structural imaging methods include traditional transcranial ultrasound techniques and ultrasound elastography. Transcranial ultrasound assesses the structure and function of the skull and brain, while ultrasound elastography evaluates the elasticity of brain tissue. Blood flow imaging includes traditional transcranial Doppler (TCD), ultrafast Doppler (UfD), contrast-enhanced ultrasound (CEUS), and ultrasound localization microscopy (ULM), which can be used to evaluate the velocity, direction, and perfusion of cerebral blood flow. Functional ultrasound imaging (fUS) detects changes in cerebral blood flow to create images of brain activity. Image enhancement techniques include full waveform inversion (FWI) and phase aberration correction techniques, focusing on more accurate localization and analysis of brain structures, achieving more precise and reliable brain imaging results. These methods have been extensively studied in clinical animal models, neonates, and adults, showing significant potential in brain tissue structural imaging, cerebral hemodynamics monitoring, and brain disease diagnosis. They represent current hotspots and focal points of ultrasound medical research. This review provides a comprehensive summary of recent developments in brain imaging technologies and methods, discussing their advantages, limitations, and future trends, offering insights into their prospects.
Collapse
Affiliation(s)
- Jiahao Ren
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Jian Li
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Shili Chen
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China
| | - Yang Liu
- State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, 92 Weijin Road, Tianjin 300072, China; International Institute for Innovative Design and Intelligent Manufacturing of Tianjin University in Zhejiang, Shaoxing 312000, China.
| | - Dean Ta
- School of Information Science and Technology, Fudan University, Shanghai 200433, China.
| |
Collapse
|
13
|
Jones RM, DeRuiter RM, Lee HR, Munot S, Belgharbi H, Santibanez F, Favorov OV, Dayton PA, Pinton GF. Non-invasive 4D transcranial functional ultrasound and ultrasound localization microscopy for multimodal imaging of neurovascular response. Sci Rep 2024; 14:30240. [PMID: 39747143 PMCID: PMC11697013 DOI: 10.1038/s41598-024-81243-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Accepted: 11/25/2024] [Indexed: 01/04/2025] Open
Abstract
A long-standing goal of neuroimaging is the non-invasive volumetric assessment of whole brain function and structure at high spatial and temporal resolutions. Functional ultrasound (fUS) and ultrasound localization microscopy (ULM) are rapidly emerging techniques that promise to bring advanced brain imaging and therapy to the clinic with the safety and low-cost advantages associated with ultrasound. fUS has been used to study cerebral hemodynamics at high temporal resolutions while ULM has been used to study cerebral microvascular structure at high spatial resolutions. These two methods have complementary spatio-temporal characteristics, making them ideally suited for multimodal imaging, but both suffer from limitations associated with transcranial ultrasound imaging. Here, these two methods are combined on the same data acquisition, completely non-invasively, using contrast-enhancements, which solves the dual challenges of sensitivity during transcranial imaging and the ability to implement super-resolution. From this combined approach, the cerebral blood flow, activated brain region, brain connectivity, vessel diameter, and vessel velocity were all calculated from the same data acquisition. During stimulation periods, there was a statistically significant (p<0.0001) increase in cerebral blood flow, diameter, and global velocity, but a decrease in velocity in the activated region. Additionally, the global flow increased (p=0.11) and connectivity decreased (24.7%) when compared to baseline. This multimodal approach allows for the study of the relationship between cerebral hemodynamics (30 ms resolution) and the microvasculature (14.6 μm resolution) using one ultrasound scan.
Collapse
Affiliation(s)
- Rebecca M Jones
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Ryan M DeRuiter
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Hanjoo R Lee
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Saachi Munot
- Department of Applied Physics, Stanford University, Stanford, CA, 94305, USA
| | - Hatim Belgharbi
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Francisco Santibanez
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Oleg V Favorov
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Paul A Dayton
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA
| | - Gianmarco F Pinton
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, 27599, USA.
| |
Collapse
|
14
|
Amin Naji M, Taghavi I, Vilain Thomsen E, Bent Larsen N, Arendt Jensen J. Underestimation of Flow Velocity in 2-D Super-Resolution Ultrasound Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1844-1854. [PMID: 38896528 DOI: 10.1109/tuffc.2024.3416512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
Velocity estimation in ultrasound imaging is a technique to measure the speed and direction of blood flow. The flow velocity in small blood vessels, i.e., arterioles, venules, and capillaries, can be estimated using super-resolution ultrasound imaging (SRUS). However, the vessel width in SRUS is relatively small compared with the full-width-half-maximum of the ultrasound beam in the elevation direction, which directly impacts the velocity estimation. By taking into consideration the small vessel widths in SRUS, it is hypothesized that the velocity is underestimated in 2-D SRUS when the vessel diameter is smaller than the full width at half maximum elevation resolution of the transducer (FWHMy). A theoretical model is introduced to show that the velocity of a 3-D parabolic velocity profile is underestimated by up to 33% in 2-D SRUS, if the width of the vessel is smaller than FWHMy. This model was tested using Field II simulations and 3-D-printed micro-flow hydrogel phantom measurements. A Verasonics Vantage 256 scanner and a GE L8-18i-D linear array transducer with FWHMy of approximately at the elevation focus were used in the simulations and measurements. Simulations of different parabolic velocity profiles showed that the velocity underestimation was 36.8% % (mean ± standard deviation). The measurements showed that the velocity was underestimated by 30% %. Moreover, the results of vessel diameters, ranging from FWHMy to FWHMy, indicate that velocities are estimated according to the theoretical model. The theoretical model can, therefore, be used for the compensation of velocity estimates under these circumstances.
Collapse
|
15
|
Qiang Y, Huang W, Liang W, Liu R, Han X, Pan Y, Wang N, Yu Y, Zhang Z, Sun L, Qiu W. An adaptive spatiotemporal filter for ultrasound localization microscopy based on density canopy clustering. ULTRASONICS 2024; 144:107446. [PMID: 39213718 DOI: 10.1016/j.ultras.2024.107446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2024] [Revised: 07/07/2024] [Accepted: 08/22/2024] [Indexed: 09/04/2024]
Abstract
Ultrasound Localization Microscopy (ULM) facilitates structural and hemodynamic imaging of microvessels with a resolution of tens of micrometers. In ULM, the extraction of effective microbubble signals is crucial for image quality. Singular Value Decomposition (SVD) is currently the most prevalent method for microbubble signal extraction in ULM. Most existing ULM studies employ a fixed SVD filter threshold using empirical values which will lead to imaging quality degradation due to the insufficient separation of blood signals. In this study, we propose an adaptive and non-threshold SVD filter based on canopy-density clustering, termed DCC-SVD. This filter automatically classifies the components of the SVD based on the density of their spatiotemporal features, eliminating the need for parameter selection. In in vitro tube phantom, DCC-SVD demonstrated its ability to adaptive separation of blood and bubble signal at varying microbubble concentrations and flow rates. We compared the proposed DCC-SVD method with the Block-match 3D (BM3D) filter and a classical adaptive method called spatial similarity matrix (SSM), using concentration-variable in vivo rat brain data, as well as open-source rat kidney and mouse tumor datasets. The proposed DCC-SVD improved the global spatial resolution by approximately 4 μm from 30.39 μm to 26.02 μm. It also captured vessel structure absent in images obtained by other methods and yielded a smoother vessel intensity profile, making it a promising spatiotemporal filter for ULM imaging.
Collapse
Affiliation(s)
- Yu Qiang
- The Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China; The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Wenyue Huang
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen, China
| | - Wenjie Liang
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Rong Liu
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Xuan Han
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yue Pan
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ningyuan Wang
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yanyan Yu
- Department of Biomedical Engineering, Shenzhen University, Shenzhen, China.
| | - Zhiqiang Zhang
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen, China.
| | - Lei Sun
- The Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China.
| | - Weibao Qiu
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China; Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen, China.
| |
Collapse
|
16
|
Rauby B, Xing P, Gasse M, Provost J. Deep Learning in Ultrasound Localization Microscopy: Applications and Perspectives. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1765-1784. [PMID: 39288061 DOI: 10.1109/tuffc.2024.3462299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/19/2024]
Abstract
Ultrasound localization microscopy (ULM) is a novel super-resolution imaging technique that can image the vasculature in vivo at depth with resolution far beyond the conventional limit of diffraction. By relying on the localization and tracking of clinically approved microbubbles injected in the blood stream, ULM can provide not only anatomical visualization but also hemodynamic quantification of the microvasculature. Several deep learning approaches have been proposed to address challenges in ULM including denoising, improving microbubble localization, estimating blood flow velocity, or performing aberration correction. Proposed deep learning methods often outperform their conventional counterparts by improving image quality and reducing processing time. In addition, their robustness to high concentrations of microbubbles can lead to reduced acquisition times in ULM, addressing a major hindrance to ULM clinical application. Herein, we propose a comprehensive review of the diversity of deep learning applications in ULM focusing on approaches assuming a sparse microbubble distribution. We first provide an overview of how existing studies vary in the constitution of their datasets or in the tasks targeted by the deep learning model. We also take a deeper look into the numerous approaches that have been proposed to improve the localization of microbubbles since they differ highly in their formulation of the optimization problem, their evaluation, or their network architectures. We finally discuss the current limitations and challenges of these methods, as well as the promises and potential of deep learning for ULM in the future.
Collapse
|
17
|
Zhang G, Gu W, Yue Y, Tang MX, Luo J, Liu X, Ta D. ULM-MbCNRT: In Vivo Ultrafast Ultrasound Localization Microscopy by Combining Multibranch CNN and Recursive Transformer. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1735-1751. [PMID: 38607709 DOI: 10.1109/tuffc.2024.3388102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/14/2024]
Abstract
Ultrasound localization microscopy (ULM) overcomes the acoustic diffraction limit by localizing tiny microbubbles (MBs), thus enabling the microvascular to be rendered at subwavelength resolution. Nevertheless, to obtain such superior spatial resolution, it is necessary to spend tens of seconds gathering numerous ultrasound (US) frames to accumulate the MB events required, resulting in ULM imaging still suffering from tradeoffs between imaging quality, data acquisition time, and data processing speed. In this article, we present a new deep learning (DL) framework combining multibranch convolutional neural network (CNN) and recursive transformer (RT), termed ULM-MbCNRT, that is capable of reconstructing a super-resolution (SR) image directly from a temporal mean low-resolution image generated by averaging much fewer raw US frames, i.e., implement an ultrafast ULM imaging. To evaluate the performance of ULM-MbCNRT, a series of numerical simulations and in vivo experiments are carried out. Numerical simulation results indicate that ULM-MbCNRT achieves high-quality ULM imaging with ~10-fold reduction in data acquisition time and ~130-fold reduction in computation time compared to the previous DL method (e.g., the modified subpixel CNN, ULM-mSPCN). For the in vivo experiments, when comparing to the ULM-mSPCN, ULM-MbCNRT allows ~37-fold reduction in data acquisition time (~0.8 s) and ~2134-fold reduction in computation time (~0.87 s) without sacrificing spatial resolution. It implies that ultrafast ULM imaging holds promise for observing rapid biological activity in vivo, potentially improving the diagnosis and monitoring of clinical conditions.
Collapse
|
18
|
Tan Q, Riemer K, Hansen-Shearer J, Yan J, Toulemonde M, Taylor L, Yan S, Dunsby C, Weinberg PD, Tang MX. Transcutaneous Imaging of Rabbit Kidney Using 3-D Acoustic Wave Sparsely Activated Localization Microscopy With a Row-Column-Addressed Array. IEEE Trans Biomed Eng 2024; 71:3446-3456. [PMID: 38990741 DOI: 10.1109/tbme.2024.3426487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
OBJECTIVE Super-resolution ultrasound (SRUS) imaging through localizing and tracking microbubbles, also known as ultrasound localization microscopy (ULM), can produce sub-diffraction resolution images of micro-vessels. We have recently demonstrated 3-D selective SRUS with a matrix array and phase change contrast agents (PCCAs). However, this method is limited to a small field of view (FOV) and by the complex hardware required. METHOD This study proposed 3-D acoustic wave sparsely activated localization microscopy (AWSALM) using PCCAs and a 128+128 row-column-addressed (RCA) array, which offers ultrafast acquisition with over 6 times larger FOV and 4 times reduction in hardware complexity than a 1024-element matrix array. We first validated this method on an in-vitro microflow phantom and subsequently demonstrated non-invasively on a rabbit kidney in-vivo. RESULTS Our results show that 3-D AWSALM images of the phantom covering a mm volume can be generated under 5 seconds with an 8 times resolution improvement over the system point spread function. The full volume of the rabbit kidney can be covered to generate 3-D microvascular structure, flow speed and direction super-resolution maps under 15 seconds, combining the large FOV of RCA with the high resolution of SRUS. Additionally, 3-D AWSALM is selective and can visualize the microvasculature within the activation volume and downstream vessels in isolation. Sub-sets of the kidney microvasculature can be imaged through selective activation of PCCAs. CONCLUSION Our study demonstrates large FOV 3-D AWSALM using an RCA probe. SIGNIFICANCE 3-D AWSALM offers an unique in-vivo imaging tool for fast, selective and large FOV vascular flow mapping.
Collapse
|
19
|
Lan H, Huang L, Wang Y, Wang R, Wei X, He Q, Luo J. Deep Power-Aware Tunable Weighting for Ultrasound Microvascular Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1701-1713. [PMID: 39480714 DOI: 10.1109/tuffc.2024.3488729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2024]
Abstract
Ultrasound microvascular imaging (UMI), including ultrafast power Doppler imaging (uPDI) and ultrasound localization microscopy (ULM), obtains blood flow information through plane wave (PW) transmissions at high frame rates. However, low signal-to-noise ratio (SNR) of PWs causes low image quality. Adaptive beamformers have been proposed to suppress noise energy to achieve higher image quality accompanied by increasing computational complexity. Deep learning (DL) leverages powerful hardware capabilities to enable rapid implementation of noise suppression at the cost of flexibility. To enhance the applicability of DL-based methods, in this work, we propose a deep power-aware tunable (DPT) weighting (i.e., postfilter) for delay-and-sum (DAS) beamforming to improve UMI by enhancing PW images. The model, called Yformer, is a hybrid structure combining convolution and Transformer. With the DAS beamformed and compounded envelope image as input, Yformer can estimate both noise power and signal power. Furthermore, we utilize the obtained powers to compute pixel-wise weights by introducing a tunable noise control factor (NCF), which is tailored for improving the quality of different UMI applications. In vivo experiments on the rat brain demonstrate that Yformer can accurately estimate the powers of noise and signal with the structural similarity index measure (SSIM) higher than 0.95. The performance of the DPT weighting is comparable to that of superior adaptive beamformer in uPDI with low computational cost. The DPT weighting was then applied to four different datasets of ULM, including public simulation, public rat brain, private rat brain, and private rat liver datasets, showing excellent generalizability using the model trained by the private rat brain dataset only. In particular, our method indirectly improves the resolution of liver ULM from 25.24 to m by highlighting small vessels. In addition, the DPT weighting exhibits more details of blood vessels with faster processing, which has the potential to facilitate the clinical applications of high-quality UMI.
Collapse
|
20
|
Parra Raad J, Lock D, Liu YY, Solomon M, Peralta L, Christensen-Jeffries K. Optically Validated Microvascular Phantom for Super-Resolution Ultrasound Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1833-1843. [PMID: 39475744 DOI: 10.1109/tuffc.2024.3484770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Super-resolution ultrasound (SRUS) visualizes microvasculature beyond the ultrasound (US) diffraction limit (wavelength( )/2) by localizing and tracking spatially isolated microbubble (MB) contrast agents. SRUS phantoms typically consist of simple tube structures, where diameter channels below m are not available. Furthermore, these phantoms are generally fragile and unstable, have limited ground truth validation, and their simple structure limits the evaluation of SRUS algorithms. To aid SRUS development, robust and durable phantoms with known and physiologically relevant microvasculature are needed for repeatable SRUS testing. This work proposes a method to fabricate durable microvascular phantoms that allow optical gauging for SRUS validation. The methodology used a microvasculature negative print embedded in a Polydimethylsiloxane (PDMS) to fabricate a microvascular phantom. Branching microvascular phantoms with variable microvascular density were demonstrated with optically validated vessel diameters down to m ( ; m). SRUS imaging was performed and validated with optical measurements. The average SRUS error was m ( ) with a standard deviation error of m. The average error decreased to m ( ) once the number of localized MBs surpassed 1000 per estimated diameter. In addition, less than 10% variance of acoustic and optical properties and the mechanical toughness of the phantoms measured a year after fabrication demonstrated their long-term durability. This work presents a method to fabricate durable and optically validated complex microvascular phantoms which can be used to quantify SRUS performance and facilitate its further development.
Collapse
|
21
|
Sobolewski J, Dencks S, Schmitz G. Influence of Image Discretization and Patch Size on Microbubble Localization Precision. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1823-1832. [PMID: 39401113 DOI: 10.1109/tuffc.2024.3479710] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
For ultrasound localization microscopy, the localization of microbubbles (MBs) is an essential part to obtain super-resolved maps of the vasculature. This article analyzes the impact of image discretization and patch size on the precision of different MB localization methods to reconcile different observations from previous studies, provide an estimate of feasible localization precision, and derive guidelines for an optimal parameter selection. For this purpose, the images of MBs were simulated with Gaussian point-spread functions (PSFs) of varying width parameter at randomly generated subpixel positions, and Rician distributed noise was added. Four localization methods were tested on the patches of different sizes (number of pixels ): Gaussian fit (GF), radial symmetry (RS) method, calculation of center of mass (CoM), and peak detection (PD). Additionally, the Cramér-Rao lower bound (CRLB) for the given estimation problem was calculated. Our results show that the localization precision is strongly influenced by the ratio of the PSF width parameter to the pixel size , as well as the patch size N. The best parameter combination depends on the localization method. Generally, very small ratios as well as large ratios in combination with small N lead to performance degradation. The GF as a representative of a model-based fit comes close to the CRLB and always performs best for the ratios given by image discretization if N is adapted to the PSF. To achieve good results with the GF and the RS method, a good rule of thumb is to set the pixel sizes and the patch sizes .
Collapse
|
22
|
Dencks S, Lisson T, Oblisz N, Kiessling F, Schmitz G. Ultrasound Localization Microscopy Precision of Clinical 3-D Ultrasound Systems. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1677-1689. [PMID: 39321018 DOI: 10.1109/tuffc.2024.3467391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/27/2024]
Abstract
Ultrasound localization microscopy (ULM) is becoming well established in preclinical applications. For its translation into clinical practice, the localization precision achievable with commercial ultrasound (US) scanners is crucial-especially with volume imaging, which is essential for dealing with out-of-plane motion. Here, we propose an easy-to-perform method to estimate the localization precision of 3-D US scanners. With this method, we evaluated imaging sequences of the Philips Epiq 7 US device using the X5-1 and the XL14-3 matrix transducers and also tested different localization methods. For the X5-1 transducer, the best lateral, elevational, and axial precision was 109, 95, and m for one contrast mode, and 29, 22, and m for the other. The higher frequency XL14-3 transducer yielded precisions of 17, 38, and m using the harmonic imaging mode. Although the center of mass was the most robust localization method also often providing the best precision, the localization method has only a minor influence on the localization precision compared to the impact by the imaging sequence and transducer. The results show that with one of the imaging modes of the X5-1 transducer, precisions comparable to the XL14-3 transducer can be achieved. However, due to localization precisions worse than m, reconstruction of the microvasculature at the capillary level will not be possible. These results show the importance of evaluating the localization precision of imaging sequences from different US transducers or scanners in all directions before using them for in vivo measurements.
Collapse
|
23
|
Zhang Y, Zhou W, Huang L, Shao Y, Luo A, Luo J, Peng B. Efficient Microbubble Trajectory Tracking in Ultrasound Localization Microscopy Using a Gated Recurrent Unit-Based Multitasking Temporal Neural Network. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1714-1734. [PMID: 38976462 DOI: 10.1109/tuffc.2024.3424955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/10/2024]
Abstract
Ultrasound localization microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical tradeoff between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps such as pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the gated recurrent unit-based multitasking temporal neural network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. In addition, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer replacements to systematically evaluate the performance of various temporal neural networks, including recurrent neural network (RNN), long short-term memory network (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. In addition, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. The model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.
Collapse
|
24
|
Coudert A, Denis L, Chavignon A, Bodard S, Naveau M, Sistiaga PP, Saulnier R, Orset C, Vivien D, Chappard C, Couture O. 3-D Transcranial Ultrasound Localization Microscopy Reveals Major Arteries in the Sheep Brain. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1666-1676. [PMID: 39052461 DOI: 10.1109/tuffc.2024.3432998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/27/2024]
Abstract
Cerebral circulation ensures the proper functioning of the entire human body, and its interruption, i.e., stroke, leads to irreversible damage. However, tools for observing cerebral circulation are still lacking. Although MRI and computed tomography (CT) scans serve as conventional methods, their accessibility remains a challenge, prompting exploration into alternative, portable, and nonionizing imaging solutions like ultrasound with reduced costs. While ultrasound localization microscopy (ULM) displays potential in high-resolution vessel imaging, its 2-D constraints limit its emergency utility. This study delves into the feasibility of 3-D ULM with multiplexed probe for transcranial vessel imaging in sheep brains, emulating human skull characteristics. Three sheep underwent 3-D ULM imaging, compared with angiographic MRI, while skull characterization was conducted in vivo using ultrashort bone MRI sequences and ex vivo via micro-CT. The study showcased 3-D ULM's ability to highlight vessels, down to the circle of Willis, yet within a confined 3-D field of view. Future enhancements in signal, aberration correction, and human trials hold promise for a portable, volumetric, transcranial ultrasound angiography system.
Collapse
|
25
|
Arthur LJMB, Voulgaridou V, Butler MB, Papageorgiou G, Lu W, McDougall SR, Sboros V. Comparison of contrast-enhanced ultrasound imaging (CEUS) and super-resolution ultrasound (SRU) for the quantification of ischaemia flow redistribution: a theoretical study. Phys Med Biol 2024; 69:235006. [PMID: 39536710 PMCID: PMC11583374 DOI: 10.1088/1361-6560/ad9231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 11/13/2024] [Indexed: 11/16/2024]
Abstract
The study of microcirculation can reveal important information related to pathology. Focusing on alterations that are represented by an obstruction of blood flow in microcirculatory regions may provide an insight into vascular biomarkers. The current in silico study assesses the capability of contrast enhanced ultrasound (CEUS) and super-resolution ultrasound imaging (SRU) flow-quantification to study occlusive actions in a microvascular bed, particularly the ability to characterise known and model induced flow behaviours. The aim is to investigate theoretical limits with the use of CEUS and SRU in order to propose realistic biomarker targets relevant for clinical diagnosis. Results from CEUS flow parameters display limitations congruent with prior investigations. Conventional resolution limits lead to signals dominated by large vessels, making discrimination of microvasculature specific signals difficult. Additionally, some occlusions lead to weakened parametric correlation against flow rate in the remainder of the network. Loss of correlation is dependent on the degree to which flow is redistributed, with comparatively minor redistribution correlating in accordance with ground truth measurements for change in mean transit time,dMTT(CEUS,R = 0.85; GT,R = 0.82) and change in peak intensity,dIp(CEUS,R = 0.87; GT,R = 0.96). Major redistributions, however, result in a loss of correlation, demonstrating that the effectiveness of time-intensity curve parameters is influenced by the site of occlusion. Conversely, results from SRU processing provides accurate depiction of the anatomy and dynamics present in the vascular bed, that extends to individual microvessels. Correspondence between model vessel structure displayed in SRU maps with the ground truth was>91%for cases of minor and major flow redistributions. In conclusion, SRU appears to be a highly promising technology in the quantification of subtle flow phenomena due ischaemia induced vascular flow redistribution.
Collapse
Affiliation(s)
- Lachlan J M B Arthur
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| | - Vasiliki Voulgaridou
- Translational Healthcare Technologies Team, Centre for Inflammation Research, University of Edinburgh, Edinburgh EH16 4TJ, United Kingdom
| | - Mairead B Butler
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| | - Georgios Papageorgiou
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| | - Weiping Lu
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| | - Steven R McDougall
- School of Energy, Geoscience, Infrastructure and Society, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| | - Vassilis Sboros
- School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh EH14 4AS, United Kingdom
| |
Collapse
|
26
|
Nyúl-Tóth Á, Negri S, Sanford M, Jiang R, Patai R, Budda M, Petersen B, Pinckard J, Chandragiri SS, Shi H, Reyff Z, Ballard C, Gulej R, Csik B, Ferrier J, Balasubramanian P, Yabluchanskiy A, Cleuren A, Conley S, Ungvari Z, Csiszar A, Tarantini S. Novel intravital approaches to quantify deep vascular structure and perfusion in the aging mouse brain using ultrasound localization microscopy (ULM). J Cereb Blood Flow Metab 2024; 44:1378-1396. [PMID: 38867576 PMCID: PMC11542130 DOI: 10.1177/0271678x241260526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 04/15/2024] [Accepted: 05/16/2024] [Indexed: 06/14/2024]
Abstract
Intra-vital visualization of deep cerebrovascular structures and blood flow in the aging brain has been a difficult challenge in the field of neurovascular research, especially when considering the key role played by the cerebrovasculature in the pathogenesis of both vascular cognitive impairment and dementia (VCID) and Alzheimer's disease (AD). Traditional imaging methods face difficulties with the thicker skull of older brains, making high-resolution imaging and cerebral blood flow (CBF) assessment challenging. However, functional ultrasound (fUS) imaging, an emerging non-invasive technique, provides real-time CBF insights with notable spatial-temporal resolution. This study introduces an enhanced longitudinal fUS method for aging brains. Using elderly (24-month C57BL/6) mice, we detail replacing the skull with a polymethylpentene window for consistent fUS imaging over extended periods. Ultrasound localization mapping (ULM), involving the injection of a microbubble (<<10 μm) suspension allows for recording of high-resolution microvascular vessels and flows. ULM relies on the localization and tracking of single circulating microbubbles in the blood flow. A FIJI-based analysis interprets these high-quality ULM visuals. Testing on older mouse brains, our method successfully unveils intricate vascular specifics even in-depth, showcasing its utility for longitudinal studies that require ongoing evaluations of CBF and vascular aspects in aging-focused research.
Collapse
Affiliation(s)
- Ádám Nyúl-Tóth
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral School of Basic and Translational Medicine/Department of Public Health, Semmelweis University, Budapest, Hungary
| | - Sharon Negri
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Stephenson Cancer Center, University of Oklahoma, Oklahoma City, OK, USA
| | - Madison Sanford
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Stephenson Cancer Center, University of Oklahoma, Oklahoma City, OK, USA
| | - Raymond Jiang
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Roland Patai
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Madeline Budda
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Department of Cellular Biology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Benjamin Petersen
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Jessica Pinckard
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Department of Cellular Biology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Siva Sai Chandragiri
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Helen Shi
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Zeke Reyff
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Cade Ballard
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Rafal Gulej
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Boglarka Csik
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Stephenson Cancer Center, University of Oklahoma, Oklahoma City, OK, USA
| | | | - Priya Balasubramanian
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Andriy Yabluchanskiy
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Stephenson Cancer Center, University of Oklahoma, Oklahoma City, OK, USA
| | - Audrey Cleuren
- Cardiovascular Biology Research Program, Oklahoma Medical Research Foundation, Oklahoma City, OK, USA
| | - Shannon Conley
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Department of Cellular Biology, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Zoltan Ungvari
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral School of Basic and Translational Medicine/Department of Public Health, Semmelweis University, Budapest, Hungary
- Department of Public Health, Semmelweis University, Semmelweis University, Budapest, Hungary
- Department of Health Promotion Sciences, College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Anna Csiszar
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- International Training Program in Geroscience, Doctoral School of Basic and Translational Medicine/Department of Public Health, Semmelweis University, Budapest, Hungary
| | - Stefano Tarantini
- Vascular Cognitive Impairment, Neurodegeneration and Healthy Brain Aging Program, Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Oklahoma Center for Geroscience and Healthy Brain Aging, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
- Stephenson Cancer Center, University of Oklahoma, Oklahoma City, OK, USA
- Department of Health Promotion Sciences, College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| |
Collapse
|
27
|
Shrestha B, Stern NB, Zhou A, Dunn A, Porter T. Current trends in the characterization and monitoring of vascular response to cancer therapy. Cancer Imaging 2024; 24:143. [PMID: 39438891 PMCID: PMC11515715 DOI: 10.1186/s40644-024-00767-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 08/26/2024] [Indexed: 10/25/2024] Open
Abstract
Tumor vascular physiology is an important determinant of disease progression as well as the therapeutic outcome of cancer treatment. Angiogenesis or the lack of it provides crucial information about the tumor's blood supply and therefore can be used as an index for cancer growth and progression. While standalone anti-angiogenic therapy demonstrated limited therapeutic benefits, its combination with chemotherapeutic agents improved the overall survival of cancer patients. This could be attributed to the effect of vascular normalization, a dynamic process that temporarily reverts abnormal vasculature to the normal phenotype maximizing the delivery and intratumor distribution of chemotherapeutic agents. Longitudinal monitoring of vascular changes following antiangiogenic therapy can indicate an optimal window for drug administration and estimate the potential outcome of treatment. This review primarily focuses on the status of various imaging modalities used for the longitudinal characterization of vascular changes before and after anti-angiogenic therapies and their clinical prospects.
Collapse
Affiliation(s)
- Binita Shrestha
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA.
| | - Noah B Stern
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
| | - Annie Zhou
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
| | - Andrew Dunn
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
| | - Tyrone Porter
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
| |
Collapse
|
28
|
Lowerison MR, Wang Y, Lin BZ, Huang Z, Yan D, Shin Y, Song P. Capillary-scale Microvessel Imaging with High-frequency Ultrasound Localization Microscopy in Mouse Brain. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.09.19.613950. [PMID: 39345604 PMCID: PMC11430000 DOI: 10.1101/2024.09.19.613950] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/01/2024]
Abstract
Ultrasound localization microscopy is a super-resolution vascular imaging technique which has garnered substantial interest as a tool for small animal neuroimaging, neuroscience research, and the characterization of vascular pathologies. In the pursuit of increasingly high-fidelity reconstructions of microvasculature, there remains several outstanding questions concerning this sub-diffraction imaging technology, including the accurate reconstruction of microvessels approaching the capillary scale and the pragmatic challenges associated with long data acquisition times. In the context of small animal neurovascular imaging, we posit that increasing the ultrasound imaging frequency is a straightforward approach to enable higher concentrations of microbubble contrast agents, thus increasing the likelihood of microvascular/capillary mapping and decreasing the imaging duration. We demonstrate that higher frequency imaging results in improved ULM fidelity and more efficient microbubble localization due to a smaller microbubble point-spread function that is easier to localize, and which can achieve a higher localizable concentration within the same unit volume of tissue. A select example of in vivo capillary-level vascular reconstruction is demonstrated for the highest frequency imaging probe, which has substantial implications for neuroscientists investigating microvascular function in disease states, regulation, and brain development. High frequency ULM yielding a spatial resolution of 7.1μm, as measured by Fourier ring correlation, throughout the entire depth of the brain, highlighting this technology as a highly relevant tool for neuroimaging research.
Collapse
|
29
|
Caudoux M, Demeulenaere O, Poree J, Sauvage J, Mateo P, Ghaleh B, Flesch M, Ferin G, Tanter M, Deffieux T, Papadacci C, Pernot M. Curved Toroidal Row Column Addressed Transducer for 3D Ultrafast Ultrasound Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3279-3291. [PMID: 38640053 DOI: 10.1109/tmi.2024.3391689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/21/2024]
Abstract
3D Imaging of the human heart at high frame rate is of major interest for various clinical applications. Electronic complexity and cost has prevented the dissemination of 3D ultrafast imaging into the clinic. Row column addressed (RCA) transducers provide volumetric imaging at ultrafast frame rate by using a low electronic channel count, but current models are ill-suited for transthoracic cardiac imaging due to field-of-view limitations. In this study, we proposed a mechanically curved RCA with an aperture adapted for transthoracic cardiac imaging ( 24×16 mm2). The RCA has a toroidal curved surface of 96 elements along columns (curvature radius rC = 4.47 cm) and 64 elements along rows (curvature radius rR = 3 cm). We implemented delay and sum beamforming with an analytical calculation of the propagation of a toroidal wave which was validated using simulations (Field II). The imaging performance was evaluated on a calibrated phantom. Experimental 3D imaging was achieved up to 12 cm deep with a total angular aperture of 30° for both lateral dimensions. The Contrast-to-Noise ratio increased by 12 dB from 2 to 128 virtual sources. Then, 3D Ultrasound Localization Microscopy (ULM) was characterized in a sub-wavelength tube diameter. Finally, 3D ULM was demonstrated on a perfused ex-vivo swine heart to image the coronary microcirculation.
Collapse
|
30
|
Ghigo N, Ramos-Palacios G, Bourquin C, Xing P, Wu A, Cortés N, Ladret H, Ikan L, Casanova C, Porée J, Sadikot A, Provost J. Dynamic Ultrasound Localization Microscopy Without ECG-Gating. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:1436-1448. [PMID: 38969526 DOI: 10.1016/j.ultrasmedbio.2024.05.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 05/04/2024] [Accepted: 05/22/2024] [Indexed: 07/07/2024]
Abstract
OBJECTIVE Dynamic Ultrasound Localization Microscopy (DULM) has first been developed for non-invasive Pulsatility measurements in the rodent brain. DULM relies on the localization and tracking of microbubbles (MBs) injected into the bloodstream, to obtain highly resolved velocity and density cine-loops. Previous DULM techniques required ECG-gating, limiting its application to specific datasets, and increasing acquisition time. The objective of this study is to eliminate the need for ECG-gating in DULM experiments by introducing a motion-matching method for time registration. METHODS We developed a motion-matching algorithm based on tissue Doppler that leverages the cyclic tissue motion within the brain. Tissue Doppler was estimated for each group of frames in the acquisitions, at multiple locations identified as local maxima in the skin above the skull. Subsequently, each group of frames was time-registered to a reference group by delaying it based on the maximum correlation value between their respective tissue Doppler signals. This synchronization ensured that each group of frames aligned with the brain tissue motion of the reference group, and consequently, with its cardiac cycle. As a result, velocities of MBs could be averaged to retrieve flow velocity variations over time. RESULTS Initially validated in ECG-gated acquisitions in a rat model (n = 1), the proposed method was successfully applied in a mice model in 2D (n = 3) and in a feline model in 3D (n = 1). Performing time-registration with the proposed motion-matching method or by using ECG-gating leads to similar results. For the first time, dynamic velocity and density cine-loops were extracted without the need for any information on the animal ECG, and complex dynamic markers such as the Pulsatility index were estimated. CONCLUSION Results suggest that DULM can be performed without external gating, enabling the use of DULM on any ULM dataset where enough MBs are detectable. Time registration by motion-matching represents a significant advancement in DULM techniques, making DULM more accessible by simplifying its experimental complexity.
Collapse
Affiliation(s)
- Nin Ghigo
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada.
| | | | - Chloé Bourquin
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada
| | - Paul Xing
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada
| | - Alice Wu
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada
| | - Nelson Cortés
- School of Optometry, University of Montreal, Montréal, Quebec, Canada
| | - Hugo Ladret
- School of Optometry, University of Montreal, Montréal, Quebec, Canada; Institut de Neurosciences de la Timone, UMR 7289, CNRS and Aix-Marseille Université, Marseille, France
| | - Lamyae Ikan
- School of Optometry, University of Montreal, Montréal, Quebec, Canada
| | | | - Jonathan Porée
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada
| | - Abbas Sadikot
- Montreal Neurological Institute, McGill University, Montréal, Quebec, Canada
| | - Jean Provost
- Department of Engineering Physics, Polytechnique Montréal, Montréal, Quebec, Canada; Montreal Heart Institute, Montréal, Quebec, Canada
| |
Collapse
|
31
|
Arendt Jensen J, Amin Naji M, Kazmarek PraeSius S, Taghavi I, Schou M, Naur Hansen L, Bech Andersen S, Byrholdt Sogaard S, Sarup Panduro N, Mehlin Sorensen C, Bachmann Nielsen M, Gundlach C, Martin Kjer H, Bjorholm Dahl A, Gueorguiev Tomov B, Lind Ommen M, Bent Larsen N, Vilain Thomsen E. Super-Resolution Ultrasound Imaging Using the Erythrocytes-Part I: Density Images. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:925-944. [PMID: 38857145 DOI: 10.1109/tuffc.2024.3411711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2024]
Abstract
A new approach for vascular super-resolution (SR) imaging using the erythrocytes as targets (SUper-Resolution ultrasound imaging of Erythrocytes (SURE) imaging) is described and investigated. SURE imaging does not require fragile contrast agent bubbles, making it possible to use the maximum allowable mechanical index (MI) for ultrasound scanning for an increased penetration depth. A synthetic aperture (SA) ultrasound sequence was employed with 12 virtual sources (VSs) using a 10-MHz GE L8-18i-D linear array hockey stick probe. The axial resolution was [Formula: see text]m) and the lateral resolution was [Formula: see text]m). Field IIpro simulations were conducted on 12.5- μ m radius vessel pairs with varying separations. A vessel pair with a separation of 70 μ m could be resolved, indicating a SURE image resolution below half a wavelength. A Verasonics research scanner was used for the in vivo experiments to scan the kidneys of Sprague-Dawley rats for up to 46 s to visualize their microvasculature by processing from 0.1 up to 45 s of data for SURE imaging and for 46.8 s for SR imaging with a SonoVue contrast agent. Afterward, the renal vasculature was filled with the ex vivo micro-computed tomography (CT) contrast agent Microfil, excised, and scanned in a micro-CT scanner at both a 22.6- μ m voxel size for 11 h and for 20 h in a 5- μ m voxel size for validating the SURE images. Comparing the SURE and micro-CT images revealed that vessels with a diameter of 28 μ m, five times smaller than the ultrasound wavelength, could be detected, and the dense grid of microvessels in the full kidney was shown for scan times between 1 and 10 s. The vessel structure in the cortex was also similar to the SURE and SR images. Fourier ring correlation (FRC) indicated a resolution capability of 29 μ m. SURE images are acquired in seconds rather than minutes without any patient preparation or contrast injection, making the method translatable to clinical use.
Collapse
|
32
|
Naji MA, Taghavi I, Schou M, Praesius SK, Hansen LN, Panduro NS, Andersen SB, Sogaard SB, Gundlach C, Kjer HM, Tomov BG, Thomsen EV, Nielsen MB, Larsen NB, Dahl AB, Sorensen CM, Jensen JA. Super-Resolution Ultrasound Imaging Using the Erythrocytes-Part II: Velocity Images. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:945-959. [PMID: 38857146 DOI: 10.1109/tuffc.2024.3411795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2024]
Abstract
Super-resolution ultrasound imaging using the erythrocytes (SURE) has recently been introduced. The method uses erythrocytes as targets instead of fragile microbubbles (MBs). The abundance of erythrocyte scatterers makes it possible to acquire SURE data in just a few seconds compared with several minutes in ultrasound localization microscopy (ULM) using MBs. A high number of scatterers can reduce the acquisition time; however, the tracking of uncorrelated and high-density scatterers is quite challenging. This article hypothesizes that it is possible to detect and track erythrocytes as targets to obtain vascular flow images. A SURE tracking pipeline is used with modules for beamforming, recursive synthetic aperture (SA) imaging, motion estimation, echo canceling, peak detection, and recursive nearest-neighbor (NN) tracker. The SURE tracking pipeline is capable of distinguishing the flow direction and separating tubes of a simulated Field II phantom with 125-25- [Formula: see text] wall-to-wall tube distances, as well as a 3-D printed hydrogel micr-flow phantom with 100-60- [Formula: see text] wall-to-wall channel distances. The comparison of an in vivo SURE scan of a Sprague-Dawley rat kidney with ULM and micro-computed tomography (CT) scans with voxel sizes of 26.5 and [Formula: see text] demonstrated consistent findings. A microvascular structure composed of 16 vessels exhibited similarities across all imaging modalities. The flow direction and velocity profiles in the SURE scan were found to be concordant with those from ULM.
Collapse
|
33
|
Lerendegui M, Riemer K, Papageorgiou G, Wang B, Arthur L, Chavignon A, Zhang T, Couture O, Huang P, Ashikuzzaman M, Dencks S, Dunsby C, Helfield B, Jensen JA, Lisson T, Lowerison MR, Rivaz H, Samir AE, Schmitz G, Schoen S, van Sloun R, Song P, Stevens T, Yan J, Sboros V, Tang MX. ULTRA-SR Challenge: Assessment of Ultrasound Localization and TRacking Algorithms for Super-Resolution Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2970-2987. [PMID: 38607705 DOI: 10.1109/tmi.2024.3388048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/14/2024]
Abstract
With the widespread interest and uptake of super-resolution ultrasound (SRUS) through localization and tracking of microbubbles, also known as ultrasound localization microscopy (ULM), many localization and tracking algorithms have been developed. ULM can image many centimeters into tissue in-vivo and track microvascular flow non-invasively with sub-diffraction resolution. In a significant community effort, we organized a challenge, Ultrasound Localization and TRacking Algorithms for Super-Resolution (ULTRA-SR). The aims of this paper are threefold: to describe the challenge organization, data generation, and winning algorithms; to present the metrics and methods for evaluating challenge entrants; and to report results and findings of the evaluation. Realistic ultrasound datasets containing microvascular flow for different clinical ultrasound frequencies were simulated, using vascular flow physics, acoustic field simulation and nonlinear bubble dynamics simulation. Based on these datasets, 38 submissions from 24 research groups were evaluated against ground truth using an evaluation framework with six metrics, three for localization and three for tracking. In-vivo mouse brain and human lymph node data were also provided, and performance assessed by an expert panel. Winning algorithms are described and discussed. The publicly available data with ground truth and the defined metrics for both localization and tracking present a valuable resource for researchers to benchmark algorithms and software, identify optimized methods/software for their data, and provide insight into the current limits of the field. In conclusion, Ultra-SR challenge has provided benchmarking data and tools as well as direct comparison and insights for a number of the state-of-the art localization and tracking algorithms.
Collapse
|
34
|
Wang W, Zhang H, Li Y, Wang Y, Zhang Q, Ding G, Yin L, Tang J, Peng B. An Automated Heart Shunt Recognition Pipeline Using Deep Neural Networks. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1424-1439. [PMID: 38388868 PMCID: PMC11300722 DOI: 10.1007/s10278-024-01047-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 01/21/2024] [Accepted: 02/11/2024] [Indexed: 02/24/2024]
Abstract
Automated recognition of heart shunts using saline contrast transthoracic echocardiography (SC-TTE) has the potential to transform clinical practice, enabling non-experts to assess heart shunt lesions. This study aims to develop a fully automated and scalable analysis pipeline for distinguishing heart shunts, utilizing a deep neural network-based framework. The pipeline consists of three steps: (1) chamber segmentation, (2) ultrasound microbubble localization, and (3) disease classification model establishment. The study's normal control group included 91 patients with intracardiac shunts, 61 patients with extracardiac shunts, and 84 asymptomatic individuals. Participants' SC-TTE images were segmented using the U-Net model to obtain cardiac chambers. The segmentation results were combined with ultrasound microbubble localization to generate multivariate time series data on microbubble counts in each chamber. A classification model was then trained using this data to distinguish between intracardiac and extracardiac shunts. The proposed framework accurately segmented heart chambers (dice coefficient = 0.92 ± 0.1) and localized microbubbles. The disease classification model achieved high accuracy, sensitivity, specificity, F1 score, kappa value, and AUC value for both intracardiac and extracardiac shunts. For intracardiac shunts, accuracy was 0.875 ± 0.008, sensitivity was 0.891 ± 0.002, specificity was 0.865 ± 0.012, F1 score was 0.836 ± 0.011, kappa value was 0.735 ± 0.017, and AUC value was 0.942 ± 0.014. For extracardiac shunts, accuracy was 0.902 ± 0.007, sensitivity was 0.763 ± 0.014, specificity was 0.966 ± 0.008, F1 score was 0.830 ± 0.012, kappa value was 0.762 ± 0.017, and AUC value was 0.916 ± 0.006. The proposed framework utilizing deep neural networks offers a fast, convenient, and accurate method for identifying intracardiac and extracardiac shunts. It aids in shunt recognition and generates valuable quantitative indices, assisting clinicians in diagnosing these conditions.
Collapse
Affiliation(s)
- Weidong Wang
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, Sichuan, China
| | - Hongme Zhang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Yizhen Li
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Yi Wang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Qingfeng Zhang
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Geqi Ding
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Lixue Yin
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Jinshan Tang
- Department of Health Administration and Policy, College of Public Health, George Mason University, Fairfax, USA
| | - Bo Peng
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, Sichuan, China.
- Department of Cardiovascular Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| |
Collapse
|
35
|
Hansen-Shearer J, Yan J, Lerendegui M, Huang B, Toulemonde M, Riemer K, Tan Q, Tonko J, Weinberg PD, Dunsby C, Tang MX. Ultrafast 3-D Transcutaneous Super Resolution Ultrasound Using Row-Column Array Specific Coherence-Based Beamforming and Rolling Acoustic Sub-aperture Processing: In Vitro, in Rabbit and in Human Study. ULTRASOUND IN MEDICINE & BIOLOGY 2024; 50:1045-1057. [PMID: 38702285 DOI: 10.1016/j.ultrasmedbio.2024.03.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 03/27/2024] [Accepted: 03/31/2024] [Indexed: 05/06/2024]
Abstract
OBJECTIVE This study aimed to realise 3-D super-resolution ultrasound imaging transcutaneously with a row-column array which has far fewer independent electronic channels and a wider field of view than typical fully addressed 2-D matrix arrays. The in vivo image quality of the row-column array is generally poor, particularly when imaging non-invasively. This study aimed to develop a suite of image formation and post-processing methods to improve image quality and demonstrate the feasibility of ultrasound localisation microscopy using a row-column array, transcutaneously on a rabbit model and in a human. METHODS To achieve this, a processing pipeline was developed which included a new type of rolling window image reconstruction, which integrated a row-column array specific coherence-based beamforming technique with acoustic sub-aperture processing. This and other processing steps reduced the 'secondary' lobe artefacts, and noise and increased the effective frame rate, thereby enabling ultrasound localisation images to be produced. RESULTS Using an in vitro cross tube, it was found that the procedure reduced the percentage of 'false' locations from ∼26% to ∼15% compared to orthogonal plane wave compounding. Additionally, it was found that the noise could be reduced by ∼7 dB and the effective frame rate was increased to over 4000 fps. In vivo, ultrasound localisation microscopy was used to produce images non-invasively of a rabbit kidney and a human thyroid. CONCLUSION It has been demonstrated that the proposed methods using a row-column array can produce large field of view super-resolution microvascular images in vivo and in a human non-invasively.
Collapse
|
36
|
Yan J, Huang B, Tonko J, Toulemonde M, Hansen-Shearer J, Tan Q, Riemer K, Ntagiantas K, Chowdhury RA, Lambiase PD, Senior R, Tang MX. Transthoracic ultrasound localization microscopy of myocardial vasculature in patients. Nat Biomed Eng 2024; 8:689-700. [PMID: 38710839 PMCID: PMC11250254 DOI: 10.1038/s41551-024-01206-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 03/30/2024] [Indexed: 05/08/2024]
Abstract
Myocardial microvasculature and haemodynamics are indicative of potential microvascular diseases for patients with symptoms of coronary heart disease in the absence of obstructive coronary arteries. However, imaging microvascular structure and flow within the myocardium is challenging owing to the small size of the vessels and the constant movement of the patient's heart. Here we show the feasibility of transthoracic ultrasound localization microscopy for imaging myocardial microvasculature and haemodynamics in explanted pig hearts and in patients in vivo. Through a customized data-acquisition and processing pipeline with a cardiac phased-array probe, we leveraged motion correction and tracking to reconstruct the dynamics of microcirculation. For four patients, two of whom had impaired myocardial function, we obtained super-resolution images of myocardial vascular structure and flow using data acquired within a breath hold. Myocardial ultrasound localization microscopy may facilitate the understanding of myocardial microcirculation and the management of patients with cardiac microvascular diseases.
Collapse
Affiliation(s)
- Jipeng Yan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Biao Huang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Johanna Tonko
- Institute of Cardiovascular Science, University College London, London, UK
| | - Matthieu Toulemonde
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Joseph Hansen-Shearer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Qingyuan Tan
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | - Kai Riemer
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK
| | | | - Rasheda A Chowdhury
- Faculty of Medicine, National Heart and Lung Institute, Imperial College London, London, UK
| | - Pier D Lambiase
- Institute of Cardiovascular Science, University College London, London, UK
| | - Roxy Senior
- Faculty of Medicine, National Heart and Lung Institute, Imperial College London, London, UK
- Royal Brompton Hospital, London, UK
- Northwick Park Hospital, Harrow, UK
| | - Meng-Xing Tang
- Ultrasound Lab for Imaging and Sensing, Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
37
|
Lerendegui M, Yan J, Stride E, Dunsby C, Tang MX. Understanding the effects of microbubble concentration on localization accuracy in super-resolution ultrasound imaging. Phys Med Biol 2024; 69:115020. [PMID: 38588678 DOI: 10.1088/1361-6560/ad3c09] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 04/08/2024] [Indexed: 04/10/2024]
Abstract
Super-resolution ultrasound (SRUS) through localising and tracking of microbubbles (MBs) can achieve sub-wavelength resolution for imaging microvascular structure and flow dynamics in deep tissuein vivo. The technique assumes that signals from individual MBs can be isolated and localised accurately, but this assumption starts to break down when the MB concentration increases and the signals from neighbouring MBs start to interfere. The aim of this study is to gain understanding of the effect of MB-MB distance on ultrasound images and their localisation. Ultrasound images of two MBs approaching each other were synthesised by simulating both ultrasound field propagation and nonlinear MB dynamics. Besides the distance between MBs, a range of other influencing factors including MB size, ultrasound frequency, transmit pulse sequence, pulse amplitude and localisation methods were studied. The results show that as two MBs approach each other, the interference fringes can lead to significant and oscillating localisation errors, which are affected by both the MB and imaging parameters. When modelling a clinical linear array probe operating at 6 MHz, localisation errors between 20 and 30μm (∼1/10 wavelength) can be generated when MBs are ∼500μm (2 wavelengths or ∼1.7 times the point spread function (PSF)) away from each other. When modelling a cardiac probe operating at 1.5 MHz, the localisation errors were as high as 200μm (∼1/5 wavelength) even when the MBs were more than 10 wavelengths apart (2.9 times the PSF). For both frequencies, at smaller separation distances, the two MBs were misinterpreted as one MB located in between the two true positions. Cross-correlation or Gaussian fitting methods were found to generate slightly smaller localisation errors than centroiding. In conclusion, caution should be taken when generating and interpreting SRUS images obtained using high agent concentration with MBs separated by less than 1.7 to 3 times the PSF, as significant localisation errors can be generated due to interference between neighbouring MBs.
Collapse
Affiliation(s)
- Marcelo Lerendegui
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Jipeng Yan
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Eleanor Stride
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | | | - Meng-Xing Tang
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
38
|
Riemer K, Tan Q, Morse S, Bau L, Toulemonde M, Yan J, Zhu J, Wang B, Taylor L, Lerendegui M, Wu Q, Stride E, Dunsby C, Weinberg PD, Tang MX. 3D Acoustic Wave Sparsely Activated Localization Microscopy With Phase Change Contrast Agents. Invest Radiol 2024; 59:379-390. [PMID: 37843819 DOI: 10.1097/rli.0000000000001033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2023]
Abstract
OBJECTIVE The aim of this study is to demonstrate 3-dimensional (3D) acoustic wave sparsely activated localization microscopy (AWSALM) of microvascular flow in vivo using phase change contrast agents (PCCAs). MATERIALS AND METHODS Three-dimensional AWSALM using acoustically activable PCCAs was evaluated on a crossed tube microflow phantom, the kidney of New Zealand White rabbits, and the brain of C57BL/6J mice through intact skull. A mixture of C 3 F 8 and C 4 F 10 low-boiling-point fluorocarbon gas was used to generate PCCAs with an appropriate activation pressure. A multiplexed 8-MHz matrix array connected to a 256-channel ultrasound research platform was used for transmitting activation and imaging ultrasound pulses and recording echoes. The in vitro and in vivo echo data were subsequently beamformed and processed using a set of customized algorithms for generating 3D super-resolution ultrasound images through localizing and tracking activated contrast agents. RESULTS With 3D AWSALM, the acoustic activation of PCCAs can be controlled both spatially and temporally, enabling contrast on demand and capable of revealing 3D microvascular connectivity. The spatial resolution of the 3D AWSALM images measured using Fourier shell correlation is 64 μm, presenting a 9-time improvement compared with the point spread function and 1.5 times compared with half the wavelength. Compared with the microbubble-based approach, more signals were localized in the microvasculature at similar concentrations while retaining sparsity and longer tracks in larger vessels. Transcranial imaging was demonstrated as a proof of principle of PCCA activation in the mouse brain with 3D AWSALM. CONCLUSIONS Three-dimensional AWSALM generates volumetric ultrasound super-resolution microvascular images in vivo with spatiotemporal selectivity and enhanced microvascular penetration.
Collapse
Affiliation(s)
- Kai Riemer
- From the Department of Bioengineering, Imperial College London, London, United Kingdom (K.R., Q.T., S.M., M.T., J.Y., J.Z., B.W., L.T., M.L., P.D.W., M.-X.T.); NDORMS, University of Oxford, Oxford, United Kingdom (L.B., Q.W., E.S.); and Department of Physics, Imperial College London, London, United Kingdom (C.D.)
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
39
|
Tuccio G, Afrakhteh S, Iacca G, Demi L. Time Efficient Ultrasound Localization Microscopy Based on A Novel Radial Basis Function 2D Interpolation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1690-1701. [PMID: 38145542 DOI: 10.1109/tmi.2023.3347261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
Abstract
Ultrasound localization microscopy (ULM) allows for the generation of super-resolved (SR) images of the vasculature by precisely localizing intravenously injected microbubbles. Although SR images may be useful for diagnosing and treating patients, their use in the clinical context is limited by the need for prolonged acquisition times and high frame rates. The primary goal of our study is to relax the requirement of high frame rates to obtain SR images. To this end, we propose a new time-efficient ULM (TEULM) pipeline built on a cutting-edge interpolation method. More specifically, we suggest employing Radial Basis Functions (RBFs) as interpolators to estimate the missing values in the 2-dimensional (2D) spatio-temporal structures. To evaluate this strategy, we first mimic the data acquisition at a reduced frame rate by applying a down-sampling (DS = 2, 4, 8, and 10) factor to high frame rate ULM data. Then, we up-sample the data to the original frame rate using the suggested interpolation to reconstruct the missing frames. Finally, using both the original high frame rate data and the interpolated one, we reconstruct SR images using the ULM framework steps. We evaluate the proposed TEULM using four in vivo datasets, a Rat brain (dataset A), a Rat kidney (dataset B), a Rat tumor (dataset C) and a Rat brain bolus (dataset D), interpolating at the in-phase and quadrature (IQ) level. Results demonstrate the effectiveness of TEULM in recovering vascular structures, even at a DS rate of 10 (corresponding to a frame rate of sub-100Hz). In conclusion, the proposed technique is successful in reconstructing accurate SR images while requiring frame rates of one order of magnitude lower than standard ULM.
Collapse
|
40
|
Zhang Z, Hwang M, Kilbaugh TJ, Katz J. Improving sub-pixel accuracy in ultrasound localization microscopy using supervised and self-supervised deep learning. MEASUREMENT SCIENCE & TECHNOLOGY 2024; 35:045701. [PMID: 38205381 PMCID: PMC10774911 DOI: 10.1088/1361-6501/ad1671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 11/30/2023] [Accepted: 12/17/2023] [Indexed: 01/12/2024]
Abstract
With a spatial resolution of tens of microns, ultrasound localization microscopy (ULM) reconstructs microvascular structures and measures intravascular flows by tracking microbubbles (1-5 μm) in contrast enhanced ultrasound (CEUS) images. Since the size of CEUS bubble traces, e.g. 0.5-1 mm for ultrasound with a wavelength λ = 280 μm, is typically two orders of magnitude larger than the bubble diameter, accurately localizing microbubbles in noisy CEUS data is vital to the fidelity of the ULM results. In this paper, we introduce a residual learning based supervised super-resolution blind deconvolution network (SupBD-net), and a new loss function for a self-supervised blind deconvolution network (SelfBD-net), for detecting bubble centers at a spatial resolution finer than λ/10. Our ultimate purpose is to improve the ability to distinguish closely located microvessels and the accuracy of the velocity profile measurements in macrovessels. Using realistic synthetic data, the performance of these methods is calibrated and compared against several recently introduced deep learning and blind deconvolution techniques. For bubble detection, errors in bubble center location increase with the trace size, noise level, and bubble concentration. For all cases, SupBD-net yields the least error, keeping it below 0.1 λ. For unknown bubble trace morphology, where all the supervised learning methods fail, SelfBD-net can still maintain an error of less than 0.15 λ. SupBD-net also outperforms the other methods in separating closely located bubbles and parallel microvessels. In macrovessels, SupBD-net maintains the least errors in the vessel radius and velocity profile after introducing a procedure that corrects for terminated tracks caused by overlapping traces. Application of these methods is demonstrated by mapping the cerebral microvasculature of a neonatal pig, where neighboring microvessels separated by 0.15 λ can be readily distinguished by SupBD-net and SelfBD-net, but not by the other techniques. Hence, the newly proposed residual learning based methods improve the spatial resolution and accuracy of ULM in micro- and macro-vessels.
Collapse
Affiliation(s)
- Zeng Zhang
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| | - Misun Hwang
- Departments of Radiology, Children’s Hospital of Philadelphia, Philadelphia, PA, United States of America
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Todd J Kilbaugh
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA, United States of America
| | - Joseph Katz
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States of America
| |
Collapse
|
41
|
Bourquin C, Porée J, Rauby B, Perrot V, Ghigo N, Belgharbi H, Bélanger S, Ramos-Palacios G, Cortes N, Ladret H, Ikan L, Casanova C, Lesage F, Provost J. Quantitative pulsatility measurements using 3D dynamic ultrasound localization microscopy. Phys Med Biol 2024; 69:045017. [PMID: 38181421 DOI: 10.1088/1361-6560/ad1b68] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 01/05/2024] [Indexed: 01/07/2024]
Abstract
A rise in blood flow velocity variations (i.e. pulsatility) in the brain, caused by the stiffening of upstream arteries, is associated with cognitive impairment and neurodegenerative diseases. The study of this phenomenon requires brain-wide pulsatility measurements, with large penetration depth and high spatiotemporal resolution. The development of dynamic ultrasound localization microscopy (DULM), based on ULM, has enabled pulsatility measurements in the rodent brain in 2D. However, 2D imaging accesses only one slice of the brain and measures only 2D-projected and hence biased velocities . Herein, we present 3D DULM: using a single ultrasound scanner at high frame rate (1000-2000 Hz), this method can produce dynamic maps of microbubbles flowing in the bloodstream and extract quantitative pulsatility measurements in the cat brain with craniotomy and in the mouse brain through the skull, showing a wide range of flow hemodynamics in both large and small vessels. We highlighted a decrease in pulsatility along the vascular tree in the cat brain, which could be mapped with ultrasound down to a few tens of micrometers for the first time. We also performed an intra-animal validation of the method by showing consistent measurements between the two sides of the Willis circle in the mouse brain. Our study provides the first step towards a new biomarker that would allow the detection of dynamic abnormalities in microvessels in the brain, which could be linked to early signs of neurodegenerative diseases.
Collapse
Affiliation(s)
- Chloé Bourquin
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
| | - Jonathan Porée
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
| | - Brice Rauby
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
| | - Vincent Perrot
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
| | - Nin Ghigo
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
| | - Hatim Belgharbi
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
- Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC 27599, United States of America
| | | | | | - Nelson Cortes
- School of Optometry, University of Montreal, Montréal, QC H3T 1P1, Canada
| | - Hugo Ladret
- School of Optometry, University of Montreal, Montréal, QC H3T 1P1, Canada
- Institut de Neurosciences de la Timone, UMR 7289, CNRS and Aix-Marseille Université, Marseille, F-13005, France
| | - Lamyae Ikan
- School of Optometry, University of Montreal, Montréal, QC H3T 1P1, Canada
| | - Christian Casanova
- School of Optometry, University of Montreal, Montréal, QC H3T 1P1, Canada
| | - Frédéric Lesage
- Department of Electrical Engineering, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
- Montreal Heart Institute, Montréal, QC H1T 1C8, Canada
| | - Jean Provost
- Department of Engineering Physics, Polytechnique Montréal, Montréal, QC H3T 1J4, Canada
- Montreal Heart Institute, Montréal, QC H1T 1C8, Canada
| |
Collapse
|
42
|
Wang B, Riemer K, Toulemonde M, Yan J, Zhou X, Smith CAB, Tang MX. Broad Elevation Projection Super-Resolution Ultrasound (BEP-SRUS) Imaging With a 1-D Unfocused Linear Array. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:255-265. [PMID: 38109244 DOI: 10.1109/tuffc.2023.3343992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2023]
Abstract
Super-resolution ultrasound (SRUS) through localizing spatially isolated microbubbles (MBs) has been demonstrated to overcome the wave diffraction limit and reveal the microvascular structure and flow information at the microscopic scale. However, 3-D SRUS imaging remains a challenge due to the fabrication and computational complexity of 2-D matrix array probes. Inspired by X-ray radiography which can present information within a volume in a single projection image with much simpler hardware than X-ray computerized tomography (CT), this study investigates the feasibility of broad elevation projection super-resolution (BEP-SR) ultrasound using a 1-D unfocused linear array. Both simulation and in vitro experiments were conducted on 3-D microvessel phantoms. In vivo demonstration was done on the Rabbit kidney. Data from a 1-D linear array with and without an elevational focus were synthesized by summing up row signals acquired from a 2-D matrix array with and without delays. A full 3-D reconstruction was also generated as the reference, using the same data of the 2-D matrix array but without summing row signals. Results show that using an unfocused 1-D array probe, BEP-SR can capture significantly more information within a volume in both vascular structure and flow velocity than the conventional 1-D elevational-focused probe. Compared with the 2-D projection image of the full 3-D SRUS results using the 2-D array probe with the same aperture size, the 2-D projection SRUS image of BEP-SR has similar volume coverage, using 32 folds fewer independent elements. This study demonstrates BEP-SR's ability of high-resolution imaging of microvascular structures and flow velocity within a 3-D volume at significantly reduced costs. The proposed BEP method could significantly benefit the clinical translation of the SRUS imaging technique by making it more affordable and repeatable.
Collapse
|
43
|
Lu JY. Modulation of Point Spread Function for Super-Resolution Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:153-171. [PMID: 37988211 DOI: 10.1109/tuffc.2023.3335883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2023]
Abstract
High image resolution is desired in wave-related areas such as ultrasound, acoustics, optics, and electromagnetics. However, the spatial resolution of an imaging system is limited by the spatial frequency of the point spread function (PSF) of the system due to diffraction. In this article, the PSF is modulated in amplitude, phase, or both to increase the spatial frequency to reconstruct super-resolution images of objects or wave sources/fields, where the modulator can be a focused shear wave produced remotely by, for example, a radiation force from a focused Bessel beam or X-wave, or can be a small particle manipulated remotely by a radiation-force (such as acoustic and optical tweezers) or electrical and magnetic forces. A theory of the PSF-modulation method was developed, and computer simulations and experiments were conducted. The result of an ultrasound experiment shows that a pulse-echo (two-way) image reconstructed has a super-resolution (0.65 mm) as compared to the diffraction limit (2.65 mm) using a 0.5-mm-diameter modulator at 1.483-mm wavelength, and the signal-to-noise ratio (SNR) of the image was about 31 dB. If the minimal SNR of a "visible" image is 3, the resolution can be further increased to about 0.19 mm by decreasing the size of the modulator. Another ultrasound experiment shows that a wave source was imaged (one-way) at about 30-dB SNR using the same modulator size and wavelength above. The image clearly separated two 0.5-mm spaced lines, which gives a 7.26-fold higher resolution than that of the diffraction limit (3.63 mm). Although, in theory, the method has no limit on the highest achievable image resolution, in practice, the resolution is limited by noises. Also, a PSF-weighted super-resolution imaging method based on the PSF-modulation method was developed. This method is easier to implement but may have some limitations. Finally, the methods above can be applied to imaging systems of an arbitrary PSF and can produce 4-D super-resolution images. With a proper choice of a modulator (e.g., a quantum dot) and imaging system, nanoscale (a few nanometers) imaging is possible.
Collapse
|
44
|
Apfelbeck M, Loupas T, Chaloupka M, Clevert DA. Improved diagnostic confidence using Super Resolution CEUS imaging in testicular lesions. Clin Hemorheol Microcirc 2024; 88:S113-S125. [PMID: 39422932 PMCID: PMC11612930 DOI: 10.3233/ch-248109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2024]
Abstract
Ultrasound is the most used interdisciplinary non-ionizing imaging technique in clinical pathologies of the testis. The testis may be affected by a plethora of different disorders such as vasculopathies, trauma, infections and manifestations of primary and secondary malignant masses. Conventional ultrasound represents the basic imaging modality of choice to assess scrotal disorders. Contrast-enhanced ultrasound (CEUS) can provide further information to distinguish between benign and malignant testicular mass lesions. The recent introduction of Super Resolution CEUS Micro-Vascular Imaging (MVI SR) and Time of Arrival (TOA SR) parametric mapping compliments the information provided by conventional CEUS, since these two new post-processing techniques improve the visualization of microvascular structures with slow blood flow and provide high-resolution images of the peak contrast enhancement and temporal perfusion patterns. This paper gives a comprehensive overview of differential diagnoses of the testicular disorder and their corresponding sono-morphologic correlates based on representative cases of the Interdisciplinary Ultrasound Center of the University Hospital Munich.
Collapse
Affiliation(s)
| | | | | | - Dirk-André Clevert
- Department of Radiology, Ludwig-Maximilians-University Munich, Munich, Germany
- Interdisciplinary Ultrasound-Center, Ludwig-Maximilians-University Munich, Munich, Germany
| |
Collapse
|
45
|
Luan S, Yu X, Lei S, Ma C, Wang X, Xue X, Ding Y, Ma T, Zhu B. Deep learning for fast super-resolution ultrasound microvessel imaging. Phys Med Biol 2023; 68:245023. [PMID: 37934040 DOI: 10.1088/1361-6560/ad0a5a] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 11/07/2023] [Indexed: 11/08/2023]
Abstract
Objective. Ultrasound localization microscopy (ULM) enables microvascular reconstruction by localizing microbubbles (MBs). Although ULM can obtain microvascular images that are beyond the ultimate resolution of the ultrasound (US) diffraction limit, it requires long data processing time, and the imaging accuracy is susceptible to the density of MBs. Deep learning (DL)-based ULM is proposed to alleviate these limitations, which simulated MBs at low-resolution and mapped them to coordinates at high-resolution by centroid localization. However, traditional DL-based ULMs are imprecise and computationally complex. Also, the performance of DL is highly dependent on the training datasets, which are difficult to realistically simulate.Approach. A novel architecture called adaptive matching network (AM-Net) and a dataset generation method named multi-mapping (MMP) was proposed to overcome the above challenges. The imaging performance and processing time of the AM-Net have been assessed by simulation andin vivoexperiments.Main results. Simulation results show that at high density (20 MBs/frame), when compared to other DL-based ULM, AM-Net achieves higher localization accuracy in the lateral/axial direction.In vivoexperiment results show that the AM-Net can reconstruct ∼24.3μm diameter micro-vessels and separate two ∼28.3μm diameter micro-vessels. Furthermore, when processing a 128 × 128 pixels image in simulation experiments and an 896 × 1280 pixels imagein vivoexperiment, the processing time of AM-Net is ∼13 s and ∼33 s, respectively, which are 0.3-0.4 orders of magnitude faster than other DL-based ULM.Significance. We proposes a promising solution for ULM with low computing costs and high imaging performance.
Collapse
Affiliation(s)
- Shunyao Luan
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Xiangyang Yu
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shuang Lei
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Chi Ma
- Department of Radiation Oncology, Rutgers-Cancer Institute of New Jersey, Rutgers-Robert Wood Johnson Medical School, New Brunswick, NJ, United States of America
| | - Xiao Wang
- Department of Radiation Oncology, Rutgers-Cancer Institute of New Jersey, Rutgers-Robert Wood Johnson Medical School, New Brunswick, NJ, United States of America
| | - Xudong Xue
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Yi Ding
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Teng Ma
- The Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, People's Republic of China
| | - Benpeng Zhu
- School of Integrated Circuits, Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
46
|
Deng L, Lea-Banks H, Jones RM, O’Reilly MA, Hynynen K. Three-dimensional super resolution ultrasound imaging with a multi-frequency hemispherical phased array. Med Phys 2023; 50:7478-7497. [PMID: 37702919 PMCID: PMC10872837 DOI: 10.1002/mp.16733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 08/27/2023] [Indexed: 09/14/2023] Open
Abstract
BACKGROUND High resolution imaging of the microvasculature plays an important role in both diagnostic and therapeutic applications in the brain. However, ultrasound pulse-echo sonography imaging the brain vasculatures has been limited to narrow acoustic windows and low frequencies due to the distortion of the skull bone, which sacrifices axial resolution since it is pulse length dependent. PURPOSE To overcome the detect limit, a large aperture 256-module sparse hemispherical transmit/receive array was used to visualize the acoustic emissions of ultrasound-vaporized lipid-coated decafluorobutane nanodroplets flowing through tube phantoms and within rabbit cerebral vasculature in vivo via passive acoustic mapping and super resolution techniques. METHODS Nanodroplets were vaporized with 55 kHz burst-mode ultrasound (burst length = 145 μs, burst repetition frequency = 9-45 Hz, peak negative acoustic pressure = 0.10-0.22 MPa), which propagates through overlying tissues well without suffering from severe distortions. The resulting emissions were received at a higher frequency (612 or 1224 kHz subarray) to improve the resulting spatial resolution during passive beamforming. Normal resolution three-dimensional images were formed using a delay, sum, and integrate beamforming algorithm, and super-resolved images were extracted via Gaussian fitting of the estimated point-spread-function to the normal resolution data. RESULTS With super resolution techniques, the mean lateral (axial) full-width-at-half-maximum image intensity was 16 ± 3 (32 ± 6) μm, and 7 ± 1 (15 ± 2) μm corresponding to ∼1/67 of the normal resolution at 612 and 1224 kHz, respectively. The mean positional uncertainties were ∼1/350 (lateral) and ∼1/180 (axial) of the receive wavelength in water. In addition, a temporal correlation between nanodroplet vaporization and the transmit waveform shape was observed, which may provide the opportunity to enhance the signal-to-noise ratio in future studies. CONCLUSIONS Here, we demonstrate the feasibility of vaporizing nanodroplets via low frequency ultrasound and simultaneously performing spatial mapping via passive beamforming at higher frequencies to improve the resulting spatial resolution of super resolution imaging techniques. This method may enable complete four-dimensional vascular mapping in organs where a hemispherical array could be positioned to surround the target, such as the brain, breast, or testicles.
Collapse
Affiliation(s)
- Lulu Deng
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, M4N 3M5, Canada
| | - Harriet Lea-Banks
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, M4N 3M5, Canada
| | - Ryan M. Jones
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, M4N 3M5, Canada
| | - Meaghan A. O’Reilly
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, M4N 3M5, Canada
- Department of Medical Biophysics, University of Toronto, Toronto, Ontario, M5G 1L7, Canada
| | - Kullervo Hynynen
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, Ontario, M4N 3M5, Canada
- Department of Medical Biophysics, University of Toronto, Toronto, Ontario, M5G 1L7, Canada
- Institute of Biomedical Engineering, University of Toronto, Toronto, Ontario, M5S 3E2, Canada
| |
Collapse
|
47
|
Wei L, Wahyulaksana G, Te Lintel Hekkert M, Beurskens R, Boni E, Ramalli A, Noothout E, Duncker DJ, Tortoli P, van der Steen AFW, de Jong N, Verweij M, Vos HJ. High-Frame-Rate Volumetric Porcine Renal Vasculature Imaging. ULTRASOUND IN MEDICINE & BIOLOGY 2023; 49:2476-2482. [PMID: 37704558 DOI: 10.1016/j.ultrasmedbio.2023.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/02/2023] [Accepted: 08/08/2023] [Indexed: 09/15/2023]
Abstract
OBJECTIVE The aim of this study was to assess the feasibility and imaging options of contrast-enhanced volumetric ultrasound kidney vasculature imaging in a porcine model using a prototype sparse spiral array. METHODS Transcutaneous freehand in vivo imaging of two healthy porcine kidneys was performed according to three protocols with different microbubble concentrations and transmission sequences. Combining high-frame-rate transmission sequences with our previously described spatial coherence beamformer, we determined the ability to produce detailed volumetric images of the vasculature. We also determined power, color and spectral Doppler, as well as super-resolved microvasculature in a volume. The results were compared against a clinical 2-D ultrasound machine. RESULTS Three-dimensional visualization of the kidney vasculature structure and blood flow was possible with our method. Good structural agreement was found between the visualized vasculature structure and the 2-D reference. Microvasculature patterns in the kidney cortex were visible with super-resolution processing. Blood flow velocity estimations were within a physiological range and pattern, also in agreement with the 2-D reference results. CONCLUSION Volumetric imaging of the kidney vasculature was possible using a prototype sparse spiral array. Reliable structural and temporal information could be extracted from these imaging results.
Collapse
Affiliation(s)
- Luxi Wei
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands.
| | - Geraldi Wahyulaksana
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | | | - Robert Beurskens
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Enrico Boni
- Department of Information Engineering, University of Florence, Florence, Italy
| | - Alessandro Ramalli
- Department of Information Engineering, University of Florence, Florence, Italy
| | - Emile Noothout
- Department of Imaging Physics, Delft University of Technology, Delft, The Netherlands
| | - Dirk J Duncker
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Piero Tortoli
- Department of Information Engineering, University of Florence, Florence, Italy
| | - Antonius F W van der Steen
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Department of Imaging Physics, Delft University of Technology, Delft, The Netherlands
| | - Nico de Jong
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Department of Imaging Physics, Delft University of Technology, Delft, The Netherlands
| | - Martin Verweij
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Department of Imaging Physics, Delft University of Technology, Delft, The Netherlands
| | - Hendrik J Vos
- Department of Cardiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands; Department of Imaging Physics, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
48
|
Yu X, Luan S, Lei S, Huang J, Liu Z, Xue X, Ma T, Ding Y, Zhu B. Deep learning for fast denoising filtering in ultrasound localization microscopy. Phys Med Biol 2023; 68:205002. [PMID: 37703894 DOI: 10.1088/1361-6560/acf98f] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Accepted: 09/13/2023] [Indexed: 09/15/2023]
Abstract
Objective.Addition of a denoising filter step in ultrasound localization microscopy (ULM) has been shown to effectively reduce the error localizations of microbubbles (MBs) and achieve resolution improvement for super-resolution ultrasound (SR-US) imaging. However, previous image-denoising methods (e.g. block-matching 3D, BM3D) requires long data processing times, making ULM only able to be processed offline. This work introduces a new way to reduce data processing time through deep learning.Approach.In this study, we propose deep learning (DL) denoising based on contrastive semi-supervised network (CS-Net). The neural network is mainly trained with simulated MBs data to extract MB signals from noise. And the performances of CS-Net denoising are evaluated in bothin vitroflow phantom experiment andin vivoexperiment of New Zealand rabbit tumor.Main results.Forin vitroflow phantom experiment, the signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) of single microbubble image are 26.91 dB and 4.01 dB, repectively. Forin vivoanimal experiment , the SNR and CNR were 12.29 dB and 6.06 dB. In addition, single microvessel of 24μm and two microvessels separated by 46μm could be clearly displayed. Most importantly,, the CS-Net denoising speeds forin vitroandin vivoexperiments were 0.041 s frame-1and 0.062 s frame-1, respectively.Significance.DL denoising based on CS-Net can improve the resolution of SR-US as well as reducing denoising time, thereby making further contributions to the clinical real-time imaging of ULM.
Collapse
Affiliation(s)
- Xiangyang Yu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shunyao Luan
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Shuang Lei
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Jing Huang
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Zeqing Liu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Xudong Xue
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Teng Ma
- The Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, People's Republic of China
| | - Yi Ding
- Department of Radiation Oncology, Hubei Cancer Hospital, TongJi Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, People's Republic of China
| | - Benpeng Zhu
- Shool of Integrated Circuit, Wuhan National Laboratory for optoelectronics, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
49
|
You Q, Lowerison MR, Shin Y, Chen X, Sekaran NVC, Dong Z, Llano DA, Anastasio MA, Song P. Contrast-Free Super-Resolution Power Doppler (CS-PD) Based on Deep Neural Networks. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:1355-1368. [PMID: 37566494 PMCID: PMC10619974 DOI: 10.1109/tuffc.2023.3304527] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/13/2023]
Abstract
Super-resolution ultrasound microvessel imaging based on ultrasound localization microscopy (ULM) is an emerging imaging modality that is capable of resolving micrometer-scaled vessels deep into tissue. In practice, ULM is limited by the need for contrast injection, long data acquisition, and computationally expensive postprocessing times. In this study, we present a contrast-free super-resolution power Doppler (CS-PD) technique that uses deep networks to achieve super-resolution with short data acquisition. The training dataset is comprised of spatiotemporal ultrafast ultrasound signals acquired from in vivo mouse brains, while the testing dataset includes in vivo mouse brain, chicken embryo chorioallantoic membrane (CAM), and healthy human subjects. The in vivo mouse imaging studies demonstrate that CS-PD could achieve an approximate twofold improvement in spatial resolution when compared with conventional power Doppler. In addition, the microvascular images generated by CS-PD showed good agreement with the corresponding ULM images as indicated by a structural similarity index of 0.7837 and a peak signal-to-noise ratio (PSNR) of 25.52. Moreover, CS-PD was able to preserve the temporal profile of the blood flow (e.g., pulsatility) that is similar to conventional power Doppler. Finally, the generalizability of CS-PD was demonstrated on testing data of different tissues using different imaging settings. The fast inference time of the proposed deep neural network also allows CS-PD to be implemented for real-time imaging. These features of CS-PD offer a practical, fast, and robust microvascular imaging solution for many preclinical and clinical applications of Doppler ultrasound.
Collapse
|
50
|
Zhang H, Huang L, Yang Y, Qiu L, He Q, Liu J, Qian L, Luo J. Evaluation of Early Diabetic Kidney Disease Using Ultrasound Localization Microscopy: A Feasibility Study. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2023; 42:2277-2292. [PMID: 37146242 DOI: 10.1002/jum.16249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 04/12/2023] [Accepted: 04/19/2023] [Indexed: 05/07/2023]
Abstract
OBJECTIVE The purpose of this study is to detect the hemodynamic changes of microvessels in the early stage of diabetic kidney disease (DKD) and to test the feasibility of ultrasound localization microscopy (ULM) in early diagnosis of DKD. METHODS In this study, streptozotocin (STZ) induced DKD rat model was used. Normal rats served as the control group. Conventional ultrasound, contrast-enhanced ultrasound (CEUS), and ULM data were collected and analyzed. The kidney cortex was divided into four segments, which are 0.25-0.5 mm (Segment 1), 0.5-0.75 mm (Segment 2), 0.75-1 mm (Segment 3), and 1-1.25 mm (Segment 4) away from the renal capsule, respectively. The mean blood flow velocities of arteries and veins in each segment were separately calculated, and also the velocity gradients and overall mean velocities of arteries and veins. Mann-Whitney U test was used for comparison of the data. RESULTS Quantitative results of microvessel velocity obtained by ULM show that the arterial velocity of Segments 2, 3, and 4, and the overall mean arterial velocity of the four segments in the DKD group are significantly lower than those in the normal group. The venous velocity of Segment 3 and the overall mean venous velocity of the four segments in the DKD group are higher than those in the normal group. The arterial velocity gradient in the DKD group is lower than that in the normal group. CONCLUSION ULM can visualize and quantify the blood flow and may be used for early diagnosis of DKD.
Collapse
Affiliation(s)
- Hong Zhang
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Lijie Huang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Yi Yang
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Lanyan Qiu
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Qiong He
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Jinping Liu
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Linxue Qian
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Jianwen Luo
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| |
Collapse
|