Super-Resolution Ultrasound Through Sparsity-Based Deconvolution and Multi-Feature Tracking

Improved Microbubble Tracking for Super-Resolution Ultrasound Localization Microscopy using a Bi-Directional Long Short-term Memory Neural Network

Ultrasound localization microscopy (ULM) enabled high-accuracy measurements of microvessel flow beyond the resolution limit of conventional ultrasound imaging by utilizing contrast microbubbles (MBs) as point targets. Robust tracking of MBs is an essential task for fast and high-quality ULM image reconstruction. Existing MB tracking methods suffer from challenging imaging scenarios such as high-density MB distributions, fast blood flow, and complex flow dynamics. Here we present a deep learning-based MB pairing and tracking method based on a bi-directional long short-term memory neural network for ULM. The proposed method integrates multiparametric MB characteristics to facilitate more robust and accurate MB pairing and tracking. The method was validated on a simulation data set, a tissue-mimicking flow phantom, and in vivo on a mouse and rat brain.

A Tracking Prior to Localization Workflow for Ultrasound Localization Microscopy

Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting in detecting microbubbles (MB) in the frames before pairing them to generate tracks. While conventional LAT methods perform well at low concentrations, they suffer from longer acquisition times and degraded localization and tracking accuracy at higher concentrations, leading to biased angiogram reconstruction and velocity estimation. In this study, we propose a novel approach to address these challenges by reversing the current workflow. The proposed method, Tracking-and-Localization (TAL), relies on first tracking the MB and then performing localization. Through comprehensive benchmarking using both in silico and in vivo experiments and employing various metrics to quantify ULM angiography and velocity maps, we demonstrate that the TAL method consistently outperforms the reference LAT workflow. Moreover, when applied to DULM, TAL successfully extracts velocity variations along the cardiac cycle with improved repeatability. The findings of this work highlight the effectiveness of the TAL approach in overcoming the limitations of conventional LAT methods, providing enhanced ULM angiography and velocity imaging.

Microbubble tracking based on partial smoothing-based adaptive generalized labelled Multi-Bernoulli filter for super-resolution imaging

Super-resolution ultrasound (SRUS) can image the vasculature at microscopic resolution according to microbubble (MB) localization, with velocity vector maps obtained based on MB tracking information. High MB concentrations can reduce the acquisition time of SRUS imaging, however adjacent and intersecting vessels are difficult to distinguish, thus decreasing resolution. Low acquisition frame rates affect the precision of flow velocity estimation. This study proposes a partial smoothing-based adaptive generalized labeled multi-Bernoulli filter (SAGLMB) to precisely track the MB motion at different flow velocities. SAGLMB employs a generalized labelled multi-Bernoulli filter (GLMB) for MB trajectory allocation to separate adjacent and intersecting vessels. Furthermore, the nonlinear motion of MB was predicted by an unscented Kalman filter, and a cardinalized probability hypothesis density filter was applied to suppress clutter interference. Finally, the trajectories were smoothed by unscented Rauch-Tung-Striebel to improve the resolution of the SRUS image. The simulation results demonstrate that SAGLMB outperforms the conventional bipartite graph-based tracking at high MB concentrations, achieving at least an 8.55 % improvement in the correctly paired precision, with 3 times increase in the structural similarity index measure. Moreover, SAGLMB can obtain more precise flow velocity estimations with a 4 times improvement than the conventional method. The SRUS results of rabbit kidney show that the proposed method significantly improves resolution of adjacent and intersecting vessels at higher MB concentrations and maintains this performance as the acquisition frame rate decreases. Furthermore, the rat brain microvascular network was reconstructed with 9.21 μm (λ/11.1) resolution. Therefore, SAGLMB can achieve robust SRUS imaging at high concentrations and low acquisition frame rates.

Underestimation of Flow Velocity in 2-D Super-Resolution Ultrasound Imaging

Velocity estimation in ultrasound imaging is a technique to measure the speed and direction of blood flow. The flow velocity in small blood vessels, i.e., arterioles, venules, and capillaries, can be estimated using super-resolution ultrasound imaging (SRUS). However, the vessel width in SRUS is relatively small compared with the full-width-half-maximum of the ultrasound beam in the elevation direction, which directly impacts the velocity estimation. By taking into consideration the small vessel widths in SRUS, it is hypothesized that the velocity is underestimated in 2-D SRUS when the vessel diameter is smaller than the full width at half maximum elevation resolution of the transducer (FWHMy). A theoretical model is introduced to show that the velocity of a 3-D parabolic velocity profile is underestimated by up to 33% in 2-D SRUS, if the width of the vessel is smaller than FWHMy. This model was tested using Field II simulations and 3-D-printed micro-flow hydrogel phantom measurements. A Verasonics Vantage 256 scanner and a GE L8-18i-D linear array transducer with FWHMy of approximately at the elevation focus were used in the simulations and measurements. Simulations of different parabolic velocity profiles showed that the velocity underestimation was 36.8% % (mean ± standard deviation). The measurements showed that the velocity was underestimated by 30% %. Moreover, the results of vessel diameters, ranging from FWHMy to FWHMy, indicate that velocities are estimated according to the theoretical model. The theoretical model can, therefore, be used for the compensation of velocity estimates under these circumstances.

Transcutaneous Imaging of Rabbit Kidney Using 3-D Acoustic Wave Sparsely Activated Localization Microscopy With a Row-Column-Addressed Array

OBJECTIVE

Super-resolution ultrasound (SRUS) imaging through localizing and tracking microbubbles, also known as ultrasound localization microscopy (ULM), can produce sub-diffraction resolution images of micro-vessels. We have recently demonstrated 3-D selective SRUS with a matrix array and phase change contrast agents (PCCAs). However, this method is limited to a small field of view (FOV) and by the complex hardware required.

METHOD

This study proposed 3-D acoustic wave sparsely activated localization microscopy (AWSALM) using PCCAs and a 128+128 row-column-addressed (RCA) array, which offers ultrafast acquisition with over 6 times larger FOV and 4 times reduction in hardware complexity than a 1024-element matrix array. We first validated this method on an in-vitro microflow phantom and subsequently demonstrated non-invasively on a rabbit kidney in-vivo.

RESULTS

Our results show that 3-D AWSALM images of the phantom covering a mm volume can be generated under 5 seconds with an 8 times resolution improvement over the system point spread function. The full volume of the rabbit kidney can be covered to generate 3-D microvascular structure, flow speed and direction super-resolution maps under 15 seconds, combining the large FOV of RCA with the high resolution of SRUS. Additionally, 3-D AWSALM is selective and can visualize the microvasculature within the activation volume and downstream vessels in isolation. Sub-sets of the kidney microvasculature can be imaged through selective activation of PCCAs.

CONCLUSION

Our study demonstrates large FOV 3-D AWSALM using an RCA probe.

SIGNIFICANCE

3-D AWSALM offers an unique in-vivo imaging tool for fast, selective and large FOV vascular flow mapping.

Ultrasound Localization Microscopy Precision of Clinical 3-D Ultrasound Systems

Ultrasound localization microscopy (ULM) is becoming well established in preclinical applications. For its translation into clinical practice, the localization precision achievable with commercial ultrasound (US) scanners is crucial-especially with volume imaging, which is essential for dealing with out-of-plane motion. Here, we propose an easy-to-perform method to estimate the localization precision of 3-D US scanners. With this method, we evaluated imaging sequences of the Philips Epiq 7 US device using the X5-1 and the XL14-3 matrix transducers and also tested different localization methods. For the X5-1 transducer, the best lateral, elevational, and axial precision was 109, 95, and m for one contrast mode, and 29, 22, and m for the other. The higher frequency XL14-3 transducer yielded precisions of 17, 38, and m using the harmonic imaging mode. Although the center of mass was the most robust localization method also often providing the best precision, the localization method has only a minor influence on the localization precision compared to the impact by the imaging sequence and transducer. The results show that with one of the imaging modes of the X5-1 transducer, precisions comparable to the XL14-3 transducer can be achieved. However, due to localization precisions worse than m, reconstruction of the microvasculature at the capillary level will not be possible. These results show the importance of evaluating the localization precision of imaging sequences from different US transducers or scanners in all directions before using them for in vivo measurements.

Efficient Microbubble Trajectory Tracking in Ultrasound Localization Microscopy Using a Gated Recurrent Unit-Based Multitasking Temporal Neural Network

Ultrasound localization microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical tradeoff between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps such as pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the gated recurrent unit-based multitasking temporal neural network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. In addition, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer replacements to systematically evaluate the performance of various temporal neural networks, including recurrent neural network (RNN), long short-term memory network (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. In addition, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. The model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.

Capillary-scale Microvessel Imaging with High-frequency Ultrasound Localization Microscopy in Mouse Brain

Ultrasound localization microscopy is a super-resolution vascular imaging technique which has garnered substantial interest as a tool for small animal neuroimaging, neuroscience research, and the characterization of vascular pathologies. In the pursuit of increasingly high-fidelity reconstructions of microvasculature, there remains several outstanding questions concerning this sub-diffraction imaging technology, including the accurate reconstruction of microvessels approaching the capillary scale and the pragmatic challenges associated with long data acquisition times. In the context of small animal neurovascular imaging, we posit that increasing the ultrasound imaging frequency is a straightforward approach to enable higher concentrations of microbubble contrast agents, thus increasing the likelihood of microvascular/capillary mapping and decreasing the imaging duration. We demonstrate that higher frequency imaging results in improved ULM fidelity and more efficient microbubble localization due to a smaller microbubble point-spread function that is easier to localize, and which can achieve a higher localizable concentration within the same unit volume of tissue. A select example of in vivo capillary-level vascular reconstruction is demonstrated for the highest frequency imaging probe, which has substantial implications for neuroscientists investigating microvascular function in disease states, regulation, and brain development. High frequency ULM yielding a spatial resolution of 7.1μm, as measured by Fourier ring correlation, throughout the entire depth of the brain, highlighting this technology as a highly relevant tool for neuroimaging research.

RF-ULM: Ultrasound Localization Microscopy Learned From Radio-Frequency Wavefronts

In Ultrasound Localization Microscopy (ULM), achieving high-resolution images relies on the precise localization of contrast agent particles across a series of beamformed frames. However, our study uncovers an enormous potential: The process of delay-and-sum beamforming leads to an irreversible reduction of Radio-Frequency (RF) channel data, while its implications for localization remain largely unexplored. The rich contextual information embedded within RF wavefronts, including their hyperbolic shape and phase, offers great promise for guiding Deep Neural Networks (DNNs) in challenging localization scenarios. To fully exploit this data, we propose to directly localize scatterers in RF channel data. Our approach involves a custom super-resolution DNN using learned feature channel shuffling, non-maximum suppression, and a semi-global convolutional block for reliable and accurate wavefront localization. Additionally, we introduce a geometric point transformation that facilitates seamless mapping to the B-mode coordinate space. To understand the impact of beamforming on ULM, we validate the effectiveness of our method by conducting an extensive comparison with State-Of-The-Art (SOTA) techniques. We present the inaugural in vivo results from a wavefront-localizing DNN, highlighting its real-world practicality. Our findings show that RF-ULM bridges the domain shift between synthetic and real datasets, offering a considerable advantage in terms of precision and complexity. To enable the broader research community to benefit from our findings, our code and the associated SOTA methods are made available at https://github.com/hahnec/rf-ulm.

Non-invasive ultrasound localization microscopy (ULM) in azoospermia: connecting testicular microcirculation to spermatogenic functions

Rationale: Azoospermia is a significant reproductive challenge. Differentiating between non-obstructive azoospermia (NOA) and obstructive azoospermia (OA) is crucial as each type requires distinct management strategies. Testicular microcirculation plays a profound role in spermatogenic functions. However, current diagnostic methods are limited in their ability to effectively elucidate this crucial connection. Methods: We employed ultrasound localization microscopy (ULM) to visualize testicular microcirculation in NOA and OA patients and quantified the testicular hemodynamic parameters. Pearson correlation analysis was conducted to investigate the inner connection between parameters of testicular microcirculation and clinical spermatogenic functions. We conducted multiple logistic regression analysis to establish a new diagnostic model that integrates follicle-stimulating hormone (FSH) and mean vascular diameter to distinguish NOA from OA. Results: Our findings demonstrated significant differences in vascular parameters between NOA and OA, with NOA characterized by lower mean vascular diameter (p < 0.001), vessel density (p < 0.001), and fractal number (p < 0.001). Testicular volume showed a moderate positive correlation with mean vascular diameter (r = 0.419, p < 0.01) and vessel density (r = 0.415, p < 0.01); Mean vascular diameter exhibited negative correlations with both FSH (r = -0.214, p < 0.05) and age (r = -0.240, p < 0.05); FSH (r = -0.202, p < 0.05) and luteinizing hormone (LH) (r = -0.235, p < 0.05) were negatively correlated with mean blood flow velocity. The diagnostic model demonstrated an area under the curve (AUC) of 0.968. We also reported a method to map the vascular pressure distribution derived from the blood flow velocity generated by ULM. Conclusions: ULM provides a non-invasive and detailed assessment of testicular microvascular dynamics. The ULM-derived vascular parameters are able to connect testicular microcirculation to spermatogenic functions. The combination of FSH and mean vascular diameter enhances diagnostic precision and holds potential for distinguishing NOA from OA.

Evaluation of tumor microvasculature with 3D ultrasound localization microscopy based on 2D matrix array

OBJECTIVE

Evaluation of tumor microvascular morphology is of great significance in tumor diagnosis, therapeutic effect prediction, and surgical planning. Recently, two-dimensional ultrasound localization microscopy (2DULM) has demonstrated its superiority in the field of microvascular imaging. However, it suffers from planar dependence and is unintuitive. We propose a novel three-dimensional ultrasound localization microscopy (3DULM) to avoid these limitations.

METHODS

We investigated 3DULM based on a 2D array for tumor microvascular imaging. After intravenous injection of contrast agents, all elements of the 2D array transmit and receive signals to ensure a high and stable frame rate. Microbubble signal extraction, filtering, positioning, tracking, and other processing were used to obtain a 3D vascular map, flow velocity, and flow direction. To verify the effectiveness of 3DULM, it was validated on double helix tubes and rabbit VX2 tumors. Cisplatin was used to verify the ability of 3DULM to detect microvascular changes during tumor treatment.

RESULTS

In vitro, the sizes measured by 3DULM at 3 mm and 13 mm were 178 μ m and 182 μ m , respectively. In the rabbit tumors, we acquired 9000 volumes to reveal vessels about 30 μ m in diameter, which surpasses the diffraction limit of ultrasound in traditional ultrasound imaging, and the results matched with micro-angiography. In addition, there were significant changes in vascular density and curvature between the treatment and control groups.

CONCLUSIONS

The effectiveness of 3DULM was verified in vitro and in vivo. Hence, 3DULM may have potential applications in tumor diagnosis, tumor treatment evaluation, surgical protocol guidance, and cardiovascular disease.

CLINICAL RELEVANCE STATEMENT

3D ultrasound localization microscopy is highly sensitive to microvascular changes; thus, it has clinical potential for tumor diagnosis and treatment evaluation.

KEY POINTS

• 3D ultrasound localization microscopy is demonstrated on double helix tubes and rabbit VX2 tumors. • 3D ultrasound localization microscopy can reveal vessels about 30 μ m in diameter-far smaller than traditional ultrasound. • This form of imaging has potential applications in tumor diagnosis, tumor treatment evaluation, surgical protocol guidance, and cardiovascular disease.

Super-Resolution Ultrasound Imaging Using the Erythrocytes-Part II: Velocity Images

Super-resolution ultrasound imaging using the erythrocytes (SURE) has recently been introduced. The method uses erythrocytes as targets instead of fragile microbubbles (MBs). The abundance of erythrocyte scatterers makes it possible to acquire SURE data in just a few seconds compared with several minutes in ultrasound localization microscopy (ULM) using MBs. A high number of scatterers can reduce the acquisition time; however, the tracking of uncorrelated and high-density scatterers is quite challenging. This article hypothesizes that it is possible to detect and track erythrocytes as targets to obtain vascular flow images. A SURE tracking pipeline is used with modules for beamforming, recursive synthetic aperture (SA) imaging, motion estimation, echo canceling, peak detection, and recursive nearest-neighbor (NN) tracker. The SURE tracking pipeline is capable of distinguishing the flow direction and separating tubes of a simulated Field II phantom with 125-25- [Formula: see text] wall-to-wall tube distances, as well as a 3-D printed hydrogel micr-flow phantom with 100-60- [Formula: see text] wall-to-wall channel distances. The comparison of an in vivo SURE scan of a Sprague-Dawley rat kidney with ULM and micro-computed tomography (CT) scans with voxel sizes of 26.5 and [Formula: see text] demonstrated consistent findings. A microvascular structure composed of 16 vessels exhibited similarities across all imaging modalities. The flow direction and velocity profiles in the SURE scan were found to be concordant with those from ULM.

ULTRA-SR Challenge: Assessment of Ultrasound Localization and TRacking Algorithms for Super-Resolution Imaging

With the widespread interest and uptake of super-resolution ultrasound (SRUS) through localization and tracking of microbubbles, also known as ultrasound localization microscopy (ULM), many localization and tracking algorithms have been developed. ULM can image many centimeters into tissue in-vivo and track microvascular flow non-invasively with sub-diffraction resolution. In a significant community effort, we organized a challenge, Ultrasound Localization and TRacking Algorithms for Super-Resolution (ULTRA-SR). The aims of this paper are threefold: to describe the challenge organization, data generation, and winning algorithms; to present the metrics and methods for evaluating challenge entrants; and to report results and findings of the evaluation. Realistic ultrasound datasets containing microvascular flow for different clinical ultrasound frequencies were simulated, using vascular flow physics, acoustic field simulation and nonlinear bubble dynamics simulation. Based on these datasets, 38 submissions from 24 research groups were evaluated against ground truth using an evaluation framework with six metrics, three for localization and three for tracking. In-vivo mouse brain and human lymph node data were also provided, and performance assessed by an expert panel. Winning algorithms are described and discussed. The publicly available data with ground truth and the defined metrics for both localization and tracking present a valuable resource for researchers to benchmark algorithms and software, identify optimized methods/software for their data, and provide insight into the current limits of the field. In conclusion, Ultra-SR challenge has provided benchmarking data and tools as well as direct comparison and insights for a number of the state-of-the art localization and tracking algorithms.

Research into super-resolution in medical imaging from 2000 to 2023: bibliometric analysis and visualization

Background

Super-resolution (SR) refers to the use of hardware or software methods to enhance the resolution of low-resolution (LR) images and produce high-resolution (HR) images. SR is applied frequently across a variety of medical imaging contexts, particularly in the enhancement of neuroimaging, with specific techniques including SR microscopy-used for diagnostic biomarkers-and functional magnetic resonance imaging (fMRI)-a neuroimaging method for the measurement and mapping of brain activity. This bibliometric analysis of the literature related to SR in medical imaging was conducted to identify the global trends in this field, and visualization via graphs was completed to offer insights into future research prospects.

Methods

In order to perform a bibliometric analysis of the SR literature, this study sourced all publications from the Web of Science Core Collection (WoSCC) database published from January 1, 2000, to October 11, 2023. A total of 3,262 articles on SR in medical imaging were evaluated. VOSviewer was used to perform co-occurrence and co-authorship analysis, and network visualization of the literature data, including author, journal, publication year, institution, and keywords, was completed.

Results

From 2000 to 2023, the annual publication volume surged from 13 to 366. The top three journals in this field in terms of publication volume were as follows: (I) Scientific Reports (86 publications), (II) IEEE Transactions on Medical Imaging (74 publications), and (III) IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control (56 publications). The most prolific country, institution, and author were the United States (1,017 publications; 31,301 citations), the Chinese Academy of Sciences (124 publications; 2,758 citations), and Dinggang Shen (20 publications; 671 citations), respectively. A cluster analysis of the top 100 keywords was conducted, which revealed the presence of five co-occurrence clusters: (I) SR and artificial intelligence (AI) for medical image enhancement, (II) SR and inverse problem processing concepts for positron emission tomography (PET) image processing, (III) SR ultrasound through microbubbles, (IV) SR microscopy for Alzheimer and Parkinson diseases, and (V) SR in brain fMRI: rapid acquisition and precise imaging. The most recent high-frequency keywords were deep learning (DL), magnetic resonance imaging (MRI), and convolutional neural networks (CNNs).

Conclusions

Over the past two decades, the output of publications by countries, institutions, and authors in the field of SR in medical imaging has steadily increased. Based on bibliometric analysis of international trends, the resurgence of SR in medical imaging has been facilitated by advancements in AI. The increasing need for multi-center and multi-modal medical images has further incentivized global collaboration, leading to the diverse research paths in SR medical imaging among prominent scientists.

Ultrafast 3-D Transcutaneous Super Resolution Ultrasound Using Row-Column Array Specific Coherence-Based Beamforming and Rolling Acoustic Sub-aperture Processing: In Vitro, in Rabbit and in Human Study

OBJECTIVE

This study aimed to realise 3-D super-resolution ultrasound imaging transcutaneously with a row-column array which has far fewer independent electronic channels and a wider field of view than typical fully addressed 2-D matrix arrays. The in vivo image quality of the row-column array is generally poor, particularly when imaging non-invasively. This study aimed to develop a suite of image formation and post-processing methods to improve image quality and demonstrate the feasibility of ultrasound localisation microscopy using a row-column array, transcutaneously on a rabbit model and in a human.

METHODS

To achieve this, a processing pipeline was developed which included a new type of rolling window image reconstruction, which integrated a row-column array specific coherence-based beamforming technique with acoustic sub-aperture processing. This and other processing steps reduced the 'secondary' lobe artefacts, and noise and increased the effective frame rate, thereby enabling ultrasound localisation images to be produced.

RESULTS

Using an in vitro cross tube, it was found that the procedure reduced the percentage of 'false' locations from ∼26% to ∼15% compared to orthogonal plane wave compounding. Additionally, it was found that the noise could be reduced by ∼7 dB and the effective frame rate was increased to over 4000 fps. In vivo, ultrasound localisation microscopy was used to produce images non-invasively of a rabbit kidney and a human thyroid.

CONCLUSION

It has been demonstrated that the proposed methods using a row-column array can produce large field of view super-resolution microvascular images in vivo and in a human non-invasively.

Microbubble detection on ultrasound imaging by utilizing phase patterned waves

Objective.Super-resolution ultrasonography offers the advantage of visualization of intricate microvasculature, which is crucial for disease diagnosis. Mapping of microvessels is possible by localizing microbubbles (MBs) that act as contrast agents and tracking their location. However, there are limitations such as the low detectability of MBs and the utilization of a diluted concentration of MBs, leading to the extension of the acquisition time. We aim to enhance the detectability of MBs to reduce the acquisition time of acoustic data necessary for mapping the microvessels.Approach.We propose utilizing phase patterned waves (PPWs) characterized by spatially patterned phase distributions in the incident beam to achieve this. In contrast to conventional ultrasound irradiation methods, this irradiation method alters bubble interactions, enhancing the oscillation response of MBs and generating more significant scattered waves from specific MBs. This enhances the detectability of MBs, thereby enabling the detection of MBs that were undetectable by the conventional method. The objective is to maximize the overall detection of bubbles by utilizing ultrasound imaging with additional PPWs, including the conventional method. In this paper, we apply PPWs to ultrasound imaging simulations considering bubble-bubble interactions to elucidate the characteristics of PPWs and demonstrate their efficacy by employing PPWs on MBs fixed in a phantom by the experiment.Main results.By utilizing two types of PPWs in addition to the conventional ultrasound irradiation method, we confirmed the detection of up to 93.3% more MBs compared to those detected using the conventional method alone.Significance.Ultrasound imaging using additional PPWs made it possible to increase the number of detected MBs, which is expected to improve the efficiency of bubble detection.

Transthoracic ultrasound localization microscopy of myocardial vasculature in patients

Myocardial microvasculature and haemodynamics are indicative of potential microvascular diseases for patients with symptoms of coronary heart disease in the absence of obstructive coronary arteries. However, imaging microvascular structure and flow within the myocardium is challenging owing to the small size of the vessels and the constant movement of the patient's heart. Here we show the feasibility of transthoracic ultrasound localization microscopy for imaging myocardial microvasculature and haemodynamics in explanted pig hearts and in patients in vivo. Through a customized data-acquisition and processing pipeline with a cardiac phased-array probe, we leveraged motion correction and tracking to reconstruct the dynamics of microcirculation. For four patients, two of whom had impaired myocardial function, we obtained super-resolution images of myocardial vascular structure and flow using data acquired within a breath hold. Myocardial ultrasound localization microscopy may facilitate the understanding of myocardial microcirculation and the management of patients with cardiac microvascular diseases.

Understanding the effects of microbubble concentration on localization accuracy in super-resolution ultrasound imaging

Super-resolution ultrasound (SRUS) through localising and tracking of microbubbles (MBs) can achieve sub-wavelength resolution for imaging microvascular structure and flow dynamics in deep tissuein vivo. The technique assumes that signals from individual MBs can be isolated and localised accurately, but this assumption starts to break down when the MB concentration increases and the signals from neighbouring MBs start to interfere. The aim of this study is to gain understanding of the effect of MB-MB distance on ultrasound images and their localisation. Ultrasound images of two MBs approaching each other were synthesised by simulating both ultrasound field propagation and nonlinear MB dynamics. Besides the distance between MBs, a range of other influencing factors including MB size, ultrasound frequency, transmit pulse sequence, pulse amplitude and localisation methods were studied. The results show that as two MBs approach each other, the interference fringes can lead to significant and oscillating localisation errors, which are affected by both the MB and imaging parameters. When modelling a clinical linear array probe operating at 6 MHz, localisation errors between 20 and 30μm (∼1/10 wavelength) can be generated when MBs are ∼500μm (2 wavelengths or ∼1.7 times the point spread function (PSF)) away from each other. When modelling a cardiac probe operating at 1.5 MHz, the localisation errors were as high as 200μm (∼1/5 wavelength) even when the MBs were more than 10 wavelengths apart (2.9 times the PSF). For both frequencies, at smaller separation distances, the two MBs were misinterpreted as one MB located in between the two true positions. Cross-correlation or Gaussian fitting methods were found to generate slightly smaller localisation errors than centroiding. In conclusion, caution should be taken when generating and interpreting SRUS images obtained using high agent concentration with MBs separated by less than 1.7 to 3 times the PSF, as significant localisation errors can be generated due to interference between neighbouring MBs.

3D Acoustic Wave Sparsely Activated Localization Microscopy With Phase Change Contrast Agents

OBJECTIVE

The aim of this study is to demonstrate 3-dimensional (3D) acoustic wave sparsely activated localization microscopy (AWSALM) of microvascular flow in vivo using phase change contrast agents (PCCAs).

MATERIALS AND METHODS

Three-dimensional AWSALM using acoustically activable PCCAs was evaluated on a crossed tube microflow phantom, the kidney of New Zealand White rabbits, and the brain of C57BL/6J mice through intact skull. A mixture of C 3 F 8 and C 4 F 10 low-boiling-point fluorocarbon gas was used to generate PCCAs with an appropriate activation pressure. A multiplexed 8-MHz matrix array connected to a 256-channel ultrasound research platform was used for transmitting activation and imaging ultrasound pulses and recording echoes. The in vitro and in vivo echo data were subsequently beamformed and processed using a set of customized algorithms for generating 3D super-resolution ultrasound images through localizing and tracking activated contrast agents.

RESULTS

With 3D AWSALM, the acoustic activation of PCCAs can be controlled both spatially and temporally, enabling contrast on demand and capable of revealing 3D microvascular connectivity. The spatial resolution of the 3D AWSALM images measured using Fourier shell correlation is 64 μm, presenting a 9-time improvement compared with the point spread function and 1.5 times compared with half the wavelength. Compared with the microbubble-based approach, more signals were localized in the microvasculature at similar concentrations while retaining sparsity and longer tracks in larger vessels. Transcranial imaging was demonstrated as a proof of principle of PCCA activation in the mouse brain with 3D AWSALM.

CONCLUSIONS

Three-dimensional AWSALM generates volumetric ultrasound super-resolution microvascular images in vivo with spatiotemporal selectivity and enhanced microvascular penetration.

Time Efficient Ultrasound Localization Microscopy Based on A Novel Radial Basis Function 2D Interpolation

Ultrasound localization microscopy (ULM) allows for the generation of super-resolved (SR) images of the vasculature by precisely localizing intravenously injected microbubbles. Although SR images may be useful for diagnosing and treating patients, their use in the clinical context is limited by the need for prolonged acquisition times and high frame rates. The primary goal of our study is to relax the requirement of high frame rates to obtain SR images. To this end, we propose a new time-efficient ULM (TEULM) pipeline built on a cutting-edge interpolation method. More specifically, we suggest employing Radial Basis Functions (RBFs) as interpolators to estimate the missing values in the 2-dimensional (2D) spatio-temporal structures. To evaluate this strategy, we first mimic the data acquisition at a reduced frame rate by applying a down-sampling (DS = 2, 4, 8, and 10) factor to high frame rate ULM data. Then, we up-sample the data to the original frame rate using the suggested interpolation to reconstruct the missing frames. Finally, using both the original high frame rate data and the interpolated one, we reconstruct SR images using the ULM framework steps. We evaluate the proposed TEULM using four in vivo datasets, a Rat brain (dataset A), a Rat kidney (dataset B), a Rat tumor (dataset C) and a Rat brain bolus (dataset D), interpolating at the in-phase and quadrature (IQ) level. Results demonstrate the effectiveness of TEULM in recovering vascular structures, even at a DS rate of 10 (corresponding to a frame rate of sub-100Hz). In conclusion, the proposed technique is successful in reconstructing accurate SR images while requiring frame rates of one order of magnitude lower than standard ULM.

Broad Elevation Projection Super-Resolution Ultrasound (BEP-SRUS) Imaging With a 1-D Unfocused Linear Array

Super-resolution ultrasound (SRUS) through localizing spatially isolated microbubbles (MBs) has been demonstrated to overcome the wave diffraction limit and reveal the microvascular structure and flow information at the microscopic scale. However, 3-D SRUS imaging remains a challenge due to the fabrication and computational complexity of 2-D matrix array probes. Inspired by X-ray radiography which can present information within a volume in a single projection image with much simpler hardware than X-ray computerized tomography (CT), this study investigates the feasibility of broad elevation projection super-resolution (BEP-SR) ultrasound using a 1-D unfocused linear array. Both simulation and in vitro experiments were conducted on 3-D microvessel phantoms. In vivo demonstration was done on the Rabbit kidney. Data from a 1-D linear array with and without an elevational focus were synthesized by summing up row signals acquired from a 2-D matrix array with and without delays. A full 3-D reconstruction was also generated as the reference, using the same data of the 2-D matrix array but without summing row signals. Results show that using an unfocused 1-D array probe, BEP-SR can capture significantly more information within a volume in both vascular structure and flow velocity than the conventional 1-D elevational-focused probe. Compared with the 2-D projection image of the full 3-D SRUS results using the 2-D array probe with the same aperture size, the 2-D projection SRUS image of BEP-SR has similar volume coverage, using 32 folds fewer independent elements. This study demonstrates BEP-SR's ability of high-resolution imaging of microvascular structures and flow velocity within a 3-D volume at significantly reduced costs. The proposed BEP method could significantly benefit the clinical translation of the SRUS imaging technique by making it more affordable and repeatable.

Ultrasound Localization Microscopy for Breast Cancer Imaging in Patients: Protocol Optimization and Comparison with Shear Wave Elastography

OBJECTIVE

Ultrasound localization microscopy (ULM) has gained increasing attention in recent years because of its ability to visualize blood vessels at super-resolution. The field of oncology, in particular, could benefit from detailed vascular characterization, for example, for diagnosis and therapy monitoring. This study was aimed at refining ULM for breast cancer patients by optimizing the measurement protocol, identifying translational challenges and combining ULM and shear wave elastography.

METHODS

We computed ULM images of 11 patients with breast cancer by recording contrast-enhanced ultrasound (CEUS) sequences and post-processing them in an offline pipeline. For CEUS, two different doses and injection speeds of SonoVue were applied. The best injection protocol was determined based on quantitative parameters derived from so-called occurrence maps. In addition, a suitable measurement time window was determined, also considering the occurrence of motion. ULM results were compared with shear wave elastography and histological vessel density.

RESULTS

At the higher dose and injection speed, the highest number of microbubbles, number of tracks and vessel coverage were achieved, leading to the most detailed representation of tumor vasculature. Even at the highest concentration, no significant overlay of microbubble signals occurred. Motion significantly reduced the number of usable frames, thus limiting the measurement window to 3.5 min. ULM vessel coverage was comparable to the histological vessel fraction and correlated significantly with mean tumor elasticity.

CONCLUSION

The settings for microbubble injection strongly influence ULM images, thus requiring optimized protocols for different indications. Patient and examiner motion was identified as the main translational challenge for ULM.

Acceleration-Based Kalman Tracking for Super-Resolution Ultrasound Imaging In Vivo

Super-resolution ultrasound (SRUS) can image microvascular structure and flow at subwave-diffraction resolution based on localizing and tracking microbubbles (MBs). Currently, tracking MBs accurately under limited imaging frame rates and high MB concentrations remains a challenge, especially under the effect of cardiac pulsatility and in highly curved vessels. In this study, an acceleration-incorporated MB motion model is introduced into a Kalman tracking framework. The tracking performance was evaluated using simulated microvasculature with different MB motion parameters, concentrations, and acquisition frame rates, and in vivo human breast tumor US datasets. The simulation results show that the acceleration-based method outperformed the nonacceleration-based method at different levels of acceleration and acquisition frame rates and achieved significant improvement in true positive rate (TPR; up to 11.3%) and false negative rate (FNR; up to 13.2%). The proposed method can also reduce errors in vasculature reconstruction via the acceleration-based nonlinear interpolation, compared with linear interpolation (up to [Formula: see text]). The tracking results from temporally downsampled low frame rate in vivo datasets from human breast tumors show that the proposed method has better MB tracking performance than the baseline method, if using results from the initial high frame data as a reference. Finally, the acceleration estimated from tracking results also provides a spatial speed gradient map that may contain extra valuable diagnostic information.

Fast 3D Super-Resolution Ultrasound With Adaptive Weight-Based Beamforming

OBJECTIVE

Super-resolution ultrasound (SRUS) imaging through localising and tracking sparse microbubbles has been shown to reveal microvascular structure and flow beyond the wave diffraction limit. Most SRUS studies use standard delay and sum (DAS) beamforming, where high side lobes and broad main lobes make isolation and localisation of densely distributed bubbles challenging, particularly in 3D due to the typically small aperture of matrix array probes.

METHOD

This study aimed to improve 3D SRUS by implementing a new fast 3D coherence beamformer based on channel signal variance. Two additional fast coherence beamformers, that have been implemented in 2D were implemented in 3D for the first time as comparison: a nonlinear beamformer with p-th root compression and a coherence factor beamformer. The 3D coherence beamformers, together with DAS, were compared in computer simulation, on a microflow phantom and in vivo.

RESULTS

Simulation results demonstrated that all three adaptive weight-based beamformers can narrow the main lobe, suppress the side lobes, while maintaining the weaker scatter signals. Improved 3D SRUS images of microflow phantom and a rabbit kidney within a 3-second acquisition were obtained using the adaptive weight-based beamformers, when compared with DAS.

CONCLUSION

The adaptive weight-based 3D beamformers can improve the SRUS and the proposed variance-based beamformer performs best in simulations and experiments.

SIGNIFICANCE

Fast 3D SRUS would significantly enhance the potential utility of this emerging imaging modality in a broad range of biomedical applications.

The Emergence of Functional Ultrasound for Noninvasive Brain-Computer Interface

A noninvasive brain-computer interface is a central task in the comprehensive analysis and understanding of the brain and is an important challenge in international brain-science research. Current implanted brain-computer interfaces are cranial and invasive, which considerably limits their applications. The development of new noninvasive reading and writing technologies will advance substantial innovations and breakthroughs in the field of brain-computer interfaces. Here, we review the theory and development of the ultrasound brain functional imaging and its applications. Furthermore, we introduce latest advancements in ultrasound brain modulation and its applications in rodents, primates, and human; its mechanism and closed-loop ultrasound neuromodulation based on electroencephalograph are also presented. Finally, high-frequency acoustic noninvasive brain-computer interface is prospected based on ultrasound super-resolution imaging and acoustic tweezers.

Ultrasound localization microscopy

Ultrasound Localization Microscopy (ULM) is an emerging technique that provides impressive super-resolved images of microvasculature, i.e., images with much better resolution than the conventional diffraction-limited ultrasound techniques and is already taking its first steps from preclinical to clinical applications. In comparison to the established perfusion or flow measurement methods, namely contrast-enhanced ultrasound (CEUS) and Doppler techniques, ULM allows imaging and flow measurements even down to the capillary level. As ULM can be realized as a post-processing method, conventional ultrasound systems can be used for. ULM relies on the localization of single microbubbles (MB) of commercial, clinically approved contrast agents. In general, these very small and strong scatterers with typical radii of 1-3 µm are imaged much larger in ultrasound images than they actually are due to the point spread function of the imaging system. However, by applying appropriate methods, these MBs can be localized with sub-pixel precision. Then, by tracking MBs over successive frames of image sequences, not only the morphology of vascular trees but also functional information such as flow velocities or directions can be obtained and visualized. In addition, quantitative parameters can be derived to describe pathological and physiological changes in the microvasculature. In this review, the general concept of ULM and conditions for its applicability to microvessel imaging are explained. Based on this, various aspects of the different processing steps for a concrete implementation are discussed. The trade-off between complete reconstruction of the microvasculature and the necessary measurement time as well as the implementation in 3D are reviewed in more detail, as they are the focus of current research. Through an overview of potential or already realized preclinical and clinical applications - pathologic angiogenesis or degeneration of vessels, physiological angiogenesis, or the general understanding of organ or tissue function - the great potential of ULM is demonstrated.

Frame rate effects and their compensation on super-resolution microvessel imaging using ultrasound localization microscopy

Ultrasound localization microscopy (ULM) breaks the diffraction limit and allows imaging microvasculature at micrometric resolution while preserving the penetration depth. Frame rate plays an important role for high-quality ULM imaging, but there is still a lack of review and investigation of the frame rate effects on ULM. This work aims to clarify how frame rate influences the performance of ULM, including the effects of microbubble detection, localization and tracking. The performance of ULM was evaluated using an in vivo rat brain dataset (15.6 MHz, 3 tilted plane waves (-5°, 0°, +5°), at a compounded frame rate of 1000 Hz) with different frame rates. Quantification methods, including Fourier ring correlation and saturation parameter, were applied to analyze the spatial resolution and reconstruction efficiency, respectively. In addition, effects on each crucial step in ULM processing were further analyzed. Results showed that when frame rates dropped from 1000 Hz to 250 Hz, the spatial resolution deteriorated from 9.9 μm to 15.0 μm. Applying a velocity constraint was able to improve the ULM performance, but inappropriate constraint may artificially result in high apparent resolution. For the dataset, compared with the results of 1000 Hz frame rate, the velocity was underestimated at 100 Hz with 47.18% difference and the saturation was reduced from 55.00% at 1000 Hz to 43.34% at 100 Hz. Analysis showed that inadequate frame rate generated unreliable microbubble detection, localization and tracking as well as incomplete track reconstruction, resulting in the deterioration in spatial resolution, the underestimation in velocity measurement and the decrease in saturation. Finally, a guidance of determining the frame rate requirement was discussed by considering the required spatial sampling points based on vessel morphology, clutter filtering method, tracking algorithm and acquisition time, which provides indications for future clinical application of ULM method.

Fast and Selective Super-Resolution Ultrasound In Vivo With Acoustically Activated Nanodroplets

Perfusion by the microcirculation is key to the development, maintenance and pathology of tissue. Its measurement with high spatiotemporal resolution is consequently valuable but remains a challenge in deep tissue. Ultrasound Localization Microscopy (ULM) provides very high spatiotemporal resolution but the use of microbubbles requires low contrast agent concentrations, a long acquisition time, and gives little control over the spatial and temporal distribution of the microbubbles. The present study is the first to demonstrate Acoustic Wave Sparsely-Activated Localization Microscopy (AWSALM) and fast-AWSALM for in vivo super-resolution ultrasound imaging, offering contrast on demand and vascular selectivity. Three different formulations of acoustically activatable contrast agents were used. We demonstrate their use with ultrasound mechanical indices well within recommended safety limits to enable fast on-demand sparse activation and destruction at very high agent concentrations. We produce super-localization maps of the rabbit renal vasculature with acquisition times between 5.5 s and 0.25 s, and a 4-fold improvement in spatial resolution. We present the unique selectivity of AWSALM in visualizing specific vascular branches and downstream microvasculature, and we show super-localized kidney structures in systole (0.25 s) and diastole (0.25 s) with fast-AWSALM outperforming microbubble based ULM. In conclusion, we demonstrate the feasibility of fast and selective imaging of microvascular dynamics in vivo with subwavelength resolution using ultrasound and acoustically activatable nanodroplet contrast agents.