Enhanced linear-array photoacoustic beamforming using modified coherence factor

Enhancing image reconstruction in photoacoustic imaging using spatial coherence mean-to-standard-deviation factor beamforming

In photoacoustic imaging (PAI), a delay-and-sum (DAS) beamforming reconstruction algorithm is widely used due to its ease of implementation and fast execution. However, it is plagued by issues such as high sidelobe artifacts and low contrast, that significantly hinder the ability to differentiate various structures in the reconstructed images. In this study, we propose an adaptive weighting factor called spatial coherence mean-to-standard deviation factor (scMSF) in DAS, which is extended into the spatial frequency domain. By combining scMSF with a minimum variance (MV) algorithm, the clutter level is reduced, thereby enhancing the image contrast. Quantitative results obtained from the phantom experiment demonstrate that our proposed method improves contrast ratio (CR) by 30.15 dB and signal-to-noise ratio (SNR) by 8.62 dB compared to DAS while also improving full-width at half maxima (FWHM) by 56%. From the in-vivo experiments, the scMSF-based reconstruction image exhibits a higher generalized contrast-to-noise ratio (gCNR), indicating improved target detectability with a 25.6% enhancement over DAS and a 22.5% improvement over MV.

Adaptive complementary neighboring sub-aperture beamforming for thermoacoustic imaging

BACKGROUND

When applied to thermoacoustic imaging (TAI), the delay-and-sum (DAS) algorithm produces strong sidelobes due to its disadvantages of uniform aperture weighting. As a result, the quality of TAI images recovered by DAS is often severely degraded by strong non-coherent clutter, which restricts the development and application of TAI.

PURPOSE

To address this issue, we propose an adaptive complementary neighboring sub-aperture (NSA) beamforming algorithm for TAI.

METHODS

In NSA, we introduce a coordinate system transformation when calculating the normalized cross-correlation (NCC) matrix. This approach enables the computation of the NCC coefficient within the specified kernel without complex coordinate calculations. We first conducted the numerical simulation experiment to validate NSA using a tree branch phantom. In addition, we also conducted phantom (five sauce tubes), ex vivo (ablation needle in ex vivo porcine liver), and in vivo (human arm) TAI experiments using our TAI system with a center frequency of 3 GHz.

RESULTS

In the numerical simulation experiment, the structural similarity index (SSIM) value for NSA is increased from 0.37828 for DAS to 0.75492. In the point target phantom TAI experiment, the generalized contrast-to-noise ratio (gCNR) value for NSA is increased from 0.936 for DAS to 0.962. The experimental results show that NSA can recover clearer thermoacoustic images compared to DAS. In the ex vivo TAI experiment, the full width at half maxima (FWHM) of an ablation needle (diameter = 1.5 mm) for coherence factor (CF) weighted DAS and NSA are 0.9 and 1.3 mm, respectively. Furthermore, in the in vivo TAI experiment, CF reduces the signals within the arm compared to NSA. Therefore, compared with CF, NSA can maintain the integrity of target information in TAI while effectively suppressing non-coherent background clutter.

CONCLUSIONS

NSA can effectively reduce non-coherent background noise while ensuring the completeness of the target information. So, NSA offers the potential to provide high-quality thermoacoustic images and further advance their clinical application.

Evaluation of 10 current image reconstruction algorithms for linear array photoacoustic imaging

Various reconstruction algorithms have been implemented for linear array photoacoustic imaging systems with the goal of accurately reconstructing the strength absorbers within the tissue being imaged. Since the existing algorithms have been introduced by different research groups and the context of performance evaluation was not consistent, it is difficult to make a fair comparison between them. In this study, we systematically compared the performance of 10 published image reconstruction algorithms (DAS, UBP, pDAS, DMAS, MV, EIGMV, SLSC, GSC, TR, and FD) using in-vitro phantom data. Evaluations were conducted based on lateral resolution of the reconstructed images, computational time, target detectability, and noise sensitivity. We anticipate the outcome of this study will assist researchers in selecting appropriate algorithms for their linear array PA imaging applications.

Improvement of LED-based photoacoustic imaging using lag-coherence factor (LCF) beamforming

BACKGROUND

Owing to its portability, affordability, and energy-efficiency, LED-based photoacoustic (PA) imaging is increasingly becoming popular when compared to its laser-based alternative, mainly for superficial vascular imaging applications. However, this technique suffers from low SNR and thereby limited imaging depth. As a result, visual image quality of LED-based PA imaging is not optimal, especially in sub-surface vascular imaging applications.

PURPOSE

Combination of linear ultrasound (US) probes and LED arrays are the most common implementation in LED-based PA imaging, which is currently being explored for different clinical imaging applications. Traditional delay-and-sum (DAS) is the most common beamforming algorithm in linear array-based PA detection. Side-lobes and reconstruction-related artifacts make the DAS performance unsatisfactory and poor for a clinical-implementation. In this work, we explored a new weighting-based image processing technique for LED-based PAs to yield improved image quality when compared to the traditional methods.

METHODS

We are proposing a lag-coherence factor (LCF), which is fundamentally based on the combination of the spatial auto-correlation of the detected PA signals. In LCF, the numerator contains lag-delay-multiply-and-sum (DMAS) beamformer instead of a conventional DAS beamformer. A spatial auto-correlation operation is performed between the detected US array signals before using DMAS beamformer. We evaluated the new method on both tissue-mimicking phantom (2D) and human volunteer imaging (3D) data acquired using a commercial LED-based PA imaging system.

RESULTS

Our novel correlation-based weighting technique showed LED-based PA image quality improvement when it is combined with conventional DAS beamformer. Both phantom and human volunteer imaging results gave a direct confirmation that by introducing LCF, image quality was improved and this method could reduce side-lobes and artifacts when compared to the DAS and coherence-factor (CF) approaches. Signal-to-noise ratio, generalized contrast-to-noise ratio, contrast ratio and spatial resolution were evaluated and compared with conventional beamformers to assess the reconstruction performance in a quantitative way. Results show that our approach offered image quality enhancement with an average signal-to-noise ratio and spatial resolution improvement of around 20% and 25% respectively, when compared with conventional CF based DAS algorithm.

CONCLUSIONS

Our results demonstrate that the proposed LCF based algorithm performs better than the conventional DAS and CF algorithms by improving signal-to-noise ratio and spatial resolution. Therefore, our new weighting technique could be a promising tool to improve the performance of LED-based PA imaging and thus accelerate its clinical translation.

High-Quality Ultrafast Power Doppler Imaging Based on Spatial Angular Coherence Factor

The morphological and hemodynamic changes of microvessels are demonstrated to be related to the diseased conditions in tissues. Ultrafast power Doppler imaging (uPDI) is a novel modality with a significantly increased Doppler sensitivity, benefiting from the ultrahigh frame rate plane-wave imaging (PWI) and advanced clutter filtering. However, unfocused plane-wave transmission often leads to a low imaging quality, which degrades the subsequent microvascular visualization in power Doppler imaging. Coherence factor (CF)-based adaptive beamformers have been widely studied in conventional B-mode imaging. In this study, we propose a spatial and angular coherence factor (SACF) beamformer for improved uPDI (SACF-uPDI) by calculating the spatial CF across apertures and the angular CF across transmit angles, respectively. To identify the superiority of SACF-uPDI, simulations, in vivo contrast-enhanced rat kidney, and in vivo contrast-free human neonatal brain studies were conducted. Results demonstrate that SACF-uPDI can effectively enhance contrast and resolution and suppress background noise simultaneously, compared with conventional uPDI methods based on delay-and-sum (DAS) (DAS-uPDI) and CF (CF-uPDI). In the simulations, SACF-uPDI can improve the lateral and axial resolutions compared with those of DAS-uPDI, from 176 to [Formula: see text] of lateral resolution, and from 111 to [Formula: see text] of axial resolution. In the in vivo contrast-enhanced experiments, SACF achieves 15.14- and 5.6-dB higher contrast-to-noise ratio (CNR), 15.25- and 3.68-dB lower noise power, and 240- and 15- [Formula: see text] narrower full-width at half-maximum (FWHM) than DAS-uPDI and CF-uPDI, respectively. In the in vivo contrast-free experiments, SACF achieves 6.11- and 1.09-dB higher CNR, 11.93- and 4.01-dB lower noise power, and 528- and 160- [Formula: see text] narrower FWHM than DAS-uPDI and CF-uPDI, respectively. In conclusion, the proposed SACF-uPDI method can efficiently improve the microvascular imaging quality and has the potential to facilitate clinical applications.

Improving photoacoustic imaging in low signal-to-noise ratio by using spatial and polarity coherence

To suppress the noise and sidelobe of photoacoustic images, a method is proposed combined with spatial coherence and polarity coherence. In this method, PA signals are delayed, multiplied, then performed polarity coherence, and finally summed. The polarity of delayed-and-multiplied signals rather than the amplitude is considered in polarity coherence operation. The polarity coherence factor is calculated based on the standard deviation of the polarity. Then, the factor as weights is applied to the coherent sum output after spatial autocorrelation to finally obtain the image. The simulated and experimental results prove that the noise level can be effectively suppressed due to its relatively low polarity coherence factor. Compared with the delay-and-sum method, the quantitative results in simulations show that the image contrast and full-width at half-maximum of the proposed method increase by about 227.0 % and 56.5 % when the signal-to-noise ratio of the raw signal is 0 dB, respectively. Besides achieving a better image contrast, this method obtains improvements in sidelobe attenuation and has a narrow main lobe.

Higher-order correlation based real-time beamforming in photoacoustic imaging

Although a delay-and-sum (DAS) beamformer is best suited for real-time photoacoustic (PA) image formation, the reconstructed images are often afflicted by noises, sidelobes, and other intense artifacts due to inaccurate assumptions in PA signal correlation. The present work aims to develop a reconstruction method that reduces the occurrence of sidelobes and artifacts and thus improves the reconstructed image quality or imaging performance. This beamformer is fundamentally based on higher-order signal correlation wherein a higher number of delayed PA signals-compared to conventional delay-multiply-and-sum (DMAS)-are combined and summed up. The proposed technique provides significant improvements in resolution, contrast, and signal-to-noise ratio (SNR) compared to traditional beamformers. For real-time implementation, the proposed algorithms were simplified, and their computational complexities were shrunk to the order of DAS [O(N)]. A GPU based study was also performed to validate the real-time capability of the proposed beamformers. For validation studies, both numerical simulation and experiments were conducted. Quantitative evaluation studies involving SNR, contrast ratio, generalized contrast-to-noise ratio, and FWHM demonstrate that the proposed higher-order DMAS beamformer is superior in PA image reconstruction. Conclusively, the proposed beamformer uniquely facilitates real-time PA image reconstruction with an achievable frame rate close to DAS and DMAS but with better imaging performance, which holds promise for real-time PA imaging and its clinical applications.

Actuated Reflector-Based 3-D Ultrasound Imaging With Synthetic Aperture Focusing

The 3-D ultrasound (US) imaging addresses the limitation in field-of-view (FOV) in conventional 2-D US imaging by providing 3-D viewing of the anatomy. The 3-D US imaging has been extensively adapted for diagnosis and image-guided surgical intervention. However, conventional approaches to implement 3-D US imaging require either expensive and sophisticated 2-D array transducers or external actuation mechanisms to move a 1-D array mechanically. Here, we propose a 3-D US imaging mechanism using an actuated acoustic reflector instead of the sensor elements for volume acquisition with significantly extended 3-D FOV, which can be implemented with simple hardware and compact size. To improve image quality on the elevation plane, we implemented the synthetic aperture focusing (SAF) method according to the diagonal geometry of the virtual element array in the proposed imaging mechanism for elevation beamforming. We first evaluated the proposed imaging mechanism and SAF with simulated point targets and cyst targets. The results of point targets suggested improved image quality on the elevation plane, and the results of cysts targets demonstrated a potential to improve 3-D visualization of human anatomy. We built a prototype imaging system with a 3-D FOV of 38 mm (lateral) by 38 mm (elevation) by 50 mm (axial) and collected data in imaging experiments with phantoms. Experimental data showed consistency with simulation results. The SAF method enhanced quantifying the cyst volume size in the breast mimicking phantom compared with no elevation beamforming. These results suggested that the proposed 3-D US imaging mechanism could potentially be applied in clinical scenarios.

Achieving depth-independent lateral resolution in AR-PAM using the synthetic-aperture focusing technique

Acoustic-resolution photoacoustic microscopy (AR-PAM) is a promising imaging modality that renders images with ultrasound resolution and extends the imaging depth beyond the optical ballistic regime. To achieve a high lateral resolution, a large numerical aperture (NA) of a focused transducer is usually applied for AR-PAM. However, AR-PAM fails to hold its performance in the out-of-focus region. The lateral resolution and signal-to-noise ratio (SNR) degrade substantially, thereby leading to a significantly deteriorated image quality outside the focal area. Based on the concept of the synthetic-aperture focusing technique (SAFT), various strategies have been developed to address this challenge. These include 1D-SAFT, 2D-SAFT, adaptive-SAFT, spatial impulse response (SIR)-based schemes, and delay-multiply-and-sum (DMAS) strategies. These techniques have shown progress in achieving depth-independent lateral resolution, while several challenges remain. This review aims to introduce these developments in SAFT-based approaches, highlight their fundamental mechanisms, underline the advantages and limitations of each approach, and discuss the outlook of the remaining challenges for future advances.

Acoustic-resolution photoacoustic microscope based on compact and low-cost delta configuration actuator

The state-of-the-art configurations for acoustic-resolution photoacoustic (PA) microscope (AR-PAM) are large in size and expensive, hindering their democratization. While previous research on AR-PAMs introduced a low-cost light source to reduce the cost, few studies have investigated the possibility of optimizing the sensor actuation, particularly for the AR-PAM. Additionally, there is an unmet need to evaluate the image quality deterioration associated with the actuation inaccuracy. A low-cost actuation device is introduced to reduce the system size and cost of the AR-PAM while maintaining the image quality by implementing the advanced beamformers. This work proposes an AR-RAM incorporating the delta configuration actuator adaptable from a low-cost off-the-shelf 3D printer as the sensor actuation device. The image degradation due to the data acquisition positioning inaccuracy is evaluated in the simulation. We further assess the mitigation of potential actuation precision uncertainty through advanced 3D synthetic aperture focusing algorithms represented by the Delay-and-Sum (DAS) with Coherence Factor (DAS+CF) and Delay-Multiply-and-Sum (DMAS) algorithms. The simulation study demonstrated the tolerance of image quality on actuation inaccuracy and the effect of compensating the actuator motion precision error through advanced reconstruction algorithms. With those algorithms, the image quality degradation was suppressed to within 25% with the presence of 0.2 mm motion inaccuracy. The experimental evaluation using phantoms and an ex-vivo sample presented the applicability of low-cost delta configuration actuators for AR-PAMs. The measured full width at half maximum of the 0.2 mm diameter pencil-lead phantom were 0.45 ± 0.06 mm, 0.31 ± 0.04 mm, and 0.35 ± 0.07 mm, by applying the DAS, DAS+CF, and DMAS algorithms, respectively. AR-PAMs with a compact and low-cost delta configuration provide high-quality PA imaging with better accessibility for biomedical applications. The research evaluated the image degradation contributed by the actuation inaccuracy and suggested that the advanced beamformers are capable of suppressing the actuation inaccuracy.

Delay-and-sum-to-delay-standard-deviation factor: a promising adaptive beamformer

A new adaptive weighting method [delay-and-sum-to-delay-standard-deviation factor (DASDSF)] combined with minimum variance (MV) beamforming is introduced in photoacoustic imaging (PAI). Existing MV-based beamformers improve photoacoustic image quality in terms of achieving narrow main lobes and, thus, improving spatial resolution. But, the beamformers give a strong side-lobe signal strength that greatly degrades the reconstructed image contrast. As a feedback weighting factor, DASDSF addresses the persisting side-lobe issue present in MV-beamformed images, i.e., our proposed method is robust against reduction in noises as well as side lobes, and it outperforms MV and MV combined with coherence factor beamformers. Validation studies-being carried out both in numerical simulation and experiments employing a low-cost (16 elements) linear transducer array in a home-built PAI system-demonstrate an excellent performance of the proposed weighting approach in improving SNR, while reducing main-lobe width (i.e., FWHM) and side-lobe signal strength. The study demonstrates that the proposed algorithm holds promise for development of a cost-effective PAI system using a low-cost linear transducer (∼16 elements against ∼128 generally used).

Subaperture Processing-Based Adaptive Beamforming for Photoacoustic Imaging

Delay-and-sum (DAS) beamformers, when applied to photoacoustic (PA) image reconstruction, produce strong sidelobes due to the absence of transmit focusing. Consequently, DAS PA images are often severely degraded by strong off-axis clutter. For preclinical in vivo cardiac PA imaging, the presence of these noise artifacts hampers the detectability and interpretation of PA signals from the myocardial wall, crucial for studying blood-dominated cardiac pathological information and to complement functional information derived from ultrasound imaging. In this article, we present PA subaperture processing (PSAP), an adaptive beamforming method, to mitigate these image degrading effects. In PSAP, a pair of DAS reconstructed images is formed by splitting the received channel data into two complementary nonoverlapping subapertures. Then, a weighting matrix is derived by analyzing the correlation between subaperture beamformed images and multiplied with the full-aperture DAS PA image to reduce sidelobes and incoherent clutter. We validated PSAP using numerical simulation studies using point target, diffuse inclusion and microvasculature imaging, and in vivo feasibility studies on five healthy murine models. Qualitative and quantitative analysis demonstrate improvements in PAI image quality with PSAP compared to DAS and coherence factor weighted DAS (DAS _CF ). PSAP demonstrated improved target detectability with a higher generalized contrast-to-noise (gCNR) ratio in vasculature simulations where PSAP produces 19.61% and 19.53% higher gCNRs than DAS and DAS _CF , respectively. Furthermore, PSAP provided higher image contrast quantified using contrast ratio (CR) (e.g., PSAP produces 89.26% and 11.90% higher CR than DAS and DAS _CF in vasculature simulations) and improved clutter suppression.

Enhancement of in vivo cardiac photoacoustic signal specificity using spatiotemporal singular value decomposition

SIGNIFICANCE

Photoacoustic imaging (PAI) can be used to infer molecular information about myocardial health non-invasively in vivo using optical excitation at ultrasonic spatial resolution. For clinical and preclinical linear array imaging systems, conventional delay-and-sum (DAS) beamforming is typically used. However, DAS cardiac PA images are prone to artifacts such as diffuse quasi-static clutter with temporally varying noise-reducing myocardial signal specificity. Typically, multiple frame averaging schemes are utilized to improve the quality of cardiac PAI, which affects the spatial and temporal resolution and reduces sensitivity to subtle PA signal variation. Furthermore, frame averaging might corrupt myocardial oxygen saturation quantification due to the presence of natural cardiac wall motion. In this paper, a spatiotemporal singular value decomposition (SVD) processing algorithm is proposed to reduce DAS PAI artifacts and subsequent enhancement of myocardial signal specificity.

AIM

Demonstrate enhancement of PA signals from myocardial tissue compared to surrounding tissues and blood inside the left-ventricular (LV) chamber using spatiotemporal SVD processing with electrocardiogram (ECG) and respiratory signal (ECG-R) gated in vivo murine cardiac PAI.

APPROACH

In vivo murine cardiac PAI was performed by collecting single wavelength (850 nm) photoacoustic channel data on eight healthy mice. A three-dimensional (3D) volume of complex PAI data over a cardiac cycle was reconstructed using a custom ECG-R gating algorithm and DAS beamforming. Spatiotemporal SVD was applied on a two-dimensional Casorati matrix generated using the 3D volume of PAI data. The singular value spectrum (SVS) was then filtered to remove contributions from diffuse quasi-static clutter and random noise. Finally, SVD processed beamformed images were derived using filtered SVS and inverse SVD computations.

RESULTS

Qualitative comparison with DAS and minimum variance (MV) beamforming shows that SVD processed images had better myocardial signal specificity, contrast, and target detectability. DAS, MV, and SVD images were quantitatively evaluated by calculating contrast ratio (CR), generalized contrast-to-noise ratio (gCNR), and signal-to-noise ratio (SNR). Quantitative evaluations were done at three cardiac time points (during systole, at end-systole (ES), and during diastole) identified from co-registered ultrasound M-Mode image. Mean CR, gCNR, and SNR values of SVD images at ES were 245, 115.15, and 258.17 times higher than DAS images with statistical significance evaluated with one-way analysis of variance.

CONCLUSIONS

Our results suggest that significantly better-quality images can be realized using spatiotemporal SVD processing for in vivo murine cardiac PAI.

Generalized spatial coherence reconstruction for photoacoustic computed tomography

SIGNIFICANCE

Coherence, a fundamental property of waves and fields, plays a key role in photoacoustic image reconstruction. Previously, techniques such as short-lag spatial coherence (SLSC) and filtered delay, multiply, and sum (FDMAS) have utilized spatial coherence to improve the reconstructed resolution and contrast with respect to delay-and-sum (DAS). While SLSC uses spatial coherence directly as the imaging contrast, FDMAS employs spatial coherence implicitly. Despite being more robust against noise, both techniques have their own drawbacks: SLSC does not preserve a relative signal magnitude, and FDMAS shows a reduced contrast-to-noise ratio.

AIM

To overcome these limitations, our aim is to develop a beamforming algorithm-generalized spatial coherence (GSC)-that unifies SLSC and FDMAS into a single equation and outperforms both beamformers.

APPROACH

We demonstrated the application of GSC in photoacoustic computed tomography (PACT) through simulation and experiments and compared it to previous beamformers: DAS, FDMAS, and SLSC.

RESULTS

GSC outperforms the imaging metrics of previous state-of-the-art coherence-based beamformers in both simulation and experiments.

CONCLUSIONS

GSC is an innovative reconstruction algorithm for PACT, which combines the strengths of FDMAS and SLSC expanding PACT's applications.

Spatiotemporal Coherence Weighting for In Vivo Cardiac Photoacoustic Image Beamformation

Photoacoustic (PA) image reconstruction generally utilizes delay-and-sum (DAS) beamforming of received acoustic waves from tissue irradiated with optical illumination. However, nonadaptive DAS reconstructed cardiac PA images exhibit temporally varying noise which causes reduced myocardial PA signal specificity, making image interpretation difficult. Adaptive beamforming algorithms such as minimum variance (MV) with coherence factor (CF) weighting have been previously reported to improve the DAS image quality. In this article, we report on an adaptive beamforming algorithm by extending CF weighting to the temporal domain for preclinical cardiac PA imaging (PAI). The proposed spatiotemporal coherence factor (STCF) considers multiple temporally adjacent image acquisition events during beamforming and cancels out signals with low spatial coherence and temporal coherence, resulting in higher background noise cancellation while preserving the main features of interest (myocardial wall) in the resultant PA images. STCF has been validated using the numerical simulations and in vivo ECG and respiratory-signal-gated cardiac PAI in healthy murine hearts. The numerical simulation results demonstrate that STCF weighting outperforms DAS and MV beamforming with and without CF weighting under different levels of inherent contrast, acoustic attenuation, optical scattering, and signal-to-noise (SNR) of channel data. Performance improvement is attributed to higher sidelobe reduction (at least 5 dB) and SNR improvement (at least 10 dB). Improved myocardial signal specificity and higher signal rejection in the left ventricular chamber and acoustic gel region are observed with STCF in cardiac PAI.

Nonlinear pth root spectral magnitude scaling beamforming for clinical photoacoustic and ultrasound imaging

A recently introduced nonlinear pth root delay-and-sum (NL-p-DAS) beamforming (BF) technique for ultrasound (US) and photoacoustic (PA) imaging, achieving better spatial and contrast resolution compared to a conventional delay and sum (DAS) technique. While the method is advantageous for better resolution, it suffers from grainy speckles and dark areas in the image mainly due to the interference of non-sinusoidal functions. In this Letter, we introduce a modified NL-p-DAS technique called nonlinear pth root spectral magnitude scaling (NL-p-SMS), which performs the pth root on the spectral magnitude instead of the temporal amplitude. We evaluated the US and PA images of NL-p-SMS against those of NL-p-DAS by comparing the axial and lateral line profiles, contrasts, and contrast-to-noise ratios (CNRs) in both phantom and in vivo imaging studies with various p values. As a result, we found that the NL-p-SMS has better axial resolution and CNR than the NL-p-DAS, and reduces the grainy speckles and dark area artifacts. We believe that, with this enhanced performance, our proposed approach could be an advancement compared to the existing nonlinear BF algorithms.

GPU implementation of photoacoustic short-lag spatial coherence imaging for improved image-guided interventions

SIGNIFICANCE

Photoacoustic-based visual servoing is a promising technique for surgical tool tip tracking and automated visualization of photoacoustic targets during interventional procedures. However, one outstanding challenge has been the reliability of obtaining segmentations using low-energy light sources that operate within existing laser safety limits.

AIM

We developed the first known graphical processing unit (GPU)-based real-time implementation of short-lag spatial coherence (SLSC) beamforming for photoacoustic imaging and applied this real-time algorithm to improve signal segmentation during photoacoustic-based visual servoing with low-energy lasers.

APPROACH

A 1-mm-core-diameter optical fiber was inserted into ex vivo bovine tissue. Photoacoustic-based visual servoing was implemented as the fiber was manually displaced by a translation stage, which provided ground truth measurements of the fiber displacement. GPU-SLSC results were compared with a central processing unit (CPU)-SLSC approach and an amplitude-based delay-and-sum (DAS) beamforming approach. Performance was additionally evaluated with in vivo cardiac data.

RESULTS

The GPU-SLSC implementation achieved frame rates up to 41.2 Hz, representing a factor of 348 speedup when compared with offline CPU-SLSC. In addition, GPU-SLSC successfully recovered low-energy signals (i.e., ≤268  μJ) with mean ± standard deviation of signal-to-noise ratios of 11.2  ±  2.4 (compared with 3.5  ±  0.8 with conventional DAS beamforming). When energies were lower than the safety limit for skin (i.e., 394.6  μJ for 900-nm wavelength laser light), the median and interquartile range (IQR) of visual servoing tracking errors obtained with GPU-SLSC were 0.64 and 0.52 mm, respectively (which were lower than the median and IQR obtained with DAS by 1.39 and 8.45 mm, respectively). GPU-SLSC additionally reduced the percentage of failed segmentations when applied to in vivo cardiac data.

CONCLUSIONS

Results are promising for the use of low-energy, miniaturized lasers to perform GPU-SLSC photoacoustic-based visual servoing in the operating room with laser pulse repetition frequencies as high as 41.2 Hz.

High-quality photoacoustic image reconstruction based on deep convolutional neural network: towards intra-operative photoacoustic imaging

The use of intra-operative imaging system as an intervention solution to provide more accurate localization of complicated structures has become a necessity during the neurosurgery. However, due to the limitations of conventional imaging systems, high-quality real-time intra-operative imaging remains as a challenging problem. Meanwhile, photoacoustic imaging has appeared so promising to provide images of crucial structures such as blood vessels and microvasculature of tumors. To achieve high-quality photoacoustic images of vessels regarding the artifacts caused by the incomplete data, we proposed an approach based on the combination of time-reversal (TR) and deep learning methods. The proposed method applies a TR method in the first layer of the network which is followed by the convolutional neural network with weights adjusted to a set of simulated training data for the other layers to estimate artifact-free photoacoustic images. It was evaluated using a generated synthetic database of vessels. The mean of signal to noise ratio (SNR), peak SNR, structural similarity index, and edge preservation index for the test data were reached 14.6 dB, 35.3 dB, 0.97 and 0.90, respectively. As our results proved, by using the lower number of detectors and consequently the lower data acquisition time, our approach outperforms the TR algorithm in all criteria in a computational time compatible with clinical use.

Multiple Delay and Sum With Enveloping Beamforming Algorithm for Photoacoustic Imaging

Delay and Sum (DAS) is one of the most common beamforming algorithms for photoacoustic imaging (PAI) reconstruction. Based on calculating beamformed signal with simple delaying and summing, DAS can function in a quick response and is quite suitable for real-time PAI. However, high sidelobes and intense artifacts may appear when using DAS due to summing with unnecessary data. In this paper, a beamforming algorithm called Multiple Delay and Sum with Enveloping (multi-DASE) is introduced to solve this problem. Compared to DAS, the multi-DASE algorithm calculates not only the initial value of the beamformed signal but also the complete N-shaped photoacoustic signal for each pixel. Through computer simulation, a phantom experiment and experiment on human finger joint, the multi-DASE algorithm is compared with other beamforming methods in removing artifacts by evaluating the quality of the reconstructed images. Furthermore, by rearranging the calculation sequences, the multi-DASE algorithm can be computing in parallel using GPU acceleration to meet the needs of real-time clinical application.

The role of noninvasive diagnostic imaging in monitoring pregnancy and detecting patients at risk for preterm birth: a review of quantitative approaches

Preterm birth (PTB) is the leading cause of neonatal morbidity and mortality worldwide. The ability to predict patients at risk for preterm birth remains a major health challenge. The currently available clinical diagnostics such as cervical length and fetal fibronectin may detect only up to 30% of patients who eventually experience a spontaneous preterm birth. This paper reviews ongoing efforts to improve the ability to conduct a risk assessment for preterm birth. In particular, this work focuses on quantitative methods of imaging using ultrasound-based techniques, magnetic resonance imaging, and optical imaging modalities. While ultrasound imaging is the major modality for preterm birth risk assessment, a summary of efforts to adopt other imaging modalities is also discussed to identify the technical and diagnostic limits associated with adopting them in clinical settings. We conclude the review by proposing a new approach using combined photoacoustic, ultrasound, and elastography as a potential means to better assess cervical tissue remodeling, and thus improve the detection of patients at-risk of PTB.

A dynamic generalized coherence factor for side lobe suppression in ultrasound imaging

Coherence-based weighting techniques have been widely studied to weight beamsummed data to improve image quality in ultrasound imaging. Although generalized coherence factor (GCF) enhances the robustness of coherence factor (CF) with preserved speckle pattern by including some incoherent components, the side lobe suppression performance is insufficient due to constant cut-off frequency M₀. To address this problem, we introduced in this paper a dynamic GCF method, referred to as DGCF-C, based on the amplitude standard deviation and the convolution output of aperture data. The cut-off frequency is adaptively selected for GCF at each imaging point using the amplitude standard deviation of aperture data. Moreover, the convolution output of aperture data is used to calculate the dynamic GCF. The proposed method is evaluated in simulation and tissue-mimicking phantom studies. The image quality was analyzed in terms of resolution, contrast ratio (CR), generalized contrast-to-noise ratio (GCNR), speckle signal-to-noise ratio (sSNR), and signal-to-noise ratio (SNR). The results demonstrate that DGCF-C (M_max=2) achieves mean resolution improvements of 35.1% in simulation, and 32.6% in experiment, compared with GCF (M₀=1). Moreover, DGCF-C (M_max=4) outperforms GCF (M₀=2) with an average GCNR improvement of 13.5% and an average sSNR improvement of 15.2%, which indicates the better-preservation of speckle.

Development of a Stationary 3D Photoacoustic Imaging System Using Sparse Single-Element Transducers: Phantom Study

Photoacoustic imaging (PAI) is an emerging label-free and non-invasive modality for imaging biological tissues. PAI has been implemented in different configurations, one of which is photoacoustic computed tomography (PACT) with a potential wide range of applications, including brain and breast imaging. Hemispherical Array PACT (HA-PACT) is a variation of PACT that has solved the limited detection-view problem. Here, we designed an HA-PACT system consisting of 50 single element transducers. For implementation, we initially performed a simulation study, with parameters close to those in practice, to determine the relationship between the number of transducers and the quality of the reconstructed image. We then used the greatest number of transducers possible on the hemisphere and imaged copper wire phantoms coated with a light absorbing material to evaluate the performance of the system. Several practical issues such as light illumination, arrangement of the transducers, and an image reconstruction algorithm have been comprehensively studied.

Real-time delay-multiply-and-sum beamforming with coherence factor for in vivo clinical photoacoustic imaging of humans

In the clinical photoacoustic (PA) imaging, ultrasound (US) array transducers are typically used to provide B-mode images in real-time. To form a B-mode image, delay-and-sum (DAS) beamforming algorithm is the most commonly used algorithm because of its ease of implementation. However, this algorithm suffers from low image resolution and low contrast drawbacks. To address this issue, delay-multiply-and-sum (DMAS) beamforming algorithm has been developed to provide enhanced image quality with higher contrast, and narrower main lobe compared but has limitations on the imaging speed for clinical applications. In this paper, we present an enhanced real-time DMAS algorithm with modified coherence factor (CF) for clinical PA imaging of humans in vivo. Our algorithm improves the lateral resolution and signal-to-noise ratio (SNR) of original DMAS beamformer by suppressing the background noise and side lobes using the coherence of received signals. We optimized the computations of the proposed DMAS with CF (DMAS-CF) to achieve real-time frame rate imaging on a graphics processing unit (GPU). To evaluate the proposed algorithm, we implemented DAS and DMAS with/without CF on a clinical US/PA imaging system and quantitatively assessed their processing speed and image quality. The processing time to reconstruct one B-mode image using DAS, DAS with CF (DAS-CF), DMAS, and DMAS-CF algorithms was 7.5, 7.6, 11.1, and 11.3 ms, respectively, all achieving the real-time imaging frame rate. In terms of the image quality, the proposed DMAS-CF algorithm improved the lateral resolution and SNR by 55.4% and 93.6 dB, respectively, compared to the DAS algorithm in the phantom imaging experiments. We believe the proposed DMAS-CF algorithm and its real-time implementation contributes significantly to the improvement of imaging quality of clinical US/PA imaging system.

GPU-accelerated Double-stage Delay-multiply-and-sum Algorithm for Fast Photoacoustic Tomography Using LED Excitation and Linear Arrays

Double-stage delay-multiply-and-sum (DS-DMAS) is an algorithm proposed for photoacoustic image reconstruction. The DS-DMAS algorithm offers a higher contrast than conventional delay-and-sum and delay-multiply and-sum but at the expense of higher computational complexity. Here, we utilized a compute unified device architecture (CUDA) graphics processing unit (GPU) parallel computation approach to address the high complexity of the DS-DMAS for photoacoustic image reconstruction generated from a commercial light-emitting diode (LED)-based photoacoustic scanner. In comparison with a single-threaded central processing unit (CPU), the GPU approach increased speeds by nearly 140-fold for 1024 × 1024 pixel image; there was no decrease in accuracy. The proposed implementation makes it possible to reconstruct photoacoustic images with frame rates of 250, 125, and 83.3 when the images are 64 × 64, 128 × 128, and 256 × 256, respectively. Thus, DS-DMAS can be efficiently used in clinical devices when coupled with CUDA GPU parallel computation.

Sparsity-based beamforming to enhance two-dimensional linear-array photoacoustic tomography

In linear-array photoacoustic imaging (PAI), beamforming methods can be used to reconstruct the images. Delay-and-sum (DAS) beamformer is extensively used due to its simple implementation. However, this algorithm results in high level of sidelobes and low resolution. In this paper, it is proposed to form the photoacoustic (PA) images through a regularized inverse problem to address these limitations and improve the image quality. We define a forward/backward problem of the beamforming and solve the inverse problem using a sparse constraint added to the model which forces the sparsity of the output beamformed data. It is shown that the proposed Sparse beamforming (SB) method is robust against noise due to the sparsity nature of the problem. Numerical results show that the SB method improves the signal-to-noise ratio (SNR) for about 98.69 dB, 82.26 dB and 74.73 dB, in average, compared to DAS, delay-multiply-and-sum (DMAS) and double stage-DMAS (DS-DMAS), respectively. Also, quantitative evaluation of the experimental results shows a significant noise reduction using SB algorithm. In particular, the contrast ratio of the wire phantom at the depth of 30 mm is improved about 103.97 dB, 82.16 dB and 65.77 dB compared to DAS, DMAS and DS-DMAS algorithms, respectively, indicating a better performance of the proposed SB in terms of noise reduction.

Image improvement in linear-array photoacoustic imaging using high resolution coherence factor weighting technique

Background

In Photoacoustic imaging (PAI), the most prevalent beamforming algorithm is delay-and-sum (DAS) due to its simple implementation. However, it results in a low quality image affected by the high level of sidelobes. Coherence factor (CF) can be used to address the sidelobes in the reconstructed images by DAS, but the resolution improvement is not good enough, compared to the high resolution beamformers such as minimum variance (MV). In this paper, it is proposed to use high-resolution-CF (HRCF) weighting technique in which MV is used instead of the existing DAS in the formula of the conventional CF.

Results

The higher performance of HRCF is proved numerically and experimentally. The quantitative results obtained with the simulations show that at the depth of 40 mm, in comparison with DAS+CF and MV+CF, HRCF improves the full-width-half-maximum of about 91% and 15% and the signal-to-noise ratio about 40% and 14%, respectively.

Conclusion

Proposed method provides a high resolution along with a low level of sidelobes for PAI.

The double-stage delay-multiply-and-sum image reconstruction method improves imaging quality in a LED-based photoacoustic array scanner

Light-emitting diode-based photoacoustic imaging is more compact and affordable than laser-based systems, but it has low power and hence a high number of replicates. Here, we describe double-stage delay-multiply-and-sum (DS-DMAS) to improve image quality collected on a LED-based scanner. DS-DMAS was evaluated experimentally using point targets (in different laterals and depths) as well as a hair and a rabbit eye. This algorithm can compensate for the low SNR of LED-based systems and offer better lateral resolution of about 60%, 25%, higher contrast ratio of about 97%, 34%, and better full-width-half-maximum of about 60%, 25%, versus delay-and-sum) and delay-multiply-and-sum, respectively. More importantly, DS-DMAS offers this using a smaller number of frames (only 2% of all the frames). These results indicate that DS-DMAS might be a valuable tool in the translation of LED-based and other low power PAI systems.

Efficient nonlinear beamformer based on P'th root of detected signals for linear-array photoacoustic tomography: application to sentinel lymph node imaging

In linear-array transducer-based photoacoustic (PA) imaging, B-scan PA images are formed using the raw channel PA signals. Delay-and-sum (DAS) is the most prevalent algorithm due to its simple implementation, but it leads to low-quality images. Delay-multiply-and-sum (DMAS) provides a higher image quality in comparison with DAS while it imposes a computational burden of O  (  M2  )  . We introduce a nonlinear (NL) beamformer for linear-array PA imaging, which uses the p'th root of the detected signals and imposes the complexity of DAS [O  (  M  )  ]. The proposed algorithm is evaluated numerically and experimentally [wire-target and in-vivo sentinel lymph node (SLN) imaging], and the effects of the parameter p are investigated. The results show that the NL algorithm, using a root of p (NL_p), leads to lower sidelobes and higher signal-to-noise ratio compared with DAS and DMAS, for (p  >  2). The sidelobes level (for the wire-target phantom), at the depth of 11.4 mm, are about -31, -52, -52, -67, -88, and -109  dB, for DAS, DMAS, NL_2, NL_3, NL_4, and NL_5, respectively, indicating the superiority of the NL_p algorithm. In addition, the best value of p for SLN imaging is reported to be 12.

Photoacoustic image formation based on sparse regularization of minimum variance beamformer

Delay-and-sum (DAS) is the most common algorithm used in photoacoustic (PA) image formation. However, this algorithm results in a reconstructed image with a wide mainlobe and high level of sidelobes. Minimum variance (MV), as an adaptive beamformer, overcomes these limitations and improves the image resolution and contrast. In this paper, a novel algorithm, named Modified-Sparse-MV (MS-MV), is proposed in which a ℓ 1-norm constraint is added to the MV minimization problem after some modifications, in order to suppress the sidelobes more efficiently, compared to MV. The added constraint can be interpreted as the sparsity of the output of the MV beamformed signals. Since the final minimization problem is convex, it can be solved efficiently using a simple iterative algorithm. The numerical results show that the proposed method, MS-MV beamformer, improves the signal-to-noise (SNR) about 19.48 dB, in average, compared to MV. Also, the experimental results, using a wire-target phantom, show that MS-MV leads to SNR improvement of about 2.64 dB in comparison with the MV.