A Novel 2-D Synthetic Aperture Focusing Technique for Acoustic-Resolution Photoacoustic Microscopy

Nonlinear beamforming for intracardiac echocardiography: a comparative study

Intracardiac echocardiography (ICE) enables cardiac imaging with a wide field of view, deep imaging depth, and high frame rate during surgery. However, strong sidelobe and grating lobe artifacts created by the ultra-compact transducer degrade its image quality, making diagnosis and monitoring of treatment difficult. Conventionally, aperture apodization algorithms are often used to suppress sidelobe and grating lobe artifacts at the expense of lateral resolution, which is undesirable in ICE. In this study, we present comparative results of the beamforming methods specifically in ICE application. We demonstrate and compare five nonlinear beamforming algorithms in ICE: nonlinear pth root delay and sum (NL-p-DAS), nonlinear pth root spectral magnitude scaling (NL-p-SMS), delay-and-sum with coherence factors (DAS + SCF), delay and sum with apodization (DAS + apodization) and delay and sum (DAS). Phantom and ex-vivo experiment compare the performance of each algorithm in static and dynamic conditions. DAS + SCF shows the best lateral resolution, and all four algorithms improve the image contrast and sidelobe suppression over conventional DAS. NL-p-SMS stands out for the best axial resolution and suppression of grating lobe artifacts. For motion tracking, NL-p-SMS shows better temporal resolution than other methods. Overall, all the beamforming algorithms other than DAS showed improved image quality. Among them, NL-p-SMS, which has a high temporal resolution, showed the potential for providing more accurate information regards movement tracking.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13534-024-00352-9.

Simultaneous photoacoustic and ultrasound imaging: A review

Photoacoustic imaging (PAI) is an emerging biomedical imaging technique that combines the advantages of optical and ultrasound imaging, enabling the generation of images with both optical resolution and acoustic penetration depth. By leveraging similar signal acquisition and processing methods, the integration of photoacoustic and ultrasound imaging has introduced a novel hybrid imaging modality suitable for clinical applications. Photoacoustic-ultrasound imaging allows for non-invasive, high-resolution, and deep-penetrating imaging, providing a wealth of image information. In recent years, with the deepening research and the expanding biomedical application scenarios of photoacoustic-ultrasound bimodal systems, the immense potential of photoacoustic-ultrasound bimodal imaging in basic research and clinical applications has been demonstrated, with some research achievements already commercialized. In this review, we introduce the principles, technical advantages, and biomedical applications of photoacoustic-ultrasound bimodal imaging techniques, specifically focusing on tomographic, microscopic, and endoscopic imaging modalities. Furthermore, we discuss the future directions of photoacoustic-ultrasound bimodal imaging technology.

Correction of high-rate motion for photoacoustic microscopy by orthogonal cross-correlation

Photoacoustic imaging is a promising technology for in vivo imaging. However, its imaging performance can be hampered by motion artifacts, especially when dealing with high-rate motion. In this paper, we propose an orthogonal motion correction method that utilizes cross-correlation along orthogonal scan directions to extract accurate motion displacements from the photoacoustic data. The extracted displacements are then applied to remove artifacts and compensate for motion-induced distortions. Phantom experiments demonstrate that the proposed method can extract the motion information and the structural similarity index measurement after correction is increased by 26.5% and 11.2% compared to no correction and the previous correction method. Then the effectiveness of our method is evaluated in vivo imaging of a mouse brain. Our method shows a stable and effective performance under high-rate motion. The high accuracy of the motion correction method makes it valuable in improving the accuracy of photoacoustic imaging.

An ultrasensitive and broadband transparent ultrasound transducer for ultrasound and photoacoustic imaging in-vivo

Transparent ultrasound transducers (TUTs) can seamlessly integrate optical and ultrasound components, but acoustic impedance mismatch prohibits existing TUTs from being practical substitutes for conventional opaque ultrasound transducers. Here, we propose a transparent adhesive based on a silicon dioxide-epoxy composite to fabricate matching and backing layers with acoustic impedances of 7.5 and 4-6 MRayl, respectively. By employing these layers, we develop an ultrasensitive, broadband TUT with 63% bandwidth at a single resonance frequency and high optical transparency ( > 80%), comparable to conventional opaque ultrasound transducers. Our TUT maximises both acoustic power and transfer efficiency with maximal spectrum flatness while minimising ringdowns. This enables high contrast and high-definition dual-modal ultrasound and photoacoustic imaging in live animals and humans. Both modalities reach an imaging depth of > 15 mm, with depth-to-resolution ratios exceeding 500 and 370, respectively. This development sets a new standard for TUTs, advancing the possibilities of sensor fusion.

Review of Three-Dimensional Handheld Photoacoustic and Ultrasound Imaging Systems and Their Applications

Photoacoustic (PA) imaging is a non-invasive biomedical imaging technique that combines the benefits of optics and acoustics to provide high-resolution structural and functional information. This review highlights the emergence of three-dimensional handheld PA imaging systems as a promising approach for various biomedical applications. These systems are classified into four techniques: direct imaging with 2D ultrasound (US) arrays, mechanical-scanning-based imaging with 1D US arrays, mirror-scanning-based imaging, and freehand-scanning-based imaging. A comprehensive overview of recent research in each imaging technique is provided, and potential solutions for system limitations are discussed. This review will serve as a valuable resource for researchers and practitioners interested in advancements and opportunities in three-dimensional handheld PA imaging technology.

All-optical optoacoustic micro-tomography in reflection mode

High-resolution optoacoustic imaging at depths beyond the optical diffusion limit is conventionally performed using a microscopy setup where a strongly focused ultrasound transducer samples the image object point-by-point. Although recent advancements in miniaturized ultrasound detectors enables one to achieve microscopic resolution with an unfocused detector in a tomographic configuration, such an approach requires illuminating the entire object, leading to an inefficient use of the optical power, and imposing a trans-illumination configuration that is limited to thin objects. We developed an optoacoustic micro-tomography system in an epi-illumination configuration, in which the illumination is scanned with the detector. The system is demonstrated in phantoms for imaging depths of up to 5 mm and in vivo for imaging the vasculature of a mouse ear. Although image-formation in optoacoustic tomography generally requires static illumination, our numerical simulations and experimental measurements show that this requirement is relaxed in practice due to light diffusion, which homogenizes the fluence in deep tissue layers.

High-resolution silicon photonics focused ultrasound transducer with a sub-millimeter aperture

We present an all-optical focused ultrasound transducer with a sub-millimeter aperture and demonstrate its capability for high-resolution imaging of tissue ex vivo. The transducer is composed of a wideband silicon photonics ultrasound detector and a miniature acoustic lens coated with a thin optically absorbing metallic layer used to produce laser-generated ultrasound. The demonstrated device achieves axial resolution and lateral resolutions of 12 μm and 60 μm, respectively, well below typical values achieved by conventional piezoelectric intravascular ultrasound. The size and resolution of the developed transducer may enable its use for intravascular imaging of thin fibrous cap atheroma.

Energy compensated synthetic aperture focusing technique for photoacoustic microscopy

We report an adaptive energy-compensated synthetic aperture focusing technique (eC-SAFT) for improving the imaging performance of photoacoustic microscopy (PAM) in terms of depth of field (DOF), spatial resolution (both axial and lateral), and SNR. In addition to coherency and time-delay (in conventional SAFT), our beamforming-based reconstruction algorithm takes into account acoustic energy loss-a primary physical parameter in acoustic wave propagation-following Beer-Lambert's law. Experimental validation studies were performed in tissue-mimicking (Agar) phantoms, complex leaf veins, and chicken breast tissues. Results demonstrate that our proposed eC-SAFT+CF outperforms conventional SAFT+CF to improve axial resolution (up to ∼ 5 % ), lateral resolution (up to ∼ 5 % ), SNR (up to ∼ 6 % ) and CR (up to ∼ 8 % ).

Optical-resolution photoacoustic microscopy with a needle-shaped beam

Optical-resolution photoacoustic microscopy (OR-PAM) can visualize wavelength-dependent optical absorption at the cellular level. However, OR-PAM suffers from a limited depth of field (DOF) due to the tight focus of the optical excitation beam, making it challenging to acquire high-resolution images of samples with uneven surfaces or high-quality volumetric images without z-scanning. To overcome this limitation, we propose needle-shaped beam photoacoustic microscopy (NB-PAM), which can extend the DOF to up to ~28-fold Rayleigh lengths via customized diffractive optical elements (DOEs). The DOE generate a needle beam with a well-maintained beam diameter, a uniform axial intensity distribution, and negligible sidelobes. The advantage of using NB-PAM is demonstrated by both histology-like imaging of fresh slide-free organs using a 266 nm laser and in vivo mouse brain vasculature imaging using a 532 nm laser. The approach provides new perspectives for slide-free intraoperative pathological imaging and in-vivo organ-level imaging.

Switchable preamplifier for dual modal photoacoustic and ultrasound imaging

Photoacoustic (PA) imaging is a high-fidelity biomedical imaging technique based on the principle of molecular-specific optical absorption of biological tissue constitute. Because PA imaging shares the same basic principle as that of ultrasound (US) imaging, the use of PA/US dual-modal imaging can be achieved using a single system. However, because PA imaging is limited to a shallower depth than US imaging due to the optical extinction in biological tissue, the PA signal yields a lower signal-to-noise ratio (SNR) than US images. To selectively amplify the PA signal, we propose a switchable preamplifier for acoustic-resolution PA microscopy implemented on an application-specific integrated circuit. Using the preamplifier, we measured the increments in the SNR with both carbon lead and wire phantoms. Furthermore, in vivo whole-body PA/US imaging of a mouse with a preamplifier showed enhancement of SNR in deep tissues, unveiling deeply located organs and vascular networks. By selectively amplifying the PA signal range to a level similar to that of the US signal without contrast agent administration, our switchable amplifier strengthens the mutual complement between PA/US imaging. PA/US imaging is impending toward clinical translation, and we anticipate that this study will help mitigate the imbalance of image depth between the two imaging modalities.

Elevational Synthetic Aperture Focusing for Three-Dimensional Photoacoustic Imaging Using a Clinical One-Dimensional Array Transducer

OBJECTIVE

Two-dimensional (2D) photoacoustic (PA) imaging based on array transducers provide high spatial resolution in the lateral direction by adopting receive dynamic focusing. However, the quality of PA image is often deteriorated by poor elevational resolution which is achieved by an acoustic lens. To overcome this limitation, we present a three-dimensional (3D) image reconstruction method using a commercial one-dimensional (1D) array transducer.

METHODS

In the method, the elevational resolution is improved by applying synthetic aperture focusing (SAF) technique along the elevational direction. For this, a commercially available 1D array transducer with an acoustic lens is modeled and appropriate synthetic focusing delay that can minimize the effect of the acoustic lens is derived by mathematical analysis.

RESULTS

From the simulation and experiment results, it was demonstrated that the proposed method can enhance the image quality of PA imaging, i.e., elevational resolution and signal-to-noise ratio (SNR).

CONCLUSION

3D PA images with improved elevational resolution were achieved using a clinical 1D array transducer.

SIGNIFICANCE

The presented method may be useful for clinical application such as detecting microcalcification, imaging of tumor vasculature and guidance of biopsy in real time.

Depth-extended acoustic-resolution photoacoustic microscopy based on a two-stage deep learning network

Acoustic resolution photoacoustic microscopy (AR-PAM) is a major modality of photoacoustic imaging. It can non-invasively provide high-resolution morphological and functional information about biological tissues. However, the image quality of AR-PAM degrades rapidly when the targets move far away from the focus. Although some works have been conducted to extend the high-resolution imaging depth of AR-PAM, most of them have a small focal point requirement, which is generally not satisfied in a regular AR-PAM system. Therefore, we propose a two-stage deep learning (DL) reconstruction strategy for AR-PAM to recover high-resolution photoacoustic images at different out-of-focus depths adaptively. The residual U-Net with attention gate was developed to implement the image reconstruction. We carried out phantom and in vivo experiments to optimize the proposed DL network and verify the performance of the proposed reconstruction method. Experimental results demonstrated that our approach extends the depth-of-focus of AR-PAM from 1mm to 3mm under the 4 mJ/cm² light energy used in the imaging system. In addition, the imaging resolution of the region 2 mm far away from the focus can be improved, similar to the in-focus area. The proposed method effectively improves the imaging ability of AR-PAM and thus could be used in various biomedical studies needing deeper depth.

Photoacoustic/Ultrasound Endoscopic Imaging Reconstruction Algorithm Based on the Approximate Gaussian Acoustic Field

This paper aims to propose a new photoacoustic/ultrasound endoscopic imaging reconstruction algorithm based on the approximate Gaussian acoustic field which significantly improves the resolution and signal-to-noise ratio (SNR) of the out-of-focus region. We demonstrated the method by numerical calculations and investigated the applicability of the algorithm in a chicken breast phantom. The validation was finally performed by the rabbit rectal endoscopy experiment. Simulation results show that the lateral resolution of the target point in the out-of-focus region can be well optimized with this new algorithm. Phantom experimental results show that the lateral resolution of the indocyanine green (ICG) tube in the photoacoustic image is reduced from 3.975 mm to 1.857 mm by using our new algorithm, which is a 52.3% improvement. Ultrasound images also show a significant improvement in lateral resolution. The results of the rabbit rectal endoscopy experiment prove that the algorithm we proposed is capable of providing higher-quality photoacoustic/ultrasound images. In conclusion, the algorithm enables fast acoustic resolution photoacoustic/ ultrasonic dynamic focusing and effectively improves the imaging quality of the system, which has significant guidance for the design of acoustic resolution photoacoustic/ultrasound endoscopy systems.

Simulation Study of Acoustic-Resolution-Based Photoacoustic Microscopy for Imaging Complex Blood Vessel Networks

The high-quality imaging of vascular networks in biological tissue is significant to accurate cancer diagnosis with acoustic-resolution-based photoacoustic microscopy (AR-PAM). So far, many new back-projection (BP) models have been proposed to improve the image quality of AR-PAM in the off-focal regions. However, many essential arguments are still open regarding the effectiveness of these methods. To settle these remaining questions and explore the potential and adaptability of these BP methods in vascular network imaging, we conducted extensive simulations of a complex vascular network based on a GPU-based data generation framework. Results show that the SAFT-CF algorithm effectively improves the reconstructed image but mainly highlights point targets. In contrast, the STR-BP algorithm can effectively balance the computational cost, signal-to-noise ratio (SNR), and consistency of target intensity for both point and line targets. Results proved that data interpolation for more A-line numbers would not improve the image quality due to information lost. Thus, the detector number in the scan should be sufficiently large. Results also showed that the STR-BP method improved the PSNR of the image by 4.7 to 7.5 dB, which helps the image withstand a noise level of higher than 25%. The proposed simulation framework and the intuitive findings will guide the design of AR-PAM systems and image reconstruction.

Visualizing tumor angiogenesis and boundary with polygon-scanning multiscale photoacoustic microscopy

Recently, we developed an integrated optical-resolution (OR) and acoustic-resolution (AR) PAM, which has multiscale imaging capability using different resolutions. However, limited by the scanning method, a tradeoff exists between the imaging speed and field of view, which impedes its wider applications. Here, we present an improved multiscale PAM which achieves high-speed wide-field imaging based on a homemade polygon scanner. Encoder trigger mode was proposed to avoid jittering of the polygon scanner during imaging. Distortions caused by polygon scanning were analyzed theoretically and compared with traditional types of distortions in optical-scanning PAM. Then a depth correction method was proposed and verified to compensate for the distortions. System characterization of OR-PAM and AR-PAM was performed prior to in vivo imaging. Blood reperfusion of an in vivo mouse ear was imaged continuously to demonstrate the feasibility of the multiscale PAM for high-speed imaging. Results showed that the maximum B-scan rate could be 14.65 Hz in a fixed range of 10 mm. Compared with our previous multiscale system, the imaging speed of the improved system was increased by a factor of 12.35. In vivo imaging of a subcutaneously inoculated B-16 melanoma of a mouse was performed. Results showed that the blood vasculature around the melanoma could be resolved and the melanoma could be visualized at a depth up to 1.6 mm using the multiscale PAM.

Achieving depth-independent lateral resolution in AR-PAM using the synthetic-aperture focusing technique

Acoustic-resolution photoacoustic microscopy (AR-PAM) is a promising imaging modality that renders images with ultrasound resolution and extends the imaging depth beyond the optical ballistic regime. To achieve a high lateral resolution, a large numerical aperture (NA) of a focused transducer is usually applied for AR-PAM. However, AR-PAM fails to hold its performance in the out-of-focus region. The lateral resolution and signal-to-noise ratio (SNR) degrade substantially, thereby leading to a significantly deteriorated image quality outside the focal area. Based on the concept of the synthetic-aperture focusing technique (SAFT), various strategies have been developed to address this challenge. These include 1D-SAFT, 2D-SAFT, adaptive-SAFT, spatial impulse response (SIR)-based schemes, and delay-multiply-and-sum (DMAS) strategies. These techniques have shown progress in achieving depth-independent lateral resolution, while several challenges remain. This review aims to introduce these developments in SAFT-based approaches, highlight their fundamental mechanisms, underline the advantages and limitations of each approach, and discuss the outlook of the remaining challenges for future advances.

Silicon-photonics acoustic detector for optoacoustic micro-tomography

Medical ultrasound and optoacoustic (photoacoustic) imaging commonly rely on the concepts of beam-forming and tomography for image formation, enabled by piezoelectric array transducers whose element size is comparable to the desired resolution. However, the tomographic measurement of acoustic signals becomes increasingly impractical for resolutions beyond 100 µm due to the reduced efficiency of piezoelectric elements upon miniaturization. For higher resolutions, a microscopy approach is preferred, in which a single focused ultrasound transducer images the object point-by-point, but the bulky apparatus and long acquisition time of this approach limit clinical applications. In this work, we demonstrate a miniaturized acoustic detector capable of tomographic imaging with spread functions whose width is below 20 µm. The detector is based on an optical resonator fabricated in a silicon-photonics platform coated by a sensitivity-enhancing elastomer, which also effectively eliminates the parasitic effect of surface acoustic waves. The detector is demonstrated in vivo in high-resolution optoacoustic tomography.

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

By considering the line pattern of acoustic-resolution photoacoustic microscopy (AR-PAM) vessel images, we develop modified algorithms for synthetic aperture focusing technique (SAFT) and deconvolution based on a directional approach to enhance images. The modified algorithms consist of Fourier accumulation SAFT (FA-SAFT) and directional model-based (D-MB) deconvolution. To evaluate the performance of our algorithms, we conduct a series of imaging experiments and apply our algorithms, and existing SAFT and deconvolution algorithms are also applied for side-by-side comparison. By imaging tungsten wire phantom, our algorithms enable full width at half maximum of 26 - 31 µm over depth of focus of 1.8 mm and minimum resolvable distance of 46 - 49 µm, besting existing SAFT and deconvolution algorithms. Imaging of leaf skeleton phantom and in vivo imaging of mouse blood vessels also prove that our algorithm is capable of providing high-resolution, high-signal-to-noise ratio, and good-fidelity results for complex structures and for in vivo applications, especially for the images with the line pattern. The proposed directional approach can not only be used in AR-PAM but also in other imaging modalities to deal with the line pattern, such as FA-SAFT for ultrasound imaging and D-MB deconvolution for optical coherence tomography angiography.

High-speed photoacoustic microscopy: A review dedicated on light sources

In recent years, many methods have been investigated to improve imaging speed in photoacoustic microscopy (PAM). These methods mainly focused upon three critical factors contributing to fast PAM: laser pulse repetition rate, scanning speed, and computing power of the microprocessors. A high laser repetition rate is fundamentally the most crucial factor to increase the PAM speed. In this paper, we review methods adopted for fast PAM systems in detail, specifically with respect to light sources. To the best of our knowledge, ours is the first review article analyzing the fundamental requirements for developing high-speed PAM and their limitations from the perspective of light sources.

High-resolution photoacoustic/ultrasound imaging of the porcine stomach wall: an ex vivo feasibility study

Photoacoustic (PA) imaging has become invaluable in preclinical and clinical research. Endoscopic PA imaging in particular has been explored as a noninvasive imaging modality to view vasculature and diagnose cancers in the digestive system. However, these feasibility studies are still limited to rodents or rabbits. Here, we develop a fully synchronized simultaneous ultrasound and photoacoustic microscopy system using two spectral bands (i.e., the visible and near-infrared) in both optical- and acoustic-resolution modes. We investigate the feasibility of imaging gastric vasculature in an ex vivo porcine model. The entire gastric wall, including the mucosa, submucosa, muscularis propria, and serosa, was excised from fresh porcine stomachs immediately followed by ultrasound and PA imaging being performed within a few hours of sacrifice. PA images of the mucosal vasculature were obtained at depths of 1.90 mm, which is a clinically significant accomplishment considering that the average thickness of the human mucosa is 1.26 mm. The layer structure of the stomach wall could be clearly distinguished in the overlaid PA and US images. Because gastric cancer starts from the mucosal surface and infiltrates into the submucosa, PA imaging can cover a clinically relevant depth in early gastric cancer diagnosis. We were able to detect mucosal vasculature in the entire mucosal layer, suggesting the potential utility of combined PA/US imaging in gastroenterology.

A photoacoustic finder fully integrated with a solid-state dye laser and transparent ultrasound transducer

The standard-of-care for evaluating lymph node status in breast cancers and melanoma metastasis is sentinel lymph node (SLN) assessment performed with a handheld gamma probe and radioisotopes. However, this method inevitably exposes patients and physicians to radiation, and the special facilities required limit its accessibility. Here, we demonstrate a non-ionizing, cost-effective, handheld photoacoustic finder (PAF) fully integrated with a solid-state dye laser and transparent ultrasound transducer (TUT). The solid-state dye laser handpiece is coaxially aligned with the spherically focused TUT. The integrated finder readily detected photoacoustic signals from a tube filled with methylene blue (MB) beneath a 22 mm thick layer of chicken tissue. In live animals, we also photoacoustically detected both SLNs injected with MB and subcutaneously injected melanomas. We believe that our radiation-free and inexpensive PAF can play a vital role in SLN assessment.

Super-Resolution Photoacoustic Microscopy Using Structured-Illumination

A novel super-resolution volumetric photoacoustic microscopy, based on the theory of structured-illumination, is proposed in this paper. The structured-illumination will be introduced in order to surpass the diffraction limit in a photoacoustic microscopy (PAM) structure. Through optical excitation of the targeted object with a sinusoidal spatial fringe pattern, the object's frequency spectrum is forced to shift in the spatial frequency domain. The shifting in the desired direction leads to the passage of the high-frequency contents of the object through the passband of the acoustic diffraction frequency response. Finally, combining the low-frequency image with the high-frequency parts in four regular orientations in the spatial frequency domain is equivalent to imaging the targeted object with an imaging system of two-fold bandwidth and thus half lateral resolution. In order to obtain the image of out-of-focus regions and improve the lateral resolution outside the focal region of a PAM imaging system, Fourier-domain reconstruction algorithm based on the synthetic aperture focusing technique (SAFT) using the virtual detector concept is utilized for reduction in the required computational load and time. The performance of the proposed imaging system is validated with in vivo and ex vivo targets. The experimental results obtained from several tungsten filaments in the depth range of 1.2 mm, show an improvement of -6 dB lateral resolution from 55- [Formula: see text] to 25- [Formula: see text] and also an improvement of signal-to-noise ratio (SNR) from 16-22 dB to 27-33 dB in the proposed system.

Dual-pulse photoactivated atomic force microscopy

Photoactivated atomic force microscopy (pAFM), which integrates light excitation and mechanical detection of the deflections of a cantilever tip, has become a widely used tool for probing nanoscale structures. Raising the illuminating laser power is an obvious way to boost the signal-to-noise ratio of pAFM, but strong laser power can damage both the sample and cantilever tip. Here, we demonstrate a dual-pulse pAFM (DP-pAFM) that avoids this problem by using two laser pulses with a time delay. The first laser heats the light absorber and alters the local Grüneisen parameter value, and the second laser boosts the mechanical vibration within the thermal relaxation time. Using this technique, we successfully mapped the optical structures of small-molecule semiconductor films. Of particular interest, DP-pAFM clearly visualized nanoscale cracks in organic semiconductor films, which create crucial problems for small-molecule semiconductors. DP-pAFM opens a promising new optical avenue for studying complex nanoscale phenomena in various research fields.

Spherical-matching hyperbolic-array photoacoustic computed tomography

Linear-array photoacoustic computed tomography (LA-PACT), for its flexibility and simplicity, has great potential in providing anatomical and functional information of tissues. However, the limited coverage view impedes the LA-PACT obtaining high-quality images. In this study, a photoacoustic tomographic system with a hyperbolic-array transducer was developed for stereoscopic PA imaging of carotid artery. The hyperbolic-array PACT increases the receiving sensitivity for PA signal detection due to its transducer's geometric structure matching with the spherical wave. The control phantom experiment shows that the proposed system can expand the angular coverage of ∼1/3 more than that of the LA-PACT system, and the volumetric PA images of rat's carotid artery demonstrates the potential of the system for carotid artery imaging. Furthermore, volumetric imaging of the human forearm verifies that the system has significant capability in human imaging, which indicates that it has bright prospect for assisting diagnosis in the vascular disease.

In-vivo imaging of melanoma with simultaneous dual-wavelength acoustic-resolution-based photoacoustic/ultrasound microscopy

Melanoma is a common, highly fatal skin cancer. Photoacoustic imaging can achieve highly sensitive and high-contrast detection of melanin molecules in tissues, also inheriting the high penetration depth and high spatial resolution characteristics of ultrasound imaging, thus it is a very promising non-invasive diagnostic tool for early melanoma. In this work, we built an acoustic-resolution-based photoacoustic microscopy system, using 1064 nm/532 nm pulsed light to observe melanoma in the back of a mouse with simultaneous photoacoustic/ultrasound imaging. Through the fusion of multi-modal images, accurate positioning of melanoma and its surrounding normal tissues were realized. This work will further promote the application of photoacoustic imaging in the clinical diagnosis of early melanoma.

3D acoustic resolution-based photoacoustic endoscopy with dynamic focusing

Background

Acoustic resolution-based photoacoustic endoscopy (ARPAE) is a non-invasive potential tool for imaging gastrointestinal and urogenital tracts. However, current ARPAE systems usually only provide 2D sectorial B-mode images, and have the limitation of the image quality significantly deteriorating out-of-focus regions due to transducers with fixed focus in these systems. To overcome these limitations, we put forward a modified back-projection method that can provide 3D images with dynamic focusing in ARPAE.

Methods

A graphics processing unit (GPU)-based parallel computation technique was adopted for efficient computation. Both simulated and phantom/ex-vivo experiments were conducted to validate our method.

Results

The findings indicated that our proposed method can effectively improve the lateral resolution and signal-to-noise ratio (SNR) in the out-of-focus regions. For a target 3 mm from the transducer focus, the new method can improve 11 times in the lateral resolution, along with an improvement of up to 37 dB in the SNR.

Conclusions

3D ARPAE provides high-quality imaging in both focus and out-of-focus regions.

Another decade of photoacoustic imaging

Photoacoustic imaging - a hybrid biomedical imaging modality finding its way to clinical practices. Although the photoacoustic phenomenon was known more than a century back, only in the last two decades it has been widely researched and used for biomedical imaging applications. In this review we focus on the development and progress of the technology in the last decade (2010-2020). From becoming more and more user friendly, cheaper in cost, portable in size, photoacoustic imaging promises a wide range of applications, if translated to clinic. The growth of photoacoustic community is steady, and with several new directions researchers are exploring, it is inevitable that photoacoustic imaging will one day establish itself as a regular imaging system in the clinical practices.

3D wide-field multispectral photoacoustic imaging of human melanomas in vivo: a pilot study

BACKGROUND

The Breslow depth is an important parameter to determine the excision margin and prognosis of melanoma. However, it is difficult to accurately determine the actual Breslow depth before surgery using the existing ocular micrometer and biopsy technique.

OBJECTIVES

To evaluate the use of 3D wide-field multispectral photoacoustic imaging to non-invasively measure depth and outline the boundary of melanomas for optimal surgical margin selection.

METHODS

Six melanoma patients were examined in vivo using the 3D multispectral photoacoustic imaging system. For five cases of melanomas (one in situ, three nodular, and one acral lentiginous type melanoma), the spectrally unmixed photoacoustic depths were calculated and compared against histopathological depths.

RESULTS

Spectrally unmixed photoacoustic depths and histopathological depths match well within a mean absolute error of 0.36 mm. In particular, the measured minimum and maximum depths in the in situ and nodular type of melanoma were 0.6 and 9.1 mm, respectively. In the 3D photoacoustic image of one metastatic melanoma, feeding vessels were visualized in the melanoma, suggesting the neovascularization around the tumour.

CONCLUSIONS

The 3D multispectral photoacoustic imaging not only provides well-measured depth and sizes of various types of melanomas, it also visualizes the metastatic type of melanoma. Obtaining accurate depth and boundary information of melanoma before surgery would play a useful role in the complete excision of melanoma during surgery.

Convolutional neural network for resolution enhancement and noise reduction in acoustic resolution photoacoustic microscopy

In acoustic resolution photoacoustic microscopy (AR-PAM), a high numerical aperture focused ultrasound transducer (UST) is used for deep tissue high resolution photoacoustic imaging. There is a significant degradation of lateral resolution in the out-of-focus region. Improvement in out-of-focus resolution without degrading the image quality remains a challenge. In this work, we propose a deep learning-based method to improve the resolution of AR-PAM images, especially at the out of focus plane. A modified fully dense U-Net based architecture was trained on simulated AR-PAM images. Applying the trained model on experimental images showed that the variation in resolution is ∼10% across the entire imaging depth (∼4 mm) in the deep learning-based method, compared to ∼180% variation in the original PAM images. Performance of the trained network on in vivo rat vasculature imaging further validated that noise-free, high resolution images can be obtained using this method.

Three-dimensional synthetic aperture focusing photoacoustic microscopy based on the acoustic simulation generated delay time and weighted factor

Acoustic resolution photoacoustic microscopy (ARPAM) is a promising imaging tool in biomedical applications for its advantage of penetration over other optical imaging techniques. However, the lateral resolution of ARPAM deteriorates significantly in the out-of-focus region. The synthetic aperture focusing technique (SAFT) is required to restore this kind of focus-related imaging distortion. The conventional SAFT method is based on the virtual detector (VD) conception, in which the phase of the received photoacoustic (PA) signal is calculated by assuming the focus of the transducer as a VD. Nevertheless, the phase of the received PA signal is not only determined by the geometrical parameters of the transducer, but also by the transducer's electromechanic response and the original PA signal. Ignoring these two factors will reduce the quality of the imaging results. In this work, a new SAFT method, which is based on acoustic simulation, is proposed for ARPAM. The measured PA signal from a point target at the focus is employed to evaluate the convolution of the transducer's electromechanic response and the original PA signal. This measured signal is used as the excitation in an acoustic simulation. The simulation, which is based on the geometrical and acoustic parameters of the transducer, is employed to calculate the delay time and weighted coefficient for the SAFT calculation. The phantom experiments with point and line targets indicate that the proposed method obtains imaging results with better lateral resolution and improved signal-noise ratio compared with the widely used VD-based SAFT method.

Spatial weight matrix in dimensionality reduction reconstruction for micro-electromechanical system-based photoacoustic microscopy

A micro-electromechanical system (MEMS) scanning mirror accelerates the raster scanning of optical-resolution photoacoustic microscopy (OR-PAM). However, the nonlinear tilt angular-voltage characteristic of a MEMS mirror introduces distortion into the maximum back-projection image. Moreover, the size of the airy disk, ultrasonic sensor properties, and thermal effects decrease the resolution. Thus, in this study, we proposed a spatial weight matrix (SWM) with a dimensionality reduction for image reconstruction. The three-layer SWM contains the invariable information of the system, which includes a spatial dependent distortion correction and 3D deconvolution. We employed an ordinal-valued Markov random field and the Harris Stephen algorithm, as well as a modified delay-and-sum method during a time reversal. The results from the experiments and a quantitative analysis demonstrate that images can be effectively reconstructed using an SWM; this is also true for severely distorted images. The index of the mutual information between the reference images and registered images was 70.33 times higher than the initial index, on average. Moreover, the peak signal-to-noise ratio was increased by 17.08% after 3D deconvolution. This accomplishment offers a practical approach to image reconstruction and a promising method to achieve a real-time distortion correction for MEMS-based OR-PAM.

In Vivo Dual-Modal Photoacoustic and Ultrasound Imaging of Sentinel Lymph Nodes Using a Solid-State Dye Laser System

Photoacoustic imaging (PAI) is being actively investigated as a non-invasive and non-radioactive imaging technique for sentinel lymph node (SLN) biopsy. By taking advantage of optical and ultrasound imaging, PAI probes SLNs non-invasively with methylene blue (MB) in both live animals and breast cancer patients. However, these PAI systems have limitations for widespread use in clinics and commercial marketplaces because the lasers used by the PAI systems, e.g., tunable liquid dye laser systems and optical parametric oscillator (OPO) lasers, are bulky in size, not economical, and use risky flammable and toxic liquid dyes. To overcome these limitations, we are proposing a novel dual-modal photoacoustic and ultrasound imaging system based on a solid-state dye laser (SD-PAUSI), which is compact, convenient, and carries far less risk of flammability and toxicity. Using a solid-state dye handpiece that generates 650-nm wavelength, we successfully imaged the MB tube positioned deeply (~3.9 cm) in chicken breast tissue. The SLNs were also photoacoustically detected in the in vivo rats beneath a 2.2-cm-thick layer of chicken breast, which is deeper than the typical depth of SLNs in humans (1.2 ± 0.5 cm). Furthermore, we showed the multispectral capability of the PAI by switching the dye handpiece, in which the MB-dyed SLN was selectively highlighted from the surrounding vasculature. These results demonstrated the great potential of the SD-PAUSI as an easy but effective modality for SLN detection.

Three-dimensional clinical handheld photoacoustic/ultrasound scanner

Clinical 2D photoacoustic (PA) imaging can be easily implemented in a traditional ultrasound (US) system. However, 3D PA imaging is still preferable because 2D B-mode PA/US imaging suffers from low reproducibility and high-operator dependency. Here, we demonstrate a compact clinical handheld 3D PA/US scanner using an 1D linear array US transducer combined with a mechanical scanning stage working via a Scotch yoke mechanism. The entire scanner measures just 100 × 80 × 100 mm3 and weighs only 950 g, so it can easily be operated by hand. Blood vessels and hemoglobin oxygen saturation images of different parts of the human body (e.g., neck, wrist, thigh, and instep) have been successfully acquired. The system can potentially be used for clinical applications in fields such as oncology, dermatology, nephrology, and internal medicine.

Optically Transparent Focused Transducers for Combined Photoacoustic and Ultrasound Microscopy

Purpose

Photoacoustic (PA) microscopy has emerged as a useful tool in biomedical imaging applications such as visualization of microvasculature and hemoglobin oxygen saturation, single-cell, and label-free imaging of organs including cancer. Since the ultrasound transducers used for PA signal detection are not optically transparent, the integration of optical and acoustic modules for coaxial alignment of laser and acoustic beam fields in PA microscopy is complex and costly.

Methods

Here, we report a recently developed optically transparent focused transducer for combined PA and ultrasound (US) microscopy. All the acoustic layers including the acoustic lens are optically transparent, enabling simple integration of optical and acoustic modules for both imaging modalities.

Results

The mean light transmittance of the transducer’s backing layer and acoustic lens and of the transducer itself were measured at 92%, 83%, and 66%, respectively. Results from in vitro and in vivo experiments demonstrated the transducer to be suitable for both US and PA imaging.

Conclusions

The results of this study represent a step toward efficient construction of probes for combined PA and US microscopy.

Versatile Single-Element Ultrasound Imaging Platform using a Water-Proofed MEMS Scanner for Animals and Humans

Single-element transducer based ultrasound (US) imaging offers a compact and affordable solution for high-frequency preclinical and clinical imaging because of its low cost, low complexity, and high spatial resolution compared to array-based US imaging. To achieve B-mode imaging, conventional approaches adapt mechanical linear or sector scanning methods. However, due to its low scanning speed, mechanical linear scanning cannot achieve acceptable temporal resolution for real-time imaging, and the sector scanning method requires specialized low-load transducers that are small and lightweight. Here, we present a novel single-element US imaging system based on an acoustic mirror scanning method. Instead of physically moving the US transducer, the acoustic path is quickly steered by a water-proofed microelectromechanical (MEMS) scanner, achieving real-time imaging. Taking advantage of the low-cost and compact MEMS scanner, we implemented both a tabletop system for in vivo small animal imaging and a handheld system for in vivo human imaging. Notably, in combination with mechanical raster scanning, we could acquire the volumetric US images in live animals. This versatile US imaging system can be potentially used for various preclinical and clinical applications, including echocardiography, ophthalmic imaging, and ultrasound-guided catheterization.

Super Wide-Field Photoacoustic Microscopy of Animals and Humans In Vivo

Acoustic-resolution photoacoustic micro-scopy (AR-PAM) is an emerging biomedical imaging modality that combines superior optical sensitivity and fine ultrasonic resolution in an optical quasi-diffusive regime (~1-3 mm in tissues). AR-PAM has been explored for anatomical, functional, and molecular information in biological tissues. Heretofore, AR-PAM systems have suffered from a limited field-of-view (FOV) and/or slow imaging speed, which have precluded them from routine preclinical and clinical applications. Here, we demonstrate an advanced AR-PAM system that overcomes both limitations of previous AR-PAM systems. The new AR-PAM system demonstrates a super wide-field scanning that utilized a 1-axis water-proofing microelectromechanical systems (MEMS) scanner integrated with two linear stepper motor stages. We achieved an extended FOV of 36 ×80 mm² by mosaicking multiple volumetric images of 36 ×2.5 mm² with a total acquisition time of 224 seconds. For one volumetric data (i.e., 36 ×2.5 mm²), the B-scan imaging speed over the short axis (i.e., 2.5 mm) was 83 Hz in humans. The 3D volumetric image was also provided by using MEMS mirror scanning along the X-axis and stepper-motor scanning along the Y-axis. The super-wide FOV mosaic image was realized by registering and merging all individual volumetric images. Finally, we obtained multi-plane whole-body in-vivo PA images of small animals, illustrating distinct multi-layered structures including microvascular networks and internal organs. Importantly, we also visualized microvascular networks in human fingers, palm, and forearm successfully. This advanced MEMS-AR-PAM system could potentially enable hitherto not possible wide preclinical and clinical applications.

Fast and High-Resolution Three-Dimensional Hybrid-Domain Photoacoustic Imaging Incorporating Analytical-Focused Transducer Beam Amplitude

Recently, many reconstruction methods have been developed to improve the lateral resolution of acoustic-resolution photoacoustic microscopy (ARPAM) in out-of-focus regions. Though these methods enhance image resolution to some extent, they require advanced computational hardware and large computational time, especially for three-dimensional (3-D) cases. However, some methods do not consider the finite size of a transducer, while others employ numerical discretization to build a focused transducer model that is less efficient and accurate. To overcome these problems, we propose a 3-D ARPAM imaging reconstruction method with high precision, high efficiency, and low memory cost. It inherits the framework of model-based reconstructions and incorporates the forward acoustic model in the hybrid domain. This hybrid-domain acoustic model promotes an analytical solution to establish a focused transducer model. Furthermore, the non-uniform fast Fourier transform (NUFFT) and deconvolution methods are introduced to reduce the required computational time and memory volume for 3-D reconstructions. According to the experimental results reconstructed by the proposed method, the lateral resolution of an ARPAM image recorded by a 20-MHz focused transducer (NA 0.393) can reach 88.39 [Formula: see text]. This resolution exceeds the diffraction limitation of the focused transducer ( [Formula: see text]). When reconstructing a 3-D image with 200×200×150 pixels, the proposed method takes only 8.15 s using a laptop loaded with Intel Core i7-8550U CPU at 1.8 GHz and 1.06-GB memory.