Full-view in vivo skin and blood vessels profile segmentation in photoacoustic imaging based on deep learning

Intelligent skin-removal photoacoustic computed tomography for human based on deep learning

Photoacoustic computed tomography (PACT) has centimeter-level imaging ability and can be used to detect the human body. However, strong photoacoustic signals from skin cover deep tissue information, hindering the frontal display and analysis of photoacoustic images of deep regions of interest. Therefore, we propose a 2.5 D deep learning model based on feature pyramid structure and single-type skin annotation to extract the skin region, and design a mask generation algorithm to remove skin automatically. PACT imaging experiments on the human periphery blood vessel verified the correctness our proposed skin-removal method. Compared with previous studies, our method exhibits high robustness to the uneven illumination, irregular skin boundary, and reconstruction artifacts in the images, and the reconstruction errors of PACT images decreased by 20% ~ 90% with a 1.65 dB improvement in the signal-to-noise ratio at the same time. This study may provide a promising way for high-definition PACT imaging of deep tissues.

Unsupervised Segmentation of 3D Microvascular Photoacoustic Images Using Deep Generative Learning

Mesoscopic photoacoustic imaging (PAI) enables label-free visualization of vascular networks in tissues with high contrast and resolution. Segmenting these networks from 3D PAI data and interpreting their physiological and pathological significance is crucial yet challenging due to the time-consuming and error-prone nature of current methods. Deep learning offers a potential solution; however, supervised analysis frameworks typically require human-annotated ground-truth labels. To address this, an unsupervised image-to-image translation deep learning model is introduced, the Vessel Segmentation Generative Adversarial Network (VAN-GAN). VAN-GAN integrates synthetic blood vessel networks that closely resemble real-life anatomy into its training process and learns to replicate the underlying physics of the PAI system in order to learn how to segment vasculature from 3D photoacoustic images. Applied to a diverse range of in silico, in vitro, and in vivo data, including patient-derived breast cancer xenograft models and 3D clinical angiograms, VAN-GAN demonstrates its capability to facilitate accurate and unbiased segmentation of 3D vascular networks. By leveraging synthetic data, VAN-GAN reduces the reliance on manual labeling, thus lowering the barrier to entry for high-quality blood vessel segmentation (F1 score: VAN-GAN vs. U-Net = 0.84 vs. 0.87) and enhancing preclinical and clinical research into vascular structure and function.

Vascular regional analysis unveils differential responses to anti-angiogenic therapy in pancreatic xenografts through macroscopic photoacoustic imaging

Pancreatic cancer (PC) is a highly lethal malignancy and the third leading cause of cancer deaths in the U.S. Despite major innovations in imaging technologies, there are limited surrogate radiographic indicators to aid in therapy planning and monitoring. Amongst the various imaging techniques Ultrasound-guided photoacoustic imaging (US-PAI) is a promising modality based on endogenous blood (hemoglobin) and blood oxygen saturation (StO 2 ) contrast to monitor response to anti-angiogenic therapies. Adaptation of US-PAI to the clinical realm requires macroscopic configurations for adequate depth visualization, illuminating the need for surrogate radiographic markers, including the tumoral microvessel density (MVD). In this work, subcutaneous xenografts with PC cell lines AsPC-1 and MIA-PaCa-2 were used to investigate the effects of receptor tyrosine kinase inhibitor (sunitinib) treatment on MVD and StO 2 . Through histological correlation, we have shown that regions of high and low vascular density (HVD and LVD) can be identified through frequency domain filtering of macroscopic PA images which could not be garnered from purely global analysis. We utilized vascular regional analysis (VRA) of treatment-induced StO 2 and total hemoglobin (HbT) changes. VRA as a tool to monitor treatment response allowed us to identify potential timepoints of vascular remodeling, highlighting its ability to provide insights into the TME not only for sunitinib treatment but also other anti-angiogenic therapies.

Noise-insensitive defocused signal and resolution enhancement for optical-resolution photoacoustic microscopy via deep learning

Optical-resolution photoacoustic microscopy suffers from narrow depth of field and a significant deterioration in defocused signal intensity and spatial resolution. Here, a method based on deep learning was proposed to enhance the defocused resolution and signal-to-noise ratio. A virtual optical-resolution photoacoustic microscopy based on k-wave was used to obtain the datasets of deep learning with different noise levels. A fully dense U-Net was trained with randomly distributed sources to improve the quality of photoacoustic images. The results show that the PSNR of defocused signal was enhanced by more than 1.2 times. An over 2.6-fold enhancement in lateral resolution and an over 3.4-fold enhancement in axial resolution of defocused regions were achieved. The large volumetric and high-resolution imaging of blood vessels further verified that the proposed method can effectively overcome the deterioration of the signal and the spatial resolution due to the narrow depth of field of optical-resolution photoacoustic microscopy.

Automated Laser-Fiber Coupling Module for Optical-Resolution Photoacoustic Microscopy

Photoacoustic imaging has emerged as a promising biomedical imaging technique that enables visualization of the optical absorption characteristics of biological tissues in vivo. Among the different photoacoustic imaging system configurations, optical-resolution photoacoustic microscopy stands out by providing high spatial resolution using a tightly focused laser beam, which is typically transmitted through optical fibers. Achieving high-quality images depends significantly on optical fluence, which is directly proportional to the signal-to-noise ratio. Hence, optimizing the laser-fiber coupling is critical. Conventional coupling systems require manual adjustment of the optical path to direct the laser beam into the fiber, which is a repetitive and time-consuming process. In this study, we propose an automated laser-fiber coupling module that optimizes laser delivery and minimizes the need for manual intervention. By incorporating a motor-mounted mirror holder and proportional derivative control, we successfully achieved efficient and robust laser delivery. The performance of the proposed system was evaluated using a leaf-skeleton phantom in vitro and a human finger in vivo, resulting in high-quality photoacoustic images. This innovation has the potential to significantly enhance the quality and efficiency of optical-resolution photoacoustic microscopy.

Recent development of photoacoustic imaging in dentistry: A review on studies over the last decade

Background

This work performs a literature review of photoacoustic imaging (PAI) in dentistry and discusses the development of PAI in relation to oral health.

Methods

A search method was used to locate papers published between 2011 and 2023 in Google Scholar and PubMed databases, and 25 studies were selected. Reports on PAI in dentistry were included. Articles not written in English or whose full text could not be accessed were excluded. The remaining publications were checked and evaluated to determine whether they contain supportive materials for PAI in dentistry.

Results

The majority of articles about PAI in dentistry are associated with caries studies. Photoacoustic microscopy is the most commonly utilized PAI system. PAI studies generally focus on ex-vivo investigations using extracted human teeth. The acoustic signal obtained from carious teeth is greater than that obtained from normal teeth. In addition to imaging oral soft tissues from animal models and the periodontal pocket depth in human volunteers, PAI is applied to evaluate dental implants and oral biofilms.

Conclusion

There have been numerous investigation on PAI in dentistry, but it is not yet applicable in dental practice. In the future, PAI studies are expected to contribute to the invention of an alternative non-ionizing imaging technology that is comfortable for patients, user friendly, and capable of providing reliable information at a reasonable cost.

A Signal Domain Object Segmentation Method for Ultrasound and Photoacoustic Computed Tomography

Image segmentation is important in improving the diagnostic capability of ultrasound computed tomography (USCT) and photoacoustic computed tomography (PACT), as it can be included in the image reconstruction process to improve image quality and quantification abilities. Segmenting the imaged object out of the background using image domain methods is easily complicated by low contrast, noise, and artifacts in the reconstructed image. Here, we introduce a new signal domain object segmentation method for USCT and PACT which does not require image reconstruction beforehand and is automatic, robust, computationally efficient, accurate, and straightforward. We first establish the relationship between the time-of-flight of the received first arrival waves and the object's boundary which is described by ellipse equations. Then, we show that the ellipses are tangent to the boundary. By looking for tangent points on the common tangent of neighboring ellipses, the boundary can be approximated with high fidelity. Imaging experiments of human fingers and mice cross-sections showed that our method provided equivalent or better segmentations than the optimal ones by active contours. In summary, our method greatly reduces the overall complexity of object segmentation and shows great potential in eliminating user dependency without sacrificing segmentation accuracy. The method can be further seamlessly incorporated into algorithms for other processing purposes in USCT and PACT, such as high-quality image reconstruction.

Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook

In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.

Whole-Body Photoacoustic Imaging Techniques for Preclinical Small Animal Studies

Photoacoustic imaging is a hybrid imaging technique that has received considerable attention in biomedical studies. In contrast to pure optical imaging techniques, photoacoustic imaging enables the visualization of optical absorption properties at deeper imaging depths. In preclinical small animal studies, photoacoustic imaging is widely used to visualize biodistribution at the molecular level. Monitoring the whole-body distribution of chromophores in small animals is a key method used in preclinical research, including drug-delivery monitoring, treatment assessment, contrast-enhanced tumor imaging, and gastrointestinal tracking. In this review, photoacoustic systems for the whole-body imaging of small animals are explored and summarized. The configurations of the systems vary with the scanning methods and geometries of the ultrasound transducers. The future direction of research is also discussed with regard to achieving a deeper imaging depth and faster imaging speed, which are the main factors that an imaging system should realize to broaden its application in biomedical studies.

Semantic segmentation of multispectral photoacoustic images using deep learning

Photoacoustic (PA) imaging has the potential to revolutionize functional medical imaging in healthcare due to the valuable information on tissue physiology contained in multispectral photoacoustic measurements. Clinical translation of the technology requires conversion of the high-dimensional acquired data into clinically relevant and interpretable information. In this work, we present a deep learning-based approach to semantic segmentation of multispectral photoacoustic images to facilitate image interpretability. Manually annotated photoacoustic and ultrasound imaging data are used as reference and enable the training of a deep learning-based segmentation algorithm in a supervised manner. Based on a validation study with experimentally acquired data from 16 healthy human volunteers, we show that automatic tissue segmentation can be used to create powerful analyses and visualizations of multispectral photoacoustic images. Due to the intuitive representation of high-dimensional information, such a preprocessing algorithm could be a valuable means to facilitate the clinical translation of photoacoustic imaging.

Deep-Learning-Based Algorithm for the Removal of Electromagnetic Interference Noise in Photoacoustic Endoscopic Image Processing

Despite all the expectations for photoacoustic endoscopy (PAE), there are still several technical issues that must be resolved before the technique can be successfully translated into clinics. Among these, electromagnetic interference (EMI) noise, in addition to the limited signal-to-noise ratio (SNR), have hindered the rapid development of related technologies. Unlike endoscopic ultrasound, in which the SNR can be increased by simply applying a higher pulsing voltage, there is a fundamental limitation in leveraging the SNR of PAE signals because they are mostly determined by the optical pulse energy applied, which must be within the safety limits. Moreover, a typical PAE hardware situation requires a wide separation between the ultrasonic sensor and the amplifier, meaning that it is not easy to build an ideal PAE system that would be unaffected by EMI noise. With the intention of expediting the progress of related research, in this study, we investigated the feasibility of deep-learning-based EMI noise removal involved in PAE image processing. In particular, we selected four fully convolutional neural network architectures, U-Net, Segnet, FCN-16s, and FCN-8s, and observed that a modified U-Net architecture outperformed the other architectures in the EMI noise removal. Classical filter methods were also compared to confirm the superiority of the deep-learning-based approach. Still, it was by the U-Net architecture that we were able to successfully produce a denoised 3D vasculature map that could even depict the mesh-like capillary networks distributed in the wall of a rat colorectum. As the development of a low-cost laser diode or LED-based photoacoustic tomography (PAT) system is now emerging as one of the important topics in PAT, we expect that the presented AI strategy for the removal of EMI noise could be broadly applicable to many areas of PAT, in which the ability to apply a hardware-based prevention method is limited and thus EMI noise appears more prominently due to poor SNR.

Segmentation and Quantitative Analysis of Photoacoustic Imaging: A Review

Photoacoustic imaging is an emerging biomedical imaging technique that combines optical contrast and ultrasound resolution to create unprecedented light absorption contrast in deep tissue. Thanks to its fusional imaging advantages, photoacoustic imaging can provide multiple structural and functional insights into biological tissues such as blood vasculatures and tumors and monitor the kinetic movements of hemoglobin and lipids. To better visualize and analyze the regions of interest, segmentation and quantitative analyses were used to extract several biological factors, such as the intensity level changes, diameter, and tortuosity of the tissues. Over the past 10 years, classical segmentation methods and advances in deep learning approaches have been utilized in research investigations. In this review, we provide a comprehensive review of segmentation and quantitative methods that have been developed to process photoacoustic imaging in preclinical and clinical experiments. We focus on the parametric reliability of quantitative analysis for semantic and instance-level segmentation. We also introduce the similarities and alternatives of deep learning models in qualitative measurements using classical segmentation methods for photoacoustic imaging.

Design of Metaheuristic Optimization-Based Vascular Segmentation Techniques for Photoacoustic Images

Biomedical imaging technologies are designed to offer functional, anatomical, and molecular details related to the internal organs. Photoacoustic imaging (PAI) is becoming familiar among researchers and industrialists. The PAI is found useful in several applications of brain and cancer imaging such as prostate cancer, breast cancer, and ovarian cancer. At the same time, the vessel images hold important medical details which offer strategies for a qualified diagnosis. Recently developed image processing techniques can be employed to segment vessels. Since vessel segmentation on PAI is a difficult process, this paper employs metaheuristic optimization-based vascular segmentation techniques for PAI. The proposed model involves two distinct kinds of vessel segmentation approaches such as Shannon’s entropy function (SEF) and multilevel Otsu thresholding (MLOT). Moreover, the threshold value and entropy function in the segmentation process are optimized using three metaheuristics such as the cuckoo search (CS), equilibrium optimizer (EO), and harmony search (HS) algorithms. A detailed experimental analysis is made on benchmark PAI dataset, and the results are inspected under varying aspects. The obtained results pointed out the supremacy of the presented model with a higher accuracy of 98.71%.