In Vivo Quantitative Vasculature Segmentation and Assessment for Photodynamic Therapy Process Monitoring Using Photoacoustic Microscopy

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Photoacoustic imaging for cutaneous melanoma assessment: a comprehensive review

Significance

Cutaneous melanoma (CM) has a high morbidity and mortality rate, but it can be cured if the primary lesion is detected and treated at an early stage. Imaging techniques such as photoacoustic (PA) imaging (PAI) have been studied and implemented to aid in the detection and diagnosis of CM.

Aim

Provide an overview of different PAI systems and applications for the study of CM, including the determination of tumor depth/thickness, cancer-related angiogenesis, metastases to lymph nodes, circulating tumor cells (CTCs), virtual histology, and studies using exogenous contrast agents.

Approach

A systematic review and classification of different PAI configurations was conducted based on their specific applications for melanoma detection. This review encompasses animal and preclinical studies, offering insights into the future potential of PAI in melanoma diagnosis in the clinic.

Results

PAI holds great clinical potential as a noninvasive technique for melanoma detection and disease management. PA microscopy has predominantly been used to image and study angiogenesis surrounding tumors and provide information on tumor characteristics. Additionally, PA tomography, with its increased penetration depth, has demonstrated its ability to assess melanoma thickness. Both modalities have shown promise in detecting metastases to lymph nodes and CTCs, and an all-optical implementation has been developed to perform virtual histology analyses. Animal and human studies have successfully shown the capability of PAI to detect, visualize, classify, and stage CM.

Conclusions

PAI is a promising technique for assessing the status of the skin without a surgical procedure. The capability of the modality to image microvasculature, visualize tumor boundaries, detect metastases in lymph nodes, perform fast and label-free histology, and identify CTCs could aid in the early diagnosis and classification of CM, including determination of metastatic status. In addition, it could be useful for monitoring treatment efficacy noninvasively.

Long-term assessment of cutaneous inflammation and treatment using optical resolution photoacoustic microscopy

Cutaneous inflammation is an acute skin disease characterized by edema and vascular hyperplasia. Longitudinal monitoring of vasculature is crucial for studying the development of inflammation and evaluating the therapeutic efficacy of drugs. Optical-resolution photoacoustic microscopy (OR-PAM) is a hybrid imaging tool for non-invasive and label-free visualization of microcirculations with a capillary-scale spatial resolution. In this study, we assess the feasibility of OR-PAM for long-term monitoring of vascular changes in 12-O-Tetradecanoylphorbol-13-Acetate (TPA)-induced mouse models, as well as the corresponding treatment process. Quantitative vascular evaluation is conducted based on derived key parameters, including vessel length, branchpoint number, vessel area fraction, vessel diameter, fractal dimension, vessel tortuosity and ear thickness, which reveal that vascular morphological changes are highly dependent on the concentration of TPA and existence of therapeutic drugs. Furthermore, the results show the potential of OR-PAM in the clinical management of inflammation and as an effective tool to evaluate vascular responses to pharmacological interventions in vivo.

Niche preclinical and clinical applications of photoacoustic imaging with endogenous contrast

In the past decade, photoacoustic (PA) imaging has attracted a great deal of popularity as an emergent diagnostic technology owing to its successful demonstration in both preclinical and clinical arenas by various academic and industrial research groups. Such steady growth of PA imaging can mainly be attributed to its salient features, including being non-ionizing, cost-effective, easily deployable, and having sufficient axial, lateral, and temporal resolutions for resolving various tissue characteristics and assessing the therapeutic efficacy. In addition, PA imaging can easily be integrated with the ultrasound imaging systems, the combination of which confers the ability to co-register and cross-reference various features in the structural, functional, and molecular imaging regimes. PA imaging relies on either an endogenous source of contrast (e.g., hemoglobin) or those of an exogenous nature such as nano-sized tunable optical absorbers or dyes that may boost imaging contrast beyond that provided by the endogenous sources. In this review, we discuss the applications of PA imaging with endogenous contrast as they pertain to clinically relevant niches, including tissue characterization, cancer diagnostics/therapies (termed as theranostics), cardiovascular applications, and surgical applications. We believe that PA imaging's role as a facile indicator of several disease-relevant states will continue to expand and evolve as it is adopted by an increasing number of research laboratories and clinics worldwide.

Homogeneous-resolution photoacoustic microscopy for ultrawide field-of-view neurovascular imaging in Alzheimer's disease

Neurovascular imaging is essential for investigating neurodegenerative diseases. However, the existing neurovascular imaging technology suffers from a trade-off between a field of view (FOV) and resolution in the whole brain, resulting in an inhomogeneous resolution and lack of information. Here, homogeneous-resolution arched-scanning photoacoustic microscopy (AS-PAM), which has an ultrawide FOV to cover the entire mouse cerebral cortex, was developed. Imaging of the neurovasculature was performed with a homogenous resolution of 6.9 µm from the superior sagittal sinus to the middle cerebral artery and caudal rhinal vein in an FOV of 12 × 12 mm². Moreover, using AS-PAM, vascular features of the meninges and cortex were quantified in early Alzheimer's disease (AD) and wild-type (WT) mice. The results demonstrated high sensitivity to the pathological progression of AD on tortuosity and branch index. The high-fidelity imaging capability in large FOV enables AS-PAM to be a promising tool for precise brain neurovascular visualization and quantification.

Melanoma Cell Reprogramming and Awakening of Antitumor Immunity as a Fingerprint of Hyper-Harmonized Hydroxylated Fullerene Water Complex (3HFWC) and Hyperpolarized Light Application In Vivo

In our recent study, we showed that in vitro treatment of melanoma cells with hyperpolarized light (HPL) as well as with the second derivative of fullerene, hyper-harmonized hydroxylated fullerene water complex (3HFWC) reduced viability of cells by decreasing their proliferative capacity and inducing senescence and reprogramming towards a normal, melanocytic phenotype. Therefore, we wanted to determine whether these effects persisted in vivo in the syngeneic mouse melanoma model with a combined treatment of HPL irradiation and 3HFWC per os. Our results demonstrated the potent antitumor effects of 3HFWC nanosubstance assisted by HPL irradiation. These effects were primarily driven by the stimulation of melanoma cell growth arrest, the establishment of a senescent phenotype, and melanocytic differentiation on the one hand, and the awakening of the antitumor immune response on the other. In addition, the combined treatment reduced the protumorigenic activity of immune cells by depleting T regulatory cells, myeloid-derived suppressors, and M2 macrophages. The support of the 3HFWC substance by HPL irradiation may be the axis of the new approach design based on tumor cell reprogramming synchronized with the mobilization of the host's protective immune response.

Multistage adaptive noise reduction technique for optical resolution photoacoustic microscopy

Photoacoustic microscopy has received great attention due to the benefits of the optical resolution contrast as well as its superior spatial resolution and relatively deep depth. Like other imaging modalities, photoacoustic images suffer from noise, and filtering techniques are required to remove them. To overcome the noise, we proposed a combination of filters, including an adaptive median filter, an effective filter for impulsive noise, and a nonlocal means filter, an effective filter for background noise, for noise removal and image quality enhancement. Our proposed method enhanced the signal-to-noise ratio by 16 dB in an in vivo study compared to the traditional image reconstruction approach and preserved the image detail with minimal blurring, which usually occurs when filtering. These experimental results verified that the proposed adaptive multistage denoising techniques could effectively improve image quality under noisy data acquisition conditions, providing a strong foundation for photoacoustic microscopy with limited laser power.

Accelerating skin regeneration and wound healing by controlled ROS from photodynamic treatment

Cellular metabolisms produce reactive oxygen species (ROS) which are essential for cellular signaling pathways and physiological functions. Nevertheless, ROS act as “double-edged swords” that have an unstable redox balance between ROS production and removal. A little raise of ROS results in cell proliferation enhancement, survival, and soft immune responses, while a high level of ROS could lead to cellular damage consequently protein, nucleic acid, and lipid damages and finally cell death. ROS play an important role in various pathological circumstances. On the contrary, ROS can show selective toxicity which is used against cancer cells and pathogens. Photodynamic therapy (PDT) is based on three important components including a photosensitizer (PS), oxygen, and light. Upon excitation of the PS at a specific wavelength, the PDT process begins which leads to ROS generation. ROS produced during PDT could induce two different pathways. If PDT produces control and low ROS, it can lead to cell proliferation and differentiation. However, excess production of ROS by PDT causes cellular photo damage which is the main mechanism used in cancer treatment. This review summarizes the functions of ROS in living systems and describes role of PDT in production of controllable ROS and finally a special focus on current ROS-generating therapeutic protocols for regeneration and wound healing.

High-speed optical resolution photoacoustic microscopy with MEMS scanner using a novel and simple distortion correction method

Optical resolution photoacoustic microscopy (OR-PAM) is a remarkable biomedical imaging technique that can selectively visualize microtissues with optical-dependent high resolution. However, traditional OR-PAM using mechanical stages provides slow imaging speed, making it difficult to biologically interpret in vivo tissue. In this study, we developed a high-speed OR-PAM using a recently commercialized MEMS mirror. This system (MEMS-OR-PAM) consists of a 1-axis MEMS mirror and a mechanical stage. Furthermore, this study proposes a novel calibration method that quickly removes the spatial distortion caused by fast MEMS scanning. The proposed calibration method can easily correct distortions caused by both the scan geometry of the MEMS mirror and its nonlinear motion by running an image sequence only once using a ruler target. The combination of MEMS-OR-PAM and distortion correction method was verified using three experiments: (1) leaf skeleton phantom imaging to test the distortion correction efficacy; (2) spatial resolution and depth of field (DOF) measurement for system performance; (3) in-vivo finger capillary imaging to verify their biomedical use. The results showed that the combination could achieve a high-speed (32 s in 2 × 4 mm) and high lateral resolution (~ 6 µm) imaging capability and precisely visualize the circulating structure of the finger capillaries.

Combined Action of Hyper-Harmonized Hydroxylated Fullerene Water Complex and Hyperpolarized Light Leads to Melanoma Cell Reprogramming In Vitro

(1) Background: Their unique structure and electron deficiency have brought fullerenes into the focus of research in many fields, including medicine. The hyper-harmonized hydroxylated fullerene water complex (3HFWC) formulation has solved the limitations of the poor solubility and bioavailability of fullerenes. To achieve better antitumor activity, 3HFWC was combined with short-term irradiation of cells with hyperpolarized light (HPL) generated by the application of a nanophotonic fullerene filter in a Bioptron^® device. The benefits of HPL were confirmed in the microcirculation, wound healing and immunological function. (2) Methods: B16, B16-F10 and A375 melanoma cells were exposed to a wide spectrum of 3HFWC doses and to a single short-term HPL irradiation. (3) Results: Apart from the differences in the redox status and level of invasiveness, the effects of the treatments were quite similar. Decreased viability, morphological alteration, signs of melanocytic differentiation and cellular senescence were observed upon the successful internalization of the nanoquantum substance. (4) Conclusions: Overall, 3HFWC/HPL promoted melanoma cell reprogramming toward a normal phenotype.

Segmentation and Quantitative Analysis of Photoacoustic Imaging: A Review

Photoacoustic imaging is an emerging biomedical imaging technique that combines optical contrast and ultrasound resolution to create unprecedented light absorption contrast in deep tissue. Thanks to its fusional imaging advantages, photoacoustic imaging can provide multiple structural and functional insights into biological tissues such as blood vasculatures and tumors and monitor the kinetic movements of hemoglobin and lipids. To better visualize and analyze the regions of interest, segmentation and quantitative analyses were used to extract several biological factors, such as the intensity level changes, diameter, and tortuosity of the tissues. Over the past 10 years, classical segmentation methods and advances in deep learning approaches have been utilized in research investigations. In this review, we provide a comprehensive review of segmentation and quantitative methods that have been developed to process photoacoustic imaging in preclinical and clinical experiments. We focus on the parametric reliability of quantitative analysis for semantic and instance-level segmentation. We also introduce the similarities and alternatives of deep learning models in qualitative measurements using classical segmentation methods for photoacoustic imaging.

Full-view in vivo skin and blood vessels profile segmentation in photoacoustic imaging based on deep learning

Photoacoustic (PA) microscopy allows imaging of the soft biological tissue based on optical absorption contrast and spatial ultrasound resolution. One of the major applications of PA imaging is its characterization of microvasculature. However, the strong PA signal from skin layer overshadowed the subcutaneous blood vessels leading to indirectly reconstruct the PA images in human study. Addressing the present situation, we examined a deep learning (DL) automatic algorithm to achieve high-resolution and high-contrast segmentation for widening PA imaging applications. In this research, we propose a DL model based on modified U-Net for extracting the relationship features between amplitudes of the generated PA signal from skin and underlying vessels. This study illustrates the broader potential of hybrid complex network as an automatic segmentation tool for the in vivo PA imaging. With DL-infused solution, our result outperforms the previous studies with achieved real-time semantic segmentation on large-size high-resolution PA images.

Multi-step deep neural network for identifying subfascial vessels in a dorsal skinfold window chamber model

Automatic segmentation of blood vessels in the dorsal skinfold window chamber (DWSC) model is a prerequisite for the evaluation of vascular-targeted photodynamic therapy (V-PDT) biological response. Recently, deep learning methods have been widely applied in blood vessel segmentation, but they have difficulty precisely identifying the subfascial vessels. This study proposed a multi-step deep neural network, named the global attention-Xnet (GA-Xnet) model, to precisely segment subfascial vessels in the DSWC model. We first used Hough transform combined with a U-Net model to extract circular regions of interest for image processing. GA step was then employed to obtain global feature learning followed by coarse segmentation for the entire blood vessel image. Secondly, the coarse segmentation of blood vessel images from the GA step and the same number of retinal images from the DRIVE datasets were combined as the mixing sample, inputted into the Xnet step to learn the multiscale feature predicting fine segmentation maps of blood vessels. The data show that the accuracy, sensitivity, and specificity for the segmentation of multiscale blood vessels in the DSWC model are 96.00%, 86.27%, 96.47%, respectively. As a result, the subfascial vessels could be accurately identified, and the connectedness of the vessel skeleton is well preserved. These findings suggest that the proposed multi-step deep neural network helps evaluate the short-term vascular responses in V-PDT.

Recent Progress on Molecular Photoacoustic Imaging with Carbon-Based Nanocomposites

For biomedical imaging, the interest in noninvasive imaging methods is ever increasing. Among many modalities, photoacoustic imaging (PAI), which is a combination of optical and ultrasound imaging techniques, has received attention because of its unique advantages such as high spatial resolution, deep penetration, and safety. Incorporation of exogenous imaging agents further amplifies the effective value of PAI, since they can deliver other specified functions in addition to imaging. For these agents, carbon-based materials can show a large specific surface area and interesting optoelectronic properties, which increase their effectiveness and have proved their potential in providing a theragnostic platform (diagnosis + therapy) that is essential for clinical use. In this review, we introduce the current state of the PAI modality, address recent progress on PAI imaging that takes advantage of carbon-based agents, and offer a future perspective on advanced PAI systems using carbon-based agents.

Photodynamic Therapy—An Up-to-Date Review

The healing power of light has attracted interest for thousands of years. Scientific discoveries and technological advancements in the field have eventually led to the emergence of photodynamic therapy, which soon became a promising approach in treating a broad range of diseases. Based on the interaction between light, molecular oxygen, and various photosensitizers, photodynamic therapy represents a non-invasive, non-toxic, repeatable procedure for tumor treatment, wound healing, and pathogens inactivation. However, classic photosensitizing compounds impose limitations on their clinical applications. Aiming to overcome these drawbacks, nanotechnology came as a solution for improving targeting efficiency, release control, and solubility of traditional photosensitizers. This paper proposes a comprehensive path, starting with the photodynamic therapy mechanism, evolution over the years, integration of nanotechnology, and ending with a detailed review of the most important applications of this therapeutic approach.