Electrothermal-MEMS-induced nonlinear distortion correction in photoacoustic laparoscopy

Advances in Portable Optical Microscopy Using Cloud Technologies and Artificial Intelligence for Medical Applications

The need for faster and more accessible alternatives to laboratory microscopy is driving many innovations throughout the image and data acquisition chain in the biomedical field. Benchtop microscopes are bulky, lack communications capabilities, and require trained personnel for analysis. New technologies, such as compact 3D-printed devices integrated with the Internet of Things (IoT) for data sharing and cloud computing, as well as automated image processing using deep learning algorithms, can address these limitations and enhance the conventional imaging workflow. This review reports on recent advancements in microscope miniaturization, with a focus on emerging technologies such as photoacoustic microscopy and more established approaches like smartphone-based microscopy. The potential applications of IoT in microscopy are examined in detail. Furthermore, this review discusses the evolution of image processing in microscopy, transitioning from traditional to deep learning methods that facilitate image enhancement and data interpretation. Despite numerous advancements in the field, there is a noticeable lack of studies that holistically address the entire microscopy acquisition chain. This review aims to highlight the potential of IoT and artificial intelligence (AI) in combination with portable microscopy, emphasizing the importance of a comprehensive approach to the microscopy acquisition chain, from portability to image analysis.

Perspectives on endoscopic functional photoacoustic microscopy

Endoscopy, enabling high-resolution imaging of deep tissues and internal organs, plays an important role in basic research and clinical practice. Recent advances in photoacoustic microscopy (PAM), demonstrating excellent capabilities in high-resolution functional imaging, have sparked significant interest in its integration into the field of endoscopy. However, there are challenges in achieving functional PAM in the endoscopic setting. This Perspective article discusses current progress in the development of endoscopic PAM and the challenges related to functional measurements. Then, it points out potential directions to advance endoscopic PAM for functional imaging by leveraging fiber optics, microfabrication, optical engineering, and computational approaches. Finally, it highlights emerging opportunities for functional endoscopic PAM in basic and translational biomedicine.

Visualizing tumor angiogenesis and boundary with polygon-scanning multiscale photoacoustic microscopy

Recently, we developed an integrated optical-resolution (OR) and acoustic-resolution (AR) PAM, which has multiscale imaging capability using different resolutions. However, limited by the scanning method, a tradeoff exists between the imaging speed and field of view, which impedes its wider applications. Here, we present an improved multiscale PAM which achieves high-speed wide-field imaging based on a homemade polygon scanner. Encoder trigger mode was proposed to avoid jittering of the polygon scanner during imaging. Distortions caused by polygon scanning were analyzed theoretically and compared with traditional types of distortions in optical-scanning PAM. Then a depth correction method was proposed and verified to compensate for the distortions. System characterization of OR-PAM and AR-PAM was performed prior to in vivo imaging. Blood reperfusion of an in vivo mouse ear was imaged continuously to demonstrate the feasibility of the multiscale PAM for high-speed imaging. Results showed that the maximum B-scan rate could be 14.65 Hz in a fixed range of 10 mm. Compared with our previous multiscale system, the imaging speed of the improved system was increased by a factor of 12.35. In vivo imaging of a subcutaneously inoculated B-16 melanoma of a mouse was performed. Results showed that the blood vasculature around the melanoma could be resolved and the melanoma could be visualized at a depth up to 1.6 mm using the multiscale PAM.

Dual-model wearable photoacoustic microscopy and electroencephalograph: study of neurovascular coupling in anesthetized and freely moving rats

Observing microscale neurovascular dynamics under different physiological conditions is of great importance to understanding brain functions and disorders. Here, we report a dual-model wearable device and an auxiliary data processing algorithm to derive neurovascular dynamics. The device integrates high-resolution photoacoustic microscopy and electroencephalography (EEG), which allows observing capillary-level hemodynamics and neural activities in anesthesia and freely moving rats. By using the developed algorithm, multiple photoacoustic/EEG parameters extracted and correlated enables investigation of the interplay between neural and vascular activities. We employed this platform to study the neurovascular coupling during different types of seizures in rats under various physiological conditions. We observed cerebral vascular vasodilation/constriction corresponding well to the seizure on/off in rats under regular anesthesia conditions, showing a strong neurovascular coupling coefficient. In rats under weak anesthesia and freely moving conditions, more intense cerebral hemodynamics and neural activities occurred with a weaker neurovascular coupling coefficient. The comprehensively quantitative analyses suggest that anesthesia has a dominant impact on the seizure onset and affect the neurovascular coupling correlation in the current drug-induced localized seizure model. Our study reveals that the designed platform has the potential to support studies on brain functions and disorders in diseased rodent models in various physiological states.

Dual-foci fast-scanning photoacoustic microscopy with 3.2-MHz A-line rate

We report fiber-based dual-foci fast-scanning OR-PAM that can double the scanning rate without compromising the imaging resolution, the field of view, and the detection sensitivity. To achieve fast scanning speed, the OR-PAM system uses a single-axis water-immersible resonant scanning mirror that can confocally scan the optical and acoustic beams at 1018 Hz with a 3-mm range. Pulse energies of 45∼100-nJ are sufficient for acquiring vascular and oxygen-saturation images. The dual-foci method can double the B-scan rate to 2036 Hz. Using two lasers and stimulated Raman scattering, we achieve dual-wavelength excitation on both foci, and the total A-line rate is 3.2-MHz. In in vivo experiments, we inject epinephrine and monitor the hemodynamic and oxygen saturation response in the peripheral vessels at 1.7 Hz over 2.5 × 6.7 mm². Dual-foci OR-PAM offers a new imaging tool for the study of fast physiological and pathological changes.

Progress of clinical translation of handheld and semi-handheld photoacoustic imaging

Photoacoustic imaging (PAI), featuring rich contrast, high spatial/temporal resolution and deep penetration, is one of the fastest-growing biomedical imaging technology over the last decade. To date, numbers of handheld and semi-handheld photoacoustic imaging devices have been reported with corresponding potential clinical applications. Here, we summarize emerged handheld and semi-handheld systems in terms of photoacoustic computed tomography (PACT), optoacoustic mesoscopy (OAMes), and photoacoustic microscopy (PAM). We will discuss each modality in three aspects: laser delivery, scanning protocol, and acoustic detection. Besides new technical developments, we also review the associated clinical studies, and the advantages/disadvantages of these new techniques. In the end, we propose the challenges and perspectives of miniaturized PAI in the future.

Miniature all-optical flexible forward-viewing photoacoustic endoscopy probe for surgical guidance

A miniature flexible photoacoustic endoscopy probe that provides high-resolution 3D images of vascular structures in the forward-viewing configuration is described. A planar Fabry-Perot ultrasound sensor with a -3dB bandwidth of 53 MHz located at the tip of the probe is interrogated via a flexible fiber bundle and a miniature optical relay system to realize an all-optical probe measuring 7.4 mm in outer diameter at the tip. This approach to photoacoustic endoscopy offers advantages over previous piezoelectric based distal-end scanning probes. These include a forward-viewing configuration in widefield photoacoustic tomography mode, finer spatial sampling (87 µm spatial sampling interval), and wider detection bandwidth (53 MHz) than has been achievable with conventional ultrasound detection technology and an all-optical passive imaging head for safe endoscopic use.

Spatial weight matrix in dimensionality reduction reconstruction for micro-electromechanical system-based photoacoustic microscopy

A micro-electromechanical system (MEMS) scanning mirror accelerates the raster scanning of optical-resolution photoacoustic microscopy (OR-PAM). However, the nonlinear tilt angular-voltage characteristic of a MEMS mirror introduces distortion into the maximum back-projection image. Moreover, the size of the airy disk, ultrasonic sensor properties, and thermal effects decrease the resolution. Thus, in this study, we proposed a spatial weight matrix (SWM) with a dimensionality reduction for image reconstruction. The three-layer SWM contains the invariable information of the system, which includes a spatial dependent distortion correction and 3D deconvolution. We employed an ordinal-valued Markov random field and the Harris Stephen algorithm, as well as a modified delay-and-sum method during a time reversal. The results from the experiments and a quantitative analysis demonstrate that images can be effectively reconstructed using an SWM; this is also true for severely distorted images. The index of the mutual information between the reference images and registered images was 70.33 times higher than the initial index, on average. Moreover, the peak signal-to-noise ratio was increased by 17.08% after 3D deconvolution. This accomplishment offers a practical approach to image reconstruction and a promising method to achieve a real-time distortion correction for MEMS-based OR-PAM.