1
|
Zhang S, Li J, Shen L, Zhao Z, Lee M, Qian K, Sun N, Hu B. Structure and oxygen saturation recovery of sparse photoacoustic microscopy images by deep learning. PHOTOACOUSTICS 2025; 42:100687. [PMID: 39896070 PMCID: PMC11787619 DOI: 10.1016/j.pacs.2025.100687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2024] [Revised: 12/24/2024] [Accepted: 01/08/2025] [Indexed: 02/04/2025]
Abstract
Photoacoustic microscopy (PAM) leverages the photoacoustic effect to provide high-resolution structural and functional imaging. However, achieving high-speed imaging with high spatial resolution remains challenging. To address this, undersampling and deep learning have emerged as common techniques to enhance imaging speed. Yet, existing methods rarely achieve effective recovery of functional images. In this study, we propose Mask-enhanced U-net (MeU-net) for recovering sparsely sampled PAM structural and functional images. The model utilizes dual-channel input, processing photoacoustic data from 532 nm and 558 nm wavelengths. Additionally, we introduce an adaptive vascular attention mask module that focuses on vascular information recovery and design a vessel-specific loss function to enhance restoration accuracy. We simulate data from mouse brain and ear imaging under various levels of sparsity (4 ×, 8 ×, 12 ×) and conduct extensive experiments. The results demonstrate that MeU-net significantly outperforms traditional interpolation methods and other representative models in structural information and oxygen saturation recovery.
Collapse
Affiliation(s)
- Shuyan Zhang
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Jingtan Li
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Lin Shen
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Zhonghao Zhao
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Minjun Lee
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Computer Science and Technology, Beijing Institute of Technology, China
| | - Kun Qian
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Naidi Sun
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| | - Bin Hu
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention (Beijing Institute of Technology), Ministry of Education, China
- School of Medical Technology, Beijing Institute of Technology, China
| |
Collapse
|
2
|
Nozdriukhin D, Cattaneo M, Klingler N, Lyu S, Li W, de Espinosa FM, Bonvin J, Supponen O, Razansky D, Deán‐Ben XL. Nanoporous Submicron Gold Particles Enable Nanoparticle-Based Localization Optoacoustic Tomography (nanoLOT). SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2024; 20:e2404904. [PMID: 39394978 PMCID: PMC11657075 DOI: 10.1002/smll.202404904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 09/11/2024] [Indexed: 10/14/2024]
Abstract
Localization optoacoustic tomography (LOT) has recently emerged as a transformative super-resolution technique breaking through the acoustic diffraction limit in deep-tissue optoacoustic (OA) imaging via individual localization and tracking of particles in the bloodstream. However, strong light absorption in red blood cells has previously restricted per-particle OA detection to relatively large microparticles, ≈5 µm in diameter. Herein, it is demonstrated that submicron-sized porous gold nanoparticles, ≈600 nm in diameter, can be individually detected for noninvasive super-resolution imaging with LOT. Ultra-high-speed bright-field microscopy revealed that these nanoparticles generate microscopic plasmonic vapor bubbles, significantly enhancing opto-acoustic energy conversion through a nano-to-micro size transformation. Comprehensive in vitro and in vivo tests further demonstrated the biocompatibility and biosafety of the particles. By reducing the detectable particle size by an order of magnitude, nanoLOT enables microangiographic imaging with a significantly reduced risk of embolisms from particle aggregation and opens new avenues to visualize how nanoparticles reach vascular and potentially extravascular targets. The performance of nanoLOT for non-invasive imaging of microvascular networks in the murine brain anticipates new insights into neurovascular coupling mechanisms and longitudinal microcirculatory changes associated with neurodegenerative diseases.
Collapse
Affiliation(s)
- Daniil Nozdriukhin
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
| | - Marco Cattaneo
- Institute of Fluid Dynamics, Department of Mechanical and Process EngineeringETH ZürichSonneggstrasse 3Zurich8092Switzerland
| | - Norman Klingler
- Institute of Fluid Dynamics, Department of Mechanical and Process EngineeringETH ZürichSonneggstrasse 3Zurich8092Switzerland
| | - Shuxin Lyu
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
- Department of Medical ImagingShanxi Medical UniversityXinjiannan Road 56Shanxi030001China
| | - Weiye Li
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
| | | | - Jerome Bonvin
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
| | - Outi Supponen
- Institute of Fluid Dynamics, Department of Mechanical and Process EngineeringETH ZürichSonneggstrasse 3Zurich8092Switzerland
| | - Daniel Razansky
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
| | - Xosé Luís Deán‐Ben
- Institute for Biomedical Engineering and Institute of Pharmacology and Toxicology, Faculty of MedicineUniversity of ZürichWinterthurerstrasse 190Zurich8057Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical EngineeringETH ZürichRämistrasse 101Zurich8093Switzerland
| |
Collapse
|
3
|
Kim D, Ahn J, Kim D, Kim JY, Yoo S, Lee JH, Ghosh P, Luke MC, Kim C. Quantitative volumetric photoacoustic assessment of vasoconstriction by topical corticosteroid application in mice skin. PHOTOACOUSTICS 2024; 40:100658. [PMID: 39553383 PMCID: PMC11563941 DOI: 10.1016/j.pacs.2024.100658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2024] [Revised: 10/13/2024] [Accepted: 10/27/2024] [Indexed: 11/19/2024]
Abstract
Topical corticosteroids manage inflammatory skin conditions via their action on the immune system. An effect of application of corticosteroids to the skin is skin blanching caused by peripheral vasoconstriction. This has been used to characterize, in some cases relative potency and also as a way to compare skin penetration. Chromameters have been used to assess skin blanching-the outcome of vasoconstriction caused by topical corticosteroids-but do not directly measure vasoconstriction. Here, we demonstrate quantitative volumetric photoacoustic microscopy (PAM) as a tool for directly assessing the vasoconstriction followed by topical corticosteroid application, noninvasively visualizing skin vasculature without any exogeneous contrast agent. We photoacoustically differentiated the vasoconstrictive ability of four topical corticosteroids in small animals through multiparametric analyses, offering detailed 3D insights into vasoconstrictive mechanisms across different skin depths. Our findings highlight the potential of PAM as a noninvasive tool for measurement of comparative vasoconstriction with potential for clinical, pharmaceutical, and bioequivalence applications.
Collapse
Affiliation(s)
- Donggyu Kim
- Department of Convergence IT Engineering, Electrical Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
| | - Joongho Ahn
- Department of Convergence IT Engineering, Electrical Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
- Opticho Inc., Pohang, Republic of Korea
| | - Donghyun Kim
- Department of Convergence IT Engineering, Electrical Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
| | - Jin Young Kim
- Department of Convergence IT Engineering, Electrical Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
- Opticho Inc., Pohang, Republic of Korea
| | - Seungah Yoo
- Department of Dermatology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Ji Hyun Lee
- Department of Dermatology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Priyanka Ghosh
- Division of Therapeutic Performance I, Office of Research and Standards, Office of Generic Drugs, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, USA
| | - Markham C. Luke
- Division of Therapeutic Performance I, Office of Research and Standards, Office of Generic Drugs, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, USA
| | - Chulhong Kim
- Department of Convergence IT Engineering, Electrical Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
- Opticho Inc., Pohang, Republic of Korea
| |
Collapse
|
4
|
Oh D, Kim H, Sung M, Kim C. Video-rate endocavity photoacoustic/harmonic ultrasound imaging with miniaturized light delivery. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11528. [PMID: 38505737 PMCID: PMC10949014 DOI: 10.1117/1.jbo.29.s1.s11528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 02/02/2024] [Accepted: 02/28/2024] [Indexed: 03/21/2024]
Abstract
Significance Endocavity ultrasound (US) imaging is a frequently employed diagnostic technique in gynecology and urology for the assessment of male and female genital diseases that present challenges for conventional transabdominal imaging. The integration of photoacoustic (PA) imaging with clinical US imaging has displayed promising outcomes in clinical research. Nonetheless, its application has been constrained due to size limitations, restricting it to spatially confined locations such as vaginal or rectal canals. Aim This study presents the development of a video-rate (20 Hz) endocavity PA/harmonic US imaging (EPAUSI) system. Approach The approach incorporates a commercially available endocavity US probe with a miniaturized laser delivery unit, comprised of a single large-core fiber and a line beamshaping engineered diffuser. The system facilitates real-time image display and subsequent processing, including angular energy density correction and spectral unmixing, in offline mode. Results The spatial resolutions of the concurrently acquired PA and harmonic US images were measured at 318 μ m and 291 μ m in the radial direction, respectively, and 1.22 deg and 1.50 deg in the angular direction, respectively. Furthermore, the system demonstrated its capability in multispectral PA imaging by successfully distinguishing two clinical dyes in a tissue-mimicking phantom. Its rapid temporal resolution enabled the capture of kinetic dye perfusion into an ex vivo porcine ovary through the depth of porcine uterine tissue. EPAUSI proved its clinical viability by detecting pulsating hemodynamics in the male rat's prostate in vivo and accurately classifying human blood vessels into arteries and veins based on sO 2 measurements. Conclusions Our proposed EPAUSI system holds the potential to unveil previously overlooked indicators of vascular alterations in genital cancers or endometriosis, addressing pressing requirements in the fields of gynecology and urology.
Collapse
Affiliation(s)
- Donghyeon Oh
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Hyunhee Kim
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Minsik Sung
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Chulhong Kim
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| |
Collapse
|