1
|
He H, Paetzold JC, Borner N, Riedel E, Gerl S, Schneider S, Fisher C, Ezhov I, Shit S, Li H, Ruckert D, Aguirre J, Biedermann T, Darsow U, Menze B, Ntziachristos V. Machine Learning Analysis of Human Skin by Optoacoustic Mesoscopy for Automated Extraction of Psoriasis and Aging Biomarkers. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2074-2085. [PMID: 38241120 DOI: 10.1109/tmi.2024.3356180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2024]
Abstract
Ultra-wideband raster-scan optoacoustic mesoscopy (RSOM) is a novel modality that has demonstrated unprecedented ability to visualize epidermal and dermal structures in-vivo. However, an automatic and quantitative analysis of three-dimensional RSOM datasets remains unexplored. In this work we present our framework: Deep Learning RSOM Analysis Pipeline (DeepRAP), to analyze and quantify morphological skin features recorded by RSOM and extract imaging biomarkers for disease characterization. DeepRAP uses a multi-network segmentation strategy based on convolutional neural networks with transfer learning. This strategy enabled the automatic recognition of skin layers and subsequent segmentation of dermal microvasculature with an accuracy equivalent to human assessment. DeepRAP was validated against manual segmentation on 25 psoriasis patients under treatment and our biomarker extraction was shown to characterize disease severity and progression well with a strong correlation to physician evaluation and histology. In a unique validation experiment, we applied DeepRAP in a time series sequence of occlusion-induced hyperemia from 10 healthy volunteers. We observe how the biomarkers decrease and recover during the occlusion and release process, demonstrating accurate performance and reproducibility of DeepRAP. Furthermore, we analyzed a cohort of 75 volunteers and defined a relationship between aging and microvascular features in-vivo. More precisely, this study revealed that fine microvascular features in the dermal layer have the strongest correlation to age. The ability of our newly developed framework to enable the rapid study of human skin morphology and microvasculature in-vivo promises to replace biopsy studies, increasing the translational potential of RSOM.
Collapse
|
2
|
Zhang R, Li X, Balasundaram G, Li B, Qi Y, Santosa A, Tan TC, Olivo M, Bi R. Hybrid Photoacoustic Ultrasound Imaging System for Cold-Induced Vasoconstriction and Vasodilation Monitoring. IEEE Trans Biomed Eng 2024; 71:712-716. [PMID: 37531313 DOI: 10.1109/tbme.2023.3301013] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/04/2023]
Abstract
Lewis hunting reaction refers to the alternating cold-induced vasoconstriction and dilation in extremities, whose underlying mechanism is complex. While numerous studies reported this intriguing phenomenon by measuring cutaneous temperature fluctuation under cold exposure, few of them tracked peripheral vascular responses in real-time, lacking a non-invasive and quantitative imaging tool. To better monitor hunting reaction and diagnose relevant diseases, we developed a hybrid photoacoustic ultrasound (PAUS) tomography system to monitor finger vessels' dynamic response to cold, together with simultaneous temperature measurement. We also came out a standard workflow for image analysis with self-defined indices. In the small cohort observational study, vascular changes in the first cycle of hunting reaction were successfully captured by the image series and quantified. Time difference between vasodilation and temperature recovery was noticed and reported for the first time, thanks to the unique capability of the PAUS imaging system in real-time and continuous vascular monitoring. The developed imaging system and indices enabled more objective and quantitative monitoring of peripheral vascular activities, indicating its great potential in numerous clinical applications.
Collapse
|
3
|
He H, Fasoula NA, Karlas A, Omar M, Aguirre J, Lutz J, Kallmayer M, Füchtenbusch M, Eckstein HH, Ziegler A, Ntziachristos V. Opening a window to skin biomarkers for diabetes stage with optoacoustic mesoscopy. LIGHT, SCIENCE & APPLICATIONS 2023; 12:231. [PMID: 37718348 PMCID: PMC10505608 DOI: 10.1038/s41377-023-01275-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 08/10/2023] [Accepted: 08/28/2023] [Indexed: 09/19/2023]
Abstract
Being the largest and most accessible organ of the human body, the skin could offer a window to diabetes-related complications on the microvasculature. However, skin microvasculature is typically assessed by histological analysis, which is not suited for applications to large populations or longitudinal studies. We introduce ultra-wideband raster-scan optoacoustic mesoscopy (RSOM) for precise, non-invasive assessment of diabetes-related changes in the dermal microvasculature and skin micro-anatomy, resolved with unprecedented sensitivity and detail without the need for contrast agents. Providing unique imaging contrast, we explored a possible role for RSOM as an investigational tool in diabetes healthcare and offer the first comprehensive study investigating the relationship between different diabetes complications and microvascular features in vivo. We applied RSOM to scan the pretibial area of 95 participants with diabetes mellitus and 48 age-matched volunteers without diabetes, grouped according to disease complications, and extracted six label-free optoacoustic biomarkers of human skin, including dermal microvasculature density and epidermal parameters, based on a novel image-processing pipeline. We then correlated these biomarkers to disease severity and found statistically significant effects on microvasculature parameters as a function of diabetes complications. We discuss how label-free RSOM biomarkers can lead to a quantitative assessment of the systemic effects of diabetes and its complications, complementing the qualitative assessment allowed by current clinical metrics, possibly leading to a precise scoring system that captures the gradual evolution of the disease.
Collapse
Affiliation(s)
- Hailong He
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
| | - Nikolina-Alexia Fasoula
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
| | - Angelos Karlas
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
- Department for Vascular and Endovascular Surgery, Klinikum rechts der Isar, Technical University of Munich (TUM), Munich, Germany
- DZHK (German Centre for Cardiovascular Research), partner site Munich Heart Alliance, Munich, Germany
| | - Murad Omar
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
| | - Juan Aguirre
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
| | - Jessica Lutz
- Diabetes Center at Marienplatz, Munich, Germany
- Forschergruppe Diabetes e.V., Helmholtz Zentrum München, Neuherberg, Germany
| | - Michael Kallmayer
- Department for Vascular and Endovascular Surgery, Klinikum rechts der Isar, Technical University of Munich (TUM), Munich, Germany
| | - Martin Füchtenbusch
- Diabetes Center at Marienplatz, Munich, Germany
- Forschergruppe Diabetes e.V., Helmholtz Zentrum München, Neuherberg, Germany
| | - Hans-Henning Eckstein
- Department for Vascular and Endovascular Surgery, Klinikum rechts der Isar, Technical University of Munich (TUM), Munich, Germany
- DZHK (German Centre for Cardiovascular Research), partner site Munich Heart Alliance, Munich, Germany
| | - Annette Ziegler
- Forschergruppe Diabetes e.V., Helmholtz Zentrum München, Neuherberg, Germany
- Institute of Diabetes Research, Helmholtz Zentrum München, Neuherberg, Germany
| | - Vasilis Ntziachristos
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany.
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany.
- DZHK (German Centre for Cardiovascular Research), partner site Munich Heart Alliance, Munich, Germany.
| |
Collapse
|
4
|
Nau T, Schönmann C, Hindelang B, Riobo L, Doll A, Schneider S, Englert L, He H, Biedermann T, Darsow U, Lauffer F, Ntziachristos V, Aguirre J. Raster-scanning optoacoustic mesoscopy biomarkers for atopic dermatitis skin lesions. PHOTOACOUSTICS 2023; 31:100513. [PMID: 37275325 PMCID: PMC10236218 DOI: 10.1016/j.pacs.2023.100513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 05/10/2023] [Accepted: 05/19/2023] [Indexed: 06/07/2023]
Abstract
Atopic dermatitis (AD) is the most common chronic inflammatory skin disease worldwide. Its severity is assessed using scores that rely on visual observation of the affected body surface area, the morphology of the lesions and subjective symptoms, like pruritus or insomnia. Ideally, such scores should be complemented by objective and accurate measurements of disease severity to standardize disease scoring in routine care and clinical trials. Recently, it was shown that raster-scanning optoacoustic mesoscopy (RSOM) can provide detailed three-dimensional images of skin inflammation processes that capture the most relevant features of their pathology. Moreover, precise RSOM biomarkers of inflammation have been identified for psoriasis. However, the objectivity and validity of such biomarkers in repeated measurements have not yet been assessed for AD. Here, we report the results of a study on the repeatability of RSOM inflammation biomarkers in AD to estimate their precision. Optoacoustic imaging analysis revealed morphological inflammation biomarkers with precision well beyond standard clinical severity metrics. Our findings suggest that optoacoustic mesoscopy may be a good choice for quantitative evaluations of AD that are inaccessible by other methods. This could potentially enable the optimization of disease scoring and drug development.
Collapse
Affiliation(s)
- T. Nau
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - C. Schönmann
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - B. Hindelang
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - L. Riobo
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - A. Doll
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
| | - S. Schneider
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - L. Englert
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - H. He
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
| | - T. Biedermann
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
| | - U. Darsow
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
| | - F. Lauffer
- Department of Dermatology and Allergology, Technical University of Munich, Munich, Germany
| | - V. Ntziachristos
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, 81675 Munich, Germany
| | - J. Aguirre
- Chair of Biological Imaging, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, 85764 Neuherberg, Germany
- Departamento de Tecnología Electrónica y de las Comunicaciones, Universidad Autonoma de Madrid, Madrid, Spain
- Instituto de Investigacion Sanitaria de la Fundacion Jimenez Diaz, Madrid, Spain
| |
Collapse
|
5
|
Formaglio P, Wosniack ME, Tromer RM, Polli JG, Matos YB, Zhong H, Raposo EP, da Luz MGE, Amino R. Plasmodium sporozoite search strategy to locate hotspots of blood vessel invasion. Nat Commun 2023; 14:2965. [PMID: 37221182 DOI: 10.1038/s41467-023-38706-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 05/10/2023] [Indexed: 05/25/2023] Open
Abstract
Plasmodium sporozoites actively migrate in the dermis and enter blood vessels to infect the liver. Despite their importance for malaria infection, little is known about these cutaneous processes. We combine intravital imaging in a rodent malaria model and statistical methods to unveil the parasite strategy to reach the bloodstream. We determine that sporozoites display a high-motility mode with a superdiffusive Lévy-like pattern known to optimize the location of scarce targets. When encountering blood vessels, sporozoites frequently switch to a subdiffusive low-motility behavior associated with probing for intravasation hotspots, marked by the presence of pericytes. Hence, sporozoites present anomalous diffusive motility, alternating between superdiffusive tissue exploration and subdiffusive local vessel exploitation, thus optimizing the sequential tasks of seeking blood vessels and pericyte-associated sites of privileged intravasation.
Collapse
Affiliation(s)
- Pauline Formaglio
- Institut Pasteur, Université Paris Cité, Malaria Infection and Immunity Unit, 75015, Paris, France
| | | | - Raphael M Tromer
- Departamento de Física Teórica e Experimental, Universidade Federal do Rio Grande do Norte, 59078- 970, Natal-RN, Brazil
| | - Jaderson G Polli
- Departamento de Física, Universidade Federal do Paraná, 81531-980, Curitiba-PR, Brazil
| | - Yuri B Matos
- Departamento de Física, Universidade Federal do Paraná, 81531-980, Curitiba-PR, Brazil
| | - Hang Zhong
- Institut Pasteur, Université Paris Cité, Malaria Infection and Immunity Unit, 75015, Paris, France
| | - Ernesto P Raposo
- Laboratório de Física Teórica e Computacional, Departamento de Física, Universidade Federal de Pernambuco, 50670-901, Recife-PE, Brazil
| | - Marcos G E da Luz
- Departamento de Física, Universidade Federal do Paraná, 81531-980, Curitiba-PR, Brazil.
| | - Rogerio Amino
- Institut Pasteur, Université Paris Cité, Malaria Infection and Immunity Unit, 75015, Paris, France.
| |
Collapse
|
6
|
Choi W, Park B, Choi S, Oh D, Kim J, Kim C. Recent Advances in Contrast-Enhanced Photoacoustic Imaging: Overcoming the Physical and Practical Challenges. Chem Rev 2023. [PMID: 36642892 DOI: 10.1021/acs.chemrev.2c00627] [Citation(s) in RCA: 34] [Impact Index Per Article: 34.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
For decades now, photoacoustic imaging (PAI) has been investigated to realize its potential as a niche biomedical imaging modality. Despite its highly desirable optical contrast and ultrasonic spatiotemporal resolution, PAI is challenged by such physical limitations as a low signal-to-noise ratio (SNR), diminished image contrast due to strong optical attenuation, and a lower-bound on spatial resolution in deep tissue. In addition, contrast-enhanced PAI has faced practical limitations such as insufficient cell-specific targeting due to low delivery efficiency and difficulties in developing clinically translatable agents. Identifying these limitations is essential to the continuing expansion of the field, and substantial advances in developing contrast-enhancing agents, complemented by high-performance image acquisition systems, have synergistically dealt with the challenges of conventional PAI. This review covers the past four years of research on pushing the physical and practical challenges of PAI in terms of SNR/contrast, spatial resolution, targeted delivery, and clinical application. Promising strategies for dealing with each challenge are reviewed in detail, and future research directions for next generation contrast-enhanced PAI are discussed.
Collapse
Affiliation(s)
- Wonseok Choi
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Byullee Park
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Seongwook Choi
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Donghyeon Oh
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Jongbeom Kim
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Chulhong Kim
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| |
Collapse
|
7
|
Dimaridis I, Sridharan P, Ntziachristos V, Karlas A, Hadjileontiadis L. Image Quality Improvement Techniques and Assessment Adequacy in Clinical Optoacoustic Imaging: A Systematic Review. BIOSENSORS 2022; 12:901. [PMID: 36291038 PMCID: PMC9599915 DOI: 10.3390/bios12100901] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 09/09/2022] [Accepted: 09/17/2022] [Indexed: 06/16/2023]
Abstract
Optoacoustic imaging relies on the detection of optically induced acoustic waves to offer new possibilities in morphological and functional imaging. As the modality matures towards clinical application, research efforts aim to address multifactorial limitations that negatively impact the resulting image quality. In an endeavor to obtain a clear view on the limitations and their effects, as well as the status of this progressive refinement process, we conduct an extensive search for optoacoustic image quality improvement approaches that have been evaluated with humans in vivo, thus focusing on clinically relevant outcomes. We query six databases (PubMed, Scopus, Web of Science, IEEE Xplore, ACM Digital Library, and Google Scholar) for articles published from 1 January 2010 to 31 October 2021, and identify 45 relevant research works through a systematic screening process. We review the identified approaches, describing their primary objectives, targeted limitations, and key technical implementation details. Moreover, considering comprehensive and objective quality assessment as an essential prerequisite for the adoption of such approaches in clinical practice, we subject 36 of the 45 papers to a further in-depth analysis of the reported quality evaluation procedures, and elicit a set of criteria with the intent to capture key evaluation aspects. Through a comparative criteria-wise rating process, we seek research efforts that exhibit excellence in quality assessment of their proposed methods, and discuss features that distinguish them from works with similar objectives. Additionally, informed by the rating results, we highlight areas with improvement potential, and extract recommendations for designing quality assessment pipelines capable of providing rich evidence.
Collapse
Affiliation(s)
- Ioannis Dimaridis
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Patmaa Sridharan
- Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, 85764 Neuherberg, Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, 85764 Neuherberg, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, 80992 Munich, Germany
- German Centre for Cardiovascular Research (DZHK), partner site Munich Heart Alliance, 80636 Munich, Germany
| | - Angelos Karlas
- Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, 81675 Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, 85764 Neuherberg, Germany
- German Centre for Cardiovascular Research (DZHK), partner site Munich Heart Alliance, 80636 Munich, Germany
- Clinic for Vascular and Endovascular Surgery, Klinikum rechts der Isar, 81675 Munich, Germany
| | - Leontios Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University, Abu Dhabi P.O. Box 127788, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University, Abu Dhabi P.O. Box 127788, United Arab Emirates
- Signal Processing and Biomedical Technology Unit, Telecommunications Laboratory, Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece
| |
Collapse
|
8
|
Englert L, Riobo L, Schönmann C, Ntziachristos V, Aguirre J. Enabling the autofocus approach for parameter optimization in planar measurement geometry clinical optoacoustic imaging. JOURNAL OF BIOPHOTONICS 2022; 15:e202200032. [PMID: 35599314 DOI: 10.1002/jbio.202200032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 04/10/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
In optoacoustic (photoacoustic) tomography, several parameters related to tissue and detector features are needed for image formation, but they may not be known a priori. An autofocus (AF) algorithm is generally used to estimate these parameters. However, the algorithm works iteratively and is therefore impractical for clinical imaging with planar geometry systems due to the long reconstruction times. We have developed a fast autofocus (FAF) algorithm for 3D optoacoustic systems with planar geometry. Such an algorithm exploits the symmetries of the planar geometry and a virtual source concept to reduce the dimensionality of the parameter estimation problem. The dimensionality reduction makes FAF much simpler computationally than the conventional AF algorithm. We show that the FAF algorithm required about 5 s to provide accurate estimates of the speed of sound in simulated data and experimental data obtained using an imaging system that is poised to enter the clinic. The applicability of FAF for estimating other image formation parameters is discussed. We expect the FAF algorithm to contribute decisively to the clinical use of optoacoustic tomography systems with planar geometry.
Collapse
Affiliation(s)
- Ludwig Englert
- Chair of Biological Imaging, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, Neuherberg, Germany
| | - Lucas Riobo
- Chair of Biological Imaging, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, Neuherberg, Germany
| | - Christine Schönmann
- Chair of Biological Imaging, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, Neuherberg, Germany
- Department of Dermatology and Allergy, Technical University of Munich, Munich, Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, Neuherberg, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Munich, Germany
| | - Juan Aguirre
- Chair of Biological Imaging, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum Munich, Neuherberg, Germany
| |
Collapse
|
9
|
Fast raster-scan optoacoustic mesoscopy enables assessment of human melanoma microvasculature in vivo. Nat Commun 2022; 13:2803. [PMID: 35589757 PMCID: PMC9120110 DOI: 10.1038/s41467-022-30471-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 05/03/2022] [Indexed: 12/23/2022] Open
Abstract
Melanoma is associated with angiogenesis and vascular changes that may extend through the entire skin depth. Three-dimensional imaging of vascular characteristics in skin lesions could therefore allow diagnostic insights not available by conventional visual inspection. Raster-scan optoacoustic mesoscopy (RSOM) images microvasculature through the entire skin depth with resolutions of tens of micrometers; however, current RSOM implementations are too slow to overcome the strong breathing motions on the upper torso where melanoma lesions commonly occur. To enable high-resolution imaging of melanoma vasculature in humans, we accelerate RSOM scanning using an illumination scheme that is coaxial with a high-sensitivity ultrasound detector path, yielding 15 s single-breath-hold scans that minimize motion artifacts. We apply this Fast RSOM to image 10 melanomas and 10 benign nevi in vivo, showing marked differences between malignant and benign lesions, supporting the possibility to use biomarkers extracted from RSOM imaging of vasculature for lesion characterization to improve diagnostics. Raster-Scanning-Optoacoustic Mesoscopy can be used to image the vasculature in skin cancer lesions but is limited by a long exposure time. Here; the authors increase the speed of the imaging using co-axial illumination and a high-sensitivity ultrasound detector path.
Collapse
|
10
|
[Optoacoustic imaging-Applications and advancements of innovative imaging techniques]. Hautarzt 2021; 72:1025-1038. [PMID: 34735593 DOI: 10.1007/s00105-021-04907-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/30/2021] [Indexed: 10/19/2022]
Abstract
Optoacoustic imaging (OAB) has developed steadily in recent years. By means of partly pulsed light, in a wide variety of wavelengths, different colour carriers (chromophores) are excited to form sound waves. These in turn are detected by the newly developed systems and converted into three-dimensional images by means of various algorithms. The technique is characterised by a good ratio between contrast and penetration depth and can create macro-, meso- and microscopic images due to its scalability. Optoacoustic macroscopy broadly irradiates the area to be examined with laser light. This can produce images with a high penetration depth, but only with a moderate resolution. Clinically interesting fields of application are for example the results of sentinel lymph nodes (SLNs) examined ex vivo using macroscopic optoacoustics. Due to the ability of OAB to visualise melanin, the detection rate of metastases was superior to previous methods, but not to histology. The ability to visualise dermal and epidermal structures, especially vessels, with good resolution makes optoacoustic mesoscopy useful in the examination of inflammatory skin diseases and could contribute to the verification of the success of therapy, e.g., with biologics for psoriasis vulgaris or atopic eczema (AE), in the future. Optoacoustic microscopy, which has so far been limited mainly to preclinical in vivo research, could be used in the future to detect even finer vascular structures and their changes. The clinical possibilities of OAB seem to be of great benefit and continue to be the subject of intensive research.
Collapse
|
11
|
Karlas A, Pleitez MA, Aguirre J, Ntziachristos V. Optoacoustic imaging in endocrinology and metabolism. Nat Rev Endocrinol 2021; 17:323-335. [PMID: 33875856 DOI: 10.1038/s41574-021-00482-5] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/19/2021] [Indexed: 02/02/2023]
Abstract
Imaging is an essential tool in research, diagnostics and the management of endocrine disorders. Ultrasonography, nuclear medicine techniques, MRI, CT and optical methods are already used for applications in endocrinology. Optoacoustic imaging, also termed photoacoustic imaging, is emerging as a method for visualizing endocrine physiology and disease at different scales of detail: microscopic, mesoscopic and macroscopic. Optoacoustic contrast arises from endogenous light absorbers, such as oxygenated and deoxygenated haemoglobin, lipids and water, or exogenous contrast agents, and reveals tissue vasculature, perfusion, oxygenation, metabolic activity and inflammation. The development of high-performance optoacoustic scanners for use in humans has given rise to a variety of clinical investigations, which complement the use of the technology in preclinical research. Here, we review key progress with optoacoustic imaging technology as it relates to applications in endocrinology; for example, to visualize thyroid morphology and function, and the microvasculature in diabetes mellitus or adipose tissue metabolism, with particular focus on multispectral optoacoustic tomography and raster-scan optoacoustic mesoscopy. We explain the merits of optoacoustic microscopy and focus on mid-infrared optoacoustic microscopy, which enables label-free imaging of metabolites in cells and tissues. We showcase current optoacoustic applications within endocrinology and discuss the potential of these technologies to advance research and clinical practice.
Collapse
Affiliation(s)
- Angelos Karlas
- Chair of Biological Imaging, Center for Translational Cancer Research (TranslaTUM), Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Department of Vascular and Endovascular Surgery, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
- Munich Partner Site, German Center for Cardiovascular Research (DZHK), Munich, Germany
| | - Miguel A Pleitez
- Chair of Biological Imaging, Center for Translational Cancer Research (TranslaTUM), Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Juan Aguirre
- Chair of Biological Imaging, Center for Translational Cancer Research (TranslaTUM), Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging, Center for Translational Cancer Research (TranslaTUM), Technical University of Munich, Munich, Germany.
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany.
| |
Collapse
|
12
|
Deán-Ben XL, Razansky D. Optoacoustic imaging of the skin. Exp Dermatol 2021; 30:1598-1609. [PMID: 33987867 DOI: 10.1111/exd.14386] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2020] [Revised: 04/23/2021] [Accepted: 04/29/2021] [Indexed: 12/11/2022]
Abstract
Optoacoustic (OA, photoacoustic) imaging capitalizes on the synergistic combination of light excitation and ultrasound detection to empower biological and clinical investigations with rich optical contrast while effectively bridging the gap between micro and macroscopic imaging realms. State-of-the-art OA embodiments consistently provide images at micron-scale resolution through superficial tissue layers by means of focused illumination that can be smoothly exchanged for acoustic-resolution images at diffuse light depths of several millimetres to centimetres via ultrasound beamforming or tomographic reconstruction. Taken together, this unique multi-scale imaging capacity opens unprecedented capabilities for high-resolution in vivo interrogations of the skin at scalable depths. Moreover, diverse anatomical and functional information is retrieved via dynamic mapping of endogenous chromophores such as haemoglobin, melanin, lipids, collagen, water and others. This, along with the use of non-ionizing radiation, facilitates a clinical translation of the OA modalities. We review recent progress in OA imaging of the skin in preclinical and clinical studies exploiting the rich contrast provided by endogenous substances in tissues. The imaging capabilities of existing approaches are discussed in the context of initial translational studies on skin cancer, inflammatory skin diseases, wounds and other conditions.
Collapse
Affiliation(s)
- Xosé Luís Deán-Ben
- Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Zurich, Switzerland.,Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Daniel Razansky
- Institute of Pharmacology and Toxicology, Faculty of Medicine, University of Zurich, Zurich, Switzerland.,Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| |
Collapse
|
13
|
Hindelang B, Aguirre J, Berezhnoi A, He H, Eyerich K, Ntziachristos V, Biedermann T, Darsow U. Optoacoustic mesoscopy shows potential to increase accuracy of allergy patch testing. Contact Dermatitis 2020; 83:206-214. [DOI: 10.1111/cod.13563] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2020] [Revised: 04/11/2020] [Accepted: 04/16/2020] [Indexed: 11/28/2022]
Affiliation(s)
- Benedikt Hindelang
- Department of Dermatology and Allergy, Faculty of MedicineTechnical University of Munich Munich Germany
- Chair of Biological Imaging and TranslaTUMTechnical University of Munich Munich Germany
- Institute of Biological and Medical ImagingHelmholtz Zentrum München Munich Germany
| | - Juan Aguirre
- Chair of Biological Imaging and TranslaTUMTechnical University of Munich Munich Germany
- Institute of Biological and Medical ImagingHelmholtz Zentrum München Munich Germany
| | - Andrei Berezhnoi
- Chair of Biological Imaging and TranslaTUMTechnical University of Munich Munich Germany
- Institute of Biological and Medical ImagingHelmholtz Zentrum München Munich Germany
| | - Hailong He
- Chair of Biological Imaging and TranslaTUMTechnical University of Munich Munich Germany
- Institute of Biological and Medical ImagingHelmholtz Zentrum München Munich Germany
| | - Kilian Eyerich
- Department of Dermatology and Allergy, Faculty of MedicineTechnical University of Munich Munich Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging and TranslaTUMTechnical University of Munich Munich Germany
- Institute of Biological and Medical ImagingHelmholtz Zentrum München Munich Germany
| | - Tilo Biedermann
- Department of Dermatology and Allergy, Faculty of MedicineTechnical University of Munich Munich Germany
| | - Ulf Darsow
- Department of Dermatology and Allergy, Faculty of MedicineTechnical University of Munich Munich Germany
| |
Collapse
|
14
|
Shan T, Zhao Y, Jiang S, Jiang H. In-vivo hemodynamic imaging of acute prenatal ethanol exposure in fetal brain by photoacoustic tomography. JOURNAL OF BIOPHOTONICS 2020; 13:e201960161. [PMID: 31994834 DOI: 10.1002/jbio.201960161] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2019] [Revised: 01/18/2020] [Accepted: 01/23/2020] [Indexed: 05/25/2023]
Abstract
Prenatal ethanol exposure (PEE) can lead to structural and functional abnormalities in fetal brain. Although neural developmental deficits due to PEE have been recognized, the immediate effects of PEE on fetal brain vasculature and hemodynamics remain poorly understood. One of the major obstacles that preclude the rapid advancement of studies on fetal vascular dynamics is the limitation of the imaging techniques. Thus, a technique for noninvasive in-vivo imaging of fetal vasculature and hemodynamics is desirable. In this study, we explored the dynamic changes of the vessel dimeter, density and oxygen saturation in fetal brain after acute maternal ethanol exposure in the second-trimester equivalent murine model using a real-time photoacoustic tomography system we developed for imaging embryo of small animals. The results indicate a significant decrease in fetal brain vessel diameter, perfusion and oxygen saturation. This work demonstrated that PAT can provide high-resolution noninvasive imaging ability to monitor fetal vascular dynamics.
Collapse
Affiliation(s)
- Tianqi Shan
- Department of Biomedical Engineering, University of Florida, Gainesville, Florida
| | - Yuan Zhao
- School of Physical Electronics, University of Electronic Science and Technology of China, Chengdu, China
| | - Shixie Jiang
- Department of Psychiatry and Behavioral Neurosciences, University of South Florida, Tampa, Florida
| | - Huabei Jiang
- Department of Medical Engineering, University of South Florida, Tampa, Florida
| |
Collapse
|
15
|
High-resolution optoacoustic imaging of tissue responses to vascular-targeted therapies. Nat Biomed Eng 2020; 4:286-297. [PMID: 32165736 PMCID: PMC7153756 DOI: 10.1038/s41551-020-0527-8] [Citation(s) in RCA: 61] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2018] [Accepted: 02/06/2020] [Indexed: 11/14/2022]
Abstract
The monitoring of vascular-targeted therapies via magnetic resonance imaging, computed omography or ultrasound is limited by their insufficient spatial resolution. By taking advantage of the intrinsic optical properties of haemoglobin, here we show that raster-scanning optoacoustic mesoscopy (RSOM) provides high-resolution images of the tumour vasculature and of the surrounding tissue, and that the detection of a wide range of ultrasound bandwidths enables the distinction of vessels of differing size, allowing for detailed insights into vascular responses to vascular-targeted therapy. By using RSOM to examine the responses to vascular-targeted photodynamic therapy in mice with subcutaneous xenografts, we observed a significant and immediate occlusion of the tumour vessels, followed by haemorrhage within the tissue and the eventual collapse of the entire vasculature. By using dual-wavelength RSOM, which distinguishes oxyhaemoglobin from deoxyhaemoglobin, we observed an increase in oxygenation of the entire tumour volume immediately after the application of the therapy, and a second wave of oxygen reperfusion approximately 24 h thereafter. We also show that RSOM allows for the quantification of differences in neo-angiogenesis that predict treatment efficacy.
Collapse
|
16
|
Kati B, Buyukfirat E, Pelit ES, Yagmur I, Demir M, Albayrak IH, Ciftci H. Percutaneous Nephrolithotomy with Different Temperature Irrigation and Effects on Surgical Complications and Anesthesiology Applications. J Endourol 2019; 32:1050-1053. [PMID: 30280908 DOI: 10.1089/end.2018.0581] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE Percutaneous nephrolithotomy (PCNL) is a widely accepted and frequently performed operation for large kidney stones. However, there is not much information about the effects of irrigation fluid temperature as well as many other factors that affect success and complications during the operation. In this study, we aimed to investigate the surgical and anesthesiological effects of irrigation fluid used in body temperature and room temperature during and after PCNL. MATERIAL AND METHODS A total of 108 PCNL patients were performed between June 2016 and April 2018. The half of these patients (54) were performed with body temperature (37°C) irrigation fluid, hence known as body temperature group (BTG), and the other half with room temperature (22°C) irrigation fluid, called as room temperature group (RTG). For the study, we recorded the body temperature of the patients during and after the operation, the amount of irrigation fluid used, the size and location of the kidney stones, the duration of the operation, postoperative shivering time during the patient's wake-up period, pre- and postoperative hemoglobin value, additional blood requirements, postoperative analgesic requirements, and postoperative urinary tract infections. RESULTS The age of patients, gender distribution, height, weight, body mass index, stone size, and postoperative analgesic requirement showed no significant differences in two groups. The postoperative body heat was significantly higher in the BTG than the RTG. The duration of waking was significantly higher in the RTG than the BTG. The amount of hemorrhage was significantly less in the patients who were irrigated in the RTG. CONCLUSION The temperature of the irrigation fluid can affect many parameters in the PCNL. We recommend using irrigation in room temperature especially with patients having bleeding risks and irrigation fluid in body temperature especially with patients having anesthetic risks for easier waking process.
Collapse
Affiliation(s)
- Bulent Kati
- 1 Department of Urology, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| | - Evren Buyukfirat
- 2 Department of Anesthesiology and Reanimation, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| | - Eyyup Sabri Pelit
- 1 Department of Urology, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| | - Ismail Yagmur
- 1 Department of Urology, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| | - Mehmet Demir
- 1 Department of Urology, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| | | | - Halil Ciftci
- 1 Department of Urology, Faculty of Medicine, Harran University , Sanliurfa, Turkey
| |
Collapse
|
17
|
Li X, Dinish US, Aguirre J, Bi R, Dev K, Attia ABE, Nitkunanantharajah S, Lim QH, Schwarz M, Yew YW, Thng STG, Ntziachristos V, Olivo M. Optoacoustic mesoscopy analysis and quantitative estimation of specific imaging metrics in Fitzpatrick skin phototypes II to V. JOURNAL OF BIOPHOTONICS 2019; 12:e201800442. [PMID: 31012286 DOI: 10.1002/jbio.201800442] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 02/12/2019] [Accepted: 04/22/2019] [Indexed: 05/07/2023]
Abstract
Raster Scanning Optoacoustic Mesoscopy (RSOM) is a novel optoacoustic imaging modality that offers non-invasive, label-free, high resolution (~7 μm axial, ~30 μm lateral) imaging up to 1 to 2 mm below the skin, providing novel quantitative insights into skin pathophysiology. As the RSOM image contrast mechanism is based on light absorption, it is expected that the amount of melanin present in the skin will affect RSOM images. However, the effect of skin tone in the performance of RSOM has not been addressed so far. Herein, we present the efficiency of RSOM for in vivo skin imaging of human subjects with Fitzpatrick (FP) skin types between II to V. RSOM images acquired from the volar forearms of the subjects were used to derive metrics used in RSOM studies, such as total blood volume, vessel diameter and melanin signal intensity. Our study shows that the melanin signal intensity derived from the RSOM images exhibited an excellent correlation with that obtained from a clinical colorimeter for the subjects of varying FP skin types. We could successfully estimate the vessel diameter at different depths of the dermis. Furthermore, our study shows that there is a need to compensate for total blood volume calculated for subjects with higher FP skin types due to the lower signal-to-noise ratio in dermis, owing to strong absorption of light by melanin. This study sheds light into how RSOM can be used for studying various skin conditions in populations with different skin phenotypes.
Collapse
Affiliation(s)
- Xiuting Li
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | - U S Dinish
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | | | - Renzhe Bi
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | - Kapil Dev
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | - Amalina Binte Ebrahim Attia
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | | | - Qian Han Lim
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| | | | | | | | - Vasilis Ntziachristos
- Technical University of Munich, Munich, Germany
- Institute for Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Malini Olivo
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, Agency for Science Technology and Research (A*STAR), Singapore
| |
Collapse
|
18
|
Berezhnoi A, Aguirre J, Hindelang B, Garzorz-Stark N, Omar M, Darsow U, Eyerich K, Ntziachristos V. Optical features of human skin revealed by optoacoustic mesoscopy in the visible and short-wave infrared regions. OPTICS LETTERS 2019; 44:4119-4122. [PMID: 31465343 DOI: 10.1364/ol.44.004119] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2019] [Accepted: 07/15/2019] [Indexed: 06/10/2023]
Abstract
Detailed assessment of skin conditions or the efficacy of skin treatments could greatly benefit from noninvasively assessing the distribution of cutaneous and subcutaneous structures and biomolecules. We considered ultrawideband raster scan optoacoustic mesoscopy with an extended wavelength range from visible to short-wave infrared and observed previously unseen high-resolution images of lipids colocalized with water, melanin, and hemoglobin distribution in human skin. Based on this contrast, the technique resolves subcutaneous fat, the pilosebaceous unit with complete hair strand and bulb, dermal microvasculature, and epidermal structures. We further visualize melanoidins that form via the Maillard reaction in the ultrathin stratum corneum layer, analyze their absorption spectrum, and separate them from the melanin layer. The suggested method may allow novel interrogation of skin conditions, possibly impacting diagnostics and medical and cosmetic treatments.
Collapse
|
19
|
Moustakidis S, Omar M, Aguirre J, Mohajerani P, Ntziachristos V. Fully automated identification of skin morphology in raster-scan optoacoustic mesoscopy using artificial intelligence. Med Phys 2019; 46:4046-4056. [PMID: 31315162 DOI: 10.1002/mp.13725] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2019] [Revised: 07/02/2019] [Accepted: 07/02/2019] [Indexed: 11/06/2022] Open
Abstract
PURPOSE Identification of morphological characteristics of skin lesions is of vital importance in diagnosing diseases with dermatological manifestations. This task is often performed manually or in an automated way based on intensity level. Recently, ultra-broadband raster-scan optoacoustic mesoscopy (UWB-RSOM) was developed to offer unique cross-sectional optical imaging of the skin. A machine learning (ML) approach is proposed here to enable, for the first time, automated identification of skin layers in UWB-RSOM data. MATERIALS AND METHODS The proposed method, termed SkinSeg, was applied to coronal UWB-RSOM images obtained from 12 human participants. SkinSeg is a multi-step methodology that integrates data processing and transformation, feature extraction, feature selection, and classification. Various image features and learning models were tested for their suitability at discriminating skin layers including traditional machine learning along with more advanced deep learning algorithms. An support vector machines-based postprocessing approach was finally applied to further improve the classification outputs. RESULTS Random forest proved to be the most effective technique, achieving mean classification accuracy of 86.89% evaluated based on a repeated leave-one-out strategy. Insights about the features extracted and their effect on classification accuracy are provided. The highest accuracy was achieved using a small group of four features and remained at the same level or was even slightly decreased when more features were included. Convolutional neural networks provided also promising results at a level of approximately 85%. The application of the proposed postprocessing technique was proved to be effective in terms of both testing accuracy and three-dimensional visualization of classification maps. CONCLUSIONS SkinSeg demonstrated unique potential in identifying skin layers. The proposed method may facilitate clinical evaluation, monitoring, and diagnosis of diseases linked to skin inflammation, diabetes, and skin cancer.
Collapse
Affiliation(s)
| | - Murad Omar
- Technische Universität München and Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Ingolstädter Landstrasse 1, D-85764, Neuherberg, Germany
| | - Juan Aguirre
- Technische Universität München and Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Ingolstädter Landstrasse 1, D-85764, Neuherberg, Germany
| | - Pouyan Mohajerani
- Technische Universität München and Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Ingolstädter Landstrasse 1, D-85764, Neuherberg, Germany
| | - Vasilis Ntziachristos
- Technische Universität München and Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Ingolstädter Landstrasse 1, D-85764, Neuherberg, Germany
| |
Collapse
|
20
|
Liu M, Drexler W. Optical coherence tomography angiography and photoacoustic imaging in dermatology. Photochem Photobiol Sci 2019; 18:945-962. [PMID: 30735220 DOI: 10.1039/c8pp00471d] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Optical coherence tomography angiography (OCTA) is a relatively novel functional extension of the widely accepted ophthalmic imaging tool named optical coherence tomography (OCT). Since OCTA's debut in ophthalmology, researchers have also been trying to expand its translational application in dermatology. The ability of OCTA to resolve microvasculature has shown promising results in imaging skin diseases. Meanwhile, photoacoustic imaging (PAI), which uses laser pulse induced ultrasound waves as the signal, has been studied to differentiate human skin layers and to help in skin disease diagnosis. This perspective article gives a short review of OCTA and PAI in the field of photodermatology. After an introduction to the principles of OCTA and PAI, we describe the most updated results of skin disease imaging using these two optical imaging modalities. We also place emphasis on dual modality imaging combining OCTA and photoacoustic tomography (PAT) for dermatological applications. In the end, the challenges and prospects of these two imaging modalities in dermatology are discussed.
Collapse
Affiliation(s)
- Mengyang Liu
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria.
| | | |
Collapse
|
21
|
Bai X, Qi Y, Liang Y, Ma J, Jin L, Guan BO. Photoacoustic computed tomography with lens-free focused fiber-laser ultrasound sensor. BIOMEDICAL OPTICS EXPRESS 2019; 10:2504-2512. [PMID: 31143500 PMCID: PMC6524584 DOI: 10.1364/boe.10.002504] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 04/14/2019] [Accepted: 04/15/2019] [Indexed: 06/09/2023]
Abstract
Optical detection of ultrasound is attractive to photoacoustic imaging due to its high sensitivity per unit area, broad bandwidth, and electromagnetic immunity. To enhance the sensitivity, previous optical transducers commonly necessitate bulk acoustic lenses to achieve focused ultrasound detection. Here, we proposed and demonstrated a novel lens-free focused optical ultrasound sensor by mechanically bending a flexible fiber laser. At a curvature radius of 30 mm, the curved fiber laser well conformed to the spherical wavefront of ultrasound exhibiting ~5 times higher sensitivity compared with the straight one. The focused fiber laser ultrasound sensor (FUS) presented a minimum detectable pressure of ~36 Pa with a working distance equal to its curvature radius. The sensor was applied to circular scanning photoacoustic computed tomography (PACT), which showed a ~70 μm in-plane resolution and a ~500 μm elevational resolution. In vivo imaging of a zebrafish and mouse brain shows the potential of this focused FUS for photoacoustic imaging in biological/medical studies.
Collapse
Affiliation(s)
- Xue Bai
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| | - Yumeng Qi
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| | - Yizhi Liang
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| | - Jun Ma
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| | - Long Jin
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| | - Bai-Ou Guan
- Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 511443, China
| |
Collapse
|
22
|
Hindelang B, Aguirre J, Schwarz M, Berezhnoi A, Eyerich K, Ntziachristos V, Biedermann T, Darsow U. Non-invasive imaging in dermatology and the unique potential of raster-scan optoacoustic mesoscopy. J Eur Acad Dermatol Venereol 2019; 33:1051-1061. [PMID: 30422337 PMCID: PMC6563473 DOI: 10.1111/jdv.15342] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2018] [Accepted: 10/18/2018] [Indexed: 12/25/2022]
Abstract
In recent years, several non‐invasive imaging methods have been introduced to facilitate diagnostics and therapy monitoring in dermatology. The microscopic imaging methods are restricted in their penetration depth, while the mesoscopic methods probe deeper but provide only morphological, not functional, information. ‘Raster‐scan optoacoustic mesoscopy’ (RSOM), an emerging new imaging technique, combines deep penetration with contrast based on light absorption, which provides morphological, molecular and functional information. Here, we compare the capabilities and limitations of currently available dermatological imaging methods and highlight the principles and unique abilities of RSOM. We illustrate the clinical potential of RSOM, in particular for non‐invasive diagnosis and monitoring of inflammatory and oncological skin diseases.
Collapse
Affiliation(s)
- B Hindelang
- Department of Dermatology and Allergy, Technische Universität München, Munich, Germany.,Chair of Biological Imaging, Technische Universität München, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - J Aguirre
- Chair of Biological Imaging, Technische Universität München, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - M Schwarz
- Chair of Biological Imaging, Technische Universität München, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany.,iThera Medical GmbH, Munich, Germany
| | - A Berezhnoi
- Chair of Biological Imaging, Technische Universität München, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - K Eyerich
- Department of Dermatology and Allergy, Technische Universität München, Munich, Germany
| | - V Ntziachristos
- Chair of Biological Imaging, Technische Universität München, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - T Biedermann
- Department of Dermatology and Allergy, Technische Universität München, Munich, Germany
| | - U Darsow
- Department of Dermatology and Allergy, Technische Universität München, Munich, Germany
| |
Collapse
|
23
|
Yan H, Chen J, Li Y, Bai Y, Wu Y, Sheng Z, Song L, Liu C, Zhang H. Ultrasmall hybrid protein–copper sulfide nanoparticles for targeted photoacoustic imaging of orthotopic hepatocellular carcinoma with a high signal-to-noise ratio. Biomater Sci 2019; 7:92-103. [DOI: 10.1039/c8bm00767e] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
A schematic illustration of CuS@BSA-RGD nanoparticle synthesis and the application of photoacoustic imaging in an orthotopic HCC model.
Collapse
Affiliation(s)
- Huixiang Yan
- Department of Ultrasound
- The Second Clinical College of Jinan University
- Shenzhen People's Hospital
- China
- Research Laboratory for Biomedical Optics and Molecular Imaging
| | - Jingqin Chen
- Research Laboratory for Biomedical Optics and Molecular Imaging
- Shenzhen Key Laboratory for Molecular Imaging
- Institute of Biomedical and Health Engineering
- Shenzhen Institutes of Advanced Technology
- Chinese Academy of Sciences
| | - Ying Li
- Division of Radiology
- Department of Medicine
- the University of Hong Kong Shenzhen Hospital
- China
| | - Yuanyuan Bai
- Research Laboratory for Biomedical Optics and Molecular Imaging
- Shenzhen Key Laboratory for Molecular Imaging
- Institute of Biomedical and Health Engineering
- Shenzhen Institutes of Advanced Technology
- Chinese Academy of Sciences
| | - Yunzhu Wu
- Department of Ultrasound
- The Second Clinical College of Jinan University
- Shenzhen People's Hospital
- China
| | - Zonghai Sheng
- Paul C. Lauterbur Research Center for Biomedical Imaging
- Institute of Biomedical and Health Engineering
- Shenzhen Institutes of Advanced Technology
- Chinese Academy of Sciences
- Shenzhen 518055
| | - Liang Song
- Research Laboratory for Biomedical Optics and Molecular Imaging
- Shenzhen Key Laboratory for Molecular Imaging
- Institute of Biomedical and Health Engineering
- Shenzhen Institutes of Advanced Technology
- Chinese Academy of Sciences
| | - Chengbo Liu
- Research Laboratory for Biomedical Optics and Molecular Imaging
- Shenzhen Key Laboratory for Molecular Imaging
- Institute of Biomedical and Health Engineering
- Shenzhen Institutes of Advanced Technology
- Chinese Academy of Sciences
| | - Hai Zhang
- Department of Ultrasound
- The Second Clinical College of Jinan University
- Shenzhen People's Hospital
- China
- Department of Ultrasound
| |
Collapse
|