1
|
Wu D, Fedorov Kukk A, Panzer R, Emmert S, Roth B. In Vivo Differentiation of Cutaneous Melanoma From Benign Nevi With Dual-Modal System of Optical Coherence Tomography and Raman Spectroscopy. JOURNAL OF BIOPHOTONICS 2025:e70040. [PMID: 40258385 DOI: 10.1002/jbio.70040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2024] [Revised: 03/06/2025] [Accepted: 04/01/2025] [Indexed: 04/23/2025]
Abstract
A multimodal method comprising optical imaging using OCT and molecular detection using Raman spectroscopy was developed to explore its capability for noninvasive differentiation between melanoma skin cancer and benign skin lesions. Key OCT parameters like the attenuation coefficient, R2, and RMSE, extracted through exponential fitting, were incorporated into machine learning, achieving 96.9% accuracy and an AUC-ROC of 0.99 in 10-fold cross-validation. Raman spectroscopy revealed differences in carotenoid, amide-I, and CH2-CH3 structures between melanoma and nevi, supporting the OCT findings. Autofluorescence background intensity variations further distinguished lesion types and enhanced lesion assessment. Future work will include the investigation of larger patient groups and the combination of both data sets in a combined algorithm. Also, the integration of both modalities and the developed method with photoacoustic tomography and high-frequency ultrasound appears beneficial toward achieving an optical biopsy of melanoma skin cancer and improving diagnostics.
Collapse
Affiliation(s)
- Di Wu
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
| | - Anatoly Fedorov Kukk
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
| | | | | | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
- Cluster of Excellence PhoenixD, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
2
|
Kupriyanov V, Blondel W, Daul C, Hohmann M, Khairallah G, Kistenev Y, Amouroux M. Machine learning-based classification of spatially resolved diffuse reflectance and autofluorescence spectra acquired on human skin for actinic keratoses and skin carcinoma diagnostics aid. JOURNAL OF BIOMEDICAL OPTICS 2025; 30:035001. [PMID: 40041369 PMCID: PMC11877879 DOI: 10.1117/1.jbo.30.3.035001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2024] [Revised: 12/22/2024] [Accepted: 01/21/2025] [Indexed: 03/06/2025]
Abstract
Significance The incidence of keratinocyte carcinomas (KCs) is increasing every year, making the task of developing new methods for KC early diagnosis of utmost medical and economical importance. Aim We aim to evaluate the KC diagnostic aid performance of an optical spectroscopy device associated with a machine-learning classification method. Approach We present the classification performance of autofluorescence and diffuse reflectance optical spectra obtained in vivo from 131 patients on four histological classes: basal cell carcinoma (BCC), squamous cell carcinoma (SCC), actinic keratosis (AK), and healthy (H) skin. Classification accuracies obtained by support vector machine, discriminant analysis, and multilayer perceptron in binary- and multi-class modes were compared to define the best classification pipeline. Results The accuracy of binary classification tests was > 80 % to discriminate BCC or SCC from H. For AK versus other classes, the classification achieved a 65% to 75% accuracy. In multiclass (three or four classes) classification modes, accuracy reached 57%. Fusion of decisions increased classification accuracies (up to 10 percentage point-increase), proving the interest of multimodal spectroscopy compared with a single modality. Conclusions Such levels of classification accuracy are promising as they are comparable to those obtained by general practitioners in KC screening.
Collapse
Affiliation(s)
- Valentin Kupriyanov
- Université de Lorraine, CNRS, CRAN UMR, Vandoeuvre-Lès-Nancy, France
- Tomsk State University, Laboratory of Laser Molecular Imaging and Machine Learning, Tomsk, Russia
| | - Walter Blondel
- Université de Lorraine, CNRS, CRAN UMR, Vandoeuvre-Lès-Nancy, France
| | - Christian Daul
- Université de Lorraine, CNRS, CRAN UMR, Vandoeuvre-Lès-Nancy, France
| | - Martin Hohmann
- Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Institute of Photonic Technologies (LPT), Erlangen, Germany
| | - Grégoire Khairallah
- Metz-Thionville Regional Hospital, Department of Plastic, Aesthetic and Reconstructive Surgery, Ars-Laquenexy, France
| | - Yury Kistenev
- Tomsk State University, Laboratory of Laser Molecular Imaging and Machine Learning, Tomsk, Russia
| | - Marine Amouroux
- Université de Lorraine, CNRS, CRAN UMR, Vandoeuvre-Lès-Nancy, France
| |
Collapse
|
3
|
Lai PY, Shih TY, Chang YH, Chang CH, Kuo WC. Deep Learning With Optical Coherence Tomography for Melanoma Identification and Risk Prediction. JOURNAL OF BIOPHOTONICS 2025; 18:e202400277. [PMID: 39462483 DOI: 10.1002/jbio.202400277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Revised: 09/18/2024] [Accepted: 10/03/2024] [Indexed: 10/29/2024]
Abstract
Malignant melanoma is the most severe skin cancer with a rising incidence rate. Several noninvasive image techniques and computer-aided diagnosis systems have been developed to help find melanoma in its early stages. However, most previous research utilized dermoscopic images to build a diagnosis model, and only a few used prospective datasets. This study develops and evaluates a convolutional neural network (CNN) for melanoma identification and risk prediction using optical coherence tomography (OCT) imaging of mice skin. Longitudinal tests are performed on four animal models: melanoma mice, dysplastic nevus mice, and their respective controls. The CNN classifies melanoma and healthy tissues with high sensitivity (0.99) and specificity (0.98) and also assigns a risk score to each image based on the probability of melanoma presence, which may facilitate early diagnosis and management of melanoma in clinical settings.
Collapse
Affiliation(s)
- Pei-Yu Lai
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Tai-Yu Shih
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Yu-Huan Chang
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chung-Hsing Chang
- Hualien Tzu chi Hospital, Buddhist Tzu Chi Medical Foundation, Skin Institute, Hualien, Taiwan
- Doctoral Degree Program in Translational Medicine, Tzu chi University and Academia Sinica, Hualien, Taiwan
- Institute of Medical Sciences, Tzu chi University, Hualien, Taiwan
| | - Wen-Chuan Kuo
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
4
|
Jütte L, González-Villà S, Quintana J, Steven M, Garcia R, Roth B. Integrating generative AI with ABCDE rule analysis for enhanced skin cancer diagnosis, dermatologist training and patient education. Front Med (Lausanne) 2024; 11:1445318. [PMID: 39421873 PMCID: PMC11484268 DOI: 10.3389/fmed.2024.1445318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Accepted: 09/25/2024] [Indexed: 10/19/2024] Open
Abstract
Significance The early detection and accurate monitoring of suspicious skin lesions are critical for effective dermatological diagnosis and treatment, particularly for reliable identification of the progression of nevi to melanoma. The traditional diagnostic framework, the ABCDE rule, provides a foundation for evaluating lesion characteristics by visual examination using dermoscopes. Simulations of skin lesion progression could improve the understanding of melanoma growth patterns. Aim This study aims to enhance lesion analysis and understanding of lesion progression by providing a simulated potential progression of nevi into melanomas. Approach The study generates a dataset of simulated lesion progressions, from nevi to simulated melanoma, based on a Cycle-Consistent Adversarial Network (Cycle-GAN) and frame interpolation. We apply an optical flow analysis to the generated dermoscopic image sequences, enabling the quantification of lesion transformation. In parallel, we evaluate changes in ABCDE rule metrics as example to assess the simulated evolution. Results We present the first simulation of nevi progressing into simulated melanoma counterparts, consisting of 152 detailed steps. The ABCDE rule metrics correlate with the simulation in a natural manner. For the seven samples studied, the asymmetry metric increased by an average of 19%, the border gradient metric increased by an average of 63%, the convexity metric decreased by an average of 3%, the diameter increased by an average of 2%, and the color dispersion metric increased by an average of 45%. The diagnostic value of the ABCDE rule is enhanced through the addition of insights based on optical flow. The outward expansion of lesions, as captured by optical flow vectors, correlates strongly with the expected increase in diameter, confirming the simulation's fidelity to known lesion growth patterns. The heatmap visualizations further illustrate the degree of change within lesions, offering an intuitive visual proxy for lesion evolution. Conclusion The achieved simulations of potential lesion progressions could facilitate improved early detection and understanding of how lesions evolve. By combining the optical flow analysis with the established criteria of the ABCDE rule, this study presents a significant advancement in dermatoscopic diagnostics and patient education. Future research will focus on applying this integrated approach to real patient data, with the aim of enhancing the understanding of lesion progression and the personalization of dermatological care.
Collapse
Affiliation(s)
- Lennart Jütte
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | | | | | - Martin Steven
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - Rafael Garcia
- Institute of Computer Vision and Robotics Research, Universitat de Girona, Girona, Spain
| | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
- Cluster of Excellence PhoenixD, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
5
|
Wu D, Fedorov Kukk A, Panzer R, Emmert S, Roth B. In vivo Raman spectroscopic and fluorescence study of suspected melanocytic lesions and surrounding healthy skin. JOURNAL OF BIOPHOTONICS 2024; 17:e202400050. [PMID: 38932707 DOI: 10.1002/jbio.202400050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 04/25/2024] [Accepted: 05/03/2024] [Indexed: 06/28/2024]
Abstract
Cutaneous melanoma is the most lethal skin cancer and noninvasively distinguishing it from benign tumor is a major challenge. Raman spectroscopic measurements were conducted on 65 suspected melanocytic lesions and surrounding healthy skin from 47 patients. Compared to the spectra of healthy skin, spectra of melanocytic lesions exhibited lower intensities in carotenoid bands and higher intensities in lipid and melanin bands, suggesting similar variations in the content of these components. Distinct variations were observed among the autofluorescence intensities of healthy skin, benign nevi and malignant melanoma. By incorporating autofluorescence information, the classification accuracy of the support vector machine for spectra of healthy skin, nevi, and melanoma reached 90.2%, surpassing the 87.9% accuracy achieved without autofluorescence, with this difference being statistically significant. These findings indicate the diagnostic value of autofluorescence intensity, which reflect differences in fluorophore content, chemical composition, and structure among healthy skin, nevi, and melanoma.
Collapse
Affiliation(s)
- Di Wu
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
| | - Anatoly Fedorov Kukk
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
| | | | | | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hanover, Germany
- Cluster of Excellence PhoenixD, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
6
|
Varga NN, Boostani M, Farkas K, Bánvölgyi A, Lőrincz K, Posta M, Lihacova I, Lihachev A, Medvecz M, Holló P, Paragh G, Wikonkál NM, Bozsányi S, Kiss N. Optically Guided High-Frequency Ultrasound Shows Superior Efficacy for Preoperative Estimation of Breslow Thickness in Comparison with Multispectral Imaging: A Single-Center Prospective Validation Study. Cancers (Basel) 2023; 16:157. [PMID: 38201584 PMCID: PMC10778011 DOI: 10.3390/cancers16010157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/07/2023] [Accepted: 12/21/2023] [Indexed: 01/12/2024] Open
Abstract
Melanoma is the most aggressive form of skin cancer that is known for its metastatic potential and has an increasing incidence worldwide. Breslow thickness, which determines the staging and surgical margin of the tumor, is unavailable at initial diagnosis. Novel imaging techniques for assessing Breslow thickness lack comparative data. This study evaluates optically guided high-frequency ultrasound (OG-HFUS) and multispectral imaging (MSI) for preoperative estimation of Breslow thickness and staging. We enrolled 101 patients with histologically confirmed primary melanoma and categorized them based on tumor thickness. Optically guided 33 MHz HFUS and MSI were utilized for the assessment. Our MSI-based algorithm categorized melanomas into three subgroups with a sensitivity of 62.6%, specificity of 81.3%, and fair agreement (κ = 0.440, CI: 0.298-0.583). In contrast, OG-HFUS demonstrated a sensitivity of 91.8%, specificity of 96.0%, and almost perfect agreement (κ = 0.858, CI: 0.763-0.952). OG-HFUS performed better than MSI in estimating Breslow thickness, emphasizing its potential as a valuable tool for melanoma diagnosis and patient management. OG-HFUS holds promise for enhancing preoperative staging and treatment decision-making in melanoma.
Collapse
Affiliation(s)
- Noémi Nóra Varga
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Mehdi Boostani
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Klára Farkas
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - András Bánvölgyi
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Kende Lőrincz
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Máté Posta
- Systems Biology of Reproduction Research Group, Institute of Molecular Life Sciences, HUN-REN Research Centre for Natural Sciences, 1117 Budapest, Hungary;
| | - Ilze Lihacova
- Biophotonics Laboratory, Institute of Atomic Physics and Spectroscopy, University of Latvia, 1004 Riga, Latvia; (I.L.); (A.L.)
| | - Alexey Lihachev
- Biophotonics Laboratory, Institute of Atomic Physics and Spectroscopy, University of Latvia, 1004 Riga, Latvia; (I.L.); (A.L.)
| | - Márta Medvecz
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Péter Holló
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Gyorgy Paragh
- Department of Dermatology, Roswell Park Comprehensive Cancer Center, Buffalo, NY 14203, USA;
| | - Norbert M. Wikonkál
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| | - Szabolcs Bozsányi
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
- Department of Dermatology, Roswell Park Comprehensive Cancer Center, Buffalo, NY 14203, USA;
| | - Norbert Kiss
- Department of Dermatology, Venereology and Dermatooncology, Semmelweis University, 1085 Budapest, Hungary; (N.N.V.); (M.B.); (K.F.); (A.B.); (K.L.); (M.M.); (P.H.); (N.M.W.); (S.B.)
| |
Collapse
|
7
|
Badieyan S, Abedini M, Razzaghi M, Moradi A, Masjedi M. Polarimetric imaging-based cancer bladder tissue's detection: A comparative study of bulk and formalin-fixed paraffin-embedded samples. Photodiagnosis Photodyn Ther 2023; 44:103698. [PMID: 37433425 DOI: 10.1016/j.pdpdt.2023.103698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 07/04/2023] [Accepted: 07/07/2023] [Indexed: 07/13/2023]
Abstract
The polarimetry imaging technique as a promising technique for pathological diagnosis provides a handy tool for identifying and discriminating cancerous tissues. In this paper, the optical polarization properties of bulk bladder tissues without any further processing and Formalin-Fixed Paraffin-Embedded (FFPE) blocks of bladder tissues have been measured. The images of the Muller matrix for both normal and cancerous samples have been obtained and for quantitative analysis and to provide a more precise comparison, two methods have been applied; the Mueller matrix polar decomposition (MMPD), and the Mueller matrix transformation (MMT). The results have shown that some of the extracted parameters from these methods can be used to identify the microstructural differentiations between normal and cancerous tissues. The results revealed a good accord between the obtained optical parameters for bulk and FFPE bladder tissues. By measuring the polarimetric properties of the tissue right after resection, and also in the early stages of pathology (FFPE tissues), this method can be applied in vivo to perform an optical biopsy; Furthermore, this method has the potential to significantly shortens the duration of pathological diagnosis. The approach seems remarkable, simple, precise, and economical compared to the existing techniques for the detection of cancerous samples.
Collapse
Affiliation(s)
- Saeedesadat Badieyan
- Laser Application in Medical Sciences Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran; Department of Biomedical Engineering, University of Neyshabur, Neyshabur, Iran.
| | - Mitra Abedini
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammadreza Razzaghi
- Laser Application in Medical Sciences Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Afshin Moradi
- Laser Application in Medical Sciences Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohammadreza Masjedi
- Laser Application in Medical Sciences Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
8
|
Kukk AF, Scheling F, Panzer R, Emmert S, Roth B. Combined ultrasound and photoacoustic C-mode imaging system for skin lesion assessment. Sci Rep 2023; 13:17947. [PMID: 37864039 PMCID: PMC10589211 DOI: 10.1038/s41598-023-44919-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 10/13/2023] [Indexed: 10/22/2023] Open
Abstract
Accurate assessment of the size and depth of infiltration is critical for effectively treating and removing skin cancer, especially melanoma. However, existing methods such as skin biopsy and histologic examination are invasive, time-consuming, and may not provide accurate depth results. We present a novel system for simultaneous and co-localized ultrasound and photoacoustic imaging, with the application for non-invasive skin lesion size and depth measurement. The developed system integrates an acoustical mirror that is placed on an ultrasound transducer, which can be translated within a flexible water tank. This allows for 3D (C-mode) imaging, which is useful for mapping the skin structure and determine the invasion size and depth of lesions including skin cancer. For efficient reconstruction of photoacoustic images, we applied the open-source MUST library. The acquisition time per 2D image is <1 s and the pulse energies are below the legal Maximum Permissible Exposure (MPE) on human skin. We present the depth and resolution capabilities of the setup on several self-designed agar phantoms and demonstrate in vivo imaging on human skin. The setup also features an unobstructed optical window from the top, allowing for simple integration with other optical modalities. The perspective towards clinical application is demonstrated.
Collapse
Affiliation(s)
- Anatoly Fedorov Kukk
- Hannover Centre for Optical Technologies, Leibniz University of Hannover, Nienburger Straße 17, 30167, Hannover, Germany.
| | - Felix Scheling
- Hannover Centre for Optical Technologies, Leibniz University of Hannover, Nienburger Straße 17, 30167, Hannover, Germany
| | - Rüdiger Panzer
- Clinic and Policlinic for Dermatology and Venereology, University Medical Center Rostock, Strempelstraße 13, 18057, Rostock, Germany
| | - Steffen Emmert
- Clinic and Policlinic for Dermatology and Venereology, University Medical Center Rostock, Strempelstraße 13, 18057, Rostock, Germany
| | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University of Hannover, Nienburger Straße 17, 30167, Hannover, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics and Engineering - Innovation Across Disciplines), Welfengarten 1a, 30167, Hannover, Germany
| |
Collapse
|