1
|
Parasca SV, Calin MA, Manea D, Radvan R. Hyperspectral imaging with machine learning for in vivo skin carcinoma margin assessment: a preliminary study. Phys Eng Sci Med 2024:10.1007/s13246-024-01435-8. [PMID: 38771442 DOI: 10.1007/s13246-024-01435-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 04/30/2024] [Indexed: 05/22/2024]
Abstract
Surgical excision is the most effective treatment of skin carcinomas (basal cell carcinoma or squamous cell carcinoma). Preoperative assessment of tumoral margins plays a decisive role for a successful result. The aim of this work was to evaluate the possibility that hyperspectral imaging could become a valuable tool in solving this problem. Hyperspectral images of 11 histologically diagnosed carcinomas (six basal cell carcinomas and five squamous cell carcinomas) were acquired prior clinical evaluation and surgical excision. The hyperspectral data were then analyzed using a newly developed method for delineating skin cancer tumor margins. This proposed method is based on a segmentation process of the hyperspectral images into regions with similar spectral and spatial features, followed by a machine learning-based data classification process resulting in the generation of classification maps illustrating tumor margins. The Spectral Angle Mapper classifier was used in the data classification process using approximately 37% of the segments as the training sample, the rest being used for testing. The receiver operating characteristic was used as the method for evaluating the performance of the proposed method and the area under the curve as a metric. The results revealed that the performance of the method was very good, with median AUC values of 0.8014 for SCCs, 0.8924 for BCCs, and 0.8930 for normal skin. With AUC values above 0.89 for all types of tissue, the method was considered to have performed very well. In conclusion, hyperspectral imaging can become an objective aid in the preoperative evaluation of carcinoma margins.
Collapse
Affiliation(s)
- Sorin Viorel Parasca
- Carol Davila University of Medicine and Pharmacy, 37 Dionisie Lupu Street, Bucharest, Romania
- Emergency Clinical Hospital for Plastic, Reconstructive Surgery and Burns, 218 Grivitei Street, Bucharest, Romania
| | - Mihaela Antonina Calin
- National Institute of Research and Development for Optoelectronics- INOE 2000, 409 Atomistilor Street, 077125, Magurele, Ilfov, P.O. BOX MG5, Romania.
| | - Dragos Manea
- National Institute of Research and Development for Optoelectronics- INOE 2000, 409 Atomistilor Street, 077125, Magurele, Ilfov, P.O. BOX MG5, Romania
| | - Roxana Radvan
- National Institute of Research and Development for Optoelectronics- INOE 2000, 409 Atomistilor Street, 077125, Magurele, Ilfov, P.O. BOX MG5, Romania
| |
Collapse
|
2
|
Jong LJS, Post AL, Veluponnar D, Geldof F, Sterenborg HJCM, Ruers TJM, Dashtbozorg B. Tissue Classification of Breast Cancer by Hyperspectral Unmixing. Cancers (Basel) 2023; 15:2679. [PMID: 37345015 DOI: 10.3390/cancers15102679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 04/26/2023] [Accepted: 05/04/2023] [Indexed: 06/23/2023] Open
Abstract
(1) Background: Assessing the resection margins during breast-conserving surgery is an important clinical need to minimize the risk of recurrent breast cancer. However, currently there is no technique that can provide real-time feedback to aid surgeons in the margin assessment. Hyperspectral imaging has the potential to overcome this problem. To classify resection margins with this technique, a tissue discrimination model should be developed, which requires a dataset with accurate ground-truth labels. However, establishing such a dataset for resection specimens is difficult. (2) Methods: In this study, we therefore propose a novel approach based on hyperspectral unmixing to determine which pixels within hyperspectral images should be assigned to the ground-truth labels from histopathology. Subsequently, we use this hyperspectral-unmixing-based approach to develop a tissue discrimination model on the presence of tumor tissue within the resection margins of ex vivo breast lumpectomy specimens. (3) Results: In total, 372 measured locations were included on the lumpectomy resection surface of 189 patients. We achieved a sensitivity of 0.94, specificity of 0.85, accuracy of 0.87, Matthew's correlation coefficient of 0.71, and area under the curve of 0.92. (4) Conclusion: Using this hyperspectral-unmixing-based approach, we demonstrated that the measured locations with hyperspectral imaging on the resection surface of lumpectomy specimens could be classified with excellent performance.
Collapse
Affiliation(s)
- Lynn-Jade S Jong
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Anouk L Post
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
| | - Dinusha Veluponnar
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Freija Geldof
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Henricus J C M Sterenborg
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
| | - Theo J M Ruers
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Behdad Dashtbozorg
- Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands
| |
Collapse
|
3
|
Tomanic T, Rogelj L, Stergar J, Markelc B, Bozic T, Brezar SK, Sersa G, Milanic M. Estimating quantitative physiological and morphological tissue parameters of murine tumor models using hyperspectral imaging and optical profilometry. JOURNAL OF BIOPHOTONICS 2023; 16:e202200181. [PMID: 36054067 DOI: 10.1002/jbio.202200181] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 07/27/2022] [Accepted: 08/05/2022] [Indexed: 06/15/2023]
Abstract
Understanding tumors and their microenvironment are essential for successful and accurate disease diagnosis. Tissue physiology and morphology are altered in tumors compared to healthy tissues, and there is a need to monitor tumors and their surrounding tissues, including blood vessels, non-invasively. This preliminary study utilizes a multimodal optical imaging system combining hyperspectral imaging (HSI) and three-dimensional (3D) optical profilometry (OP) to capture hyperspectral images and surface shapes of subcutaneously grown murine tumor models. Hyperspectral images are corrected with 3D OP data and analyzed using the inverse-adding doubling (IAD) method to extract tissue properties such as melanin volume fraction and oxygenation. Blood vessels are segmented using the B-COSFIRE algorithm from oxygenation maps. From 3D OP data, tumor volumes are calculated and compared to manual measurements using a vernier caliper. Results show that tumors can be distinguished from healthy tissue based on most extracted tissue parameters ( p < 0.05 ). Furthermore, blood oxygenation is 50% higher within the blood vessels than in the surrounding tissue, and tumor volumes calculated using 3D OP agree within 26% with manual measurements using a vernier caliper. Results suggest that combining HSI and OP could provide relevant quantitative information about tumors and improve the disease diagnosis.
Collapse
Affiliation(s)
- Tadej Tomanic
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
| | - Luka Rogelj
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
| | - Jost Stergar
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| | - Bostjan Markelc
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Health Sciences, University of Ljubljana, Ljubljana, Slovenia
| | - Tim Bozic
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
| | - Simona Kranjc Brezar
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
| | - Gregor Sersa
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Health Sciences, University of Ljubljana, Ljubljana, Slovenia
| | - Matija Milanic
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| |
Collapse
|
4
|
PAOLI J, PÖLÖNEN I, SALMIVUORI M, RÄSÄNEN J, ZAAR O, POLESIE S, KOSKENMIES S, PITKÄNEN S, ÖVERMARK M, ISOHERRANEN K, JUTEAU S, RANKI A, GRÖNROOS M, NEITTAANMÄKI N. Hyperspectral Imaging for Non-invasive Diagnostics of Melanocytic Lesions. Acta Derm Venereol 2022; 102:adv00815. [PMID: 36281811 PMCID: PMC9811300 DOI: 10.2340/actadv.v102.2045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
Malignant melanoma poses a clinical diagnostic problem, since a large number of benign lesions are excised to find a single melanoma. This study assessed the accuracy of a novel non-invasive diagnostic technology, hyperspectral imaging, for melanoma detection. Lesions were imaged prior to excision and histopathological analysis. A deep neural network algorithm was trained twice to distinguish between histopathologically verified malignant and benign melanocytic lesions and to classify the separate subgroups. Furthermore, 2 different approaches were used: a majority vote classification and a pixel-wise classification. The study included 325 lesions from 285 patients. Of these, 74 were invasive melanoma, 88 melanoma in situ, 115 dysplastic naevi, and 48 non-dysplastic naevi. The study included a training set of 358,800 pixels and a validation set of 7,313 pixels, which was then tested with a training set of 24,375 pixels. The majority vote classification achieved high overall sensitivity of 95% and a specificity of 92% (95% confidence interval (95% CI) 0.024-0.029) in differentiating malignant from benign lesions. In the pixel-wise classification, the overall sensitivity and specificity were both 82% (95% CI 0.005-0.005). When divided into 4 subgroups, the diagnostic accuracy was lower. Hyperspectral imaging provides high sensitivity and specificity in distinguishing between naevi and melanoma. This novel method still needs further validation.
Collapse
Affiliation(s)
- John PAOLI
- Department of Dermatology and Venereology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg,Department of Dermatology and Venereology, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Ilkka PÖLÖNEN
- Faculty of Information Technology, University of Jyväskylä
| | - Mari SALMIVUORI
- Department of Dermatology and Allergology, Päijät-Häme Social and Health Care Group, Lahti,Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Janne RÄSÄNEN
- Department of Dermatology and Allergology, Päijät-Häme Social and Health Care Group, Lahti,Department of Dermatology, Tampere University Hospital and Faculty of Medicine and Medical technology, Tampere University, Tampere
| | - Oscar ZAAR
- Department of Dermatology and Venereology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg,Department of Dermatology and Venereology, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Sam POLESIE
- Department of Dermatology and Venereology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg,Department of Dermatology and Venereology, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Sari KOSKENMIES
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Sari PITKÄNEN
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Meri ÖVERMARK
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Kirsi ISOHERRANEN
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Susanna JUTEAU
- Department of Pathology, University of Helsinki and HUSLAB, Helsinki, Finland
| | - Annamari RANKI
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, Helsinki
| | - Mari GRÖNROOS
- Department of Dermatology and Allergology, Päijät-Häme Social and Health Care Group, Lahti
| | - Noora NEITTAANMÄKI
- Department of Dermatology and Venereology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg,Department of Laboratory Medicine, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg,Department of Clinical Pathology, Region Västra Götaland, Sahlgrenska University Hospital, Gothenburg, Sweden
| |
Collapse
|
5
|
Aloupogianni E, Ichimura T, Hamada M, Ishikawa M, Murakami T, Sasaki A, Nakamura K, Kobayashi N, Obi T. Hyperspectral imaging for tumor segmentation on pigmented skin lesions. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:106007. [PMID: 36316301 PMCID: PMC9619132 DOI: 10.1117/1.jbo.27.10.106007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 10/10/2022] [Indexed: 06/16/2023]
Abstract
SIGNIFICANCE Malignant skin tumors, which include melanoma and nonmelanoma skin cancers, are the most prevalent type of malignant tumor. Gross pathology of pigmented skin lesions (PSL) remains manual, time-consuming, and heavily dependent on the expertise of the medical personnel. Hyperspectral imaging (HSI) can assist in the detection of tumors and evaluate the status of tumor margins by their spectral signatures. AIM Tumor segmentation of medical HSI data is a research field. The goal of this study is to propose a framework for HSI-based tumor segmentation of PSL. APPROACH An HSI dataset of 28 PSL was prepared. Two frameworks for data preprocessing and tumor segmentation were proposed. Models based on machine learning and deep learning were used at the core of each framework. RESULTS Cross-validation performance showed that pixel-wise processing achieves higher segmentation performance, in terms of the Jaccard coefficient. Simultaneous use of spatio-spectral features produced more comprehensive tumor masks. A three-dimensional Xception-based network achieved performance similar to state-of-the-art networks while allowing for more detailed detection of the tumor border. CONCLUSIONS Good performance was achieved for melanocytic lesions, but margins were difficult to detect in some cases of basal cell carcinoma. The frameworks proposed in this study could be further improved for robustness against different pathologies and detailed delineation of tissue margins to facilitate computer-assisted diagnosis during gross pathology.
Collapse
Affiliation(s)
- Eleni Aloupogianni
- Tokyo Institute of Technology, Department of Information and Communications Engineering, Meguro, Japan
| | - Takaya Ichimura
- Saitama Medical University Moroyama Campus, Department of Pathology, Faculty of Medicine, Iruma, Japan
| | - Mei Hamada
- Saitama Medical University Moroyama Campus, Department of Pathology, Faculty of Medicine, Iruma, Japan
| | - Masahiro Ishikawa
- Saitama Medical University Hidaka Campus, Faculty of Health and Medical Care, Hidaka, Japan
| | - Takuo Murakami
- Saitama Medical University Moroyama Campus, Department of Dermatology, Faculty of Medicine, Iruma, Japan
| | - Atsushi Sasaki
- Saitama Medical University Moroyama Campus, Department of Pathology, Faculty of Medicine, Iruma, Japan
| | - Koichiro Nakamura
- Saitama Medical University Moroyama Campus, Department of Dermatology, Faculty of Medicine, Iruma, Japan
| | - Naoki Kobayashi
- Saitama Medical University Hidaka Campus, Faculty of Health and Medical Care, Hidaka, Japan
| | - Takashi Obi
- Tokyo Institute of Technology, Department of Information and Communications Engineering, Meguro, Japan
- Tokyo Institute of Technology, Institute of Innovative Research, Yokohama, Japan
| |
Collapse
|
6
|
Aloupogianni E, Ishikawa M, Kobayashi N, Obi T. Hyperspectral and multispectral image processing for gross-level tumor detection in skin lesions: a systematic review. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-220029VR. [PMID: 35676751 PMCID: PMC9174598 DOI: 10.1117/1.jbo.27.6.060901] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/23/2022] [Indexed: 05/11/2023]
Abstract
SIGNIFICANCE Skin cancer is one of the most prevalent cancers worldwide. In the advent of medical digitization and telepathology, hyper/multispectral imaging (HMSI) allows for noninvasive, nonionizing tissue evaluation at a macroscopic level. AIM We aim to summarize proposed frameworks and recent trends in HMSI-based classification and segmentation of gross-level skin tissue. APPROACH A systematic review was performed, targeting HMSI-based systems for the classification and segmentation of skin lesions during gross pathology, including melanoma, pigmented lesions, and bruises. The review adhered to the 2020 Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. For eligible reports published from 2010 to 2020, trends in HMSI acquisition, preprocessing, and analysis were identified. RESULTS HMSI-based frameworks for skin tissue classification and segmentation vary greatly. Most reports implemented simple image processing or machine learning, due to small training datasets. Methodologies were evaluated on heavily curated datasets, with the majority targeting melanoma detection. The choice of preprocessing scheme influenced the performance of the system. Some form of dimension reduction is commonly applied to avoid redundancies that are inherent in HMSI systems. CONCLUSIONS To use HMSI for tumor margin detection in practice, the focus of system evaluation should shift toward the explainability and robustness of the decision-making process.
Collapse
Affiliation(s)
- Eleni Aloupogianni
- Tokyo Institute of Technology, Department of Information and Communication Engineering, Tokyo, Japan
- Address all correspondence to Eleni Aloupogianni,
| | - Masahiro Ishikawa
- Saitama Medical University, Faculty of Health and Medical Care, Saitama, Japan
| | - Naoki Kobayashi
- Saitama Medical University, Faculty of Health and Medical Care, Saitama, Japan
| | - Takashi Obi
- Tokyo Institute of Technology, Department of Information and Communication Engineering, Tokyo, Japan
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan
| |
Collapse
|
7
|
Raita-Hakola AM, Annala L, Lindholm V, Trops R, Näsilä A, Saari H, Ranki A, Pölönen I. FPI Based Hyperspectral Imager for the Complex Surfaces—Calibration, Illumination and Applications. SENSORS 2022; 22:s22093420. [PMID: 35591109 PMCID: PMC9103796 DOI: 10.3390/s22093420] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 04/13/2022] [Accepted: 04/23/2022] [Indexed: 01/27/2023]
Abstract
Hyperspectral imaging (HSI) applications for biomedical imaging and dermatological applications have been recently under research interest. Medical HSI applications are non-invasive methods with high spatial and spectral resolution. HS imaging can be used to delineate malignant tumours, detect invasions, and classify lesion types. Typical challenges of these applications relate to complex skin surfaces, leaving some skin areas unreachable. In this study, we introduce a novel spectral imaging concept and conduct a clinical pre-test, the findings of which can be used to develop the concept towards a clinical application. The SICSURFIS spectral imager concept combines a piezo-actuated Fabry–Pérot interferometer (FPI) based hyperspectral imager, a specially designed LED module and several sizes of stray light protection cones for reaching and adapting to the complex skin surfaces. The imager is designed for the needs of photometric stereo imaging for providing the skin surface models (3D) for each captured wavelength. The captured HS images contained 33 selected wavelengths (ranging from 477 nm to 891 nm), which were captured simultaneously with accordingly selected LEDs and three specific angles of light. The pre-test results show that the data collected with the new SICSURFIS imager enable the use of the spectral and spatial domains with surface model information. The imager can reach complex skin surfaces. Healthy skin, basal cell carcinomas and intradermal nevi lesions were classified and delineated pixel-wise with promising results, but further studies are needed. The results were obtained with a convolutional neural network.
Collapse
Affiliation(s)
- Anna-Maria Raita-Hakola
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
- Correspondence:
| | - Leevi Annala
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Vivian Lindholm
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (V.L.); (A.R.)
| | - Roberts Trops
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Antti Näsilä
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Heikki Saari
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Annamari Ranki
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (V.L.); (A.R.)
| | - Ilkka Pölönen
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| |
Collapse
|
8
|
Lindholm V, Raita-Hakola AM, Annala L, Salmivuori M, Jeskanen L, Saari H, Koskenmies S, Pitkänen S, Pölönen I, Isoherranen K, Ranki A. Differentiating Malignant from Benign Pigmented or Non-Pigmented Skin Tumours-A Pilot Study on 3D Hyperspectral Imaging of Complex Skin Surfaces and Convolutional Neural Networks. J Clin Med 2022; 11:jcm11071914. [PMID: 35407522 PMCID: PMC8999463 DOI: 10.3390/jcm11071914] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Accepted: 03/28/2022] [Indexed: 02/08/2023] Open
Abstract
Several optical imaging techniques have been developed to ease the burden of skin cancer disease on our health care system. Hyperspectral images can be used to identify biological tissues by their diffuse reflected spectra. In this second part of a three-phase pilot study, we used a novel hand-held SICSURFIS Spectral Imager with an adaptable field of view and target-wise selectable wavelength channels to provide detailed spectral and spatial data for lesions on complex surfaces. The hyperspectral images (33 wavelengths, 477–891 nm) provided photometric data through individually controlled illumination modules, enabling convolutional networks to utilise spectral, spatial, and skin-surface models for the analyses. In total, 42 lesions were studied: 7 melanomas, 13 pigmented and 7 intradermal nevi, 10 basal cell carcinomas, and 5 squamous cell carcinomas. All lesions were excised for histological analyses. A pixel-wise analysis provided map-like images and classified pigmented lesions with a sensitivity of 87% and a specificity of 93%, and 79% and 91%, respectively, for non-pigmented lesions. A majority voting analysis, which provided the most probable lesion diagnosis, diagnosed 41 of 42 lesions correctly. This pilot study indicates that our non-invasive hyperspectral imaging system, which involves shape and depth data analysed by convolutional neural networks, is feasible for differentiating between malignant and benign pigmented and non-pigmented skin tumours, even on complex skin surfaces.
Collapse
Affiliation(s)
- Vivian Lindholm
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
- Correspondence: (V.L.); (A.-M.R.-H.); Tel.: +358-9471-86355 (V.L.)
| | - Anna-Maria Raita-Hakola
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
- Correspondence: (V.L.); (A.-M.R.-H.); Tel.: +358-9471-86355 (V.L.)
| | - Leevi Annala
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Mari Salmivuori
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Leila Jeskanen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Heikki Saari
- VTT Technical Research Centre of Finland, 02150 Espoo, Finland;
| | - Sari Koskenmies
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Sari Pitkänen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Ilkka Pölönen
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Kirsi Isoherranen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Annamari Ranki
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| |
Collapse
|
9
|
Calin MA, Parasca SV. Automatic detection of basal cell carcinoma by hyperspectral imaging. JOURNAL OF BIOPHOTONICS 2022; 15:e202100231. [PMID: 34427393 DOI: 10.1002/jbio.202100231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 08/19/2021] [Indexed: 06/13/2023]
Abstract
The purpose of this study was to test the ability of hyperspectral imaging (HSI) combined with unsupervised anomaly detectors to automatically differentiate basal cell carcinoma (BCC) from normal skin. Hyperspectral images of the face of a female patient with a BCC of the lower lip were acquired using a visible/near-infrared HSI system and two anomaly detection algorithms (Reed-Xiaoli and Reed-Xiaoli/Uniform Target hybrid anomaly detectors) were used to detect pathological tissue from normal skin. The results revealed that the receiver operating characteristic curve of the Reed-Xiaoli/Uniform Target hybrid detector was higher than that of the Reed-Xiaoli detector in the range of false positive rates between 0 and 0.8. The area under curve values were good (0.7074 and 0.8607, respectively) with Reed-Xiaoli/Uniform Target hybrid detector performing better. In conclusion, HSI combined with either of two anomaly detectors can play a promising role in the automated screening of BCC.
Collapse
Affiliation(s)
- Mihaela Antonina Calin
- Optoelectronic Methods for Biomedical Applications Department, National Institute of Research and Development for Optoelectronics INOE 2000, Magurele, Ilfov, Romania
| | - Sorin Viorel Parasca
- Plastic and Reconstructive Surgery Department, Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
- Emergency Clinical Hospital for Plastic, Reconstructive Surgery and Burns, Bucharest, Romania
| |
Collapse
|
10
|
Courtenay LA, González-Aguilera D, Lagüela S, del Pozo S, Ruiz-Mendez C, Barbero-García I, Román-Curto C, Cañueto J, Santos-Durán C, Cardeñoso-Álvarez ME, Roncero-Riesco M, Hernandez-Lopez D, Guerrero-Sevilla D, Rodríguez-Gonzalvez P. Hyperspectral imaging and robust statistics in non-melanoma skin cancer analysis. BIOMEDICAL OPTICS EXPRESS 2021; 12:5107-5127. [PMID: 34513245 PMCID: PMC8407807 DOI: 10.1364/boe.428143] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 06/21/2021] [Accepted: 06/28/2021] [Indexed: 05/31/2023]
Abstract
Non-Melanoma skin cancer is one of the most frequent types of cancer. Early detection is encouraged so as to ensure the best treatment, Hyperspectral imaging is a promising technique for non-invasive inspection of skin lesions, however, the optimal wavelengths for these purposes are yet to be conclusively determined. A visible-near infrared hyperspectral camera with an ad-hoc built platform was used for image acquisition in the present study. Robust statistical techniques were used to conclude an optimal range between 573.45 and 779.88 nm to distinguish between healthy and non-healthy skin. Wavelengths between 429.16 and 520.17 nm were additionally found to be optimal for the differentiation between cancer types.
Collapse
Affiliation(s)
- Lloyd A. Courtenay
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Diego González-Aguilera
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Susana Lagüela
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Susana del Pozo
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Camilo Ruiz-Mendez
- Department of Didactics of Mathematics and
Experimental Sciences, Faculty of
Education, Paseo de Canaleja 169, 37008, Salamanca,
Spain
| | - Inés Barbero-García
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Concepción Román-Curto
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
- Instituto de
Investigación Biomédica de Salamanca
(IBSAL), Paseo de San Vicente, 58-182, 37007 Salamanca,
Spain
| | - Javier Cañueto
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
- Instituto de
Investigación Biomédica de Salamanca
(IBSAL), Paseo de San Vicente, 58-182, 37007 Salamanca,
Spain
- Instituto de Biología
Molecular y Celular del Cáncer (IBMCC)/Centro de
Investigación del Cáncer (lab 7). Campus
Miguel de Unamuno s/n. 37007 Salamanca, Spain
| | - Carlos Santos-Durán
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
| | | | - Mónica Roncero-Riesco
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
| | - David Hernandez-Lopez
- Institute for Regional Development,
University of Castilla la Mancha, Campus
Universitario s/n, 02071, Albacete, Spain
| | - Diego Guerrero-Sevilla
- Institute for Regional Development,
University of Castilla la Mancha, Campus
Universitario s/n, 02071, Albacete, Spain
| | - Pablo Rodríguez-Gonzalvez
- Department of Mining Technology, Topography
and Structures, University of León,
Ponferrada, Léon, Spain
| |
Collapse
|
11
|
Zhou X, Ma L, Brown W, Little JV, Chen AY, Myers LL, Sumer BD, Fei B. Automatic detection of head and neck squamous cell carcinoma on pathologic slides using polarized hyperspectral imaging and machine learning. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11603:116030Q. [PMID: 34955584 PMCID: PMC8699168 DOI: 10.1117/12.2582330] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
The aim of this study is to incorporate polarized hyperspectral imaging (PHSI) with machine learning for automatic detection of head and neck squamous cell carcinoma (SCC) on hematoxylin and eosin (H&E) stained tissue slides. A polarized hyperspectral imaging microscope had been developed in our group. In this paper, we imaged 20 H&E stained tissue slides from 10 patients with SCC of the larynx by the PHSI microscope. Several machine learning algorithms, including support vector machine (SVM), random forest, Gaussian naive Bayes, and logistic regression, were applied to the collected image data for the automatic detection of SCC on the H&E stained tissue slides. The performance of these methods was compared among the collected PHSI data, the pseudo-RGB images generated from the PHSI data, and the PHSI data after applying the principal component analysis (PCA) transformation. The results suggest that SVM is a superior classifier for the classification task based on the PHSI data cubes compared to the other three classifiers. The incorporate of four Stokes vector parameters improved the classification accuracy. Finally, the PCA transformed image data did not improve the accuracy as it might lose some important information from the original PHSI data. The preliminary results show that polarized hyperspectral imaging can have many potential applications in digital pathology.
Collapse
Affiliation(s)
- Ximing Zhou
- The University of Texas at Dallas, Department of Bioengineering and Center for Imaging and Surgical Innovation, Richardson, TX
| | - Ling Ma
- The University of Texas at Dallas, Department of Bioengineering and Center for Imaging and Surgical Innovation, Richardson, TX
| | - William Brown
- The University of Texas at Dallas, Department of Bioengineering and Center for Imaging and Surgical Innovation, Richardson, TX
| | - James V. Little
- Emory University, Department of Pathology and Laboratory
Medicine, Atlanta, GA
| | - Amy Y. Chen
- Emory University, Department of Otolaryngology, Atlanta,
GA
| | - Larry L. Myers
- Univ. of Texas Southwestern Medical Center, Dept. of
Otolaryngology, Dallas, TX
| | - Baran D. Sumer
- Univ. of Texas Southwestern Medical Center, Dept. of
Otolaryngology, Dallas, TX
| | - Baowei Fei
- The University of Texas at Dallas, Department of Bioengineering and Center for Imaging and Surgical Innovation, Richardson, TX
- Univ. of Texas Southwestern Medical Center, Advanced
Imaging Research Center, Dallas, TX
- Univ. of Texas Southwestern Medical Center, Dept. of
Radiology, Dallas, TX
| |
Collapse
|
12
|
Greywal T, Goldenberg A, Eimpunth S, Jiang S. Key characteristics of basal cell carcinoma with large subclinical extension. J Eur Acad Dermatol Venereol 2019; 34:485-490. [DOI: 10.1111/jdv.15884] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2018] [Accepted: 07/16/2019] [Indexed: 12/23/2022]
Affiliation(s)
- T. Greywal
- Department of Dermatology University of California, San Diego San Diego CA USA
| | - A. Goldenberg
- Department of Dermatology University of California, San Diego San Diego CA USA
| | - S. Eimpunth
- Department of Dermatology Faculty of Medicine Siriraj Hospital Mahidol University Bangkok Thailand
| | - S.B. Jiang
- Department of Dermatology University of California, San Diego San Diego CA USA
| |
Collapse
|
13
|
Halicek M, Fabelo H, Ortega S, Little JV, Wang X, Chen AY, Callico GM, Myers L, Sumer BD, Fei B. Hyperspectral imaging for head and neck cancer detection: specular glare and variance of the tumor margin in surgical specimens. J Med Imaging (Bellingham) 2019; 6:035004. [PMID: 31528662 DOI: 10.1117/1.jmi.6.3.035004] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2019] [Accepted: 08/06/2019] [Indexed: 12/19/2022] Open
Abstract
Head and neck squamous cell carcinoma (SCC) is primarily managed by surgical cancer resection. Recurrence rates after surgery can be as high as 55%, if residual cancer is present. Hyperspectral imaging (HSI) is evaluated for detection of SCC in ex-vivo surgical specimens. Several machine learning methods are investigated, including convolutional neural networks (CNNs) and a spectral-spatial classification framework based on support vector machines. Quantitative results demonstrate that additional data preprocessing and unsupervised segmentation can improve CNN results to achieve optimal performance. The methods are trained in two paradigms, with and without specular glare. Classifying regions that include specular glare degrade the overall results, but the combination of the CNN probability maps and unsupervised segmentation using a majority voting method produces an area under the curve value of 0.81 [0.80, 0.83]. As the wavelengths of light used in HSI can penetrate different depths into biological tissue, cancer margins may change with depth and create uncertainty in the ground truth. Through serial histological sectioning, the variance in the cancer margin with depth is investigated and paired with qualitative classification heat maps using the methods proposed for the testing group of SCC patients. The results determined that the validity of the top section alone as the ground truth may be limited to 1 to 2 mm. The study of specular glare and margin variation provided better understanding of the potential of HSI for the use in the operating room.
Collapse
Affiliation(s)
- Martin Halicek
- University of Texas at Dallas, Department of Bioengineering, Dallas, Texas, United States.,Emory University and Georgia Institute of Technology, Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Himar Fabelo
- University of Texas at Dallas, Department of Bioengineering, Dallas, Texas, United States.,University of Las Palmas de Gran Canaria, Institute for Applied Microelectronics, Las Palmas, Spain
| | - Samuel Ortega
- University of Las Palmas de Gran Canaria, Institute for Applied Microelectronics, Las Palmas, Spain
| | - James V Little
- Emory University School of Medicine, Department of Pathology and Laboratory Medicine, Atlanta, Georgia, United States
| | - Xu Wang
- Emory University School of Medicine, Department of Hematology and Medical Oncology, Atlanta, Georgia, United States
| | - Amy Y Chen
- Emory University School of Medicine, Department of Otolaryngology, Atlanta, Georgia, United States
| | - Gustavo Marrero Callico
- University of Las Palmas de Gran Canaria, Institute for Applied Microelectronics, Las Palmas, Spain
| | - Larry Myers
- University of Texas Southwestern Medical Center, Department of Otolaryngology, Dallas, Texas, United States
| | - Baran D Sumer
- University of Texas Southwestern Medical Center, Department of Otolaryngology, Dallas, Texas, United States
| | - Baowei Fei
- University of Texas at Dallas, Department of Bioengineering, Dallas, Texas, United States.,University of Texas Southwestern Medical Center, Advanced Imaging Research Center, Dallas, Texas, United States.,University of Texas Southwestern Medical Center, Department of Radiology, Dallas, Texas, United States
| |
Collapse
|