1
|
Bali A, Wolter S, Pelzel D, Weyer U, Azevedo T, Lio P, Kouka M, Geißler K, Bitter T, Ernst G, Xylander A, Ziller N, Mühlig A, von Eggeling F, Guntinas-Lichius O, Pertzborn D. Real-Time Intraoperative Decision-Making in Head and Neck Tumor Surgery: A Histopathologically Grounded Hyperspectral Imaging and Deep Learning Approach. Cancers (Basel) 2025; 17:1617. [PMID: 40427116 PMCID: PMC12109655 DOI: 10.3390/cancers17101617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2025] [Revised: 04/28/2025] [Accepted: 05/07/2025] [Indexed: 05/29/2025] Open
Abstract
BACKGROUND Accurate and rapid intraoperative tumor margin assessment remains a major challenge in surgical oncology. Current gold-standard methods, such as frozen section histology, are time-consuming, operator-dependent, and prone to misclassification, which limits their clinical utility. OBJECTIVE To develop and evaluate a novel hyperspectral imaging (HSI) workflow that integrates deep learning with three-dimensional (3D) tumor modeling for real-time, label-free tumor margin delineation in head and neck squamous cell carcinoma (HNSCC). METHODS Freshly resected HNSCC samples were snap-frozen and imaged ex vivo from multiple perspectives using a standardized HSI protocol, resulting in a 3D model derived from HSI. Each sample was serially sectioned, stained, and annotated by pathologists to create high-resolution 3D histological reconstructions. The volumetric histological models were co-registered with the HSI data (n = 712 Datacubes), enabling voxel-wise projection of tumor segmentation maps from the HSI-derived 3D model onto the corresponding histological ground truth. Three deep learning models were trained and validated on these datasets to differentiate tumor from non-tumor regions with high spatial precision. RESULTS This work demonstrates strong potential for the proposed HSI system, with an overall classification accuracy of 0.98 and a tumor sensitivity of 0.93, underscoring the system's ability to reliably detect tumor regions and showing high concordance with histopathological findings. CONCLUSION The integration of HSI with deep learning and 3D tumor modeling offers a promising approach for precise, real-time intraoperative tumor margin assessment in HNSCC. This novel workflow has the potential to improve surgical precision and patient outcomes by providing rapid, label-free tissue differentiation.
Collapse
Affiliation(s)
- Ayman Bali
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Saskia Wolter
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Daniela Pelzel
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Ulrike Weyer
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge CB3 0FD, UK; (T.A.); (P.L.)
| | - Pietro Lio
- Department of Computer Science and Technology, University of Cambridge, Cambridge CB3 0FD, UK; (T.A.); (P.L.)
| | - Mussab Kouka
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Katharina Geißler
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Thomas Bitter
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Günther Ernst
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Anna Xylander
- Department of Pathology, Jena University Hospital, 453003 Jena, Germany;
| | - Nadja Ziller
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Anna Mühlig
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
- Comprehensive Cancer Center Central Germany, 07747 Jena, Germany
| | - Ferdinand von Eggeling
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - Orlando Guntinas-Lichius
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| | - David Pertzborn
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (S.W.); (D.P.); (U.W.); (M.K.); (K.G.); (T.B.); (G.E.); (N.Z.); (A.M.); (F.v.E.); (O.G.-L.)
| |
Collapse
|
2
|
Jong LJS, Veluponnar D, Geldof F, Sanders J, Guimaraes MDS, Vrancken Peeters MJTFD, van Duijnhoven F, Sterenborg HJCM, Dashtbozorg B, Ruers TJM. Toward real-time margin assessment in breast-conserving surgery with hyperspectral imaging. Sci Rep 2025; 15:9556. [PMID: 40108280 PMCID: PMC11923364 DOI: 10.1038/s41598-025-94526-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2024] [Accepted: 03/14/2025] [Indexed: 03/22/2025] Open
Abstract
Margin assessment in breast-conserving surgery (BSC) remains a critical challenge, with 20-25% of cases resulting in inadequate tumor resection, increasing the risk of local recurrence and the need for additional treatment. In this study, we evaluate the diagnostic performance of hyperspectral imaging (HSI) as a non-invasive technique for assessing resection margins in ex vivo lumpectomy specimens. A dataset of over 200 lumpectomy specimens was collected using two hyperspectral cameras, and a classification algorithm was developed to distinguish between healthy and tumor tissue within margins of 0 and 2 mm. The proposed approach achieved its highest diagnostic performance at a 0 mm margin, with a sensitivity of 92%, specificity of 78%, accuracy of 83%, Matthews correlation coefficient of 68%, and an area under the curve of 89%. The entire resection surface could be imaged and evaluated within 10 minutes, providing a rapid and non-invasive alternative to conventional margin assessment techniques. These findings represent a significant advancement toward real-time intraoperative margin assessment, highlighting the potential of HSI to enhance surgical precision and reduce re-excision rates in BCS.
Collapse
Affiliation(s)
- Lynn-Jade S Jong
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
- Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NB, The Netherlands
| | - Dinusha Veluponnar
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
- Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NB, The Netherlands
| | - Freija Geldof
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
| | - Joyce Sanders
- Department of Pathology, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
| | - Marcos Da Silva Guimaraes
- Department of Pathology, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
| | | | - Frederieke van Duijnhoven
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
| | - Henricus J C M Sterenborg
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
| | - Behdad Dashtbozorg
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands.
| | - Theo J M Ruers
- Image-Guided Surgery, Department of Surgery, Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam, 1066 CX, The Netherlands
- Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NB, The Netherlands
| |
Collapse
|
3
|
Bali A, Bitter T, Mafra M, Ballmaier J, Kouka M, Schneider G, Mühlig A, Ziller N, Werner T, von Eggeling F, Guntinas-Lichius O, Pertzborn D. Endoscopic In Vivo Hyperspectral Imaging for Head and Neck Tumor Surgeries Using a Medically Approved CE-Certified Camera with Rapid Visualization During Surgery. Cancers (Basel) 2024; 16:3785. [PMID: 39594741 PMCID: PMC11592278 DOI: 10.3390/cancers16223785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2024] [Revised: 11/06/2024] [Accepted: 11/08/2024] [Indexed: 11/28/2024] Open
Abstract
Background: In vivo visualization of malignant tumors remains the main challenge during head and neck cancer surgery. This can result in inadequate tumor margin assessment and incomplete tumor resection, adversely affecting patient outcomes. Hyperspectral imaging (HSI) is a promising approach to address this issue. However, its application in surgery has been limited by the lack of medically approved HSI devices compliant with MDR regulations, as well as challenges regarding the integration into the surgical workflow. Methods: In this feasibility study, we employed endoscopic HSI during surgery to visualize the tumor sites of 12 head and neck cancer patients. We optimized the HSI workflow to minimize time required during surgery and to reduce the adaptation period needed for surgeons to adjust to the new workflow. Additionally, we implemented data processing to enable real-time classification and visualization of HSI within the intraoperative setting. HSI evaluation was conducted using principal component analysis and k-means clustering, with this clustering validated through comparison with expert annotations. Results: Our complete HSI workflow requires two to three minutes, with each HSI measurement-including evaluation and visualization-taking less than 10 s, achieving an accuracy of 79%, sensitivity of 72%, and specificity of 84%. Medical personnel became proficient with the HSI system after two surgeries. Conclusions: This study presents an HSI workflow for in vivo tissue differentiation during head and neck cancer surgery, providing accurate and visually accessible results within minimal time. This approach enhances the in vivo evaluation of tumor margins, leading to more clear margins and, consequently, improved patient outcomes.
Collapse
Affiliation(s)
- Ayman Bali
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| | - Thomas Bitter
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (T.B.); (J.B.); (M.K.); (G.S.)
| | - Marcela Mafra
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| | - Jonas Ballmaier
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (T.B.); (J.B.); (M.K.); (G.S.)
| | - Mussab Kouka
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (T.B.); (J.B.); (M.K.); (G.S.)
| | - Gerlind Schneider
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (T.B.); (J.B.); (M.K.); (G.S.)
| | - Anna Mühlig
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
- Comprehensive Cancer Center Central Germany, 07747 Jena, Germany
| | - Nadja Ziller
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| | - Theresa Werner
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| | - Ferdinand von Eggeling
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| | - Orlando Guntinas-Lichius
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (T.B.); (J.B.); (M.K.); (G.S.)
| | - David Pertzborn
- Clinical Biophotonics & MALDI Imaging, Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany; (A.B.); (M.M.); (A.M.); (N.Z.); (T.W.); (F.v.E.); (O.G.-L.)
| |
Collapse
|
4
|
Pertzborn D, Bali A, Mühlig A, von Eggeling F, Guntinas-Lichius O. Hyperspectral imaging and evaluation of surgical margins: where do we stand? Curr Opin Otolaryngol Head Neck Surg 2024; 32:96-104. [PMID: 38193544 DOI: 10.1097/moo.0000000000000957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
PURPOSE OF REVIEW To highlight the recent literature on the use of hyperspectral imaging (HSI) for cancer margin evaluation ex vivo, for head and neck cancer pathology and in vivo during head and neck cancer surgery. RECENT FINDINGS HSI can be used ex vivo on unstained and stained tissue sections to analyze head and neck tissue and tumor cells in combination with machine learning approaches to analyze head and neck cancer cell characteristics and to discriminate the tumor border from normal tissue. Data on in vivo applications during head and neck cancer surgery are preliminary and limited. Even now an accuracy of 80% for tumor versus nonneoplastic tissue classification can be achieved for certain tasks, within the current in vivo settings. SUMMARY Significant progress has been made to introduce HSI for ex vivo head and neck cancer pathology evaluation and for an intraoperative use to define the tumor margins. To optimize the accuracy for in vivo use, larger HSI databases with annotations for head and neck cancer are needed.
Collapse
Affiliation(s)
- David Pertzborn
- Department of Otorhinolaryngology, Jena University Hospital, Jena, Germany
| | | | | | | | | |
Collapse
|
5
|
Bekedam NM, Karssemakers LHE, van Alphen MJA, van Veen RLP, Smeele LE, Karakullukcu MB. Comparison of image quality of 3D ultrasound: motorized acquisition versus freehand navigated acquisition, a phantom study. Int J Comput Assist Radiol Surg 2023; 18:1649-1663. [PMID: 37243918 PMCID: PMC10491552 DOI: 10.1007/s11548-023-02934-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 04/21/2023] [Indexed: 05/29/2023]
Abstract
PURPOSE Intra-operative assessment of resection margins during oncological surgery is a field that needs improvement. Ultrasound (US) shows the potential to fulfill this need, but this imaging technique is highly operator-dependent. A 3D US image of the whole specimen may remedy the operator dependence. This study aims to compare and evaluate the image quality of 3D US between freehand acquisition (FA) and motorized acquisition (MA). METHODS Multiple 3D US volumes of a commercial phantom were acquired in motorized and freehand fashion. FA images were collected with electromagnetic navigation. An integrated algorithm reconstructed the FA images. MA images were stacked into a 3D volume. The image quality is evaluated following the metrics: contrast resolution, axial and elevation resolution, axial and elevation distance calibration, stability, inter-operator variability, and intra-operator variability. A linear mixed model determined statistical differences between FA and MA for these metrics. RESULTS The MA results in a statistically significant lower error of axial distance calibration (p < 0.0001) and higher stability (p < 0.0001) than FA. On the other hand, the FA has a better elevation resolution (p < 0.003) than the MA. CONCLUSION MA results in better image quality of 3D US than the FA method based on axial distance calibration, stability, and variability. This study suggests acquiring 3D US volumes for intra-operative ex vivo margin assessment in a motorized fashion.
Collapse
Affiliation(s)
- N M Bekedam
- Department of Head and Neck Surgery and Oncology, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands.
- Academic Centre of Dentistry Amsterdam, Vrije Universiteit, Gustav Mahlerlaan 3004, 1081 LA, Amsterdam, The Netherlands.
| | - L H E Karssemakers
- Department of Head and Neck Surgery and Oncology, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - M J A van Alphen
- Department of Head and Neck Surgery and Oncology, Verwelius 3D Lab, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Amsterdam, The Netherlands
| | - R L P van Veen
- Department of Head and Neck Surgery and Oncology, Verwelius 3D Lab, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Amsterdam, The Netherlands
| | - L E Smeele
- Department of Head and Neck Surgery and Oncology, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - M B Karakullukcu
- Department of Head and Neck Surgery and Oncology, Netherlands Cancer Institute, Antoni van Leeuwenhoek, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| |
Collapse
|
6
|
Kolpakov AV, Moshkova AA, Melikhova EV, Sokolova DY, Muravskaya NP, Samorodov AV, Kopaneva NO, Lukina GI, Abramova MY, Mamatsashvili VG, Parshkov VV. Diffuse Reflectance Spectroscopy of the Oral Mucosa: In Vivo Experimental Validation of the Precancerous Lesions Early Detection Possibility. Diagnostics (Basel) 2023; 13:diagnostics13091633. [PMID: 37175023 PMCID: PMC10177876 DOI: 10.3390/diagnostics13091633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 04/28/2023] [Accepted: 05/03/2023] [Indexed: 05/15/2023] Open
Abstract
This article is devoted to the experimental validation of the possibility of early detection of precancerous lesions in the oral mucosa in vivo using diffuse reflectance spectroscopy in the wavelength range from 360 to 1000 nm. During the study, a sample of 119 patients with precancerous lesions has been collected and analyzed. As a result of the analysis, the most informative wavelength ranges were determined, in which the maximum differences in the backscattering spectra of lesions and intact tissues were observed, methods for automatic classification of backscattering spectra of the oral mucosa were studied, sensitivity and specificity values, achievable using diffuse reflectance spectroscopy for detecting hyperkeratosis on the tongue ventrolateral mucosa surface and buccal mucosa, were evaluated. As a result of preliminary experimental studies in vivo, the possibility of automatic detection of precancerous lesions of the oral mucosa surface using diffuse reflectance spectroscopy in the wavelength range from 500 to 900 nm with an accuracy of at least 75 percent has been shown.
Collapse
Affiliation(s)
- Alexander V Kolpakov
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Anastasia A Moshkova
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Ekaterina V Melikhova
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Diana Yu Sokolova
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Natalia P Muravskaya
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Andrey V Samorodov
- Faculty of Biomedical Engineering, Bauman Moscow State Technical University, Moscow 105005, Russia
| | - Nina O Kopaneva
- Department of Therapeutic Dentistry and Diseases of the Oral Mucosa, Moscow State University of Medicine and Dentistry, Moscow 127473, Russia
| | - Galina I Lukina
- Department of Therapeutic Dentistry and Diseases of the Oral Mucosa, Moscow State University of Medicine and Dentistry, Moscow 127473, Russia
| | - Marina Ya Abramova
- Department of Therapeutic Dentistry and Diseases of the Oral Mucosa, Moscow State University of Medicine and Dentistry, Moscow 127473, Russia
| | - Veta G Mamatsashvili
- Department of Therapeutic Dentistry and Diseases of the Oral Mucosa, Moscow State University of Medicine and Dentistry, Moscow 127473, Russia
| | - Vadim V Parshkov
- Department of Therapeutic Dentistry and Diseases of the Oral Mucosa, Moscow State University of Medicine and Dentistry, Moscow 127473, Russia
| |
Collapse
|
7
|
Deep-Learning-Based Automated Identification and Visualization of Oral Cancer in Optical Coherence Tomography Images. Biomedicines 2023; 11:biomedicines11030802. [PMID: 36979780 PMCID: PMC10044902 DOI: 10.3390/biomedicines11030802] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 02/15/2023] [Accepted: 03/04/2023] [Indexed: 03/09/2023] Open
Abstract
Early detection and diagnosis of oral cancer are critical for a better prognosis, but accurate and automatic identification is difficult using the available technologies. Optical coherence tomography (OCT) can be used as diagnostic aid due to the advantages of high resolution and non-invasion. We aim to evaluate deep-learning-based algorithms for OCT images to assist clinicians in oral cancer screening and diagnosis. An OCT data set was first established, including normal mucosa, precancerous lesion, and oral squamous cell carcinoma. Then, three kinds of convolutional neural networks (CNNs) were trained and evaluated by using four metrics (accuracy, precision, sensitivity, and specificity). Moreover, the CNN-based methods were compared against machine learning approaches through the same dataset. The results show the performance of CNNs, with a classification accuracy of up to 96.76%, is better than the machine-learning-based method with an accuracy of 92.52%. Moreover, visualization of lesions in OCT images was performed and the rationality and interpretability of the model for distinguishing different oral tissues were evaluated. It is proved that the automatic identification algorithm of OCT images based on deep learning has the potential to provide decision support for the effective screening and diagnosis of oral cancer.
Collapse
|
8
|
Wang C, Hodge S, Ravi D, Chen EY, Hoopes PJ, Tichauer KM, Samkoe KS. Rapid and Quantitative Intraoperative Pathology-Assisted Surgery by Paired-Agent Imaging-Derived Confidence Map. Mol Imaging Biol 2023; 25:190-202. [PMID: 36315374 PMCID: PMC11841742 DOI: 10.1007/s11307-022-01780-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 10/04/2022] [Accepted: 10/05/2022] [Indexed: 02/03/2023]
Abstract
PURPOSE In nonmetastatic head and neck cancer treatment, surgical margin status is the most important prognosticator of recurrence and patient survival. Fresh frozen sectioning (FFS) of tissue margins is the standard of care for intraoperative margin assessment. However, FFS is time intensive, and its accuracy is not consistent among institutes. Mapping the epidermal growth factor receptor (EGFR) using paired-agent imaging (PAI) has the potential to provide more consistent intraoperative margin assessment in a fraction of the time as FFS. PROCEDURES PAI was carried out through IV injection of an anti-epidermal growth factor receptor (EGFR) affibody molecule (ABY-029, eIND 122,681) and an untargeted IRDye680LT carboxylate. Imaging was performed on 4 µm frozen sections from three oral squamous cell carcinoma xenograft mouse models (n = 24, 8 samples per cell line). The diagnostic ability and tumor contrast were compared between binding potential, targeted, and untargeted images. Confidence maps were constructed based on group histogram-derived tumor probability curves. Tumor differentiability and contrast by confidence maps were evaluated. RESULTS PAI outperformed ABY-029 and IRDye 680LT alone, demonstrating the highest individual receiver operating characteristic (ROC) curve area under the curve (PAI AUC: 0.91, 0.90, and 0.79) and contrast-to-noise ratio (PAI CNR: 1, 1.1, and 0.6) for FaDu, Det 562, and A253. PAI confidence maps (PAI CM) maintain high tumor diagnostic ability (PAI CMAUC: 0.91, 0.90, and 0.79) while significantly enhancing tumor contrast (PAI CMCNR: 1.5, 1.3, and 0.8) in FaDu, Det 562, and A253. Additionally, the PAI confidence map allows avascular A253 to be differentiated from a healthy tissue with significantly higher contrast than PAI. Notably, PAI does not require additional staining and therefore significantly reduces the tumor delineation time in a 5 [Formula: see text] 5 mm slice from ~ 35 min to under a minute. CONCLUSION This study demonstrated that PAI improved tumor detection in frozen sections with high diagnostic accuracy and rapid analysis times. The novel PAI confidence map improved the contrast in vascular tumors and differentiability in avascular tumors. With a larger database, the PAI confidence map promises to standardize fluorescence imaging in intraoperative pathology-assisted surgery (IPAS).
Collapse
Affiliation(s)
- Cheng Wang
- Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
| | - Sassan Hodge
- Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
| | - Divya Ravi
- Geisel School of Medicine, Dartmouth College, Hanover, NH, USA
| | - Eunice Y Chen
- Department of Surgery, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
- Geisel School of Medicine, Dartmouth College, Hanover, NH, USA
| | - P Jack Hoopes
- Thayer School of Engineering, Dartmouth College, Hanover, NH, USA
- Department of Surgery, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
- Geisel School of Medicine, Dartmouth College, Hanover, NH, USA
| | - Kenneth M Tichauer
- Biomedical Engineering, Illinois Institute of Technology, Chicago, IL, USA
| | - Kimberley S Samkoe
- Thayer School of Engineering, Dartmouth College, Hanover, NH, USA.
- Department of Surgery, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA.
- Geisel School of Medicine, Dartmouth College, Hanover, NH, USA.
| |
Collapse
|
9
|
Mathiesen T, Haslund-Vinding J, Skjøth-Rasmussen J, Poulsgaard L, Fugleholm K, Mirian C, Daniela Maier A, Santarius T, Rom Poulsen F, Andrée Larsen V, Winther Kristensen B, Scheie D, Law I, Ziebell M. Letter to the Editor. Copenhagen grading of meningioma. J Neurosurg 2022; 136:1506-1508. [PMID: 35061983 DOI: 10.3171/2021.10.jns204467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Tiit Mathiesen
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
- 2University of Copenhagen, Denmark
- 3Karolinska Institutet, Stockholm, Sweden
| | | | - Jane Skjøth-Rasmussen
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
- 2University of Copenhagen, Denmark
| | - Lars Poulsgaard
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | - Kåre Fugleholm
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
- 2University of Copenhagen, Denmark
| | - Christian Mirian
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | | | - Thomas Santarius
- 4Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Frantz Rom Poulsen
- 5Odense University Hospital, Clinical Institute, University of Southern Denmark, Odense, Denmark
- 6BRIDGE-Brain Research Inter Disciplinary Guided Excellence, Clinical Institute, University of Southern Denmark, Odense, Denmark
| | | | - Bjarne Winther Kristensen
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
- 2University of Copenhagen, Denmark
| | - David Scheie
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | - Ian Law
- 7Nuclear Medicine and PET, Copenhagen University Hospital, Copenhagen, Denmark
| | - Morten Ziebell
- 1Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| |
Collapse
|
10
|
Noorlag R, de Bree R, Witjes MJH. Image-guided surgery in oral cancer: toward improved margin control. Curr Opin Oncol 2022; 34:170-176. [PMID: 35256552 DOI: 10.1097/cco.0000000000000824] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE OF REVIEW The aim of this review is to discuss recent studies on the assessment of tumor extension and resection margins by different intraoperative techniques allowing for image-guided surgery of oral cancer. RECENT FINDINGS There are different in-vivo and ex-vivo intraoperative techniques to improve margin control of which intraoperative ultrasound and targeted fluorescence-guided resections have high potential clinical value and are closest to clinical implementation. SUMMARY In oral cancer surgery, resection margins, particularly deep margins, are often inadequate. Intraoperative frozen section does not improve resection margin control sufficiently. Specimen-driven intraoperative assessment for gross analysis of suspected margins reduces the amount of positive resection margins substantially but leaves still room for improvement. Mucosal staining methods, optical coherence tomography and narrow band imaging can only be used for superficial (mucosal) resection margin control. Spectroscopy is under investigation, but clinical data are scarce. Intraoperative ex-vivo imaging of the resection specimen by magnetic resonance and PET/computed tomography may be used to assess resection margins but needs more research. Intraoperative in-vivo ad ex-vivo ultrasound and targeted fluorescence imaging have high potential clinical value to guide oral cancer resections and are closest to clinical implementation for improved margin control.
Collapse
Affiliation(s)
- Rob Noorlag
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Utrecht
| | - Remco de Bree
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Utrecht
| | - Max J H Witjes
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
11
|
Voskuil FJ, Vonk J, van der Vegt B, Kruijff S, Ntziachristos V, van der Zaag PJ, Witjes MJH, van Dam GM. Intraoperative imaging in pathology-assisted surgery. Nat Biomed Eng 2022; 6:503-514. [PMID: 34750537 DOI: 10.1038/s41551-021-00808-8] [Citation(s) in RCA: 51] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2019] [Accepted: 06/17/2021] [Indexed: 12/12/2022]
Abstract
The pathological assessment of surgical specimens during surgery can reduce the incidence of positive resection margins, which otherwise can result in additional surgeries or aggressive therapeutic regimens. To improve patient outcomes, intraoperative spectroscopic, fluorescence-based, structural, optoacoustic and radiological imaging techniques are being tested on freshly excised tissue. The specific clinical setting and tumour type largely determine whether endogenous or exogenous contrast is to be detected and whether the tumour specificity of the detected biomarker, image resolution, image-acquisition times or penetration depth are to be prioritized. In this Perspective, we describe current clinical standards for intraoperative tissue analysis and discuss how intraoperative imaging is being implemented. We also discuss potential implementations of intraoperative pathology-assisted surgery for clinical decision-making.
Collapse
Affiliation(s)
- Floris J Voskuil
- Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.,Department of Pathology and Medical Biology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Jasper Vonk
- Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Bert van der Vegt
- Department of Pathology and Medical Biology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Schelto Kruijff
- Department of Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Vasilis Ntziachristos
- Chair for Biological Imaging, Center for Translational Cancer Research, Technical University of Munich, Klinikum rechts der Isar, Munich, Germany.,Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Pieter J van der Zaag
- Phillips Research Laboratories, Eindhoven, The Netherlands.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.,Molecular Biophysics, Zernike Institute, University of Groningen, Groningen, The Netherlands
| | - Max J H Witjes
- Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Gooitzen M van Dam
- Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands. .,AxelaRx/TRACER BV, Groningen, The Netherlands.
| |
Collapse
|
12
|
Courtenay LA, González-Aguilera D, Lagüela S, Pozo SD, Ruiz C, Barbero-García I, Román-Curto C, Cañueto J, Santos-Durán C, Cardeñoso-Álvarez ME, Roncero-Riesco M, Hernández-López D, Guerrero-Sevilla D, Rodríguez-Gonzalvez P. Deep Convolutional Neural Support Vector Machines for the Classification of Basal Cell Carcinoma Hyperspectral Signatures. J Clin Med 2022; 11:2315. [PMID: 35566440 PMCID: PMC9102335 DOI: 10.3390/jcm11092315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 04/18/2022] [Accepted: 04/19/2022] [Indexed: 11/17/2022] Open
Abstract
Non-melanoma skin cancer, and basal cell carcinoma in particular, is one of the most common types of cancer. Although this type of malignancy has lower metastatic rates than other types of skin cancer, its locally destructive nature and the advantages of its timely treatment make early detection vital. The combination of multispectral imaging and artificial intelligence has arisen as a powerful tool for the detection and classification of skin cancer in a non-invasive manner. The present study uses hyperspectral images to discern between healthy and basal cell carcinoma hyperspectral signatures. Upon the combined use of convolutional neural networks, with a final support vector machine activation layer, the present study reaches up to 90% accuracy, with an area under the receiver operating characteristic curve being calculated at 0.9 as well. While the results are promising, future research should build upon a dataset with a larger number of patients.
Collapse
Affiliation(s)
- Lloyd A. Courtenay
- Department of Cartographic and Terrain Engineering, Higher Polytechnic School of Ávila, University of Salamanca, Hornos Caleros 50, 05003 Ávila, Spain; (D.G.-A.); (S.L.); (S.D.P.); (I.B.-G.)
| | - Diego González-Aguilera
- Department of Cartographic and Terrain Engineering, Higher Polytechnic School of Ávila, University of Salamanca, Hornos Caleros 50, 05003 Ávila, Spain; (D.G.-A.); (S.L.); (S.D.P.); (I.B.-G.)
| | - Susana Lagüela
- Department of Cartographic and Terrain Engineering, Higher Polytechnic School of Ávila, University of Salamanca, Hornos Caleros 50, 05003 Ávila, Spain; (D.G.-A.); (S.L.); (S.D.P.); (I.B.-G.)
| | - Susana Del Pozo
- Department of Cartographic and Terrain Engineering, Higher Polytechnic School of Ávila, University of Salamanca, Hornos Caleros 50, 05003 Ávila, Spain; (D.G.-A.); (S.L.); (S.D.P.); (I.B.-G.)
| | - Camilo Ruiz
- Department of Didactics of Mathematics and Experimental Sciences, Faculty of Education, Paseo de Canaleja 169, 37008 Salamanca, Spain;
| | - Innes Barbero-García
- Department of Cartographic and Terrain Engineering, Higher Polytechnic School of Ávila, University of Salamanca, Hornos Caleros 50, 05003 Ávila, Spain; (D.G.-A.); (S.L.); (S.D.P.); (I.B.-G.)
| | - Concepción Román-Curto
- Department of Dermatology, University Hospital of Spain, Paseo de San Vicente 58-182, 37007 Salamanca, Spain; (C.R.-C.); (J.C.); (C.S.-D.); (M.E.C.-Á.); (M.R.-R.)
- Instituto de Investigación Biomédica de Salamanca (IBSAL), Paseo de San Vicente 58-182, 37007 Salamanca, Spain
| | - Javier Cañueto
- Department of Dermatology, University Hospital of Spain, Paseo de San Vicente 58-182, 37007 Salamanca, Spain; (C.R.-C.); (J.C.); (C.S.-D.); (M.E.C.-Á.); (M.R.-R.)
- Instituto de Investigación Biomédica de Salamanca (IBSAL), Paseo de San Vicente 58-182, 37007 Salamanca, Spain
- Institute of Molecular Biology and Cellular Cancer (IBMCC), Centre of Cancer Investigation (Lab 7), Campus Miguel de Unamuno s/n, 37007 Salamanca, Spain
| | - Carlos Santos-Durán
- Department of Dermatology, University Hospital of Spain, Paseo de San Vicente 58-182, 37007 Salamanca, Spain; (C.R.-C.); (J.C.); (C.S.-D.); (M.E.C.-Á.); (M.R.-R.)
| | - María Esther Cardeñoso-Álvarez
- Department of Dermatology, University Hospital of Spain, Paseo de San Vicente 58-182, 37007 Salamanca, Spain; (C.R.-C.); (J.C.); (C.S.-D.); (M.E.C.-Á.); (M.R.-R.)
| | - Mónica Roncero-Riesco
- Department of Dermatology, University Hospital of Spain, Paseo de San Vicente 58-182, 37007 Salamanca, Spain; (C.R.-C.); (J.C.); (C.S.-D.); (M.E.C.-Á.); (M.R.-R.)
| | - David Hernández-López
- Institute for Regional Development, University of Castilla la Mancha, Campus Universitario s/n, 02071 Albacete, Spain; (D.H.-L.); (D.G.-S.)
| | - Diego Guerrero-Sevilla
- Institute for Regional Development, University of Castilla la Mancha, Campus Universitario s/n, 02071 Albacete, Spain; (D.H.-L.); (D.G.-S.)
| | - Pablo Rodríguez-Gonzalvez
- Department of Mining Technology, Topography and Structures, University of León, Av. Astorga s/n, 24401 Ponferrada, Spain;
| |
Collapse
|
13
|
van Vliet-Pérez SM, van de Berg NJ, Manni F, Lai M, Rijstenberg L, Hendriks BHW, Dankelman J, Ewing-Graham PC, Nieuwenhuyzen-de Boer GM, van Beekhuizen HJ. Hyperspectral Imaging for Tissue Classification after Advanced Stage Ovarian Cancer Surgery-A Pilot Study. Cancers (Basel) 2022; 14:cancers14061422. [PMID: 35326577 PMCID: PMC8946803 DOI: 10.3390/cancers14061422] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 02/24/2022] [Accepted: 03/08/2022] [Indexed: 02/05/2023] Open
Abstract
The most important prognostic factor for the survival of advanced-stage epithelial ovarian cancer (EOC) is the completeness of cytoreductive surgery (CRS). Therefore, an intraoperative technique to detect microscopic tumors would be of great value. The aim of this pilot study is to assess the feasibility of near-infrared hyperspectral imaging (HSI) for EOC detection in ex vivo tissue samples. Images were collected during CRS in 11 patients in the wavelength range of 665−975 nm, and processed by calibration, normalization, and noise filtering. A linear support vector machine (SVM) was employed to classify healthy and tumorous tissue (defined as >50% tumor cells). Classifier performance was evaluated using leave-one-out cross-validation. Images of 26 tissue samples from 10 patients were included, containing 26,446 data points that were matched to histopathology. Tumorous tissue could be classified with an area under the curve of 0.83, a sensitivity of 0.81, a specificity of 0.70, and Matthew’s correlation coefficient of 0.41. This study paves the way to in vivo and intraoperative use of HSI during CRS. Hyperspectral imaging can scan a whole tissue surface in a fast and non-contact way. Our pilot study demonstrates that HSI and SVM learning can be used to discriminate EOC from surrounding tissue.
Collapse
Affiliation(s)
- Sharline M. van Vliet-Pérez
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands
- Correspondence:
| | - Nick J. van de Berg
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
| | - Francesca Manni
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (F.M.); (M.L.)
| | - Marco Lai
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (F.M.); (M.L.)
| | - Lucia Rijstenberg
- Department of Pathology, Erasmus University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (L.R.); (P.C.E.-G.)
| | - Benno H. W. Hendriks
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
| | - Jenny Dankelman
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
| | - Patricia C. Ewing-Graham
- Department of Pathology, Erasmus University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (L.R.); (P.C.E.-G.)
| | - Gatske M. Nieuwenhuyzen-de Boer
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
- Department of Gynecology, Albert Schweitzer Hospital, 3318 AT Dordrecht, The Netherlands
| | - Heleen J. van Beekhuizen
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
| |
Collapse
|
14
|
Proposal of a new grading system for meningioma resection: the Copenhagen Protocol. Acta Neurochir (Wien) 2022; 164:229-238. [PMID: 34714434 DOI: 10.1007/s00701-021-05025-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 10/12/2021] [Indexed: 12/19/2022]
Abstract
INTRODUCTION The extent of meningioma resection is the most fundamental risk factor for recurrence, and exact knowledge of extent of resection is necessary for prognostication and for planning of adjuvant treatment. Currently used classifications are the EANO-grading and the Simpson grading. The former comprises radiological imaging with contrast-enhanced MRI and differentiation between "gross total removal" and "subtotal removal," while the latter comprises a five-tiered differentiation of the surgeon's impression of the extent of resection. The extent of resection of tumors is usually defined via analyses of resection margins but has until now not been implemented for meningiomas. PET/MRI imaging with 68Ga-DOTATOC allows more sensitive and specific imaging than MRI following surgery of meningiomas. OBJECTIVE To develop an objective grading system based on microscopic analyses of resection margins and sensitive radiological analyses to improve management of follow-up, adjuvant therapy, and prognostication of meningiomas. Based on the rationale of resection-margin analyses as gold standard and superior imaging performance of 68Ga DOTATOC PET, we propose "Copenhagen Grading" for meningiomas. RESULTS Copenhagen Grading was described for six pilot patients with examples of positive and negative findings on histopathology and DOTATOC PET scanning. The grading could be traceably implemented and parameters of grading appeared complementary. Copenhagen Grading is prospectively implemented as a clinical standard at Rigshospitalet, Copenhagen. CONCLUSION Copenhagen Grading provided a comprehensive, logical, and reproducible definition of the extent of resection. It offers promise to be the most sensitive and specific imaging modality available for meningiomas. Clinical and cost-efficacy remain to be established during prospective implementation.
Collapse
|
15
|
Yang Z, Shang J, Liu C, Zhang J, Liang Y. Identification of oral precancerous and cancerous tissue by swept source optical coherence tomography. Lasers Surg Med 2021; 54:320-328. [PMID: 34342365 DOI: 10.1002/lsm.23461] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/11/2021] [Indexed: 12/11/2022]
Abstract
BACKGROUND AND OBJECTIVES Distinguishing cancer from precancerous lesions is critical and challenging in oral medicine. As a noninvasive method, optical coherence tomography (OCT) has the advantages of real-time, in vivo, and large-depth imaging. Texture information hidden in OCT images can provide an important auxiliary effect for improving diagnostic accuracy. The aim of this study is to explore a reliable and accurate OCT-based method for the screening and diagnosis of human oral diseases, especially oral cancer. MATERIALS AND METHODS Fresh ex vivo oral tissues including normal mucosa, leukoplakia with epithelial hyperplasia (LEH), and oral squamous cell carcinoma (OSCC) were imaged intraoperatively by a homemade OCT system, and 58 texture features were extracted to create computational models of these tissues. A principal component analysis algorithm was employed to optimize the combination of texture feature vectors. The identification based on artificial neural network (ANN) was proposed and the sensitivity/specificity was calculated statistically to evaluate the classification performance. RESULTS A total of 71 sites of three types of oral tissues were measured, and 5176 OCT images of three types of oral tissues were used in this study. The superior classification result based on ANN was obtained with an average accuracy of 98.17%. The sensitivity and specificity of normal mucosa, LEH, and OSCC are 98.17% / 98.38%, 93.81% / 98.54%, and 98.11% / 99.04%, respectively. CONCLUSION It is demonstrated from the high accuracies, sensitivities, and specificities that texture-based analysis can be used to identify oral precancerous and cancerous tissue in OCT images, and it has the potential to help surgeons in diseases screening and diagnosis effectively.
Collapse
Affiliation(s)
- Zihan Yang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-Scale Optical Information Science and Technology, Tianjin, China
| | - Jianwei Shang
- Department of Oral Pathology, Tianjin Stomatological Hospital, Hospital of Stomatology, Nankai University, Tianjin, China
| | - Chenlu Liu
- Department of Oral Medicine, Tianjin Stomatological Hospital, Hospital of Stomatology, Nankai University, Tianjin, China
| | - Jun Zhang
- Department of Oral-Maxillofacial Surgery, Tianjin Stomatological Hospital, Hospital of Stomatology, Nankai University, Tianjin, China
| | - Yanmei Liang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-Scale Optical Information Science and Technology, Tianjin, China
| |
Collapse
|
16
|
Courtenay LA, González-Aguilera D, Lagüela S, del Pozo S, Ruiz-Mendez C, Barbero-García I, Román-Curto C, Cañueto J, Santos-Durán C, Cardeñoso-Álvarez ME, Roncero-Riesco M, Hernandez-Lopez D, Guerrero-Sevilla D, Rodríguez-Gonzalvez P. Hyperspectral imaging and robust statistics in non-melanoma skin cancer analysis. BIOMEDICAL OPTICS EXPRESS 2021; 12:5107-5127. [PMID: 34513245 PMCID: PMC8407807 DOI: 10.1364/boe.428143] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 06/21/2021] [Accepted: 06/28/2021] [Indexed: 05/31/2023]
Abstract
Non-Melanoma skin cancer is one of the most frequent types of cancer. Early detection is encouraged so as to ensure the best treatment, Hyperspectral imaging is a promising technique for non-invasive inspection of skin lesions, however, the optimal wavelengths for these purposes are yet to be conclusively determined. A visible-near infrared hyperspectral camera with an ad-hoc built platform was used for image acquisition in the present study. Robust statistical techniques were used to conclude an optimal range between 573.45 and 779.88 nm to distinguish between healthy and non-healthy skin. Wavelengths between 429.16 and 520.17 nm were additionally found to be optimal for the differentiation between cancer types.
Collapse
Affiliation(s)
- Lloyd A. Courtenay
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Diego González-Aguilera
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Susana Lagüela
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Susana del Pozo
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Camilo Ruiz-Mendez
- Department of Didactics of Mathematics and
Experimental Sciences, Faculty of
Education, Paseo de Canaleja 169, 37008, Salamanca,
Spain
| | - Inés Barbero-García
- Department of Cartographic and Terrain
Engineering, Higher Polytechnic School of Ávila,
University of Salamanca, Hornos Caleros 50,
05003 Ávila, Spain
| | - Concepción Román-Curto
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
- Instituto de
Investigación Biomédica de Salamanca
(IBSAL), Paseo de San Vicente, 58-182, 37007 Salamanca,
Spain
| | - Javier Cañueto
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
- Instituto de
Investigación Biomédica de Salamanca
(IBSAL), Paseo de San Vicente, 58-182, 37007 Salamanca,
Spain
- Instituto de Biología
Molecular y Celular del Cáncer (IBMCC)/Centro de
Investigación del Cáncer (lab 7). Campus
Miguel de Unamuno s/n. 37007 Salamanca, Spain
| | - Carlos Santos-Durán
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
| | | | - Mónica Roncero-Riesco
- Department of Dermatology,
University Hospital of Spain, Paseo de San
Vicente 58-182, 37007, Salamanca, Spain
| | - David Hernandez-Lopez
- Institute for Regional Development,
University of Castilla la Mancha, Campus
Universitario s/n, 02071, Albacete, Spain
| | - Diego Guerrero-Sevilla
- Institute for Regional Development,
University of Castilla la Mancha, Campus
Universitario s/n, 02071, Albacete, Spain
| | - Pablo Rodríguez-Gonzalvez
- Department of Mining Technology, Topography
and Structures, University of León,
Ponferrada, Léon, Spain
| |
Collapse
|
17
|
Brouwer de Koning SG, Schaeffers AWMA, Schats W, van den Brekel MWM, Ruers TJM, Karakullukcu MB. Assessment of the deep resection margin during oral cancer surgery: A systematic review. Eur J Surg Oncol 2021; 47:2220-2232. [PMID: 33895027 DOI: 10.1016/j.ejso.2021.04.016] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 04/13/2021] [Indexed: 12/14/2022] Open
Abstract
The main challenge for radical resection in oral cancer surgery is to obtain adequate resection margins. Especially the deep margin, which can only be estimated based on palpation during surgery, is often reported inadequate. To increase the percentage of radical resections, there is a need for a quick, easy, minimal invasive method, which assesses the deep resection margin without interrupting or prolonging surgery. This systematic review provides an overview of technologies that are currently being studied with the aim of fulfilling this demand. A literature search was conducted through the databases Medline, Embase and the Cochrane Library. A total of 62 studies were included. The results were categorized according to the type of technique: 'Frozen Section Analysis', 'Fluorescence', 'Optical Imaging', 'Conventional imaging techniques', and 'Cytological assessment'. This systematic review gives for each technique an overview of the reported performance (accuracy, sensitivity, specificity, positive predictive value, negative predictive value, or a different outcome measure), acquisition time, and sampling depth. At the moment, the most prevailing technique remains frozen section analysis. In the search for other assessment methods to evaluate the deep resection margin, some technologies are very promising for future use when effectiveness has been shown in larger trials, e.g., fluorescence (real-time, sampling depth up to 6 mm) or optical techniques such as hyperspectral imaging (real-time, sampling depth few mm) for microscopic margin assessment and ultrasound (less than 10 min, sampling depth several cm) for assessment on a macroscopic scale.
Collapse
Affiliation(s)
- S G Brouwer de Koning
- Department of Head and Neck Surgery and Oncology, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands.
| | - A W M A Schaeffers
- Department of Head and Neck Surgery and Oncology, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands
| | - W Schats
- Scientific Information Service, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands
| | - M W M van den Brekel
- Department of Head and Neck Surgery and Oncology, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands
| | - T J M Ruers
- Department of Surgical Oncology, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands; Faculty of Science and Technology, University of Twente, Enschede, the Netherlands
| | - M B Karakullukcu
- Department of Head and Neck Surgery and Oncology, Antoni van Leeuwenhoek, Netherlands Cancer Institute, Amsterdam, the Netherlands
| |
Collapse
|
18
|
Takamatsu T, Kitagawa Y, Akimoto K, Iwanami R, Endo Y, Takashima K, Okubo K, Umezawa M, Kuwata T, Sato D, Kadota T, Mitsui T, Ikematsu H, Yokota H, Soga K, Takemura H. Over 1000 nm Near-Infrared Multispectral Imaging System for Laparoscopic In Vivo Imaging. SENSORS (BASEL, SWITZERLAND) 2021; 21:2649. [PMID: 33918935 PMCID: PMC8069262 DOI: 10.3390/s21082649] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 04/01/2021] [Accepted: 04/06/2021] [Indexed: 01/17/2023]
Abstract
In this study, a laparoscopic imaging device and a light source able to select wavelengths by bandpass filters were developed to perform multispectral imaging (MSI) using over 1000 nm near-infrared (OTN-NIR) on regions under a laparoscope. Subsequently, MSI (wavelengths: 1000-1400 nm) was performed using the built device on nine live mice before and after tumor implantation. The normal and tumor pixels captured within the mice were used as teaching data sets, and the tumor-implanted mice data were classified using a neural network applied following a leave-one-out cross-validation procedure. The system provided a specificity of 89.5%, a sensitivity of 53.5%, and an accuracy of 87.8% for subcutaneous tumor discrimination. Aggregated true-positive (TP) pixels were confirmed in all tumor-implanted mice, which indicated that the laparoscopic OTN-NIR MSI could potentially be applied in vivo for classifying target lesions such as cancer in deep tissues.
Collapse
Affiliation(s)
- Toshihiro Takamatsu
- Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba 277-8577, Japan;
- Research Institute for Biomedical Sciences, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.S.); (H.T.)
| | - Yuichi Kitagawa
- Department of Materials Science and Technology, Tokyo University of Science, Katsushika, Tokyo 162-8601, Japan; (Y.K.); (R.I.); (K.O.); (M.U.)
| | - Kohei Akimoto
- Department of Mechanical Engineering, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.A.); (Y.E.)
| | - Ren Iwanami
- Department of Materials Science and Technology, Tokyo University of Science, Katsushika, Tokyo 162-8601, Japan; (Y.K.); (R.I.); (K.O.); (M.U.)
| | - Yuto Endo
- Department of Mechanical Engineering, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.A.); (Y.E.)
| | - Kenji Takashima
- Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan; (K.T.); (D.S.); (T.K.); (T.M.)
| | - Kyohei Okubo
- Department of Materials Science and Technology, Tokyo University of Science, Katsushika, Tokyo 162-8601, Japan; (Y.K.); (R.I.); (K.O.); (M.U.)
| | - Masakazu Umezawa
- Department of Materials Science and Technology, Tokyo University of Science, Katsushika, Tokyo 162-8601, Japan; (Y.K.); (R.I.); (K.O.); (M.U.)
| | - Takeshi Kuwata
- Department of Pathology and Clinical Laboratories, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan;
| | - Daiki Sato
- Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan; (K.T.); (D.S.); (T.K.); (T.M.)
| | - Tomohiro Kadota
- Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan; (K.T.); (D.S.); (T.K.); (T.M.)
| | - Tomohiro Mitsui
- Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan; (K.T.); (D.S.); (T.K.); (T.M.)
| | - Hiroaki Ikematsu
- Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Chiba 277-8577, Japan;
- Department of Gastroenterology and Endoscopy, National Cancer Center Hospital East, Kashiwa, Chiba 277-8577, Japan; (K.T.); (D.S.); (T.K.); (T.M.)
| | - Hideo Yokota
- RIKEN Center for Advanced Photonics, Wako, Saitama 351-0198, Japan;
| | - Kohei Soga
- Research Institute for Biomedical Sciences, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.S.); (H.T.)
- Department of Materials Science and Technology, Tokyo University of Science, Katsushika, Tokyo 162-8601, Japan; (Y.K.); (R.I.); (K.O.); (M.U.)
| | - Hiroshi Takemura
- Research Institute for Biomedical Sciences, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.S.); (H.T.)
- Department of Mechanical Engineering, Tokyo University of Science, Noda, Chiba 278-8510, Japan; (K.A.); (Y.E.)
| |
Collapse
|
19
|
Trajanovski S, Shan C, Weijtmans PJC, de Koning SGB, Ruers TJM. Tongue Tumor Detection in Hyperspectral Images Using Deep Learning Semantic Segmentation. IEEE Trans Biomed Eng 2021; 68:1330-1340. [PMID: 32976092 DOI: 10.1109/tbme.2020.3026683] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
OBJECTIVE The utilization of hyperspectral imaging (HSI) in real-time tumor segmentation during a surgery have recently received much attention, but it remains a very challenging task. METHODS In this work, we propose semantic segmentation methods, and compare them with other relevant deep learning algorithms for tongue tumor segmentation. To the best of our knowledge, this is the first work using deep learning semantic segmentation for tumor detection in HSI data using channel selection, and accounting for more spatial tissue context, and global comparison between the prediction map, and the annotation per sample. Results, and Conclusion: On a clinical data set with tongue squamous cell carcinoma, our best method obtains very strong results of average dice coefficient, and area under the ROC-curve of [Formula: see text], and [Formula: see text], respectively on the original spatial image size. The results show that a very good performance can be achieved even with a limited amount of data. We demonstrate that important information regarding tumor decision is encoded in various channels, but some channel selection, and filtering is beneficial over the full spectra. Moreover, we use both visual (VIS), and near-infrared (NIR) spectrum, rather than commonly used only VIS spectrum; although VIS spectrum is generally of higher significance, we demonstrate NIR spectrum is crucial for tumor capturing in some cases. SIGNIFICANCE The HSI technology augmented with accurate deep learning algorithms has a huge potential to be a promising alternative to digital pathology or a doctors' supportive tool in real-time surgeries.
Collapse
|
20
|
Manni F, van der Sommen F, Fabelo H, Zinger S, Shan C, Edström E, Elmi-Terander A, Ortega S, Marrero Callicó G, de With PHN. Hyperspectral Imaging for Glioblastoma Surgery: Improving Tumor Identification Using a Deep Spectral-Spatial Approach. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6955. [PMID: 33291409 PMCID: PMC7730670 DOI: 10.3390/s20236955] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Revised: 12/01/2020] [Accepted: 12/03/2020] [Indexed: 12/16/2022]
Abstract
The primary treatment for malignant brain tumors is surgical resection. While gross total resection improves the prognosis, a supratotal resection may result in neurological deficits. On the other hand, accurate intraoperative identification of the tumor boundaries may be very difficult, resulting in subtotal resections. Histological examination of biopsies can be used repeatedly to help achieve gross total resection but this is not practically feasible due to the turn-around time of the tissue analysis. Therefore, intraoperative techniques to recognize tissue types are investigated to expedite the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the power of extracting additional information from the imaged tissue. Because HSI images cannot be visually assessed by human observers, we instead exploit artificial intelligence techniques and leverage a Convolutional Neural Network (CNN) to investigate the potential of HSI in twelve in vivo specimens. The proposed framework consists of a 3D-2D hybrid CNN-based approach to create a joint extraction of spectral and spatial information from hyperspectral images. A comparison study was conducted exploiting a 2D CNN, a 1D DNN and two conventional classification methods (SVM, and the SVM classifier combined with the 3D-2D hybrid CNN) to validate the proposed network. An overall accuracy of 80% was found when tumor, healthy tissue and blood vessels were classified, clearly outperforming the state-of-the-art approaches. These results can serve as a basis for brain tumor classification using HSI, and may open future avenues for image-guided neurosurgical applications.
Collapse
Affiliation(s)
- Francesca Manni
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands; (F.v.d.S.); (S.Z.); (P.H.N.d.W.)
| | - Fons van der Sommen
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands; (F.v.d.S.); (S.Z.); (P.H.N.d.W.)
| | - Himar Fabelo
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (H.F.); (S.O.); (G.M.C.)
| | - Svitlana Zinger
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands; (F.v.d.S.); (S.Z.); (P.H.N.d.W.)
| | - Caifeng Shan
- College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, China;
| | - Erik Edström
- Department of Neurosurgery, Karolinska University Hospital and Department of Clinical Neuroscience, Karolinska Institutet, SE-171 46 Stockholm, Sweden; (E.E.); (A.E.-T.)
| | - Adrian Elmi-Terander
- Department of Neurosurgery, Karolinska University Hospital and Department of Clinical Neuroscience, Karolinska Institutet, SE-171 46 Stockholm, Sweden; (E.E.); (A.E.-T.)
| | - Samuel Ortega
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (H.F.); (S.O.); (G.M.C.)
| | - Gustavo Marrero Callicó
- Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain; (H.F.); (S.O.); (G.M.C.)
| | - Peter H. N. de With
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands; (F.v.d.S.); (S.Z.); (P.H.N.d.W.)
| |
Collapse
|
21
|
Köhler H, Kulcke A, Maktabi M, Moulla Y, Jansen-Winkeln B, Barberio M, Diana M, Gockel I, Neumuth T, Chalopin C. Laparoscopic system for simultaneous high-resolution video and rapid hyperspectral imaging in the visible and near-infrared spectral range. JOURNAL OF BIOMEDICAL OPTICS 2020; 25:JBO-200121RR. [PMID: 32860357 PMCID: PMC7453262 DOI: 10.1117/1.jbo.25.8.086004] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Accepted: 08/12/2020] [Indexed: 05/07/2023]
Abstract
SIGNIFICANCE Hyperspectral imaging (HSI) can support intraoperative perfusion assessment, the identification of tissue structures, and the detection of cancerous lesions. The practical use of HSI for minimal-invasive surgery is currently limited, for example, due to long acquisition times, missing video, or large set-ups. AIM An HSI laparoscope is described and evaluated to address the requirements for clinical use and high-resolution spectral imaging. APPROACH Reflectance measurements with reference objects and resected human tissue from 500 to 1000 nm are performed to show the consistency with an approved medical HSI device for open surgery. Varying object distances are investigated, and the signal-to-noise ratio (SNR) is determined for different light sources. RESULTS The handheld design enables real-time processing and visualization of HSI data during acquisition within 4.6 s. A color video is provided simultaneously and can be augmented with spectral information from push-broom imaging. The reflectance data from the HSI system for open surgery at 50 cm and the HSI laparoscope are consistent for object distances up to 10 cm. A standard rigid laparoscope in combination with a customized LED light source resulted in a mean SNR of 30 to 43 dB (500 to 950 nm). CONCLUSIONS Compact and rapid HSI with a high spatial- and spectral-resolution is feasible in clinical practice. Our work may support future studies on minimally invasive HSI to reduce intra- and postoperative complications.
Collapse
Affiliation(s)
- Hannes Köhler
- University of Leipzig, Innovation Center Computer Assisted Surgery, Leipzig, Germany
- Diaspective Vision GmbH, Am Salzhaff, Germany
- Address all correspondence to Hannes Köhler, E-mail: Hannes.
| | - Axel Kulcke
- Diaspective Vision GmbH, Am Salzhaff, Germany
| | - Marianne Maktabi
- University of Leipzig, Innovation Center Computer Assisted Surgery, Leipzig, Germany
| | - Yusef Moulla
- University Hospital of Leipzig, Department of Visceral, Thoracic, Transplant, and Vascular Surgery, Leipzig, Germany
| | - Boris Jansen-Winkeln
- University Hospital of Leipzig, Department of Visceral, Thoracic, Transplant, and Vascular Surgery, Leipzig, Germany
| | - Manuel Barberio
- IHU-Strasbourg Institute of Image-Guided Surgery, Strasbourg, France
| | - Michele Diana
- IHU-Strasbourg Institute of Image-Guided Surgery, Strasbourg, France
| | - Ines Gockel
- University Hospital of Leipzig, Department of Visceral, Thoracic, Transplant, and Vascular Surgery, Leipzig, Germany
| | - Thomas Neumuth
- University of Leipzig, Innovation Center Computer Assisted Surgery, Leipzig, Germany
| | - Claire Chalopin
- University of Leipzig, Innovation Center Computer Assisted Surgery, Leipzig, Germany
| |
Collapse
|