1
|
Feenstra L, van der Stel SD, Da Silva Guimaraes M, Dashtbozorg B, Ruers TJM. Point Projection Mapping System for Tracking, Registering, Labeling, and Validating Optical Tissue Measurements. J Imaging 2024; 10:37. [PMID: 38392085 PMCID: PMC10890146 DOI: 10.3390/jimaging10020037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 01/23/2024] [Accepted: 01/27/2024] [Indexed: 02/24/2024] Open
Abstract
The validation of newly developed optical tissue-sensing techniques for tumor detection during cancer surgery requires an accurate correlation with the histological results. Additionally, such an accurate correlation facilitates precise data labeling for developing high-performance machine learning tissue-classification models. In this paper, a newly developed Point Projection Mapping system will be introduced, which allows non-destructive tracking of the measurement locations on tissue specimens. Additionally, a framework for accurate registration, validation, and labeling with the histopathology results is proposed and validated on a case study. The proposed framework provides a more-robust and accurate method for the tracking and validation of optical tissue-sensing techniques, which saves time and resources compared to the available conventional techniques.
Collapse
Affiliation(s)
- Lianne Feenstra
- Image-Guided Surgery, Department of Surgical Oncology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands; (S.D.v.d.S.); (B.D.); (T.J.M.R.)
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Stefan D. van der Stel
- Image-Guided Surgery, Department of Surgical Oncology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands; (S.D.v.d.S.); (B.D.); (T.J.M.R.)
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| | - Marcos Da Silva Guimaraes
- Department of Pathology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands;
| | - Behdad Dashtbozorg
- Image-Guided Surgery, Department of Surgical Oncology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands; (S.D.v.d.S.); (B.D.); (T.J.M.R.)
| | - Theo J. M. Ruers
- Image-Guided Surgery, Department of Surgical Oncology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam, The Netherlands; (S.D.v.d.S.); (B.D.); (T.J.M.R.)
- Department of Nanobiophysics, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, 7522 NB Enschede, The Netherlands
| |
Collapse
|
2
|
Throckmorton GA, Haugen E, Thomas G, Willmon P, Baba JS, Solórzano CC, Mahadevan-Jansen A. Label-free intraoperative nerve detection and visualization using ratiometric diffuse reflectance spectroscopy. Sci Rep 2023; 13:7599. [PMID: 37165016 PMCID: PMC10172349 DOI: 10.1038/s41598-023-34054-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 04/24/2023] [Indexed: 05/12/2023] Open
Abstract
Iatrogenic nerve injuries contribute significantly to postoperative morbidity across various surgical disciplines and occur in approximately 500,000 cases annually in the US alone. Currently, there are no clinically adopted means to intraoperatively visualize nerves beyond the surgeon's visual assessment. Here, we report a label-free method for nerve detection using diffuse reflectance spectroscopy (DRS). Starting with an in vivo rat model, fiber- and imaging-based DRS independently identified similar wavelengths that provided optimal contrast for nerve identification with an accuracy of 92%. Optical property measurements of rat and human cadaver tissues verify that the source of contrast between nerve and surrounding tissues is largely due to higher scattering in nerve and differences in oxygenated hemoglobin content. Clinical feasibility was demonstrated in patients undergoing thyroidectomies using both probe-based and imaging-based approaches where the nerve were identified with 91% accuracy. Based on our preliminary results, DRS has the potential to both provide surgeons with a label-free, intraoperative means of nerve visualization and reduce the incidence of iatrogenic nerve injuries along with its detrimental complications.
Collapse
Affiliation(s)
- Graham A Throckmorton
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37235, USA
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN, 37235, USA
| | - Ezekiel Haugen
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37235, USA
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN, 37235, USA
| | - Giju Thomas
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37235, USA
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN, 37235, USA
| | - Parker Willmon
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37235, USA
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN, 37235, USA
| | | | - Carmen C Solórzano
- Department of Surgery, Vanderbilt University Medical Center, Nashville, TN, 37232, USA
| | - Anita Mahadevan-Jansen
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, 37235, USA.
- Vanderbilt Biophotonics Center, Vanderbilt University, Nashville, TN, 37235, USA.
- Department of Surgery, Vanderbilt University Medical Center, Nashville, TN, 37232, USA.
- Department of Otolaryngology, Vanderbilt University Medical Center, Nashville, TN, 37232, USA.
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, 37232, USA.
| |
Collapse
|
3
|
Liu GS, Shenson JA, Farrell JE, Blevins NH. Signal to noise ratio quantifies the contribution of spectral channels to classification of human head and neck tissues ex vivo using deep learning and multispectral imaging. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:016004. [PMID: 36726664 PMCID: PMC9884103 DOI: 10.1117/1.jbo.28.1.016004] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 01/06/2023] [Indexed: 05/09/2023]
Abstract
SIGNIFICANCE Accurate identification of tissues is critical for performing safe surgery. Combining multispectral imaging (MSI) with deep learning is a promising approach to increasing tissue discrimination and classification. Evaluating the contributions of spectral channels to tissue discrimination is important for improving MSI systems. AIM Develop a metric to quantify the contributions of individual spectral channels to tissue classification in MSI. APPROACH MSI was integrated into a digital operating microscope with three sensors and seven illuminants. Two convolutional neural network (CNN) models were trained to classify 11 head and neck tissue types using white light (RGB) or MSI images. The signal to noise ratio (SNR) of spectral channels was compared with the impact of channels on tissue classification performance as determined using CNN visualization methods. RESULTS Overall tissue classification accuracy was higher with use of MSI images compared with RGB images, both for classification of all 11 tissue types and binary classification of nerve and parotid ( p < 0.001 ). Removing spectral channels with SNR > 20 reduced tissue classification accuracy. CONCLUSIONS The spectral channel SNR is a useful metric for both understanding CNN tissue classification and quantifying the contributions of different spectral channels in an MSI system.
Collapse
Affiliation(s)
- George S. Liu
- Stanford University, Department of Otolaryngology — Head and Neck Surgery, Palo Alto, California, United States
| | - Jared A. Shenson
- Stanford University, Department of Otolaryngology — Head and Neck Surgery, Palo Alto, California, United States
| | - Joyce E. Farrell
- Stanford University, Department of Electrical Engineering, Stanford, California, United States
| | - Nikolas H. Blevins
- Stanford University, Department of Otolaryngology — Head and Neck Surgery, Palo Alto, California, United States
- Address all correspondence to Nikolas H. Blevins,
| |
Collapse
|
4
|
Sun Y, Dumont AP, Arefin MS, Patil CA. Model-based characterization platform of fiber optic extended-wavelength diffuse reflectance spectroscopy for identification of neurovascular bundles. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:095002. [PMID: 36088529 PMCID: PMC9463544 DOI: 10.1117/1.jbo.27.9.095002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 08/22/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE Fiber-optic extended-wavelength diffuse reflectance spectroscopy (EWDRS) using both visible/near-infrared and shortwave-infrared detectors enables improved detection of spectral absorbances arising from lipids, water, and collagen and has demonstrated promise in a variety of applications, including detection of nerves and neurovascular bundles (NVB). Development of future applications of EWDRS for nerve detection could benefit from the use of model-based analyses including Monte Carlo (MC) simulations and evaluation of agreement between model systems and empirical measurements. AIM The aim of this work is to characterize agreement between EWDRS measurements and simulations and inform future applications of model-based studies of nerve-detecting applications. APPROACH A model-based platform consisting of an ex vivo microsurgical nerve dissection model, unique two-layer optical phantoms, and MC model simulations of fiber-optic EWDRS spectroscopic measurements were used to characterize EWDRS and compare agreement across models. In addition, MC simulations of an EWDRS measurement scenario are performed to provide a representative example of future analyses. RESULTS EWDRS studies performed in the common chicken thigh femoral nerve microsurgical dissection model indicate similar spectral features for classification of NVB versus adjacent tissues as reported in porcine models and human subjects. A comparison of measurements from unique EWDRS issue mimicking optical phantoms and MC simulations indicates high agreement between the two in homogeneous and two-layer optical phantoms, as well as in dissected tissues. Finally, MC simulations of measurement over a simulated NVB indicate the potential of future applications for measurement of nerve plexus. CONCLUSIONS Characterization of agreement between fiber-optic EWDRS measurements and MC simulations demonstrates strong agreement across a variety of tissues and optical phantoms, offering promise for further use to guide the continued development of EWDRS for translational applications.
Collapse
Affiliation(s)
- Yu Sun
- Temple University, Department of Bioengineering, Philadelphia, Pennsylvania, United States
| | - Alexander P. Dumont
- Temple University, Department of Bioengineering, Philadelphia, Pennsylvania, United States
| | | | - Chetan A. Patil
- Temple University, Department of Bioengineering, Philadelphia, Pennsylvania, United States
| |
Collapse
|
5
|
Wilson BC, Eu D. Optical Spectroscopy and Imaging in Surgical Management of Cancer Patients. TRANSLATIONAL BIOPHOTONICS 2022. [DOI: 10.1002/tbio.202100009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Affiliation(s)
- Brian C. Wilson
- Princess Margaret Cancer Centre/University Health Network 101 College Street Toronto Ontario Canada
- Department of Medical Biophysics, Faculty of Medicine University of Toronto Canada
| | - Donovan Eu
- Department of Otolaryngology‐Head and Neck Surgery‐Surgical Oncology, Princess Margaret Cancer Centre/University Health Network University of Toronto Canada
- Department of Otolaryngology‐Head and Neck Surgery National University Hospital System Singapore
| |
Collapse
|
6
|
Geldof F, Dashtbozorg B, Hendriks BHW, Sterenborg HJCM, Ruers TJM. Layer thickness prediction and tissue classification in two-layered tissue structures using diffuse reflectance spectroscopy. Sci Rep 2022; 12:1698. [PMID: 35105926 PMCID: PMC8807816 DOI: 10.1038/s41598-022-05751-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 01/12/2022] [Indexed: 11/26/2022] Open
Abstract
During oncological surgery, it can be challenging to identify the tumor and establish adequate resection margins. This study proposes a new two-layer approach in which diffuse reflectance spectroscopy (DRS) is used to predict the top layer thickness and classify the layers in two-layered phantom and animal tissue. Using wavelet-based and peak-based DRS spectral features, the proposed method could predict the top layer thickness with an accuracy of up to 0.35 mm. In addition, the tissue types of the first and second layers were classified with an accuracy of 0.95 and 0.99. Distinguishing multiple tissue layers during spectral analyses results in a better understanding of more complex tissue structures encountered in surgical practice.
Collapse
Affiliation(s)
- Freija Geldof
- Department of Surgery, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands.
| | - Behdad Dashtbozorg
- Department of Surgery, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
| | - Benno H W Hendriks
- Department of IGT and US Devices & Systems, Philips Research Laboratories, 5656 AE, Eindhoven, The Netherlands
- Department of BioMechanical Engineering, 3mE, Delft University of Technology, 2628 CD, Delft, The Netherlands
| | - Henricus J C M Sterenborg
- Department of Surgery, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, 1105 AZ, Amsterdam, The Netherlands
| | - Theo J M Ruers
- Department of Surgery, Netherlands Cancer Institute, 1066 CX, Amsterdam, The Netherlands
- Faculty of Science and Technology, University of Twente, 7522 NB, Enschede, The Netherlands
| |
Collapse
|