1
|
Adriaansens CMEM, de Koning KJ, van Es RJJ, de Bree R, Noorlag R. Beneath the surface: A systematic review on intraoperative imaging techniques for deep margin assessment in oral squamous cell carcinoma. Oral Oncol 2024; 153:106823. [PMID: 38701572 DOI: 10.1016/j.oraloncology.2024.106823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 04/09/2024] [Accepted: 04/24/2024] [Indexed: 05/05/2024]
Abstract
Resection margins of oral squamous cell carcinoma (SCC) are often inadequate. A systematic review on clinical intraoperative whole-specimen imaging techniques to obtain adequate deep resection margins in oral SCC is lacking. Such a review may render better alternatives for the current insufficient intraoperative techniques: palpation and frozen section analyses (FSA). This review resulted in ten publications investigating ultrasound (US), four investigating fluorescence, and three investigating MRI. Both US and fluorescence were able to image the tumor intraorally and perform ex-vivo imaging of the resection specimen. Fluorescence was also able to image residual tumor tissue in the wound bed. MRI could only be used on the ex-vivo specimen. The 95 % confidence intervals for sensitivity and specificity were large, due to the small sample sizes for all three techniques. The sensitivity and specificity of US for identifying < 5 mm margins ranged from 0 % to 100 % and 60 % to 100 %, respectively. For fluorescence, this ranged from 0 % to 100 % and 76 % to 100 %, respectively. For MRI, this ranged from 7 % to 100 % and 81 % to 100 %, respectively. US, MRI and fluorescence are the currently available imaging techniques that can potentially be used intraoperatively and which can image the entire tumor-free margin, although they have insufficient sensitivity for identifying < 5 mm margins. Further research on larger cohorts is needed to improve the sensitivity by determining cut-off points on imaging for inadequate margins. This improves the number of adequate resections of oral SCC's and pave the way for routine clinical implementation of these techniques.
Collapse
Affiliation(s)
- C M E M Adriaansens
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, the Netherlands.
| | - K J de Koning
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, the Netherlands.
| | - R J J van Es
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, the Netherlands
| | - R de Bree
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, the Netherlands
| | - Rob Noorlag
- Department of Head and Neck Surgical Oncology, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, the Netherlands
| |
Collapse
|
2
|
Schmidt VM, Zelger P, Wöss C, Fodor M, Hautz T, Schneeberger S, Huck CW, Arora R, Brunner A, Zelger B, Schirmer M, Pallua JD. Handheld hyperspectral imaging as a tool for the post-mortem interval estimation of human skeletal remains. Heliyon 2024; 10:e25844. [PMID: 38375262 PMCID: PMC10875450 DOI: 10.1016/j.heliyon.2024.e25844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 01/30/2024] [Accepted: 02/02/2024] [Indexed: 02/21/2024] Open
Abstract
In forensic medicine, estimating human skeletal remains' post-mortem interval (PMI) can be challenging. Following death, bones undergo a series of chemical and physical transformations due to their interactions with the surrounding environment. Post-mortem changes have been assessed using various methods, but estimating the PMI of skeletal remains could still be improved. We propose a new methodology with handheld hyperspectral imaging (HSI) system based on the first results from 104 human skeletal remains with PMIs ranging between 1 day and 2000 years. To differentiate between forensic and archaeological bone material, the Convolutional Neural Network analyzed 65.000 distinct diagnostic spectra: the classification accuracy was 0.58, 0.62, 0.73, 0.81, and 0.98 for PMIs of 0 week-2 weeks, 2 weeks-6 months, 6 months-1 year, 1 year-10 years, and >100 years, respectively. In conclusion, HSI can be used in forensic medicine to distinguish bone materials >100 years old from those <10 years old with an accuracy of 98%. The model has adequate predictive performance, and handheld HSI could serve as a novel approach to objectively and accurately determine the PMI of human skeletal remains.
Collapse
Affiliation(s)
- Verena-Maria Schmidt
- Institute of Forensic Medicine, Medical University of Innsbruck, Muellerstraße 44, 6020 Innsbruck, Austria
| | - Philipp Zelger
- University Clinic for Hearing, Voice and Speech Disorders, Medical University of Innsbruck, Anichstrasse 35, 6020 Innsbruck, Austria
| | - Claudia Wöss
- Institute of Forensic Medicine, Medical University of Innsbruck, Muellerstraße 44, 6020 Innsbruck, Austria
| | - Margot Fodor
- OrganLifeTM, Department of Visceral, Transplant and Thoracic Surgery, Medical University of Innsbruck, Innsbruck, Austria
| | - Theresa Hautz
- OrganLifeTM, Department of Visceral, Transplant and Thoracic Surgery, Medical University of Innsbruck, Innsbruck, Austria
| | - Stefan Schneeberger
- OrganLifeTM, Department of Visceral, Transplant and Thoracic Surgery, Medical University of Innsbruck, Innsbruck, Austria
| | - Christian Wolfgang Huck
- Institute of Analytical Chemistry and Radiochemistry, University of Innsbruck, 6020 Innsbruck, Austria
| | - Rohit Arora
- Department of Orthopaedics and Traumatology, Medical University of Innsbruck, Anichstraße 35, 6020 Innsbruck, Austria
| | - Andrea Brunner
- Institute of Pathology, Neuropathology, and Molecular Pathology, Medical University of Innsbruck, Muellerstrasse 44, 6020 Innsbruck, Austria
| | - Bettina Zelger
- Institute of Pathology, Neuropathology, and Molecular Pathology, Medical University of Innsbruck, Muellerstrasse 44, 6020 Innsbruck, Austria
| | - Michael Schirmer
- Department of Internal Medicine, Clinic II, Medical University of Innsbruck, Anichstrasse 35, 6020 Innsbruck, Austria
| | - Johannes Dominikus Pallua
- Department of Orthopaedics and Traumatology, Medical University of Innsbruck, Anichstraße 35, 6020 Innsbruck, Austria
| |
Collapse
|
3
|
Loperfido A, Celebrini A, Marzetti A, Bellocchi G. Current role of artificial intelligence in head and neck cancer surgery: a systematic review of literature. EXPLORATION OF TARGETED ANTI-TUMOR THERAPY 2023; 4:933-940. [PMID: 37970203 PMCID: PMC10645467 DOI: 10.37349/etat.2023.00174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Accepted: 07/19/2023] [Indexed: 11/17/2023] Open
Abstract
Aim Artificial intelligence (AI) is a new field of science in which computers will provide decisions-supporting tools to help doctors make difficult clinical choices. Recent AI applications in otolaryngology include head and neck oncology, rhinology, neurotology, and laryngology. The aim of this systematic review is to describe the potential uses of AI in head and neck oncology with a special focus on the surgical field. Methods The authors performed a systematic review, in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines, in the main medical databases, including PubMed, Scopus, and Cochrane Library, considering all original studies published until February 2023 about the role of AI in head and neck cancer surgery. The search strategy included a combination of the following terms: "artificial intelligence" or "machine learning" and "head and neck cancer". Results Overall, 303 papers were identified and after duplicate removal (12 papers) and excluding papers not written in English (1 paper) and off-topic (4 papers), papers were assessed for eligibility; finally, only 12 papers were included. Three main fields of clinical interest were identified: the most widely investigated included the role of AI in surgical margins assessment (7 papers); the second most frequently evaluated topic was complications assessment (4 papers); finally, only one paper dealt with the indication of salvage laryngectomy after primary radiotherapy. Conclusions The authors report the first systematic review in the literature concerning the role of AI in head and neck cancer surgery. An increasing influx of AI applications to clinical problems in otolaryngology is expected, so specialists should be increasingly prepared to manage the constant changes. It will always remain critical for clinicians to use their skills and knowledge to critically evaluate the additional information provided by AI and make the final decisions on each patient.
Collapse
Affiliation(s)
| | | | - Andrea Marzetti
- Department of Otolaryngology Head and Neck Surgery, Fabrizio Spaziani Hospital, 03100 Frosinone, Italy
| | | |
Collapse
|
4
|
Ma L, Srinivas A, Krishnamurthy A, Zhou X, Shah NS, Obaid G, Fei B. Automated Polarized Hyperspectral Imaging (PHSI) for ex-vivo and in-vivo Tissue Assessment. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2023; 12391:123910F. [PMID: 38476292 PMCID: PMC10932616 DOI: 10.1117/12.2651011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
Polarized light interactions with biological tissues can reveal information regarding tissue structure, while spectral characteristics are closely related to tissue composition. An integration of both modalities in a compact system could better assist tissue assessment. This study aims to develop a polarized hyperspectral imaging (PHSI) system that fulfills both linearly and circularly polarized hyperspectral imaging for in vivo and ex vivo applications. The system is comprised of a white LED, two linear polarizers, two liquid crystal variable retarders (LCVRs), and a hyperspectral snapshot camera. The system was calibrated to compute the full Stokes polarimetry. For tissue differentiation, fresh ex vivo mouse tissue specimens from kidney, liver, spleen, muscle, lung, and salivary gland of mice were imaged. The spectra of three features, named degree of polarization (DOP), degree of linear polarization (DOLP), and degree of circular polarization (DOCP), were generated. A k-nearest neighbor (k-NN) classifier was trained with multi-class spectra and 5-fold cross validation. It was found that DOP better differentiates tissue with an average accuracy of 0.87. Additionally, support vector machine (SVM) classifiers were trained to differentiate between each two of the organs, and it was determined that DOLP better identified kidney, liver, and spleen, whereas DOCP better identified muscle and lung tissues. Then, the setup was employed to image in vivo human fingers with and without a blood occlusion to qualitatively estimate oxygen saturation. Preliminary results demonstrate that both DOLP and DOCP reveal a distinction of oxygen saturation states. These results demonstrate the feasibility of the PHSI system for distinguishing between optical properties of tissues, which has the potential to reveal disease-related information for diverse medical applications.
Collapse
Affiliation(s)
- Ling Ma
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Akhila Srinivas
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Abirami Krishnamurthy
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Ximing Zhou
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | | | - Girgis Obaid
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Baowei Fei
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, TX
| |
Collapse
|
5
|
Martinez-Vega B, Tkachenko M, Matkabi M, Ortega S, Fabelo H, Balea-Fernandez F, La Salvia M, Torti E, Leporati F, Callico GM, Chalopin C. Evaluation of Preprocessing Methods on Independent Medical Hyperspectral Databases to Improve Analysis. SENSORS (BASEL, SWITZERLAND) 2022; 22:8917. [PMID: 36433516 PMCID: PMC9693077 DOI: 10.3390/s22228917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 11/10/2022] [Accepted: 11/15/2022] [Indexed: 06/16/2023]
Abstract
Currently, one of the most common causes of death worldwide is cancer. The development of innovative methods to support the early and accurate detection of cancers is required to increase the recovery rate of patients. Several studies have shown that medical Hyperspectral Imaging (HSI) combined with artificial intelligence algorithms is a powerful tool for cancer detection. Various preprocessing methods are commonly applied to hyperspectral data to improve the performance of the algorithms. However, there is currently no standard for these methods, and no studies have compared them so far in the medical field. In this work, we evaluated different combinations of preprocessing steps, including spatial and spectral smoothing, Min-Max scaling, Standard Normal Variate normalization, and a median spatial smoothing technique, with the goal of improving tumor detection in three different HSI databases concerning colorectal, esophagogastric, and brain cancers. Two machine learning and deep learning models were used to perform the pixel-wise classification. The results showed that the choice of preprocessing method affects the performance of tumor identification. The method that showed slightly better results with respect to identifing colorectal tumors was Median Filter preprocessing (0.94 of area under the curve). On the other hand, esophagogastric and brain tumors were more accurately identified using Min-Max scaling preprocessing (0.93 and 0.92 of area under the curve, respectively). However, it is observed that the Median Filter method smooths sharp spectral features, resulting in high variability in the classification performance. Therefore, based on these results, obtained with different databases acquired by different HSI instrumentation, the most relevant preprocessing technique identified in this work is Min-Max scaling.
Collapse
Affiliation(s)
- Beatriz Martinez-Vega
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
| | - Mariia Tkachenko
- Innovation Center Computer-Assisted Surgery (ICCAS), University of Leipzig, 04103 Leipzig, Germany
- Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), University of Leipzig, 04105 Leipzig, Germany
| | - Marianne Matkabi
- Innovation Center Computer-Assisted Surgery (ICCAS), University of Leipzig, 04103 Leipzig, Germany
- Department of Electrical Engineering, Mechanical Engineering and Industrial Engineering, Anhalt University of Applied Science Anhalt, 06366 Köthen, Germany
| | - Samuel Ortega
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
- Nofima, Norwegian Institute of Food Fisheries and Aquaculture Research, NO-9291 Tromsø, Norway
| | - Himar Fabelo
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
- Fundacion Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), 35019 Las Palmas de Gran Canaria, Spain
| | - Francisco Balea-Fernandez
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
- Department of Psychology, Sociology and Social Work, University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
| | - Marco La Salvia
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Emanuele Torti
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Francesco Leporati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Gustavo M. Callico
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
| | - Claire Chalopin
- Innovation Center Computer-Assisted Surgery (ICCAS), University of Leipzig, 04103 Leipzig, Germany
| |
Collapse
|
6
|
Zhang L, Huang D, Chen X, Zhu L, Chen X, Xie Z, Huang G, Gao J, Shi W, Cui G. Visible near-infrared hyperspectral imaging and supervised classification for the detection of small intestinal necrosis tissue in vivo. BIOMEDICAL OPTICS EXPRESS 2022; 13:6061-6080. [PMID: 36733734 PMCID: PMC9872898 DOI: 10.1364/boe.470202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 09/23/2022] [Accepted: 09/26/2022] [Indexed: 06/18/2023]
Abstract
Complete recognition of necrotic areas during small bowel tissue resection remains challenging due to the lack of optimal intraoperative aid identification techniques. This research utilizes hyperspectral imaging techniques to automatically distinguish normal and necrotic areas of small intestinal tissue. Sample data were obtained from the animal model of small intestinal tissue of eight Japanese large-eared white rabbits developed by experienced physicians. A spectral library of normal and necrotic regions of small intestinal tissue was created and processed using six different supervised classification algorithms. The results show that hyperspectral imaging combined with supervised classification algorithms can be a suitable technique to automatically distinguish between normal and necrotic areas of small intestinal tissue. This new technique could aid physicians in objectively identify normal and necrotic areas of small intestinal tissue.
Collapse
Affiliation(s)
- LeChao Zhang
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - DanFei Huang
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - XiaoJing Chen
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - LiBin Zhu
- Pediatric General Surgery, The Second Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China
| | - XiaoQing Chen
- Pediatric General Surgery, The Second Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China
| | - ZhongHao Xie
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - GuangZao Huang
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - JunZhao Gao
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - Wen Shi
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - GuiHua Cui
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| |
Collapse
|
7
|
Witteveen M, Sterenborg HJCM, van Leeuwen TG, Aalders MCG, Ruers TJM, Post AL. Comparison of preprocessing techniques to reduce nontissue-related variations in hyperspectral reflectance imaging. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:106003. [PMID: 36207772 PMCID: PMC9541333 DOI: 10.1117/1.jbo.27.10.106003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 08/23/2022] [Indexed: 06/16/2023]
Abstract
SIGNIFICANCE Hyperspectral reflectance imaging can be used in medicine to identify tissue types, such as tumor tissue. Tissue classification algorithms are developed based on, e.g., machine learning or principle component analysis. For the development of these algorithms, data are generally preprocessed to remove variability in data not related to the tissue itself since this will improve the performance of the classification algorithm. In hyperspectral imaging, the measured spectra are also influenced by reflections from the surface (glare) and height variations within and between tissue samples. AIM To compare the ability of different preprocessing algorithms to decrease variations in spectra induced by glare and height differences while maintaining contrast based on differences in optical properties between tissue types. APPROACH We compare eight preprocessing algorithms commonly used in medical hyperspectral imaging: standard normal variate, multiplicative scatter correction, min-max normalization, mean centering, area under the curve normalization, single wavelength normalization, first derivative, and second derivative. We investigate conservation of contrast stemming from differences in: blood volume fraction, presence of different absorbers, scatter amplitude, and scatter slope-while correcting for glare and height variations. We use a similarity metric, the overlap coefficient, to quantify contrast between spectra. We also investigate the algorithms for clinical datasets from the colon and breast. CONCLUSIONS Preprocessing reduces the overlap due to glare and distance variations. In general, the algorithms standard normal variate, min-max, area under the curve, and single wavelength normalization are the most suitable to preprocess data used to develop a classification algorithm for tissue classification. The type of contrast between tissue types determines which of these four algorithms is most suitable.
Collapse
Affiliation(s)
- Mark Witteveen
- the Netherlands Cancer Institute, Surgical Oncology, Amsterdam, The Netherlands
- University of Twente, Science and Technology, Nanobiophysics, Enschede, The Netherlands
| | - Henricus J. C. M. Sterenborg
- the Netherlands Cancer Institute, Surgical Oncology, Amsterdam, The Netherlands
- Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Department of Biomedical Engineering and Physics, Amsterdam, The Netherlands
| | - Ton G. van Leeuwen
- Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Department of Biomedical Engineering and Physics, Amsterdam, The Netherlands
| | - Maurice C. G. Aalders
- Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Department of Biomedical Engineering and Physics, Amsterdam, The Netherlands
- University of Amsterdam, Co van Ledden Hulsebosch Center, Amsterdam, The Netherlands
| | - Theo J. M. Ruers
- the Netherlands Cancer Institute, Surgical Oncology, Amsterdam, The Netherlands
- University of Twente, Science and Technology, Nanobiophysics, Enschede, The Netherlands
| | - Anouk L. Post
- the Netherlands Cancer Institute, Surgical Oncology, Amsterdam, The Netherlands
- Amsterdam UMC, University of Amsterdam, Cancer Center Amsterdam, Amsterdam Cardiovascular Sciences, Department of Biomedical Engineering and Physics, Amsterdam, The Netherlands
| |
Collapse
|
8
|
van Vliet-Pérez SM, van de Berg NJ, Manni F, Lai M, Rijstenberg L, Hendriks BHW, Dankelman J, Ewing-Graham PC, Nieuwenhuyzen-de Boer GM, van Beekhuizen HJ. Hyperspectral Imaging for Tissue Classification after Advanced Stage Ovarian Cancer Surgery-A Pilot Study. Cancers (Basel) 2022; 14:cancers14061422. [PMID: 35326577 PMCID: PMC8946803 DOI: 10.3390/cancers14061422] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Revised: 02/24/2022] [Accepted: 03/08/2022] [Indexed: 02/05/2023] Open
Abstract
The most important prognostic factor for the survival of advanced-stage epithelial ovarian cancer (EOC) is the completeness of cytoreductive surgery (CRS). Therefore, an intraoperative technique to detect microscopic tumors would be of great value. The aim of this pilot study is to assess the feasibility of near-infrared hyperspectral imaging (HSI) for EOC detection in ex vivo tissue samples. Images were collected during CRS in 11 patients in the wavelength range of 665−975 nm, and processed by calibration, normalization, and noise filtering. A linear support vector machine (SVM) was employed to classify healthy and tumorous tissue (defined as >50% tumor cells). Classifier performance was evaluated using leave-one-out cross-validation. Images of 26 tissue samples from 10 patients were included, containing 26,446 data points that were matched to histopathology. Tumorous tissue could be classified with an area under the curve of 0.83, a sensitivity of 0.81, a specificity of 0.70, and Matthew’s correlation coefficient of 0.41. This study paves the way to in vivo and intraoperative use of HSI during CRS. Hyperspectral imaging can scan a whole tissue surface in a fast and non-contact way. Our pilot study demonstrates that HSI and SVM learning can be used to discriminate EOC from surrounding tissue.
Collapse
Affiliation(s)
- Sharline M. van Vliet-Pérez
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands
- Correspondence:
| | - Nick J. van de Berg
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
| | - Francesca Manni
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (F.M.); (M.L.)
| | - Marco Lai
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (F.M.); (M.L.)
| | - Lucia Rijstenberg
- Department of Pathology, Erasmus University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (L.R.); (P.C.E.-G.)
| | - Benno H. W. Hendriks
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
| | - Jenny Dankelman
- Department of Biomechanical Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands; (N.J.v.d.B.); (B.H.W.H.); (J.D.)
| | - Patricia C. Ewing-Graham
- Department of Pathology, Erasmus University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (L.R.); (P.C.E.-G.)
| | - Gatske M. Nieuwenhuyzen-de Boer
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
- Department of Gynecology, Albert Schweitzer Hospital, 3318 AT Dordrecht, The Netherlands
| | - Heleen J. van Beekhuizen
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, 3015 GD Rotterdam, The Netherlands; (G.M.N.-d.B.); (H.J.v.B.)
| |
Collapse
|
9
|
Eggert D, Bengs M, Westermann S, Gessert N, Gerstner AOH, Mueller NA, Bewarder J, Schlaefer A, Betz C, Laffers W. In vivo detection of head and neck tumors by hyperspectral imaging combined with deep learning methods. JOURNAL OF BIOPHOTONICS 2022; 15:e202100167. [PMID: 34889065 DOI: 10.1002/jbio.202100167] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 11/25/2021] [Accepted: 11/25/2021] [Indexed: 05/24/2023]
Abstract
Currently, there are no fast and accurate screening methods available for head and neck cancer, the eighth most common tumor entity. For this study, we used hyperspectral imaging, an imaging technique for quantitative and objective surface analysis, combined with deep learning methods for automated tissue classification. As part of a prospective clinical observational study, hyperspectral datasets of laryngeal, hypopharyngeal and oropharyngeal mucosa were recorded in 98 patients before surgery in vivo. We established an automated data interpretation pathway that can classify the tissue into healthy and tumorous using convolutional neural networks with 2D spatial or 3D spatio-spectral convolutions combined with a state-of-the-art Densenet architecture. Using 24 patients for testing, our 3D spatio-spectral Densenet classification method achieves an average accuracy of 81%, a sensitivity of 83% and a specificity of 79%.
Collapse
Affiliation(s)
- Dennis Eggert
- Clinic and Polyclinic for Otolaryngology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Marcel Bengs
- Institute of Medical Technology, Hamburg University of Technology, Hamburg, Germany
| | - Stephan Westermann
- Department of Otorhinolaryngology/Head and Neck Surgery, University of Bonn, Bonn, Germany
| | - Nils Gessert
- Institute of Medical Technology, Hamburg University of Technology, Hamburg, Germany
| | | | - Nina A Mueller
- Department of Otorhinolaryngology/Head and Neck Surgery, University of Bonn, Bonn, Germany
| | - Julian Bewarder
- Clinic and Polyclinic for Otolaryngology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Alexander Schlaefer
- Institute of Medical Technology, Hamburg University of Technology, Hamburg, Germany
| | - Christian Betz
- Clinic and Polyclinic for Otolaryngology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Wiebke Laffers
- Clinic and Polyclinic for Otolaryngology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Otorhinolaryngology/Head and Neck Surgery, University of Bonn, Bonn, Germany
- Department of Otorhinolaryngology, Head and Neck Surgery, Evangelisches Krankenhaus, Carl von Ossietzky-University, Oldenburg, Germany
| |
Collapse
|
10
|
Sommer F, Sun B, Fischer J, Goldammer M, Thiele C, Malberg H, Markgraf W. Hyperspectral Imaging during Normothermic Machine Perfusion—A Functional Classification of Ex Vivo Kidneys Based on Convolutional Neural Networks. Biomedicines 2022; 10:biomedicines10020397. [PMID: 35203605 PMCID: PMC8962340 DOI: 10.3390/biomedicines10020397] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 01/28/2022] [Accepted: 01/30/2022] [Indexed: 12/18/2022] Open
Abstract
Facing an ongoing organ shortage in transplant medicine, strategies to increase the use of organs from marginal donors by objective organ assessment are being fostered. In this context, normothermic machine perfusion provides a platform for ex vivo organ evaluation during preservation. Consequently, analytical tools are emerging to determine organ quality. In this study, hyperspectral imaging (HSI) in the wavelength range of 550–995 nm was applied. Classification of 26 kidneys based on HSI was established using KidneyResNet, a convolutional neural network (CNN) based on the ResNet-18 architecture, to predict inulin clearance behavior. HSI preprocessing steps were implemented, including automated region of interest (ROI) selection, before executing the KidneyResNet algorithm. Training parameters and augmentation methods were investigated concerning their influence on the prediction. When classifying individual ROIs, the optimized KidneyResNet model achieved 84% and 62% accuracy in the validation and test set, respectively. With a majority decision on all ROIs of a kidney, the accuracy increased to 96% (validation set) and 100% (test set). These results demonstrate the feasibility of HSI in combination with KidneyResNet for non-invasive prediction of ex vivo kidney function. This knowledge of preoperative renal quality may support the organ acceptance decision.
Collapse
|
11
|
Leitch K, Halicek M, Shahedi M, Little JV, Chen AY, Fei B. Detecting Aggressive Papillary Thyroid Carcinoma Using Hyperspectral Imaging and Radiomic Features. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12033:1203322. [PMID: 36798628 PMCID: PMC9929637 DOI: 10.1117/12.2611842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Hyperspectral imaging (HSI) and radiomics have the potential to improve the accuracy of tumor malignancy prediction and assessment. In this work, we extracted radiomic features of fresh surgical papillary thyroid carcinoma (PTC) specimen that were imaged with HSI. A total of 107 unique radiomic features were extracted. This study includes 72 ex-vivo tissue specimens from 44 patients with pathology-confirmed PTC. With the dilated hyperspectral images, the shape feature of least axis length was able to predict the tumor aggressiveness with a high accuracy. The HSI-based radiomic method may provide a useful tool to aid oncologists in determining tumors with intermediate to high risk and in clinical decision making.
Collapse
Affiliation(s)
- Ka’Toria Leitch
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Martin Halicek
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Maysam Shahedi
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - James V. Little
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA
| | - Amy Y. Chen
- Department of Otolaryngology, Emory University School of Medicine, Atlanta, GA
| | - Baowei Fei
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Department of Radiology, The University of Texas Southwestern Medical Center, Dallas, TX
| |
Collapse
|
12
|
Machine-Learning Assisted Discrimination of Precancerous and Cancerous from Healthy Oral Tissue Based on Multispectral Autofluorescence Lifetime Imaging Endoscopy. Cancers (Basel) 2021; 13:cancers13194751. [PMID: 34638237 PMCID: PMC8507537 DOI: 10.3390/cancers13194751] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Revised: 09/13/2021] [Accepted: 09/15/2021] [Indexed: 12/20/2022] Open
Abstract
Multispectral autofluorescence lifetime imaging (maFLIM) can be used to clinically image a plurality of metabolic and biochemical autofluorescence biomarkers of oral epithelial dysplasia and cancer. This study tested the hypothesis that maFLIM-derived autofluorescence biomarkers can be used in machine-learning (ML) models to discriminate dysplastic and cancerous from healthy oral tissue. Clinical widefield maFLIM endoscopy imaging of cancerous and dysplastic oral lesions was performed at two clinical centers. Endoscopic maFLIM images from 34 patients acquired at one of the clinical centers were used to optimize ML models for automated discrimination of dysplastic and cancerous from healthy oral tissue. A computer-aided detection system was developed and applied to a set of endoscopic maFLIM images from 23 patients acquired at the other clinical center, and its performance was quantified in terms of the area under the receiver operating characteristic curve (ROC-AUC). Discrimination of dysplastic and cancerous from healthy oral tissue was achieved with an ROC-AUC of 0.81. This study demonstrates the capabilities of widefield maFLIM endoscopy to clinically image autofluorescence biomarkers that can be used in ML models to discriminate dysplastic and cancerous from healthy oral tissue. Widefield maFLIM endoscopy thus holds potential for automated in situ detection of oral dysplasia and cancer.
Collapse
|
13
|
Calin MA, Macovei A, Savastru R, Nica AS, Parasca SV. New evidence from hyperspectral imaging analysis on the effect of photobiomodulation therapy on normal skin oxygenation. Lasers Med Sci 2021; 37:1539-1547. [PMID: 34436694 DOI: 10.1007/s10103-021-03397-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 08/06/2021] [Indexed: 11/24/2022]
Abstract
The aim of this study was to assess the changes induced by photobiomodulation therapy in oxygenation of normal skin and underlying tissue using hyperspectral imaging combined with a chemometric regression approach. Eleven healthy adult volunteers were enrolled in this study. The dorsal side of the left hand of each subject was exposed to photobiomodulation therapy, while the correspondent side of the right hand was used as a control (placebo effect). Laser irradiation was performed with a laser diode system (635 nm, 15mW, 9 J/cm2) for 900 s. Changes in skin oxygenation were assessed before and after applying the photobiomodulation therapy and placebo using the hyperspectral imaging. Hyperspectral data analysis showed that variations of oxyhemoglobin and deoxyhemoglobin concentrations had no statistical significance in both groups. In conclusion, photobiomodulation therapy does not induce changes in oxyhemoglobin and deoxyhemoglobin concentrations in the normal skin measured from hyperspectral images, at least at λ = 635 nm and 900-s exposure time.
Collapse
Affiliation(s)
- Mihaela Antonina Calin
- National Institute of Research and Development for Optoelectronics INOE 2000, 409 Atomistilor Street, P.O. Box MG5, 077125, Magurele, Ilfov, Romania.
| | - Adrian Macovei
- Gen. Dr. Aviator Victor Anastasiu National Institute of Aeronautical and Space Medicine, 88 Mircea Vulcanescu Street, Bucharest, Romania
| | - Roxana Savastru
- National Institute of Research and Development for Optoelectronics INOE 2000, 409 Atomistilor Street, P.O. Box MG5, 077125, Magurele, Ilfov, Romania
| | - Adriana Sarah Nica
- Physical Medicine and Balneoclimatology, National Institute of Rehabilitation, Clinique III, 11th Ion Mihalache Street, Bucharest, Romania.,Carol Davila University of Medicine and Pharmacy, 37 Dionisie Lupu Street, Bucharest, Romania
| | - Sorin Viorel Parasca
- Carol Davila University of Medicine and Pharmacy, 37 Dionisie Lupu Street, Bucharest, Romania.,Emergency Clinical Hospital for Plastic, Reconstructive Surgery and Burns, 218 Grivitei Street, Bucharest, Romania
| |
Collapse
|
14
|
Wu Q, Wu Z, Zhang L, Wang H. Clinical Application of Medical Imaging in Neurointerventional Treatment of Brain Diseases. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
The incidence rate of cerebral infarction is high, and the risk of death is also grown significantly with age. Atherosclerotic stenosis is a part of the main causes of cerebral infarction. The effect of drug conservative therapy is not ideal. Interventional therapy is tantamount to
send the guidewire, catheter and so on to the lesion site using imaging means, and operates the local area to achieve the purpose of a precise treatment. Therefore, it is important to explore the characteristics and high-risk factors of complications for clinical prevention and guidance of
treatment righteousness. This study was to investigate the clinical effect of digital subtraction angiography (DSA) in the treatment of ischemic cerebrovascular disease. Also, this paper discusses the clinical effect of digital subtraction angiography (DSA) in the treatment of cerebral infarction.
It has been proved that the application of flat detector CT in the interventional room can not only obtain high-quality 3D angiography (3D rotational angiography), but also display the vessels and high-density structures (skeleton, vascular clamp, coil, stent, and ingenious plaque). Fd-ct
has also been proved to be able to perform 3D reconstruction on the stent placed in the patient’s heart and the stent of the external carotid artery. Compared with multi-slice spiral CT, the stent is much clearer and can be used to evaluate the soil and stent placement in the treatment
of aneurysms.
Collapse
Affiliation(s)
- Qidong Wu
- Department of Neurosurgery, Mingguang People's Hospital, Mingguang Anhui, 239400 China
| | - Zongliang Wu
- Department of Neurosurgery, Mingguang People's Hospital, Mingguang Anhui, 239400 China
| | - Lei Zhang
- Department of Neurosurgery, Mingguang People's Hospital, Mingguang Anhui, 239400 China
| | - Haiyang Wang
- Department of Neurosurgery, Mingguang People's Hospital, Mingguang Anhui, 239400 China
| |
Collapse
|
15
|
Ma L, Shahedi M, Shi T, Halicek M, Little JV, Chen AY, Myers LL, Sumer BD, Fei B. Pixel-level Tumor Margin Assessment of Surgical Specimen with Hyperspectral Imaging and Deep Learning Classification. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11598:1159811. [PMID: 35755403 PMCID: PMC9232191 DOI: 10.1117/12.2581046] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Surgery is a major treatment method for squamous cell carcinoma (SCC). During surgery, insufficient tumor margin may lead to local recurrence of cancer. Hyperspectral imaging (HSI) is a promising optical imaging technique for in vivo cancer detection and tumor margin assessment. In this study, a fully convolutional network (FCN) was implemented for tumor classification and margin assessment on hyperspectral images of SCC. The FCN was trained and validated with hyperspectral images of 25 ex vivo SCC surgical specimens from 20 different patients. The network was evaluated per patient and achieved pixel-level tissue classification with an average area under the curve (AUC) of 0.88, as well as 0.83 accuracy, 0.84 sensitivity, and 0.70 specificity across all the 20 patients. The 95% Hausdorff distance of assessed tumor margin in 17 patients was less than 2 mm, and the classification time of each tissue specimen took less than 10 seconds. The proposed methods can potentially facilitate intraoperative tumor margin assessment and improve surgical outcomes.
Collapse
Affiliation(s)
- Ling Ma
- Department of Bioengineering, University of Texas at Dallas
- State Key Laboratory of Precision Measurement Technology and Instrument, Tianjin University
| | - Maysam Shahedi
- Department of Bioengineering, University of Texas at Dallas
| | - Ted Shi
- Department of Bioengineering, University of Texas at Dallas
| | - Martin Halicek
- Department of Bioengineering, University of Texas at Dallas
| | - James V. Little
- Department of Pathology and Laboratory Medicine, Emory University
| | - Amy Y. Chen
- Department of Otolaryngology, Emory University
| | - Larry L. Myers
- Department of Otolaryngology, University of Texas Southwestern Medical Center
| | - Baran D. Sumer
- Department of Otolaryngology, University of Texas Southwestern Medical Center
| | - Baowei Fei
- Department of Bioengineering, University of Texas at Dallas
- Advanced Imaging Research Center, University of Texas Southwestern Medical Center
- Department of Radiology, University of Texas Southwestern Medical Center
| |
Collapse
|
16
|
Edwards K, Halicek M, Little JV, Chen AY, Fei B. Multiparametric Radiomics for Predicting the Aggressiveness of Papillary Thyroid Carcinoma Using Hyperspectral Images. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11597:1159728. [PMID: 35756897 PMCID: PMC9232190 DOI: 10.1117/12.2582147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Papillary thyroid carcinoma (PTC) is primarily treated by surgical resection. During surgery, surgeons often need intraoperative frozen analysis and pathologic consultation in order to detect PTC. In some cases pathologists cannot determine if the tumor is aggressive until the operation has been completed. In this work, we have taken tumor classification a step further by determining the tumor aggressiveness of fresh surgical specimens. We employed hyperspectral imaging (HSI) in combination with multiparametric radiomic features to complete this task. The study cohort includes 72 ex-vivo tissue specimens from 44 patients with pathology-confirmed PTC. A total of 67 features were extracted from this data. Using machine learning classification methods, we were able to achieve an AUC of 0.85. Our study shows that hyperspectral imaging and multiparametric radiomic features could aid in the pathological detection of tumor aggressiveness using fresh surgical spemens obtained during surgery.
Collapse
Affiliation(s)
- Ka’Toria Edwards
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Martin Halicek
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - James V. Little
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA
| | - Amy Y. Chen
- Department of Otolaryngology, Emory University School of Medicine, Atlanta, GA
| | - Baowei Fei
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Department of Radiology, The University of Texas Southwestern Medical Center, Dallas, TX
| |
Collapse
|
17
|
Wang Q, Sun L, Wang Y, Zhou M, Hu M, Chen J, Wen Y, Li Q. Identification of Melanoma From Hyperspectral Pathology Image Using 3D Convolutional Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:218-227. [PMID: 32956043 DOI: 10.1109/tmi.2020.3024923] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Skin biopsy histopathological analysis is one of the primary methods used for pathologists to assess the presence and deterioration of melanoma in clinical. A comprehensive and reliable pathological analysis is the result of correctly segmented melanoma and its interaction with benign tissues, and therefore providing accurate therapy. In this study, we applied the deep convolution network on the hyperspectral pathology images to perform the segmentation of melanoma. To make the best use of spectral properties of three dimensional hyperspectral data, we proposed a 3D fully convolutional network named Hyper-net to segment melanoma from hyperspectral pathology images. In order to enhance the sensitivity of the model, we made a specific modification to the loss function with caution of false negative in diagnosis. The performance of Hyper-net surpassed the 2D model with the accuracy over 92%. The false negative rate decreased by nearly 66% using Hyper-net with the modified loss function. These findings demonstrated the ability of the Hyper-net for assisting pathologists in diagnosis of melanoma based on hyperspectral pathology images.
Collapse
|
18
|
Ma L, Fei B. Comprehensive review of surgical microscopes: technology development and medical applications. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-200292VRR. [PMID: 33398948 PMCID: PMC7780882 DOI: 10.1117/1.jbo.26.1.010901] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2020] [Accepted: 12/04/2020] [Indexed: 05/06/2023]
Abstract
SIGNIFICANCE Surgical microscopes provide adjustable magnification, bright illumination, and clear visualization of the surgical field and have been increasingly used in operating rooms. State-of-the-art surgical microscopes are integrated with various imaging modalities, such as optical coherence tomography (OCT), fluorescence imaging, and augmented reality (AR) for image-guided surgery. AIM This comprehensive review is based on the literature of over 500 papers that cover the technology development and applications of surgical microscopy over the past century. The aim of this review is threefold: (i) providing a comprehensive technical overview of surgical microscopes, (ii) providing critical references for microscope selection and system development, and (iii) providing an overview of various medical applications. APPROACH More than 500 references were collected and reviewed. A timeline of important milestones during the evolution of surgical microscope is provided in this study. An in-depth technical overview of the optical system, mechanical system, illumination, visualization, and integration with advanced imaging modalities is provided. Various medical applications of surgical microscopes in neurosurgery and spine surgery, ophthalmic surgery, ear-nose-throat (ENT) surgery, endodontics, and plastic and reconstructive surgery are described. RESULTS Surgical microscopy has been significantly advanced in the technical aspects of high-end optics, bright and shadow-free illumination, stable and flexible mechanical design, and versatile visualization. New imaging modalities, such as hyperspectral imaging, OCT, fluorescence imaging, photoacoustic microscopy, and laser speckle contrast imaging, are being integrated with surgical microscopes. Advanced visualization and AR are being added to surgical microscopes as new features that are changing clinical practices in the operating room. CONCLUSIONS The combination of new imaging technologies and surgical microscopy will enable surgeons to perform challenging procedures and improve surgical outcomes. With advanced visualization and improved ergonomics, the surgical microscope has become a powerful tool in neurosurgery, spinal, ENT, ophthalmic, plastic and reconstructive surgeries.
Collapse
Affiliation(s)
- Ling Ma
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
| | - Baowei Fei
- University of Texas at Dallas, Department of Bioengineering, Richardson, Texas, United States
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, Texas, United States
| |
Collapse
|
19
|
Parallel Classification Pipelines for Skin Cancer Detection Exploiting Hyperspectral Imaging on Hybrid Systems. ELECTRONICS 2020. [DOI: 10.3390/electronics9091503] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The early detection of skin cancer is of crucial importance to plan an effective therapy to treat the lesion. In routine medical practice, the diagnosis is based on the visual inspection of the lesion and it relies on the dermatologists’ expertise. After a first examination, the dermatologist may require a biopsy to confirm if the lesion is malignant or not. This methodology suffers from false positives and negatives issues, leading to unnecessary surgical procedures. Hyperspectral imaging is gaining relevance in this medical field since it is a non-invasive and non-ionizing technique, capable of providing higher accuracy than traditional imaging methods. Therefore, the development of an automatic classification system based on hyperspectral images could improve the medical practice to distinguish pigmented skin lesions from malignant, benign, and atypical lesions. Additionally, the system can assist general practitioners in first aid care to prevent noncritical lesions from reaching dermatologists, thereby alleviating the workload of medical specialists. In this paper is presented a parallel pipeline for skin cancer detection that exploits hyperspectral imaging. The computational times of the serial processing have been reduced by adopting multicore and many-core technologies, such as OpenMP and CUDA paradigms. Different parallel approaches have been combined, leading to the development of fifteen classification pipeline versions. Experimental results using in-vivo hyperspectral images show that a hybrid parallel approach is capable of classifying an image of 50 × 50 pixels with 125 bands in less than 1 s.
Collapse
|
20
|
Halicek M, Dormer JD, Little JV, Chen AY, Fei B. Tumor detection of the thyroid and salivary glands using hyperspectral imaging and deep learning. BIOMEDICAL OPTICS EXPRESS 2020; 11:1383-1400. [PMID: 32206417 PMCID: PMC7075628 DOI: 10.1364/boe.381257] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 01/24/2020] [Accepted: 01/25/2020] [Indexed: 05/05/2023]
Abstract
The performance of hyperspectral imaging (HSI) for tumor detection is investigated in ex-vivo specimens from the thyroid (N = 200) and salivary glands (N = 16) from 82 patients. Tissues were imaged with HSI in broadband reflectance and autofluorescence modes. For comparison, the tissues were imaged with two fluorescent dyes. Additionally, HSI was used to synthesize three-band RGB multiplex images to represent the human-eye response and Gaussian RGBs, which are referred to as HSI-synthesized RGB images. Using histological ground truths, deep learning algorithms were developed for tumor detection. For the classification of thyroid tumors, HSI-synthesized RGB images achieved the best performance with an AUC score of 0.90. In salivary glands, HSI had the best performance with 0.92 AUC score. This study demonstrates that HSI could aid surgeons and pathologists in detecting tumors of the thyroid and salivary glands.
Collapse
Affiliation(s)
- Martin Halicek
- The University of Texas at Dallas, Department of Bioengineering, Richardson, TX 75080, USA
- Emory University and Georgia Institute of Technology, Department of Biomedical Engineering, Atlanta, GA 30332, USA
| | - James D. Dormer
- The University of Texas at Dallas, Department of Bioengineering, Richardson, TX 75080, USA
| | - James V. Little
- Emory University School of Medicine, Department of Pathology and Laboratory Medicine, Atlanta, GA 30322, USA
| | - Amy Y. Chen
- Emory University School of Medicine, Department of Otolaryngology, Atlanta, GA 30322, USA
| | - Baowei Fei
- The University of Texas at Dallas, Department of Bioengineering, Richardson, TX 75080, USA
- The University of Texas Southwestern Medical Center, Department of Radiology, Dallas, TX 75080, USA
| |
Collapse
|
21
|
Halicek M, Dormer JD, Little JV, Chen AY, Myers L, Sumer BD, Fei B. Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning. Cancers (Basel) 2019; 11:E1367. [PMID: 31540063 PMCID: PMC6769839 DOI: 10.3390/cancers11091367] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2019] [Revised: 09/04/2019] [Accepted: 09/12/2019] [Indexed: 01/27/2023] Open
Abstract
Surgical resection of head and neck (H and N) squamous cell carcinoma (SCC) may yield inadequate surgical cancer margins in 10 to 20% of cases. This study investigates the performance of label-free, reflectance-based hyperspectral imaging (HSI) and autofluorescence imaging for SCC detection at the cancer margin in excised tissue specimens from 102 patients and uses fluorescent dyes for comparison. Fresh surgical specimens (n = 293) were collected during H and N SCC resections (n = 102). The tissue specimens were imaged with reflectance-based HSI and autofluorescence imaging and afterwards with two fluorescent dyes for comparison. A histopathological ground truth was made. Deep learning tools were developed to detect SCC with new patient samples (inter-patient) and machine learning for intra-patient tissue samples. Area under the curve (AUC) of the receiver-operator characteristic was used as the main evaluation metric. Additionally, the performance was estimated in mm increments circumferentially from the tumor-normal margin. In intra-patient experiments, HSI classified conventional SCC with an AUC of 0.82 up to 3 mm from the cancer margin, which was more accurate than proflavin dye and autofluorescence (both p < 0.05). Intra-patient autofluorescence imaging detected human papilloma virus positive (HPV+) SCC with an AUC of 0.99 at 3 mm and greater accuracy than proflavin dye (p < 0.05). The inter-patient results showed that reflectance-based HSI and autofluorescence imaging outperformed proflavin dye and standard red, green, and blue (RGB) images (p < 0.05). In new patients, HSI detected conventional SCC in the larynx, oropharynx, and nasal cavity with 0.85-0.95 AUC score, and autofluorescence imaging detected HPV+ SCC in tonsillar tissue with 0.91 AUC score. This study demonstrates that label-free, reflectance-based HSI and autofluorescence imaging methods can accurately detect the cancer margin in ex-vivo specimens within minutes. This non-ionizing optical imaging modality could aid surgeons and reduce inadequate surgical margins during SCC resections.
Collapse
Affiliation(s)
- Martin Halicek
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USA
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA 30329, USA
| | - James D Dormer
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USA
| | - James V Little
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA
| | - Amy Y Chen
- Department of Otolaryngology, Emory University School of Medicine, Atlanta, GA 30322, USA
| | - Larry Myers
- Department of Otolaryngology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | - Baran D Sumer
- Department of Otolaryngology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA
| | - Baowei Fei
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USA.
- Advanced Imaging Research Center, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
- Department of Radiology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
| |
Collapse
|