Hyperspectral Imaging for the Detection of Glioblastoma Tumor Cells in H&E Slides Using Convolutional Neural Networks

Real-Time Intraoperative Decision-Making in Head and Neck Tumor Surgery: A Histopathologically Grounded Hyperspectral Imaging and Deep Learning Approach

BACKGROUND

Accurate and rapid intraoperative tumor margin assessment remains a major challenge in surgical oncology. Current gold-standard methods, such as frozen section histology, are time-consuming, operator-dependent, and prone to misclassification, which limits their clinical utility.

OBJECTIVE

To develop and evaluate a novel hyperspectral imaging (HSI) workflow that integrates deep learning with three-dimensional (3D) tumor modeling for real-time, label-free tumor margin delineation in head and neck squamous cell carcinoma (HNSCC).

METHODS

Freshly resected HNSCC samples were snap-frozen and imaged ex vivo from multiple perspectives using a standardized HSI protocol, resulting in a 3D model derived from HSI. Each sample was serially sectioned, stained, and annotated by pathologists to create high-resolution 3D histological reconstructions. The volumetric histological models were co-registered with the HSI data (n = 712 Datacubes), enabling voxel-wise projection of tumor segmentation maps from the HSI-derived 3D model onto the corresponding histological ground truth. Three deep learning models were trained and validated on these datasets to differentiate tumor from non-tumor regions with high spatial precision.

RESULTS

This work demonstrates strong potential for the proposed HSI system, with an overall classification accuracy of 0.98 and a tumor sensitivity of 0.93, underscoring the system's ability to reliably detect tumor regions and showing high concordance with histopathological findings.

CONCLUSION

The integration of HSI with deep learning and 3D tumor modeling offers a promising approach for precise, real-time intraoperative tumor margin assessment in HNSCC. This novel workflow has the potential to improve surgical precision and patient outcomes by providing rapid, label-free tissue differentiation.

Using hyperspectral imaging to predict the occurrence of delayed graft function

Delayed Graft Function (DGF) is a prevalent complication in kidney transplantation (KT) that significantly affects allograft function and patient prognosis. Early and precise identification of DGF is crucial for improving post-transplant outcomes. In this study, we present KGnet, a predictive model leveraging hyperspectral imaging (HSI) to assess delayed graft function status. We analyzed 72 zero-hour biopsy samples from transplanted kidneys with confirmed pathological diagnoses, capturing spectral data across a wavelength range of 400 to 1000 nm. By examining spectral signatures related to tissue oxygenation, perfusion, and metabolic states, our approach enabled the detection of subtle biochemical changes indicative of DGF risk. The preprocessed spectral data were input into KGnet, achieving a prediction accuracy of 94 % for DGF occurrence, significantly outperforming existing predictive models. This study identifies key spectral signatures associated with DGF, allowing for precise risk prediction even before clinical symptoms emerge. Leveraging HSI for early detection introduces a novel pathway for individualized post-transplant management, offering substantial potential to enhance kidney transplantation outcomes and patient quality of life. These findings highlight significant clinical and research implications for the broader application of HSI in transplant medicine.

Deep learning-based hyperspectral technique identifies metastatic lymph nodes in oral squamous cell carcinoma-A pilot study

AIMS

To establish a system based on hyperspectral imaging and deep learning for the detection of cancer cells in metastatic lymph nodes.

MAIN METHODS

The continuous sections of metastatic lymph nodes from 45 oral squamous cell carcinoma (OSCC) patients were collected. An improved ResUNet algorithm was established for deep learning to analyze the spectral curve differences between cancer cells and lymphocytes, and that between tumor tissue and normal tissue.

KEY FINDINGS

It was found that cancer cells, lymphocytes, and erythrocytes in the metastatic lymph nodes could be distinguished basing hyperspectral image, with overall accuracy (OA) as 87.30% and average accuracy (AA) as 85.46%. Cancerous area could be recognized by hyperspectral image and deep learning, and the average intersection over union (IOU) and accuracy were 0.6253 and 0.7692, respectively.

SIGNIFICANCE

This study indicated that deep learning-based hyperspectral techniques can identify tumor tissue in OSCC metastatic lymph nodes, achieving high accuracy of pathological diagnosis, high work efficiency, and reducing work burden. But these are preliminary results limited to a small sample.

Advancing hyperspectral imaging and machine learning tools toward clinical adoption in tissue diagnostics: A comprehensive review

Hyperspectral imaging (HSI) has become an evident transformative apparatus in medical diagnostics. The review aims to appraise the present advancement and challenges in HSI for medical applications. It features a variety of medical applications namely diagnosing diabetic retinopathy, neurodegenerative diseases like Parkinson's and Alzheimer's, which illustrates its effectiveness in early diagnosis, early caries detection in periodontal disease, and dermatology by detecting skin cancer. Regardless of these advances, the challenges exist within every aspect that limits its broader clinical adoption. It has various constraints including difficulties with technology related to the complexity of the HSI system and needing specialist training, which may act as a drawback to its clinical settings. This article pertains to potential challenges expressed in medical applications and probable solutions to overcome these constraints. Successful companies that perform advanced solutions with HSI in terms of medical applications are being emphasized in this study to signal the high level of interest in medical diagnosis for systems to incorporate machine learning ML and artificial intelligence AI to foster precision diagnosis and standardized clinical workflow. This advancement signifies progressive possibilities of HSI in real-time clinical assessments. In conclusion despite HSI has been presented as a significant advanced medical imaging tool, addressing its limitations and probable solutions is for broader clinical adoption.

Advancing hyperspectral imaging and machine learning tools toward clinical adoption in tissue diagnostics: A comprehensive review

Hyperspectral imaging (HSI) has become an evident transformative apparatus in medical diagnostics. The review aims to appraise the present advancement and challenges in HSI for medical applications. It features a variety of medical applications namely diagnosing diabetic retinopathy, neurodegenerative diseases like Parkinson's and Alzheimer's, which illustrates its effectiveness in early diagnosis, early caries detection in periodontal disease, and dermatology by detecting skin cancer. Regardless of these advances, the challenges exist within every aspect that limits its broader clinical adoption. It has various constraints including difficulties with technology related to the complexity of the HSI system and needing specialist training, which may act as a drawback to its clinical settings. This article pertains to potential challenges expressed in medical applications and probable solutions to overcome these constraints. Successful companies that perform advanced solutions with HSI in terms of medical applications are being emphasized in this study to signal the high level of interest in medical diagnosis for systems to incorporate machine learning ML and artificial intelligence AI to foster precision diagnosis and standardized clinical workflow. This advancement signifies progressive possibilities of HSI in real-time clinical assessments. In conclusion despite HSI has been presented as a significant advanced medical imaging tool, addressing its limitations and probable solutions is for broader clinical adoption.

Evolution of Molecular Biomarkers and Precision Molecular Therapeutic Strategies in Glioblastoma

Glioblastoma is the most commonly occurring malignant brain tumor, with a high mortality rate despite current treatments. Its classification has evolved over the years to include not only histopathological features but also molecular findings. Given the heterogeneity of glioblastoma, molecular biomarkers for diagnosis have become essential for initiating treatment with current therapies, while new technologies for detecting specific variations using computational tools are being rapidly developed. Advances in molecular genetics have made possible the creation of tailored therapies based on specific molecular targets, with various degrees of success. This review provides an overview of the latest advances in the fields of histopathology and radiogenomics and the use of molecular markers for management of glioblastoma, as well as the development of new therapies targeting the most common molecular markers. Furthermore, we offer a summary of the results of recent preclinical and clinical trials to recognize the current trends of investigation and understand the possible future directions of molecular targeted therapies in glioblastoma.

Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems

Brain cancer is a substantial factor in the mortality associated with cancer, presenting difficulties in the timely identification of the disease. The precision of diagnoses is significantly dependent on the proficiency of radiologists and neurologists. Although there is potential for early detection with computer-aided diagnosis (CAD) algorithms, the majority of current research is hindered by its modest sample sizes. This meta-analysis aims to comprehensively assess the diagnostic test accuracy (DTA) of computer-aided design (CAD) models specifically designed for the detection of brain cancer utilizing hyperspectral (HSI) technology. We employ Quadas-2 criteria to choose seven papers and classify the proposed methodologies according to the artificial intelligence method, cancer type, and publication year. In order to evaluate heterogeneity and diagnostic performance, we utilize Deeks' funnel plot, the forest plot, and accuracy charts. The results of our research suggest that there is no notable variation among the investigations. The CAD techniques that have been examined exhibit a notable level of precision in the automated detection of brain cancer. However, the absence of external validation hinders their potential implementation in real-time clinical settings. This highlights the necessity for additional studies in order to authenticate the CAD models for wider clinical applicability.

Sexually dimorphic computational histopathological signatures prognostic of overall survival in high-grade gliomas via deep learning

High-grade glioma (HGG) is an aggressive brain tumor. Sex is an important factor that differentially affects survival outcomes in HGG. We used an end-to-end deep learning approach on hematoxylin and eosin (H&E) scans to (i) identify sex-specific histopathological attributes of the tumor microenvironment (TME), and (ii) create sex-specific risk profiles to prognosticate overall survival. Surgically resected H&E-stained tissue slides were analyzed in a two-stage approach using ResNet18 deep learning models, first, to segment the viable tumor regions and second, to build sex-specific prognostic models for prediction of overall survival. Our mResNet-Cox model yielded C-index (0.696, 0.736, 0.731, and 0.729) for the female cohort and C-index (0.729, 0.738, 0.724, and 0.696) for the male cohort across training and three independent validation cohorts, respectively. End-to-end deep learning approaches using routine H&E-stained slides, trained separately on male and female patients with HGG, may allow for identifying sex-specific histopathological attributes of the TME associated with survival and, ultimately, build patient-centric prognostic risk assessment models.

Hybrid brain tumor classification of histopathology hyperspectral images by linear unmixing and an ensemble of deep neural networks

Hyperspectral imaging has demonstrated its potential to provide correlated spatial and spectral information of a sample by a non-contact and non-invasive technology. In the medical field, especially in histopathology, HSI has been applied for the classification and identification of diseased tissue and for the characterization of its morphological properties. In this work, we propose a hybrid scheme to classify non-tumor and tumor histological brain samples by hyperspectral imaging. The proposed approach is based on the identification of characteristic components in a hyperspectral image by linear unmixing, as a features engineering step, and the subsequent classification by a deep learning approach. For this last step, an ensemble of deep neural networks is evaluated by a cross-validation scheme on an augmented dataset and a transfer learning scheme. The proposed method can classify histological brain samples with an average accuracy of 88%, and reduced variability, computational cost, and inference times, which presents an advantage over methods in the state-of-the-art. Hence, the work demonstrates the potential of hybrid classification methodologies to achieve robust and reliable results by combining linear unmixing for features extraction and deep learning for classification.

Intelligent tumor tissue classification for Hybrid Health Care Units

Introduction

In the evolving healthcare landscape, we aim to integrate hyperspectral imaging into Hybrid Health Care Units to advance the diagnosis of medical diseases through the effective fusion of cutting-edge technology. The scarcity of medical hyperspectral data limits the use of hyperspectral imaging in disease classification.

Methods

Our study innovatively integrates hyperspectral imaging to characterize tumor tissues across diverse body locations, employing the Sharpened Cosine Similarity framework for tumor classification and subsequent healthcare recommendation. The efficiency of the proposed model is evaluated using Cohen's kappa, overall accuracy, and f1-score metrics.

Results

The proposed model demonstrates remarkable efficiency, with kappa of 91.76%, an overall accuracy of 95.60%, and an f1-score of 96%. These metrics indicate superior performance of our proposed model over existing state-of-the-art methods, even in limited training data.

Conclusion

This study marks a milestone in hybrid healthcare informatics, improving personalized care and advancing disease classification and recommendations.

Histological Hyperspectral Glioblastoma Dataset (HistologyHSI-GB)

Hyperspectral (HS) imaging (HSI) technology combines the main features of two existing technologies: imaging and spectroscopy. This allows to analyse simultaneously the morphological and chemical attributes of the objects captured by a HS camera. In recent years, the use of HSI provides valuable insights into the interaction between light and biological tissues, and makes it possible to detect patterns, cells, or biomarkers, thus, being able to identify diseases. This work presents the HistologyHSI-GB dataset, which contains 469 HS images from 13 patients diagnosed with brain tumours, specifically glioblastoma. The slides were stained with haematoxylin and eosin (H&E) and captured using a microscope at 20× power magnification. Skilled histopathologists diagnosed the slides and provided image-level annotations. The dataset was acquired using custom HSI instrumentation, consisting of a microscope equipped with an HS camera covering the spectral range from 400 to 1000 nm.

Custom Hyperspectral Imaging System Reveals Unique Spectral Signatures of Heart, Kidney, and Liver Tissues

The rapid advancement of diagnostic and therapeutic optical techniques for oncology demands a good understanding of the optical properties of biological tissues. This study explores the capabilities of hyperspectral (HS) cameras as a non-invasive and non-contact optical imaging system to distinguish and highlight spectral differences inbiological soft tissuesof three structures (kidney, heart, and liver) for use inendoscopic interventionoropen surgery. The study presents an optical system consisting of two individual setups, the transmission setup, and the reflection setup, both incorporating anHS camerawith apolychromatic light sourcewithin the range of 380 to 1050 nm to measure tissue's light transmission (Tr) and diffuse light reflectance (Rd), respectively. The optical system was calibrated with a customizedliquid optical phantom, then 30 samples from various organs were investigated fortissue characterizationby measuring both Tr and Rd at the visible and near infrared (VIS-NIR) band. We exploited the ANOVA test, subsequently by a Tukey's test on the created three independent clusters (kidney vs. heart: group I / kidney vs. liver: group II / heart vs. liver: group III) to identify the optimum wavelength for each tissue regarding their spectroscopic optical properties in the VIS-NIR spectrum. The optimum spectral span for the determined light Tr of the three groups was 640 ∼ 680 nm, and the ideal range was 720 ∼ 760 nm for the measured light Rd for mutual group I and group II. However, the group III range was different at a range of 520 ∼ 560 nm. Therefore, the investigation provides vital information concerning theoptimum spectral scalefor the computed light Tr and Rd of the investigatedbiological tissues(kidney, liver, and heart) to be employed in diagnostic andtherapeutic medical applications.

Preclinical Application of CEST MRI to Detect Early and Regional Tumor Response to Local Brain Tumor Treatment

Treating glioblastoma and monitoring treatment response non-invasively remain challenging. Here, we developed a robust approach using a drug-loaded liposomal hydrogel that is mechanically compatible with the brain, and, simultaneously, we successfully monitored early tumor response using Chemical Exchange Saturation Transfer (CEST) MRI. This CEST-detectable liposomal hydrogel was optimized based on a sustainable drug release and a soft hydrogel for the brain tumor, which is unfavorable for tumor cell proliferation. After injecting the hydrogel next to the tumor, three distinctive CEST contrasts enabled the monitoring of tumor response and drug release longitudinally at 3T. As a result, a continuous tumor volume decrease was observed in the treatment group along with a significant decrease in CEST contrasts relating to the tumor response at 3.5 ppm (Amide Proton Transfer; APT) and at -3.5 ppm (relayed Nuclear Overhauser Effect; rNOE) when compared to the control group (p < 0.05). Interestingly, the molecular change at 3.5 ppm on day 3 (p < 0.05) was found to be prior to the significant decrease in tumor volume on day 5. An APT signal also showed a strong correlation with the number of proliferating cells in the tumors. This demonstrated that APT detected a distinctive decrease in mobile proteins and peptides in tumors before the change in tumor morphology. Moreover, the APT signal showed a regional response to the treatment, associated with proliferating and apoptotic cells, which allowed an in-depth evaluation and prediction of the tumor treatment response. This newly developed liposomal hydrogel allows image-guided brain tumor treatment to address clinical needs using CEST MRI.

Optimization of a real-time LED based spectral imaging system

We are designing a real-time spectral imaging system using micro-LEDs and a high-speed micro-camera for potential endoscopic applications. Currently, gastrointestinal (GI) endoscopic imaging has largely been limited to white light imaging (WLI), while other endoscopic approaches have seen advancements in imaging techniques including fluorescence imaging, narrow-band imaging, and stereoscopic visualization. To further advance GI endoscopic imaging, we are working towards a high-speed spectral imaging system that can be implemented with a chip-on-tip design for a flexible endoscope. Hyperspectral imaging has potential applications in a variety of imaging procedures with its ability to discern spectral footprints of the imaging field in a series of two-dimensional images at different wavelengths. For investigating the feasibility of a real-time LED-based hyperspectral imaging system for endoscopic applications we designed and developed a large-scale prototype using through-hole LEDs, which is further analyzed as we design our future system. For high quality imaging, the LED array must be designed with the specific illumination patterns and intensities of each LED considered. We present our work in optimizing our current LED array through optical simulations performed in silico. Damped least squares and orthogonal descent algorithms are implemented to maximize irradiance power and improve illumination homogeneity at several working distances by adjusting radial distances of each LED from the camera. With our prototype LED-based hyperspectral imaging system, the simulation and optimization approach achieved an average increase of 8.36 ± 8.79% in irradiance and a 4.3% decrease in standard deviation at multiple working distances and field-of-views for each LED, as compared to the original design, leading to improved image quality and maintained acquisition speeds. This work highlights the value of in silico optical simulation and provides a framework for improved optical system design and will inform design decisions in future works.

Hyperspectral imaging benchmark based on machine learning for intraoperative brain tumour detection

Brain surgery is one of the most common and effective treatments for brain tumour. However, neurosurgeons face the challenge of determining the boundaries of the tumour to achieve maximum resection, while avoiding damage to normal tissue that may cause neurological sequelae to patients. Hyperspectral (HS) imaging (HSI) has shown remarkable results as a diagnostic tool for tumour detection in different medical applications. In this work, we demonstrate, with a robust k-fold cross-validation approach, that HSI combined with the proposed processing framework is a promising intraoperative tool for in-vivo identification and delineation of brain tumours, including both primary (high-grade and low-grade) and secondary tumours. Analysis of the in-vivo brain database, consisting of 61 HS images from 34 different patients, achieve a highest median macro F1-Score result of 70.2 ± 7.9% on the test set using both spectral and spatial information. Here, we provide a benchmark based on machine learning for further developments in the field of in-vivo brain tumour detection and delineation using hyperspectral imaging to be used as a real-time decision support tool during neurosurgical workflows.

Multispectral Imaging Method for Rapid Identification and Analysis of Paraffin-Embedded Pathological Tissues

The study of the interaction between light and biological tissue is of great help in the identification of diseases as well as structural alterations in tissues. In the present study, we have developed a tissue diagnostic technique by using multispectral imaging in the visible spectrum combined with principal component analysis (PCA). We used information from the propagation of light through paraffin-embedded tissues to assess differences in the eye tissues of control mouse embryos compared to mouse embryos whose mothers were deprived of folic acid (FA), a crucial vitamin necessary for the growth and development of the fetus. After acquiring the endmembers from the multispectral images, spectral unmixing was used to identify the abundances of those endmembers in each pixel. For each acquired image, the final analysis was performed by performing a pixel-by-pixel and wavelength-by-wavelength absorbance calculation. Non-negative least squares (NNLS) were used in this research. The abundance maps obtained for the first endmember revealed vascular alterations (vitreous and choroid) in the embryos with maternal FA deficiency. However, the abundance maps obtained for the third endmember showed alterations in the texture of some tissues such as the lens and retina. Results indicated that multispectral imaging applied to paraffin-embedded tissues enhanced tissue visualization. Using this method, first, it can be seen tissue damage location and then decide what kind of biological techniques to apply.

Deep ultraviolet high-resolution microscopic hyperspectral imager and its biological tissue detection

Ultraviolet (UV) hyperspectral imaging technology is commonly used in the field of atmospheric remote sensing. In recent years, some in-laboratory research has been carried out for substance detection and identification. In this paper, UV hyperspectral imaging technology is introduced into microscopy to better utilize the obvious absorption characteristics of components, such as proteins and nucleic acids in biological tissues in the ultraviolet band. A deep UV microscopic hyperspectral imager based on the Offner structure with F # 2.5, low spectral keystone and smile is designed and developed. A 0.68 numerical aperture microscope objective is designed. The spectral range of the system is from 200 nm to 430 nm; the spectral resolution is better than 0.5 nm; and the spatial resolution is better than 1.3 µm. The K562 cells can be distinguished by transmission spectrum of nucleus. The UV microscopic hyperspectral image of the unstained mouse liver slices showed similar results to the microscopic image after hematoxylin and eosin staining, which could help to simplify the pathological examination process. Both results show a great performance in spatial and spectral detecting capabilities of our instrument, which has the potential for biomedical research and diagnosis.

Blur-specific image quality assessment of microscopic hyperspectral images

Hyperspectral (HS) imaging (HSI) expands the number of channels captured within the electromagnetic spectrum with respect to regular imaging. Thus, microscopic HSI can improve cancer diagnosis by automatic classification of cells. However, homogeneous focus is difficult to achieve in such images, being the aim of this work to automatically quantify their focus for further image correction. A HS image database for focus assessment was captured. Subjective scores of image focus were obtained from 24 subjects and then correlated to state-of-the-art methods. Maximum Local Variation, Fast Image Sharpness block-based Method and Local Phase Coherence algorithms provided the best correlation results. With respect to execution time, LPC was the fastest.

Towards Real-Time Hyperspectral Multi-Image Super-Resolution Reconstruction Applied to Histological Samples

Hyperspectral Imaging (HSI) is increasingly adopted in medical applications for the usefulness of understanding the spectral signature of specific organic and non-organic elements. The acquisition of such images is a complex task, and the commercial sensors that can measure such images is scarce down to the point that some of them have limited spatial resolution in the bands of interest. This work proposes an approach to enhance the spatial resolution of hyperspectral histology samples using super-resolution. As the data volume associated to HSI has always been an inconvenience for the image processing in practical terms, this work proposes a relatively low computationally intensive algorithm. Using multiple images of the same scene taken in a controlled environment (hyperspectral microscopic system) with sub-pixel shifts between them, the proposed algorithm can effectively enhance the spatial resolution of the sensor while maintaining the spectral signature of the pixels, competing in performance with other state-of-the-art super-resolution techniques, and paving the way towards its use in real-time applications.

Conditional Generative Adversarial Network (cGAN) for Synthesis of Digital Histologic Images from Hyperspectral Images

Hyperspectral imaging (HSI) has been demonstrated in various digital pathology applications. However, the intrinsic high dimensionality of hyperspectral images makes it difficult for pathologists to visualize the information. The aim of this study is to develop a method to transform hyperspectral images of hemoxylin & eosin (H&E)-stained slides to natural-color RGB histologic images for easy visualization. Hyperspectral images were obtained at 40× magnification with an automated microscopic imaging system and downsampled by various factors to generate data equivalent to different magnifications. High-resolution digital histologic RGB images were cropped and registered to the corresponding hyperspectral images as the ground truth. A conditional generative adversarial network (cGAN) was trained to output natural color RGB images of the histological tissue samples. The generated synthetic RGBs have similar color and sharpness to real RGBs. Image classification was implemented using the real and synthetic RGBs, respectively, with a pretrained network. The classification of tumor and normal tissue using the HSI-synthesized RGBs yielded a comparable but slightly higher accuracy and AUC than the real RGBs. The proposed method can reduce the acquisition time of two imaging modalities while giving pathologists access to the high information density of HSI and the quality visualization of RGBs. This study demonstrated that HSI may provide a potentially better alternative to current RGB-based pathologic imaging and thus make HSI a viable tool for histopathological diagnosis.

An automatic whole-slide hyperspectral imaging microscope

Whole slide imaging (WSI) is a common step used in histopathology to quickly digitize stained histological slides. Digital whole-slide images not only improve the efficiency of labeling but also open the door for computer-aided diagnosis, specifically machine learning-based methods. Hyperspectral imaging (HSI) is an imaging modality that captures data in various wavelengths, some beyond the range of visible lights. In this study, we developed and implemented an automated microscopy system that can acquire hyperspectral whole slide images (HWSI). The system is robust since it consists of parts that can be swapped and bought from different manufacturers. We used the automated system and built a database of 49 HWSI of thyroid cancer. The automatic whole-slide hyperspectral imaging microscope can have many potential applications in biological and medical areas.

Estimating quantitative physiological and morphological tissue parameters of murine tumor models using hyperspectral imaging and optical profilometry

Understanding tumors and their microenvironment are essential for successful and accurate disease diagnosis. Tissue physiology and morphology are altered in tumors compared to healthy tissues, and there is a need to monitor tumors and their surrounding tissues, including blood vessels, non-invasively. This preliminary study utilizes a multimodal optical imaging system combining hyperspectral imaging (HSI) and three-dimensional (3D) optical profilometry (OP) to capture hyperspectral images and surface shapes of subcutaneously grown murine tumor models. Hyperspectral images are corrected with 3D OP data and analyzed using the inverse-adding doubling (IAD) method to extract tissue properties such as melanin volume fraction and oxygenation. Blood vessels are segmented using the B-COSFIRE algorithm from oxygenation maps. From 3D OP data, tumor volumes are calculated and compared to manual measurements using a vernier caliper. Results show that tumors can be distinguished from healthy tissue based on most extracted tissue parameters ( p < 0.05 ). Furthermore, blood oxygenation is 50% higher within the blood vessels than in the surrounding tissue, and tumor volumes calculated using 3D OP agree within 26% with manual measurements using a vernier caliper. Results suggest that combining HSI and OP could provide relevant quantitative information about tumors and improve the disease diagnosis.

Deep Learning in Medical Hyperspectral Images: A Review

With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.

Double spiral chip-embedded micro-trapezoid filters (SMT filters) for the sensitive isolation of CTCs of prostate cancer by spectral detection

Circulating tumor cells (CTCs) are cancer cells that are released from the original tumor and circulate in the blood vessels, carrying greatly similar constituents as the original tumor. Therefore, CTCs have a significant value in cancer prognosis, early diagnosis, and anti-cancer therapy. However, their rarity and heterogeneity make the isolation of CTCs an arduous task. In the present research, we propose a double spiral chip-embedded micro-trapezoid filter (SMT filter) for the sensitive isolation of the CTCs of prostate cancer by spectral detection. SMT filters were elongated to effectively capture CTCs and this distinctive design was conducive to their isolation and enrichment. The SMT filters were verified with tumor cells and artificial patient blood with a capture efficiency as high as 94% at a flow rate of 1.5 mL h^-1. As a further validation, the SMT filters were validated in isolating CTCs from 10 prostate cancers and other cancers in 4 mL blood samples. Also, the CTCs tested positive for each patient blood sample, ranging from 83-114 CTCs. Significantly, we advanced hyperspectral imaging to detect the characteristic spectrum of CTCs both captured in situ on SMT filters and enriched after isolation. The CTCs could be positively identified by hyperspectral imaging with complete integrity of the cell morphology and an improved characteristic spectrum. This represents a breakthrough in the conventional surface-enhanced Raman scattering (SERS) spectroscopy of nanoparticles. Also, the characteristic spectrum of the CTCs would be highly beneficial for distinguishing the cancer type and accurate for enumerating tumor cells with varied intensities. Furthermore, a novel integrated flower-shaped microfilter was presented with all these aforementioned merits. The success of both the SMT filters and characteristic spectral detection indicated their feasibility for further clinical analysis, the evaluation of cancer therapy, and for potential application.

A hyperspectral dataset of precancerous lesions in gastric cancer and benchmarks for pathological diagnosis

Gastric cancer (GC) is one of the most common cancers worldwide. A lot of studies have found that early GC has good prognosis. Unfortunately, the diagnosis rate of early GC is suboptimal due to inadequate disease screening and the insidious nature of early lesions. Pathological diagnosis is usually regarded as the "gold standard" for the diagnosis of GC. However, traditional pathological diagnosis is tedious and time-consuming. With the development of deep learning, computer-aided diagnosis is widely used to assist pathologists for diagnosis. As conventional pathology, diagnosis is based on color images, it is not as informative as hyperspectral imaging, which introduces spectroscopy into imaging techniques. This article combines microscopic hyperspectral image (HSI) with deep learning networks to assist in the diagnosis of precancerous lesions in gastric cancer (PLGC). A large scale microscopic hyperspectral PLGC dataset with 924 effective scenes is built and self-supervised learning is adopted to provide pretrained models for HSI. These pretrained models effectively improve the performance of downstream classification tasks. Furthermore, a symmetrically deep connected network is proposed to train with images from different imaging modalities and improve the diagnostic accuracy to 96.59%.

Hyperspectral three-dimensional absorption imaging using snapshot optical tomography

Hyperspectral imaging (HSI) records a series of two-dimensional (2D) images for different wavelengths to provide the chemical fingerprint at each pixel. Combining HSI with a tomographic data acquisition method, we can obtain the chemical fingerprint of a sample at each point in three-dimensional (3D) space. The so-called 3D HSI typically suffers from low imaging throughput due to the requirement of scanning the wavelength and rotating the beam or sample. In this paper we present an optical system which captures the entire four-dimensional (4D), i.e., 3D structure and 1D spectrum, dataset of a sample with the same throughput of conventional HSI systems. Our system works by combining snapshot projection optical tomography (SPOT) which collects multiple projection images with a single snapshot, and Fourier-transform spectroscopy (FTS) which results in superior spectral resolution by collecting and processing a series of interferogram images. Using this hyperspectral SPOT system we imaged the volumetric absorbance of dyed polystyrene microbeads, oxygenated red blood cells (RBCs), and deoxygenated RBCs. The 4D optical system demonstrated in this paper provides a tool for high-throughput chemical imaging of complex microscopic specimens.

Applications of Artificial Intelligence Based on Medical Imaging in Glioma: Current State and Future Challenges

Glioma is one of the most fatal primary brain tumors, and it is well-known for its difficulty in diagnosis and management. Medical imaging techniques such as magnetic resonance imaging (MRI), positron emission tomography (PET), and spectral imaging can efficiently aid physicians in diagnosing, treating, and evaluating patients with gliomas. With the increasing clinical records and digital images, the application of artificial intelligence (AI) based on medical imaging has reduced the burden on physicians treating gliomas even further. This review will classify AI technologies and procedures used in medical imaging analysis. Additionally, we will discuss the applications of AI in glioma, including tumor segmentation and classification, prediction of genetic markers, and prediction of treatment response and prognosis, using MRI, PET, and spectral imaging. Despite the benefits of AI in clinical applications, several issues such as data management, incomprehension, safety, clinical efficacy evaluation, and ethical or legal considerations, remain to be solved. In the future, doctors and researchers should collaborate to solve these issues, with a particular emphasis on interdisciplinary teamwork.

Review on the Application of Hyperspectral Imaging Technology of the Exposed Cortex in Cerebral Surgery

The study of brain science is vital to human health. The application of hyperspectral imaging in biomedical fields has grown dramatically in recent years due to their unique optical imaging method and multidimensional information acquisition. Hyperspectral imaging technology can acquire two-dimensional spatial information and one-dimensional spectral information of biological samples simultaneously, covering the ultraviolet, visible and infrared spectral ranges with high spectral resolution, which can provide diagnostic information about the physiological, morphological and biochemical components of tissues and organs. This technology also presents finer spectral features for brain imaging studies, and further provides more auxiliary information for cerebral disease research. This paper reviews the recent advance of hyperspectral imaging in cerebral diagnosis. Firstly, the experimental setup, image acquisition and pre-processing, and analysis methods of hyperspectral technology were introduced. Secondly, the latest research progress and applications of hyperspectral imaging in brain tissue metabolism, hemodynamics, and brain cancer diagnosis in recent years were summarized briefly. Finally, the limitations of the application of hyperspectral imaging in cerebral disease diagnosis field were analyzed, and the future development direction was proposed.

Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging

SIGNIFICANCE

Hyperspectral imaging (HSI) provides rich spectral information for improved histopathological cancer detection. However, acquiring high-resolution HSI data for whole-slide imaging (WSI) can be time-consuming and requires a huge amount of storage space.

AIM

WSI using a color camera can be achieved with fast speed, high image resolution, and excellent image quality due to the established techniques. We aim to develop an RGB-guided unsupervised hyperspectral super-resolution reconstruction method that is hypothesized to improve image quality while maintaining the spectral characteristics.

APPROACH

High-resolution hyperspectral images of 32 histologic slides were obtained via automated WSI. High-resolution RGB histology images were registered to the hyperspectral images for RGB guidance. An unsupervised super-resolution network was trained to take the downsampled low-resolution hyperspectral patches (LR-HSI) and high-resolution RGB patches (HR-RGB) as inputs to reconstruct high-resolution hyperspectral patches (HR-HSI). Then, an Inception-based network was trained with the HR-RGB, original HR-HSI, and generated HR-HSI, respectively, for whole-slide histopathological cancer detection.

RESULTS

Our super-resolution reconstruction network generated high-resolution hyperspectral images with well-maintained spectral characteristics and improved image quality. Image classification using the original hyperspectral data outperformed RGB because of the extra spectral information. The generated hyperspectral image patches further improved the results.

CONCLUSIONS

The proposed method potentially reduces image acquisition time, saves storage space without compromising image quality, and improves the image classification performance.

Automatic detection of head and neck squamous cell carcinoma on histologic slides using hyperspectral microscopic imaging

SIGNIFICANCE

Automatic, fast, and accurate identification of cancer on histologic slides has many applications in oncologic pathology.

AIM

The purpose of this study is to investigate hyperspectral imaging (HSI) for automatic detection of head and neck cancer nuclei in histologic slides, as well as cancer region identification based on nuclei detection.

APPROACH

A customized hyperspectral microscopic imaging system was developed and used to scan histologic slides from 20 patients with squamous cell carcinoma (SCC). Hyperspectral images and red, green, and blue (RGB) images of the histologic slides with the same field of view were obtained and registered. A principal component analysis-based nuclei segmentation method was developed to extract nuclei patches from the hyperspectral images and the coregistered RGB images. Spectra-based support vector machine and patch-based convolutional neural networks (CNNs) were implemented for nuclei classification. The CNNs were trained with RGB patches (RGB-CNN) and hyperspectral patches (HSI-CNN) of the segmented nuclei and the utility of the extra spectral information provided by HSI was evaluated. Furthermore, cancer region identification was implemented by image-wise classification based on the percentage of cancerous nuclei detected in each image.

RESULTS

RGB-CNN, which mainly used the spatial information of nuclei, resulted in a 0.81 validation accuracy and 0.74 testing accuracy. HSI-CNN, which utilized the spatial and spectral features of the nuclei, showed significant improvement in classification performance and achieved 0.89 validation accuracy as well as 0.82 testing accuracy. Furthermore, the image-wise cancer region identification based on nuclei detection could generally improve the cancer detection rate.

CONCLUSIONS

We demonstrated that the morphological and spectral information contribute to SCC nuclei differentiation and that the spectral information within hyperspectral images could improve classification performance.

Tumor cell identification and classification in esophageal adenocarcinoma specimens by hyperspectral imaging

Esophageal cancer is the sixth leading cause of cancer-related death worldwide. Histopathological confirmation is a key step in tumor diagnosis. Therefore, simplification in decision-making by discrimination between malignant and non-malignant cells of histological specimens can be provided by combination of new imaging technology and artificial intelligence (AI). In this work, hyperspectral imaging (HSI) data from 95 patients were used to classify three different histopathological features (squamous epithelium cells, esophageal adenocarcinoma (EAC) cells, and tumor stroma cells), based on a multi-layer perceptron with two hidden layers. We achieved an accuracy of 78% for EAC and stroma cells, and 80% for squamous epithelium. HSI combined with machine learning algorithms is a promising and innovative technique, which allows image acquisition beyond Red–Green–Blue (RGB) images. Further method validation and standardization will be necessary, before automated tumor cell identification algorithms can be used in daily clinical practice.

Unsupervised Super Resolution Network for Hyperspectral Histologic Imaging

Hyperspectral imaging (HSI) has many advantages in microscopic applications, including high sensitivity and specificity for cancer detection on histological slides. However, acquiring hyperspectral images of a whole slide with a high image resolution and a high image quality can take a long scanning time and require a very large data storage. One potential solution is to acquire and save low-resolution hyperspectral images and reconstruct the high-resolution ones only when needed. The purpose of this study is to develop a simple yet effective unsupervised super resolution network for hyperspectral histologic imaging with the guidance of RGB digital histology images. High-resolution hyperspectral images of hemoxylin & eosin (H&E) stained slides were obtained at 10× magnification and down-sampled 2×, 4×, and 5× to generate low-resolution hyperspectral data. High-resolution digital histologic RGB images of the same field of view (FOV) were cropped and registered to the corresponding high-resolution hyperspectral images. A neural network based on a modified U-Net architecture, which takes the low-resolution hyperspectral images and high-resolution RGB images as inputs, was trained with unsupervised methods to output high-resolution hyperspectral data. The generated high-resolution hyperspectral images have similar spectral signatures and improved image contrast than the original high-resolution hyperspectral images, which indicates that the super resolution network with RGB guidance can improve the image quality. The proposed method can reduce the acquisition time and save storage space taken up by hyperspectral images without compromising image quality, which will potentially promote the use of hyperspectral imaging technology in digital pathology and many other clinical applications.

Hyperspectral Imaging for Clinical Applications

Measuring morphological and biochemical features of tissue is crucial for disease diagnosis and surgical guidance, providing clinically significant information related to pathophysiology. Hyperspectral imaging (HSI) techniques obtain both spatial and spectral features of tissue without labeling molecules such as fluorescent dyes, which provides rich information for improved disease diagnosis and treatment. Recent advances in HSI systems have demonstrated its potential for clinical applications, especially in disease diagnosis and image-guided surgery. This review summarizes the basic principle of HSI and optical systems, deep-learning-based image analysis, and clinical applications of HSI to provide insight into this rapidly growing field of research. In addition, the challenges facing the clinical implementation of HSI techniques are discussed.

VNIR-NIR hyperspectral imaging fusion targeting intraoperative brain cancer detection

Currently, intraoperative guidance tools used for brain tumor resection assistance during surgery have several limitations. Hyperspectral (HS) imaging is arising as a novel imaging technique that could offer new capabilities to delineate brain tumor tissue in surgical-time. However, the HS acquisition systems have some limitations regarding spatial and spectral resolution depending on the spectral range to be captured. Image fusion techniques combine information from different sensors to obtain an HS cube with improved spatial and spectral resolution. This paper describes the contributions to HS image fusion using two push-broom HS cameras, covering the visual and near-infrared (VNIR) [400–1000 nm] and near-infrared (NIR) [900–1700 nm] spectral ranges, which are integrated into an intraoperative HS acquisition system developed to delineate brain tumor tissue during neurosurgical procedures. Both HS images were registered using intensity-based and feature-based techniques with different geometric transformations to perform the HS image fusion, obtaining an HS cube with wide spectral range [435–1638 nm]. Four HS datasets were captured to verify the image registration and the fusion process. Moreover, segmentation and classification methods were evaluated to compare the performance results between the use of the VNIR and NIR data, independently, with respect to the fused data. The results reveal that the proposed methodology for fusing VNIR–NIR data improves the classification results up to 21% of accuracy with respect to the use of each data modality independently, depending on the targeted classification problem.

P. C. Rodrigues J, Refahy Mahmoud S, Chowdhry BS, Gupta M. Artificial Neural Networks to Solve the Singular Model with Neumann-Robin, Dirichlet and Neumann Boundary Conditions

The aim of this work is to solve the case study singular model involving the Neumann–Robin, Dirichlet, and Neumann boundary conditions using a novel computing framework that is based on the artificial neural network (ANN), global search genetic algorithm (GA), and local search sequential quadratic programming method (SQPM), i.e., ANN-GA-SQPM. The inspiration to present this numerical framework comes through the objective of introducing a reliable structure that associates the operative ANNs features using the optimization procedures of soft computing to deal with such stimulating systems. Four different problems that are based on the singular equations involving Neumann–Robin, Dirichlet, and Neumann boundary conditions have been occupied to scrutinize the robustness, stability, and proficiency of the designed ANN-GA-SQPM. The proposed results through ANN-GA-SQPM have been compared with the exact results to check the efficiency of the scheme through the statistical performances for taking fifty independent trials. Moreover, the study of the neuron analysis based on three and 15 neurons is also performed to check the authenticity of the proposed ANN-GA-SQPM.

Machine Learning in Oncology: What Should Clinicians Know?

The volume and complexity of scientific and clinical data in oncology have grown markedly over recent years, including but not limited to the realms of electronic health data, radiographic and histologic data, and genomics. This growth holds promise for a deeper understanding of malignancy and, accordingly, more personalized and effective oncologic care. Such goals require, however, the development of new methods to fully make use of the wealth of available data. Improvements in computer processing power and algorithm development have positioned machine learning, a branch of artificial intelligence, to play a prominent role in oncology research and practice. This review provides an overview of the basics of machine learning and highlights current progress and challenges in applying this technology to cancer diagnosis, prognosis, and treatment recommendations, including a discussion of current takeaways for clinicians.

Special Series Guest Editorial: Artificial Intelligence and Machine Learning in Biomedical Optics

Guest editors Behrouz Shabestri, Mark Anastasio, Baowei Fei, and Frédéric Leblond provide an overview of the JBO Special Series on Artificial Intelligence Machine Learning in Biomedical Optics.

Deep learning-based six-type classifier for lung cancer and mimics from histopathological whole slide images: a retrospective study

BACKGROUND

Targeted therapy and immunotherapy put forward higher demands for accurate lung cancer classification, as well as benign versus malignant disease discrimination. Digital whole slide images (WSIs) witnessed the transition from traditional histopathology to computational approaches, arousing a hype of deep learning methods for histopathological analysis. We aimed at exploring the potential of deep learning models in the identification of lung cancer subtypes and cancer mimics from WSIs.

METHODS

We initially obtained 741 WSIs from the First Affiliated Hospital of Sun Yat-sen University (SYSUFH) for the deep learning model development, optimization, and verification. Additional 318 WSIs from SYSUFH, 212 from Shenzhen People's Hospital, and 422 from The Cancer Genome Atlas were further collected for multi-centre verification. EfficientNet-B5- and ResNet-50-based deep learning methods were developed and compared using the metrics of recall, precision, F1-score, and areas under the curve (AUCs). A threshold-based tumour-first aggregation approach was proposed and implemented for the label inferencing of WSIs with complex tissue components. Four pathologists of different levels from SYSUFH reviewed all the testing slides blindly, and the diagnosing results were used for quantitative comparisons with the best performing deep learning model.

RESULTS

We developed the first deep learning-based six-type classifier for histopathological WSI classification of lung adenocarcinoma, lung squamous cell carcinoma, small cell lung carcinoma, pulmonary tuberculosis, organizing pneumonia, and normal lung. The EfficientNet-B5-based model outperformed ResNet-50 and was selected as the backbone in the classifier. Tested on 1067 slides from four cohorts of different medical centres, AUCs of 0.970, 0.918, 0.963, and 0.978 were achieved, respectively. The classifier achieved high consistence to the ground truth and attending pathologists with high intraclass correlation coefficients over 0.873.

CONCLUSIONS

Multi-cohort testing demonstrated our six-type classifier achieved consistent and comparable performance to experienced pathologists and gained advantages over other existing computational methods. The visualization of prediction heatmap improved the model interpretability intuitively. The classifier with the threshold-based tumour-first label inferencing method exhibited excellent accuracy and feasibility in classifying lung cancers and confused nonneoplastic tissues, indicating that deep learning can resolve complex multi-class tissue classification that conforms to real-world histopathological scenarios.

Hyperspectral Microscopic Imaging for the Detection of Head and Neck Squamous Cell Carcinoma on Histologic Slides

The purpose of this study is to investigate hyperspectral microscopic imaging and deep learning methods for automatic detection of head and neck squamous cell carcinoma (SCC) on histologic slides. Hyperspectral imaging (HSI) cubes were acquired from pathologic slides of 18 patients with SCC of the larynx, hypopharynx, and buccal mucosa. An Inception-based two-dimensional convolutional neural network (CNN) was trained and validated for the HSI data. The automatic deep learning method was tested with independent data of human patients. This study demonstrated the feasibility of using hyperspectral microscopic imaging and deep learning classification to aid pathologists in detecting SCC on histologic slides.

Multiparametric Radiomics for Predicting the Aggressiveness of Papillary Thyroid Carcinoma Using Hyperspectral Images

Papillary thyroid carcinoma (PTC) is primarily treated by surgical resection. During surgery, surgeons often need intraoperative frozen analysis and pathologic consultation in order to detect PTC. In some cases pathologists cannot determine if the tumor is aggressive until the operation has been completed. In this work, we have taken tumor classification a step further by determining the tumor aggressiveness of fresh surgical specimens. We employed hyperspectral imaging (HSI) in combination with multiparametric radiomic features to complete this task. The study cohort includes 72 ex-vivo tissue specimens from 44 patients with pathology-confirmed PTC. A total of 67 features were extracted from this data. Using machine learning classification methods, we were able to achieve an AUC of 0.85. Our study shows that hyperspectral imaging and multiparametric radiomic features could aid in the pathological detection of tumor aggressiveness using fresh surgical spemens obtained during surgery.

Hyperspectral Imaging Tera Hertz System for Soil Analysis: Initial Results

Analyzing soils using conventional methods is often time consuming and costly due to their complexity. These methods require soil sampling (e.g., by augering), pretreatment of samples (e.g., sieving, extraction), and wet chemical analysis in the laboratory. Researchers are seeking alternative sensor-based methods that can provide immediate results with little or no excavation and pretreatment of samples. Currently, visible and infrared spectroscopy, electrical resistivity, gamma ray spectroscopy, and X-ray spectroscopy have been investigated extensively for their potential utility in soil sensing. Little research has been conducted on the application of THz (Tera Hertz) spectroscopy in soil science. The Tera Hertz band covers the frequency range between 100 GHz and 10 THz of the electromagnetic spectrum. One important feature of THz radiation is its correspondence with the particle size of the fine fraction of soil minerals (clay < 2 µm to sand < 2 mm). The particle size distribution is a fundamental soil property that governs soil water and nutrient content, among other characteristics. The interaction of THz radiation with soil particles creates detectable Mie scattering, which is the elastic scattering of electromagnetic waves by particles whose diameter corresponds approximately to the wavelength of the radiation. However, single-spot Mie scattering spectra are difficult to analyze and the understanding of interaction between THz radiation and soil material requires basic research. To improve the interpretation of THz spectra, a hyperspectral imaging system was developed. The addition of the spatial dimension to THz spectra helps to detect relevant features. Additionally, multiple samples can be scanned in parallel and measured under identical conditions, and the high number of data points within an image can improve the statistical accuracy. Technical details of the newly designed hyperspectral imaging THz system working from 250 to 370 GHz are provided. Results from measurements of different soil samples and buried objects in soil demonstrated its performance. The system achieved an optical resolution of about 2 mm. The sensitivity of signal damping to the changes in particle size of 100 µm is about 10 dB. Therefore, particle size variations in the µm range should be detectable. In conclusion, automated hyperspectral imaging reduced experimental effort and time consumption, and provided reliable results because of the measurement of hundreds of sample positions in one run. At this stage, the proposed setup cannot replace the current standard laboratory methods, but the present study represents the initial step to develop a new automated method for soil analysis and imaging.

Surgical Guidance for Removal of Cholesteatoma Using a Multispectral 3D-Endoscope

We develop a stereo-multispectral endoscopic prototype in which a filter-wheel is used for surgical guidance to remove cholesteatoma tissue in the middle ear. Cholesteatoma is a destructive proliferating tissue. The only treatment for this disease is surgery. Removal is a very demanding task, even for experienced surgeons. It is very difficult to distinguish between bone and cholesteatoma. In addition, it can even reoccur if not all tissue particles of the cholesteatoma are removed, which leads to undesirable follow-up operations. Therefore, we propose an image-based method that combines multispectral tissue classification and 3D reconstruction to identify all parts of the removed tissue and determine their metric dimensions intraoperatively. The designed multispectral filter-wheel 3D-endoscope prototype can switch between narrow-band spectral and broad-band white illumination, which is technically evaluated in terms of optical system properties. Further, it is tested and evaluated on three patients. The wavelengths 400 nm and 420 nm are identified as most suitable for the differentiation task. The stereoscopic image acquisition allows accurate 3D surface reconstruction of the enhanced image information. The first results are promising, as the cholesteatoma can be easily highlighted, correctly identified, and visualized as a true-to-scale 3D model showing the patient-specific anatomy.

Sensors, Signal and Image Processing in Biomedicine and Assisted Living

Sensor technologies are crucial in biomedicine, as the biomedical systems and devices used for screening and diagnosis rely on their efficiency and effectiveness [...].

Hyperspectral Superpixel-Wise Glioblastoma Tumor Detection in Histological Samples

The combination of hyperspectral imaging (HSI) and digital pathology may yield more accurate diagnosis. In this work, we propose the use of superpixels in HS images for combining regions of pixels that can be classified according to their spectral information to classify glioblastoma (GB) brain tumors in histologic slides. The superpixels are generated by a modified simple linear iterative clustering (SLIC) method to accommodate HS images. This work employs a dataset of H&E (Hematoxylin and Eosin) stained histology slides from 13 patients with GB and over 426,000 superpixels. A linear support vector machine (SVM) classifier was performed on independent training, validation, and testing datasets. The results of this investigation show that the proposed method can detect GB brain tumors from non-tumor samples with average sensitivity and specificity of 87% and 81%, respectively. The overall accuracy of this method is 83%. The study demonstrates that hyperspectral digital pathology can be useful for detecting GB brain tumors by exploiting spectral information alone on a superpixel level.