Tissue Classification of Breast Cancer by Hyperspectral Unmixing

(1) Background: Assessing the resection margins during breast-conserving surgery is an important clinical need to minimize the risk of recurrent breast cancer. However, currently there is no technique that can provide real-time feedback to aid surgeons in the margin assessment. Hyperspectral imaging has the potential to overcome this problem. To classify resection margins with this technique, a tissue discrimination model should be developed, which requires a dataset with accurate ground-truth labels. However, establishing such a dataset for resection specimens is difficult. (2) Methods: In this study, we therefore propose a novel approach based on hyperspectral unmixing to determine which pixels within hyperspectral images should be assigned to the ground-truth labels from histopathology. Subsequently, we use this hyperspectral-unmixing-based approach to develop a tissue discrimination model on the presence of tumor tissue within the resection margins of ex vivo breast lumpectomy specimens. (3) Results: In total, 372 measured locations were included on the lumpectomy resection surface of 189 patients. We achieved a sensitivity of 0.94, specificity of 0.85, accuracy of 0.87, Matthew's correlation coefficient of 0.71, and area under the curve of 0.92. (4) Conclusion: Using this hyperspectral-unmixing-based approach, we demonstrated that the measured locations with hyperspectral imaging on the resection surface of lumpectomy specimens could be classified with excellent performance.

Raman Spectroscopic Imaging of Human Bladder Resectates towards Intraoperative Cancer Assessment

Raman spectroscopy offers label-free assessment of bladder tissue for in vivo and ex vivo intraoperative applications. In a retrospective study, control and cancer specimens were prepared from ten human bladder resectates. Raman microspectroscopic images were collected from whole tissue samples in a closed chamber at 785 nm laser excitation using a 20× objective lens and 250 µm step size. Without further preprocessing, Raman images were decomposed by the hyperspectral unmixing algorithm vertex component analysis into endmember spectra and their abundancies. Hierarchical cluster analysis distinguished endmember Raman spectra that were assigned to normal bladder, bladder cancer, necrosis, epithelium and lipid inclusions. Interestingly, Raman spectra of microplastic particles, pigments or carotenoids were detected in 13 out of 20 specimens inside tissue and near tissue margins and their identity was confirmed by spectral library surveys. Hypotheses about the origin of these foreign materials are discussed. In conclusion, our Raman workflow and data processing protocol with minimal user interference offers advantages for future clinical translation such as intraoperative tumor detection and label-free material identification in complex matrices.

Linear Spatial Misregistration Detection and Correction Based on Spectral Unmixing for FAHI Hyperspectral Imagery

In push-broom hyperspectral imaging systems, the sensor rotation to the optical plane leads to linear spatial misregistration (LSM) in hyperspectral images (HSIs). To compensate for hardware defects through software, this paper develops four methods to detect LSM in HSIs. Different from traditional methods for grayscale images, the method of fitting the sum of abundance (FSAM) and the method of searching for equal abundance (SEAM) are achieved by hyperspectral unmixing for a selected rectangular transition areas containing an edge, which makes good use of spatial and spectral information. The method based on line detection for band-interleaved-by-line (BIL) images (LDBM) and the method based on the Fourier transform of BIL images (FTBM) aim to characterize the slope of line structure in BIL images and get rid of the dependence on scene and wavelength. A full strategy is detailed from aspects of data selection, LSM detection, and image correction. The full spectrum airborne hyperspectral imager (FAHI) is China's new generation push-broom scanner. The HSIs obtained by FAHI are tested and analyzed. Experiments on simulation data compare the four proposed methods with traditional methods and prove that FSAM outperforms other methods in terms of accuracy and stability. In experiments on real data, the application of the full strategy on FAHI verifies its effectiveness. This work not only provides reference for other push-broom imagers with similar problems, but also helps to reduce the requirement for hardware calibration.

Non-Negative Matrix Factorization Based on Smoothing and Sparse Constraints for Hyperspectral Unmixing

Hyperspectral unmixing (HU) is a technique for estimating a set of pure source signals (end members) and their proportions (abundances) from each pixel of the hyperspectral image. Non-negative matrix factorization (NMF) can decompose the observation matrix into the product of two non-negative matrices simultaneously and can be used in HU. Unfortunately, a limitation of many traditional NMF-based methods, i.e., the non-convexity of the objective function, may lead to a sub-optimal solution. Thus, we put forward a new unmixing method based on NMF under smoothing and sparse constraints to obtain a better solution. First, considering the sparseness of the abundance matrix, a weight sparse regularization is introduced into the NMF model to ensure the sparseness of the abundance matrix. Second, according to the similarity prior of the same feature in the adjacent pixels, a Total Variation regularization is further added to the NMF model to improve the smoothness of the abundance map. Finally, the signatures of each end member are modified smoothly in spectral space. Moreover, it is noticed that discontinuities may emerge due to the removal of noisy bands. Therefore, the spectral data are piecewise smooth in spectral space. Then, in this paper, a piecewise smoothness constraint is further applied to each column of the end-member matrix. Experiments are conducted to evaluate the effectiveness of the proposed method based on two different datasets, including a synthetic dataset and the real-life Cuprite dataset, respectively. Experimental results show that the proposed method outperforms several state-of-the-art HU methods. In the Cuprite hyperspectral dataset, the proposed method's Spectral Angle Distance is 0.1694, compared to the TV-RSNMF method's 0.1703, L_1/2NMF method's 0.1925, and VCA-FCLS method's 0.1872.