Multimodal nonlinear microscopy of head and neck carcinoma - toward surgery assisting frozen section analysis

Feasibility studies of multimodal nonlinear endoscopy using multicore fiber bundles for remote scanning from tissue sections to bulk organs

Here, we report on the development and application of a compact multi-core fiber optical probe for multimodal non-linear imaging, combining the label-free modalities of Coherent Anti-Stokes Raman Scattering, Second Harmonic Generation, and Two-Photon Excited Fluorescence. Probes of this multi-core fiber design avoid moving and voltage-carrying parts at the distal end, thus providing promising improved compatibility with clinical requirements over competing implementations. The performance characteristics of the probe are established using thin cryo-sections and artificial targets before the applicability to clinically relevant samples is evaluated using ex vivo bulk human and porcine intestine tissues. After image reconstruction to counteract the data's inherently pixelated nature, the recorded images show high image quality and morpho-chemical conformity on the tissue level compared to multimodal non-linear images obtained with a laser-scanning microscope using a standard microscope objective. Furthermore, a simple yet effective reconstruction procedure is presented and demonstrated to yield satisfactory results. Finally, a clear pathway for further developments to facilitate a translation of the multimodal fiber probe into real-world clinical evaluation and application is outlined.

Diagnostic accuracy of intraoperative margin assessment techniques in surgery for head and neck squamous cell carcinoma: A meta-analysis

BACKGROUND

Positive margins following head and neck squamous cell carcinoma (HNSCC) surgery lead to significant morbidity and mortality. Existing Intraoperative Margin Assessment (IMA) techniques are not widely used due to limitations in sampling technique, time constraints and resource requirements. We performed a meta-analysis of the diagnostic performance of existing IMA techniques in HNSCC, providing a benchmark against which emerging techniques may be judged.

METHODS

The study was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guidelines. Studies were included if they reported diagnostic metrics of techniques used during HNSCC surgery, compared with permanent histopathology. Screening, manuscript review and data extraction was performed by multiple independent observers. Pooled sensitivity and specificity were estimated using the bivariate random effects model.

RESULTS

From an initial 2344 references, 35 studies were included for meta-analysis. Sensitivity (Sens), specificity (Spec), diagnostic odds ratio (DOR) and area under the receiver operating characteristic curve (AUROC) were calculated for each group (n, Sens, Spec, DOR, AUROC): frozen section = 13, 0.798, 0.991, 309.8, 0.976; tumour-targeted fluorescence (TTF) = 5, 0.957, 0.827, 66.4, 0.944; optical techniques = 10, 0.919, 0.855, 58.9, 0.925; touch imprint cytology = 3, 0.925, 0.988, 51.1, 0.919; topical staining = 4, 0.918, 0.759, 16.4, 0.833.

CONCLUSIONS

Frozen section and TTF had the best diagnostic performance. Frozen section is limited by sampling error. TTF shows promise but involves administration of a systemic agent. Neither is currently in widespread clinical use. Emerging techniques must demonstrate competitive diagnostic accuracy whilst allowing rapid, reliable, cost-effective results.

[Multimodal spectroscopic imaging : A new, powerful tool for intraoperative tumor diagnostics]

BACKGROUND

The increasing number of cancer cases requires new imaging approaches for intraoperative tumor characterization.

OBJECTIVE

Utilization of new optical/photonic methods in combination with artificial intelligence (AI) approaches to address urgent challenges in clinical pathology in terms of intraoperative computational spectral histopathology.

METHODS

Multimodal nonlinear imaging by combining the spectroscopic methods coherent anti-Stokes Raman scattering (CARS), two-photon excited autofluorescence (TPEF), fluorescence lifetime imaging microscopy (FLIM), and second harmonic generation (SHG).

RESULTS

By using multimodal spectroscopic imaging, tissue morphochemistry, i.e., its morphology and molecular structure can be visualized in a label-free manner. The multimodal images can be automatically analyzed using AI-based image analysis approaches. For clinical application in terms of frozen section diagnostics or in vivo use, the presented multimodal imaging approach can be translated into a compact microscope or endoscopic probe concepts.

CONCLUSIONS

The synergistic combination of spectroscopic imaging modalities in combination with automated data analysis has great potential for fast and precise tumor diagnostics e.g., in terms of precise surgical guidance in laser or robotic surgery. Overall, intraoperative multimodal spectroscopic imaging may represent an innovative advancement for tumor diagnostics in the future, directly leading to improved patient care and significant cost savings.

CARS Imaging Advances Early Diagnosis of Cardiac Manifestation of Fabry Disease

Vibrational spectroscopy can detect characteristic biomolecular signatures and thus has the potential to support diagnostics. Fabry disease (FD) is a lipid disorder disease that leads to accumulations of globotriaosylceramide in different organs, including the heart, which is particularly critical for the patient’s prognosis. Effective treatment options are available if initiated at early disease stages, but many patients are late- or under-diagnosed. Since Coherent anti-Stokes Raman (CARS) imaging has a high sensitivity for lipid/protein shifts, we applied CARS as a diagnostic tool to assess cardiac FD manifestation in an FD mouse model. CARS measurements combined with multivariate data analysis, including image preprocessing followed by image clustering and data-driven modeling, allowed for differentiation between FD and control groups. Indeed, CARS identified shifts of lipid/protein content between the two groups in cardiac tissue visually and by subsequent automated bioinformatic discrimination with a mean sensitivity of 90–96%. Of note, this genotype differentiation was successful at a very early time point during disease development when only kidneys are visibly affected by globotriaosylceramide depositions. Altogether, the sensitivity of CARS combined with multivariate analysis allows reliable diagnostic support of early FD organ manifestation and may thus improve diagnosis, prognosis, and possibly therapeutic monitoring of FD.

Coherent Raman scattering microscopy for chemical imaging of biological systems

Coherent Raman scattering (CRS) processes, including both the coherent anti-Stokes Raman scattering and stimulated Raman scattering, have been utilized in state-of-the-art microscopy platforms for chemical imaging of biological samples. The key advantage of CRS microscopy over fluorescence microscopy is label-free, which is an attractive characteristic for modern biological and medical sciences. Besides, CRS has other advantages such as higher selectivity to metabolites, no photobleaching, and narrow peak width. These features have brought fast-growing attention to CRS microscopy in biological research. In this review article, we will first briefly introduce the history of CRS microscopy, and then explain the theoretical background of the CRS processes in detail using the classical approach. Next, we will cover major instrumentation techniques of CRS microscopy. Finally, we will enumerate examples of recent applications of CRS imaging in biological and medical sciences.

Computational tissue staining of non-linear multimodal imaging using supervised and unsupervised deep learning

Hematoxylin and Eosin (H&E) staining is the 'gold-standard' method in histopathology. However, standard H&E staining of high-quality tissue sections requires long sample preparation times including sample embedding, which restricts its application for 'real-time' disease diagnosis. Due to this reason, a label-free alternative technique like non-linear multimodal (NLM) imaging, which is the combination of three non-linear optical modalities including coherent anti-Stokes Raman scattering, two-photon excitation fluorescence and second-harmonic generation, is proposed in this work. To correlate the information of the NLM images with H&E images, this work proposes computational staining of NLM images using deep learning models in a supervised and an unsupervised approach. In the supervised and the unsupervised approach, conditional generative adversarial networks (CGANs) and cycle conditional generative adversarial networks (cycle CGANs) are used, respectively. Both CGAN and cycle CGAN models generate pseudo H&E images, which are quantitatively analyzed based on mean squared error, structure similarity index and color shading similarity index. The mean of the three metrics calculated for the computationally generated H&E images indicate significant performance. Thus, utilizing CGAN and cycle CGAN models for computational staining is beneficial for diagnostic applications without performing a laboratory-based staining procedure. To the author's best knowledge, it is the first time that NLM images are computationally stained to H&E images using GANs in an unsupervised manner.

Raman Imaging: An Impending Approach Towards Cancer Diagnosis

In accordance with the recent studies, Raman spectroscopy is well experimented as a highly sensitive analytical and imaging technique in biomedical research, mainly for various disease diagnosis including cancer. In comparison with other imaging modalities, Raman spectroscopy facilitate numerous assistances owing to its low background signal, immense spatial resolution, high chemical specificity, multiplexing capability, excellent photo stability and non-invasive detection capability. In cancer diagnosis Raman imaging intervened as a promising investigative tool to provide molecular level information to differentiate the cancerous vs non-cancerous cells, tissues and even in body fluids. Anciently, spontaneous Raman scattering is very feeble due to its low signal intensity and long acquisition time but new advanced techniques like coherent Raman scattering (CRS) and surface enhanced Raman scattering (SERS) gradually superseded these issues. So, the present review focuses on the recent developments and applications of Raman spectroscopy-based imaging techniques for cancer diagnosis.

Nonlinear multispectral imaging for tumor delineation

SIGNIFICANCE

In breast-preserving tumor surgery, the inspection of the excised tissue boundaries for tumor residue is too slow to provide feedback during the surgery. The discovery of positive margins requires a new surgery which is difficult and associated with low success. If the re-excision could be done immediately this is believed to improve the success rate considerably.

AIM

Our aim is for a fast microscopic analysis that can be done directly on the excised tissue in or near the operating theatre.

APPROACH

We demonstrate the combination of three nonlinear imaging techniques at selected wavelengths to delineate tumor boundaries. We use hyperspectral coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG), and two-photon excited fluorescence (TPF) on excised patient tissue.

RESULTS

We show the discriminatory power of each of the signals and demonstrate a sensitivity of 0.87 and a specificity of 0.95 using four CARS wavelengths in combination with SHG and TPF. We verify that the information is independent of sample treatment.

CONCLUSIONS

Nonlinear multispectral imaging can be used to accurately determine tumor boundaries. This demonstration using microscopy in the epi-direction directly on thick tissue slices brings this technology one step closer to clinical implementation.

CARS-imaging guidance for fs-laser ablation precision surgery

Due to ageing populations the number of tumors is increasing worldwide. Successful surgical treatment requires complete resection of tumors to reduce recurrence rates. To reach this goal, novel methods combining in vivo tumor and tumor margin detection with low invasive precision surgical tools are needed. Coherent anti-Stokes Raman scattering (CARS) imaging is a highly promising optical tool for visualizing tumors based on characteristic changes in tissue morphology and molecular composition, while fs-laser ablation is to date the most precise surgical tool established in ophthalmology. In this contribution, CARS imaging has been combined with fs-laser ablation as a new approach for image-guided precision surgery for the first time. CARS guided fs-ablation has been applied to ablate brain, liver, skin, muscular and vascular tissues with μm-precision using sub-100 fs pulses of μJ level. We demonstrate superior imaging performance and contrast as well as detection of tissue margins by coherent Raman microscopy in comparison to laser reflectance imaging. The combination of CARS-image-guided tissue ablation is a promising tool for minimally invasive surgeries particularly in the vicinity of functional structures in the future.

Non-invasive Imaging Techniques: From Histology to In Vivo Imaging : Chapter of Imaging in Oncology

In this chapter, we will introduce and review molecular-sensitive imaging techniques, which close the gap between ex vivo and in vivo analysis. In detail, we will introduce spontaneous Raman spectral imaging, coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS), second-harmonic generation (SHG) and third-harmonic generation (THG), two-photon excited fluorescence (TPEF), and fluorescence lifetime imaging (FLIM). After reviewing these imaging techniques, we shortly introduce chemometric methods and machine learning techniques, which are needed to use these imaging techniques in diagnostic applications.

Multimodal Nonlinear Microscopy for Therapy Monitoring of Cold Atmospheric Plasma Treatment

Here we report on a non-linear spectroscopic method for visualization of cold atmospheric plasma (CAP)-induced changes in tissue for reaching a new quality level of CAP application in medicine via online monitoring of wound or cancer treatment. A combination of coherent anti-Stokes Raman scattering (CARS), two-photon fluorescence lifetime imaging (2P-FLIM) and second harmonic generation (SHG) microscopy has been used for non-invasive and label-free detection of CAP-induced changes on human skin and mucosa samples. By correlation with histochemical staining, the observed local increase in fluorescence could be assigned to melanin. CARS and SHG prove the integrity of the tissue structure, visualize tissue morphology and composition. The influence of plasma effects by variation of plasma parameters e.g., duration of treatment, gas composition and plasma source has been evaluated. Overall quantitative spectroscopic markers could be identified for a direct monitoring of CAP-treated tissue areas, which is very important for translating CAPs into clinical routine.

Coherent anti-Stokes Raman Fourier ptychography

We present a theoretical and numerical study of coherent anti-Stokes Raman scattering Fourier ptychography microscopy (CARS-FPM), a scheme that has not been considered so far in the previously reported CARS wide-field imaging schemes. In this approach, the distribution of the Raman scatterer density of the sample is reconstructed numerically from CARS images obtained under various angles of incidences of the pump or Stokes beam. Our inversion procedure is based on an accurate vectorial model linking the CARS image to the sample and yields both the real and imaginary parts of the susceptibility, the latter giving access to the Raman information, with an improved resolution.

Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy

Maximal resection of tumor while preserving the adjacent healthy tissue is particularly important for larynx surgery, hence precise and rapid intraoperative histology of laryngeal tissue is crucial for providing optimal surgical outcomes. We hypothesized that deep-learning based stimulated Raman scattering (SRS) microscopy could provide automated and accurate diagnosis of laryngeal squamous cell carcinoma on fresh, unprocessed surgical specimens without fixation, sectioning or staining. Methods: We first compared 80 pairs of adjacent frozen sections imaged with SRS and standard hematoxylin and eosin histology to evaluate their concordance. We then applied SRS imaging on fresh surgical tissues from 45 patients to reveal key diagnostic features, based on which we have constructed a deep learning based model to generate automated histologic results. 18,750 SRS fields of views were used to train and cross-validate our 34-layered residual convolutional neural network, which was used to classify 33 untrained fresh larynx surgical samples into normal and neoplasia. Furthermore, we simulated intraoperative evaluation of resection margins on totally removed larynxes. Results: We demonstrated near-perfect diagnostic concordance (Cohen's kappa, κ > 0.90) between SRS and standard histology as evaluated by three pathologists. And deep-learning based SRS correctly classified 33 independent surgical specimens with 100% accuracy. We also demonstrated that our method could identify tissue neoplasia at the simulated resection margins that appear grossly normal with naked eyes. Conclusion: Our results indicated that SRS histology integrated with deep learning algorithm provides potential for delivering rapid intraoperative diagnosis that could aid the surgical management of laryngeal cancer.

Fully convolutional networks in multimodal nonlinear microscopy images for automated detection of head and neck carcinoma: Pilot study

BACKGROUND

A fully convolutional neural networks (FCN)-based automated image analysis algorithm to discriminate between head and neck cancer and noncancerous epithelium based on nonlinear microscopic images was developed.

METHODS

Head and neck cancer sections were used for standard histopathology and co-registered with multimodal images from the same sections using the combination of coherent anti-Stokes Raman scattering, two-photon excited fluorescence, and second harmonic generation microscopy. The images analyzed with semantic segmentation using a FCN for four classes: cancer, normal epithelium, background, and other tissue types.

RESULTS

A total of 114 images of 12 patients were analyzed. Using a patch score aggregation, the average recognition rate and an overall recognition rate or the four classes were 88.9% and 86.7%, respectively. A total of 113 seconds were needed to process a whole-slice image in the dataset.

CONCLUSION

Multimodal nonlinear microscopy in combination with automated image analysis using FCN seems to be a promising technique for objective differentiation between head and neck cancer and noncancerous epithelium.

Identification of Proteomic Markers in Head and Neck Cancer Using MALDI-MS Imaging, LC-MS/MS, and Immunohistochemistry

PURPOSE

The heterogeneity of squamous cell carcinoma tissue greatly complicates diagnosis and individualized therapy. Therefore, characterizing the heterogeneity of tissue spatially and identifying appropriate biomarkers is crucial. MALDI-MS imaging (MSI) is capable of analyzing spatially resolved tissue biopsies on a molecular level.

EXPERIMENTAL DESIGN

MALDI-MSI is used on snap frozen and formalin-fixed and paraffin-embedded (FFPE) tissue samples from patients with head and neck cancer (HNC) to analyze m/z values localized in tumor and nontumor regions. Peptide identification is performed using LC-MS/MS and immunohistochemistry (IHC).

RESULTS

In both FFPE and frozen tissue specimens, eight characteristic masses of the tumor's epithelial region are found. Using LC-MS/MS, the peaks are identified as vimentin, keratin type II, nucleolin, heat shock protein 90, prelamin-A/C, junction plakoglobin, and PGAM1. Lastly, vimentin, nucleolin, and PGAM1 are verified with IHC.

CONCLUSIONS AND CLINICAL RELEVANCE

The combination of MALDI-MSI, LC-MS/MS, and subsequent IHC furnishes a tool suitable for characterizing the molecular heterogeneity of tissue. It is also suited for use in identifying new representative biomarkers to enable a more individualized therapy.

Simultaneous dual-channel stimulated Raman scattering microscopy demultiplexed at distinct modulation frequencies

To increase the information per pixel in stimulated Raman scattering (SRS) microscopy as well as to correct from artifacts, it is valuable to acquire images at two different Raman shifts. We present a three-color SRS approach acquiring two perfectly registered SRS images where both pump beams are modulated at distinct frequencies while demodulating the Stokes beam. Our implementation uses two optical parametric oscillators that can be tuned to an almost arbitrary energy difference of Raman shifts, allowing investigation of fingerprint resonances simultaneously to CH-stretch vibrations.

Perspectives, potentials and trends of ex vivo and in vivo optical molecular pathology

It is pivotal for medical applications, such as noninvasive histopathologic characterization of tissue, to realize label-free and molecule-specific representation of morphologic and biochemical composition in real-time with subcellular spatial resolution. This unmet clinical need requires new approaches for rapid and reliable real-time assessment of pathologies to complement established diagnostic tools. Photonic imaging combined with digitalization offers the potential to provide the clinician the requested information both under in vivo and ex vivo conditions. This report summarizes photonic approaches and their use in combination with image processing, machine learning and augmented virtual reality that might solve current challenges in modern medicine. Details are given for pathology, intraoperative diagnosis in head and neck cancer and endoscopic diagnosis in gastroenterology.

Label-Free Molecular Imaging of Biological Cells and Tissues by Linear and Nonlinear Raman Spectroscopic Approaches

Raman spectroscopy is an emerging technique in bioanalysis and imaging of biomaterials owing to its unique capability of generating spectroscopic fingerprints. Imaging cells and tissues by Raman microspectroscopy represents a nondestructive and label-free approach. All components of cells or tissues contribute to the Raman signals, giving rise to complex spectral signatures. Resonance Raman scattering and surface-enhanced Raman scattering can be used to enhance the signals and reduce the spectral complexity. Raman-active labels can be introduced to increase specificity and multimodality. In addition, nonlinear coherent Raman scattering methods offer higher sensitivities, which enable the rapid imaging of larger sampling areas. Finally, fiber-based imaging techniques pave the way towards in vivo applications of Raman spectroscopy. This Review summarizes the basic principles behind medical Raman imaging and its progress since 2012.

Beyond endoscopic assessment in inflammatory bowel disease: real-time histology of disease activity by non-linear multimodal imaging

Assessing disease activity is a prerequisite for an adequate treatment of inflammatory bowel diseases (IBD) such as Crohn’s disease and ulcerative colitis. In addition to endoscopic mucosal healing, histologic remission poses a promising end-point of IBD therapy. However, evaluating histological remission harbors the risk for complications due to the acquisition of biopsies and results in a delay of diagnosis because of tissue processing procedures. In this regard, non-linear multimodal imaging techniques might serve as an unparalleled technique that allows the real-time evaluation of microscopic IBD activity in the endoscopy unit. In this study, tissue sections were investigated using the non-linear multimodal microscopy combination of coherent anti-Stokes Raman scattering (CARS), two-photon excited auto fluorescence (TPEF) and second-harmonic generation (SHG). After the measurement a gold-standard assessment of histological indexes was carried out based on a conventional H&E stain. Subsequently, various geometry and intensity related features were extracted from the multimodal images. An optimized feature set was utilized to predict histological index levels based on a linear classifier. Based on the automated prediction, the diagnosis time interval is decreased. Therefore, non-linear multimodal imaging may provide a real-time diagnosis of IBD activity suited to assist clinical decision making within the endoscopy unit.