Automated seeding-based nuclei segmentation in nonlinear optical microscopy

Toward cancer detection by label-free microscopic imaging in oncological surgery: Techniques, instrumentation and applications

This review examines the clinical application of label-free microscopy and spectroscopy, which are based on optical signals emitted by tissue components. Over the past three decades, a variety of techniques have been investigated with the aim of developing an in situ histopathology method that can rapidly and accurately identify tumor margins during surgical procedures. These techniques can be divided into two groups. One group encompasses techniques exploiting linear optical signals, and includes infrared and Raman microspectroscopy, and autofluorescence microscopy. The second group includes techniques based on nonlinear optical signals, including harmonic generation, coherent Raman scattering, and multiphoton autofluorescence microscopy. Some of these methods provide comparable information, while others are complementary. However, all of them have distinct advantages and disadvantages due to their inherent nature. The first part of the review provides an explanation of the underlying physics of the excitation mechanisms and a description of the instrumentation. It also covers endomicroscopy and data analysis, which are important for understanding the current limitations in implementing label-free techniques in clinical settings. The second part of the review describes the application of label-free microscopy imaging to improve oncological surgery with focus on brain tumors and selected gastrointestinal cancers, and provides a critical assessment of the current state of translation of these methods into clinical practice. Finally, the potential of confocal laser endomicroscopy for the acquisition of autofluorescence is discussed in the context of immediate clinical applications.

Evaluation of breast carcinoma regression after preoperative chemotherapy by label-free multiphoton imaging and image analysis

Neoadjuvant chemotherapy is increasingly being used in breast carcinoma as it significantly improves the prognosis and consistently leads to an increased rate of breast preservation. How to accurately assess tumor response after treatment is a crucial factor for developing reasonable therapeutic strategy. In this study, we were in an attempt to monitor tumor response by multimodal multiphoton imaging including two-photon excitation fluorescence and second-harmonic generation imaging. We found that multiphoton imaging can identify different degrees of tumor response such as a slight, significant, or complete response and can detect morphological alteration associated with extracellular matrix during the progression of breast carcinoma following preoperative chemotherapy. Two quantitative optical biomarkers including tumor cellularity and collagen content were extracted based on automatic image analysis to help monitor changes in tumor and its microenvironment. Furthermore, tumor regression grade diagnosis was tried to evaluate by multiphoton microscopy. These results may offer a basic framework for using multiphoton microscopic imaging techniques as a helpful diagnostic tool for assessing breast carcinoma response after presurgical treatment.

Identification of distinctive features in human intracranial tumors by label-free nonlinear multimodal microscopy

Nonlinear multimodal microscopy offers a series of label-free techniques with potential for intraoperative identification of tumor borders in situ using novel endoscopic devices. Here, we combined coherent anti-Stokes Raman scattering, two-photon excited fluorescence (TPEF) and second harmonic generation imaging to analyze biopsies of different human brain tumors, with the aim to understand whether the morphological information carried by single field of view images, similar to what delivered by present endoscopic systems, is sufficient for tumor recognition. We imaged 40 human biopsies of high and low grade glioma, meningioma, as well as brain metastases of melanoma, breast, lung and renal carcinoma, in comparison with normal brain parenchyma. Furthermore, five biopsies of schwannoma were analyzed and compared with nonpathological nerve tissue. Besides the high cellularity, the typical features of tumor, which were identified and quantified, are intracellular and extracellular lipid droplets, aberrant vessels, extracellular matrix collagen and diffuse TPEF. Each tumor type displayed a particular morphochemistry characterized by specific patterns of the above-mentioned features. Nonlinear multimodal microscopy performed on fresh unprocessed biopsies confirmed that the technique has the ability to visualize tumor structures and discern normal from neoplastic tissue likewise in conditions close to in situ.

A novel multiphoton microscopy images segmentation method based on superpixel and watershed

Multiphoton microscopy (MPM) imaging technique based on two-photon excited fluorescence (TPEF) and second harmonic generation (SHG) shows fantastic performance for biological imaging. The automatic segmentation of cellular architectural properties for biomedical diagnosis based on MPM images is still a challenging issue. A novel multiphoton microscopy images segmentation method based on superpixels and watershed (MSW) is presented here to provide good segmentation results for MPM images. The proposed method uses SLIC superpixels instead of pixels to analyze MPM images for the first time. The superpixels segmentation based on a new distance metric combined with spatial, CIE Lab color space and phase congruency features, divides the images into patches which keep the details of the cell boundaries. Then the superpixels are used to reconstruct new images by defining an average value of superpixels as image pixels intensity level. Finally, the marker-controlled watershed is utilized to segment the cell boundaries from the reconstructed images. Experimental results show that cellular boundaries can be extracted from MPM images by MSW with higher accuracy and robustness.

Raman spectroscopy for medical diagnostics--From in-vitro biofluid assays to in-vivo cancer detection

Raman spectroscopy is an optical technique based on inelastic scattering of light by vibrating molecules and can provide chemical fingerprints of cells, tissues or biofluids. The high chemical specificity, minimal or lack of sample preparation and the ability to use advanced optical technologies in the visible or near-infrared spectral range (lasers, microscopes, fibre-optics) have recently led to an increase in medical diagnostic applications of Raman spectroscopy. The key hypothesis underpinning this field is that molecular changes in cells, tissues or biofluids, that are either the cause or the effect of diseases, can be detected and quantified by Raman spectroscopy. Furthermore, multivariate calibration and classification models based on Raman spectra can be developed on large "training" datasets and used subsequently on samples from new patients to obtain quantitative and objective diagnosis. Historically, spontaneous Raman spectroscopy has been known as a low signal technique requiring relatively long acquisition times. Nevertheless, new strategies have been developed recently to overcome these issues: non-linear optical effects and metallic nanoparticles can be used to enhance the Raman signals, optimised fibre-optic Raman probes can be used for real-time in-vivo single-point measurements, while multimodal integration with other optical techniques can guide the Raman measurements to increase the acquisition speed and spatial accuracy of diagnosis. These recent efforts have advanced Raman spectroscopy to the point where the diagnostic accuracy and speed are compatible with clinical use. This paper reviews the main Raman spectroscopy techniques used in medical diagnostics and provides an overview of various applications.

Texture analysis and classification in coherent anti-Stokes Raman scattering (CARS) microscopy images for automated detection of skin cancer

Coherent anti-Stokes Raman scattering (CARS) microscopy is a powerful tool for fast label-free tissue imaging, which is promising for early medical diagnostics. To facilitate the diagnostic process, automatic image analysis algorithms, which are capable of extracting relevant features from the image content, are needed. In this contribution we perform an automated classification of healthy and tumor areas in CARS images of basal cell carcinoma (BCC) skin samples. The classification is based on extraction of texture features from image regions and subsequent classification of these regions into healthy and cancerous with a perceptron algorithm. The developed approach is capable of an accurate classification of texture types with high sensitivity and specificity, which is an important step towards an automated tumor detection procedure.

Automated method for the segmentation and morphometry of nerve fibers in large-scale CARS images of spinal cord tissue

A fully automated method for large-scale segmentation of nerve fibers from coherent anti-Stokes Raman scattering (CARS) microscopy images is presented. The method is specifically designed for CARS images of transverse cross sections of nervous tissue but is also suitable for use with standard light microscopy images. After a detailed description of the two-part segmentation algorithm, its accuracy is quantified by comparing the resulting binary images to manually segmented images. We then demonstrate the ability of our method to retrieve morphological data from CARS images of nerve tissue. Finally, we present the segmentation of a large mosaic of CARS images covering more than half the area of a mouse spinal cord cross section and show evidence of clusters of neurons with similar g-ratios throughout the spinal cord.

Single virus detection by means of atomic force microscopy in combination with advanced image analysis

In the present contribution virions of five different virus species, namely Varicella-zoster virus, Porcine teschovirus, Tobacco mosaic virus, Coliphage M13 and Enterobacteria phage PsP3, are investigated using atomic force microscopy (AFM). From the resulting height images quantitative features like maximal height, area and volume of the viruses could be extracted and compared to reference values. Subsequently, these features were accompanied by image moments, which quantify the morphology of the virions. Both types of features could be utilized for an automatic discrimination of the five virus species. The accuracy of this classification model was 96.8%. Thus, a virus detection on a single-particle level using AFM images is possible. Due to the application of advanced image analysis the morphology could be quantified and used for further analysis. Here, an automatic recognition by means of a classification model could be achieved in a reliable and objective manner.