Automatic cell segmentation and nuclear-to-cytoplasmic ratio analysis for third harmonic generated microscopy medical images

SLAM medical imaging enabled by pre-chirp and gain jointly managed Yb-fiber laser

We demonstrate a pre-chirp and gain jointly managed Yb-fiber laser that drives simultaneous label-free autofluorescence-multiharmonic (SLAM) medical imaging. We show that a gain managed Yb-fiber amplifier produces high-quality compressed pulses when the seeding pulses exhibit proper negative pre-chirp. The resulting laser source can generate 43-MHz, 34-fs pulses centered at 1110 nm with more than 90-nJ energy. We apply this ultrafast source to SLAM imaging of cellular and extracellular components in various human tissues of intestinal adenocarcinoma, lung adenocarcinoma, and liver.

Effect of a novel telehealth device for dietary cognitive behavioral intervention in overweight or obesity care

Obesity has become a major public health issue which relate to numerous physical problems and highly comorbid with depression and anxiety. Recently, some studies of technology-based interventions for weight reduction emerged to overcome the barriers from time, cost and distance. Mood component and eating behavior related to obesity are less discussed so far with technology-based intervention though. This pilot study was aimed to investigate the effect of telehealth assisted intervention on weight reduction, mood status, and eating behavior change under a smartphone application (app) with novel 3D food picture recognition and incorporated with cognitive behavioral training programs. Adult aged 30-60 years old with overweight were recruited and randomly assigned to control-first group and intervention-first group. In period 1, control-first group had regular life and intervention-first group underwent app intervention; in period 2, two groups went crossover. Body composition and psychological/behavioral questionnaires were collected at baseline, end of period 1, and end of period 2. Nonparametric statistics was performed for data analyzing. A total of 20 participants were enrolled. In control-first group, there were statistically significant reduction in body weight (- 0.55 kg, p = 0.02) and change of body weight percentage (- 0.6%, p = 0.02) after App use. In intervention-first group, the fat percentage decreased by 0.4% after App use in period 1, and increased by 0.05% in period 2. The integrated crossover data revealed that subjects of App group had significant improvements in mindful eating behavior. This pilot study showed the effectiveness in using CogniNU app for weight control and eating behavior. The difference of short-term and long-term effectiveness of technology-based weight control intervention deserves more investigation in the future.Clinical Trial Registration: ISRCTN16082909.

In vivo harmonic generation microscopy for monitoring the height of basal keratinocytes in solar lentigines after laser depigmentation treatment

The development of solar lentigines (SLs) is related to chronic ultraviolet exposure-induced cell senescence. We have previously demonstrated that basal keratinocyte enlargement is a morphological hallmark of skin senescence correlated to the process of skin aging, while clinical studies on the long-term monitoring of the cellular morphological changes in SLs after laser treatment are lacking. In this study, we have developed the harmonic generation microscopy (HGM) for in vivo monitoring the height of basal keratinocytes (HBK) and had administered Q-switched ruby laser or picosecond 532-nm Nd:YAG laser treatment on each side of the face of 25 Asian patients with facial SLs, respectively. In vivo HGM imaging was conducted to longitudinally analyze HBK and the horizontal cell size (HCS). Before treatment, the HBK was significantly higher in the SLs lesional area than that in the adjacent normal region, whereas there was no significant difference in the HCS. After treatment, the lesional HBK remained significantly higher than normal skin regardless of the laser treatment used. Our study indicates that the basal keratinocytes remain abnormal after laser treatment and demonstrates the capability of in vivo HGM for longitudinal, quantitative monitoring of cell senescence and therapeutic effect in SLs.

Optical biopsy of laryngeal lesions using femtosecond multiphoton microscopy

Laryngeal squamous cell carcinoma (LSCC) is one of the most prevalent malignancy of the upper aerodigestive tract. Detection of early lesions in vivo could improve the survival rate significantly. In this study, we demonstrated that femtosecond multiphoton microscopy (MPM) is an effective tool to visualize the microscopic features within fixed laryngeal tissues, without sectioning, staining, or labeling. Accurate detection of lesions and determination of the tumor grading can be achieved, with excellent consistency with conventional histological examination. These results suggest that MPM may represent a powerful tool for in-vivo or fast ex-vivo diagnosis of laryngeal lesions at the point of care.

Compact portable multiphoton microscopy reveals histopathological hallmarks of unprocessed lung tumor tissue in real time

During lung cancer operations a rapid and reliable assessment of tumor tissue can reduce operation time and potentially improve patient outcomes. We show that third harmonic generation (THG), second harmonic generation (SHG) and two-photon excited autofluorescence (2PEF) microscopy reveals relevant, histopathological information within seconds in fresh unprocessed human lung samples. We used a compact, portable microscope and recorded images within 1 to 3 seconds using a power of 5 mW. The generated THG/SHG/2PEF images of tumorous and nontumorous tissues are compared with the corresponding standard histology images, to identify alveolar structures and histopathological hallmarks. Cellular structures (tumor cells, macrophages and lymphocytes) (THG), collagen (SHG) and elastin (2PEF) are differentiated and allowed for rapid identification of carcinoid with solid growth pattern, minimally enlarged monomorphic cell nuclei with salt-and-pepper chromatin pattern, and adenocarcinoma with lipidic and micropapillary growth patterns. THG/SHG/2PEF imaging is thus a promising tool for clinical intraoperative assessment of lung tumor tissue.

Slide-free clinical imaging of melanin with absolute quantities using label-free third-harmonic-generation enhancement-ratio microscopy

The capability to image the 3D distribution of melanin in human skin in vivo with absolute quantities and microscopic details will not only enable noninvasive histopathological diagnosis of melanin-related cutaneous disorders, but also make long term treatment assessment possible. In this paper, we demonstrate clinical in vivo imaging of the melanin distribution in human skin with absolute quantities on mass density and with microscopic details by using label-free third-harmonic-generation (THG) enhancement-ratio microscopy. As the dominant absorber in skin, melanin provides the strongest THG nonlinearity in human skin due to resonance enhancement. We show that the THG-enhancement-ratio (erTHG) parameter can be calibrated in vivo and can indicate the melanin mass density. With an unprecedented clinical imaging resolution, our study revealed erTHG-microscopy's unique capability for long-term treatment assessment and direct clinical observation of melanin's micro-distribution to shed light into the unknown pathway and regulation mechanism of melanosome transfer and translocation.

Comparative analysis of intrinsic skin aging between Caucasian and Asian subjects by slide-free in vivo harmonic generation microscopy

Phenotypical and functional differences in the intrinsic skin aging process of individuals between Caucasians and Asians have generated considerable interest in dermatology and cosmetic industry. Most of the studies focused on the stratum corneum, and in some other studies inter-individual differences overwhelms the racial difference. None of the studies comparatively analyzes the difference from the histopathological point of view. Here we report our harmonic generation microscopy study to analyze the difference of intrinsic aging between Caucasian and Asian skin from a histopathological point of view. As a result, the cellular and nuclear areas of basal cells in Caucasian subjects were found to increase at the same rate as the Asian subjects, ideal for scoring age. The maximum thickness of the viable epidermis, the dermal papilla (DP) volume per unit area and the depth of the DP zone in Caucasians were found to decrease at faster rates than those in Asians.

Automated Individualization of Size-Varying and Touching Neurons in Macaque Cerebral Microscopic Images

In biomedical research, cell analysis is important to assess physiological and pathophysiological information. Virtual microscopy offers the unique possibility to study the compositions of tissues at a cellular scale. However, images acquired at such high spatial resolution are massive, contain complex information, and are therefore difficult to analyze automatically. In this article, we address the problem of individualization of size-varying and touching neurons in optical microscopy two-dimensional (2-D) images. Our approach is based on a series of processing steps that incorporate increasingly more information. (1) After a step of segmentation of neuron class using a Random Forest classifier, a novel min-max filter is used to enhance neurons' centroids and boundaries, enabling the use of region growing process based on a contour-based model to drive it to neuron boundary and achieve individualization of touching neurons. (2) Taking into account size-varying neurons, an adaptive multiscale procedure aiming at individualizing touching neurons is proposed. This protocol was evaluated in 17 major anatomical regions from three NeuN-stained macaque brain sections presenting diverse and comprehensive neuron densities. Qualitative and quantitative analyses demonstrate that the proposed method provides satisfactory results in most regions (e.g., caudate, cortex, subiculum, and putamen) and outperforms a baseline Watershed algorithm. Neuron counts obtained with our method show high correlation with an adapted stereology technique performed by two experts (respectively, 0.983 and 0.975 for the two experts). Neuron diameters obtained with our method ranged between 2 and 28.6 μm, matching values reported in the literature. Further works will aim to evaluate the impact of staining and interindividual variability on our protocol.

In vivo third-harmonic generation microscopy study on vitiligo patients

Melanin is known to provide strong third-harmonic generation (THG) contrast in human skin. With a high concentration in basal cell cytoplasm, THG contrast provided by melanin overshadows other THG sources in human skin studies. For better understanding of the THG signals in keratinocytes without the influence of melanin, an in vivo THG microscopy (THGM) study was first conducted on vitiliginous skin. As a result, the THG-brightness ratio between the melanin-lacking cytoplasm of basal cells and collagen fibers is about 1.106 at the dermal-epidermal junctions of vitiliginous skin, indicating high sensitivity of THGM for the presence of melanin. We further applied the in vivo THGM to assist evaluating the therapeutic outcome from the histopathological point of view for those showed no improvement under narrowband ultraviolet B therapy based on the seven-point Physician Global Assessment score. Our clinical study indicates the high potential of THGM to assist the histopathological assessment of the therapeutic efficacy of vitiligo treatments.

Tensor regularized total variation for denoising of third harmonic generation images of brain tumors

Third harmonic generation (THG) microscopy shows great potential for instant pathology of brain tissue during surgery. However, the rich morphologies contained and the noise associated makes image restoration, necessary for quantification of the THG images, challenging. Anisotropic diffusion filtering (ADF) has been recently applied to restore THG images of normal brain, but ADF is hard-to-code, time-consuming and only reconstructs salient edges. This work overcomes these drawbacks by expressing ADF as a tensor regularized total variation model, which uses the Huber penalty and the L1 norm for tensor regularization and fidelity measurement, respectively. The diffusion tensor is constructed from the structure tensor of ADF yet the tensor decomposition is performed only in the non-flat areas. The resulting model is solved by an efficient and easy-to-code primal-dual algorithm. Tests on THG brain tumor images show that the proposed model has comparable denoising performance as ADF while it much better restores weak edges and it is up to 60% more time efficient.

Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review

Digital pathology and microscopy image analysis is widely used for comprehensive studies of cell morphology or tissue structure. Manual assessment is labor intensive and prone to interobserver variations. Computer-aided methods, which can significantly improve the objectivity and reproducibility, have attracted a great deal of interest in recent literature. Among the pipeline of building a computer-aided diagnosis system, nucleus or cell detection and segmentation play a very important role to describe the molecular morphological information. In the past few decades, many efforts have been devoted to automated nucleus/cell detection and segmentation. In this review, we provide a comprehensive summary of the recent state-of-the-art nucleus/cell segmentation approaches on different types of microscopy images including bright-field, phase-contrast, differential interference contrast, fluorescence, and electron microscopies. In addition, we discuss the challenges for the current methods and the potential future work of nucleus/cell detection and segmentation.

Characterization of tissue-engineered posterior corneas using second- and third-harmonic generation microscopy

Three-dimensional tissues, such as the cornea, are now being engineered as substitutes for the rehabilitation of vision in patients with blinding corneal diseases. Engineering of tissues for translational purposes requires a non-invasive monitoring to control the quality of the resulting biomaterial. Unfortunately, most current methods still imply invasive steps, such as fixation and staining, to clearly observe the tissue-engineered cornea, a transparent tissue with weak natural contrast. Second- and third-harmonic generation imaging are well known to provide high-contrast, high spatial resolution images of such tissues, by taking advantage of the endogenous contrast agents of the tissue itself. In this article, we imaged tissue-engineered corneal substitutes using both harmonic microscopy and classic histopathology techniques. We demonstrate that second- and third-harmonic imaging can non-invasively provide important information regarding the quality and the integrity of these partial-thickness posterior corneal substitutes (observation of collagen network, fibroblasts and endothelial cells). These two nonlinear imaging modalities offer the new opportunity of monitoring the engineered corneas during the entire process of production.

Nuclear shape descriptors by automated morphometry may distinguish aggressive variants of squamous cell carcinoma from relatively benign skin proliferative lesions: a pilot study

We evaluated whether degrees of dysplasia may be consistently accessed in an automatic fashion, using different kinds of non-melanoma skin cancer (NMSC) as a validatory model. Namely, we compared Bowen disease, actinic keratosis, basal cell carcinoma, low-grade squamous cell carcinoma, and invasive squamous cell carcinoma. We hypothesized that characterizing the shape of nuclei may be important to consistently diagnose the aggressiveness of a skin tumor. While basal cell carcinoma is comparatively relatively benign, management of squamous cell carcinoma is controversial because of its potential to recur and intraoperative dilemma regarding choice of the margin or the depth for the excision. We provide evidence here that progressive nuclear dysplasia may be automatically estimated through the thresholded images of skin cancer and quantitative parameters estimated to provide a quasi-quantitative data, which can thenceforth guide the management of the particular cancer. For circularity, averaging more than 2500 nuclei in each group estimated the means ± SD as 0.8 ± 0.007 vs. 0.78 ± 0.0063 vs. 0.42 ± 0.014 vs. 0.63 ± 0.02 vs. 0.51 ± 0.02 (F = 318063.56, p < 0.0001, one-way analyses of variance). The mean aspect ratios were (means ± SD) 0.97 ± 0.0014 vs. 0.95 ± 0.002 vs. 0.38 ± 0.018 vs. 0.84 ± 0.0035 vs. 0.74 ± 0.019 (F = 1022631.931, p < 0.0001, one-way analyses of variance). The Feret diameters averaged over 2500 nuclei in each group were the following: 1 ± 0.0001 vs. 0.9 ± 0.002 vs. 5 ± 0.031 vs. 1.5 ± 0.01 vs. 1.9 ± 0.004 (F = 33105614.194, p < 0.0001, one-way analyses of variance). Multivariate analyses of composite parameters potentially detect aggressive variants of squamous cell carcinoma as the most dysplastic form, in comparison to locally occurring squamous cell carcinoma and basal cell carcinoma, or benign skin lesions.

A method for automatic segmentation of nuclei in phase-contrast images based on intensity, convexity and texture

This paper presents a method for automatic segmentation of nuclei in phase-contrast images using the intensity, convexity and texture of the nuclei. The proposed method consists of three main stages: preprocessing, h-maxima transformation-based marker controlled watershed segmentation ( h-TMC), and texture analysis. In the preprocessing stage, a top-hat filter is used to increase the contrast and suppress the non-uniform illumination, shading, and other imaging artifacts in the input image. The nuclei segmentation stage consists of a distance transformation, h-maxima transformation and watershed segmentation. These transformations utilize the intensity information and the convexity property of the nucleus for the purpose of detecting a single marker in every nucleus; these markers are then used in the h-TMC watershed algorithm to obtain segments of the nuclei. However, dust particles, imaging artifacts, or prolonged cell cytoplasm may falsely be segmented as nuclei at this stage, and thus may lead to an inaccurate analysis of the cell image. In order to identify and remove these non-nuclei segments, in the third stage a texture analysis is performed, that uses six of the Haralick measures along with the AdaBoost algorithm. The novelty of the proposed method is that it introduces a systematic framework that utilizes intensity, convexity, and texture information to achieve a high accuracy for automatic segmentation of nuclei in the phase-contrast images. Extensive experiments are performed demonstrating the superior performance ( precision = 0.948; recall = 0.924; F1-measure = 0.936; validation based on  ∼ 4850 manually-labeled nuclei) of the proposed method.

Improved and robust detection of cell nuclei from four dimensional fluorescence images

Segmentation-free direct methods are quite efficient for automated nuclei extraction from high dimensional images. A few such methods do exist but most of them do not ensure algorithmic robustness to parameter and noise variations. In this research, we propose a method based on multiscale adaptive filtering for efficient and robust detection of nuclei centroids from four dimensional (4D) fluorescence images. A temporal feedback mechanism is employed between the enhancement and the initial detection steps of a typical direct method. We estimate the minimum and maximum nuclei diameters from the previous frame and feed back them as filter lengths for multiscale enhancement of the current frame. A radial intensity-gradient function is optimized at positions of initial centroids to estimate all nuclei diameters. This procedure continues for processing subsequent images in the sequence. Above mechanism thus ensures proper enhancement by automated estimation of major parameters. This brings robustness and safeguards the system against additive noises and effects from wrong parameters. Later, the method and its single-scale variant are simplified for further reduction of parameters. The proposed method is then extended for nuclei volume segmentation. The same optimization technique is applied to final centroid positions of the enhanced image and the estimated diameters are projected onto the binary candidate regions to segment nuclei volumes.Our method is finally integrated with a simple sequential tracking approach to establish nuclear trajectories in the 4D space. Experimental evaluations with five image-sequences (each having 271 3D sequential images) corresponding to five different mouse embryos show promising performances of our methods in terms of nuclear detection, segmentation, and tracking. A detail analysis with a sub-sequence of 101 3D images from an embryo reveals that the proposed method can improve the nuclei detection accuracy by 9 over the previous methods, which used inappropriate large valued parameters. Results also confirm that the proposed method and its variants achieve high detection accuracies ( 98 mean F-measure) irrespective of the large variations of filter parameters and noise levels.