Three-dimensional graph-based skin layer segmentation in optical coherence tomography images for roughness estimation

Automatic skin layer segmentation in optical coherence tomography (OCT) images is important for a topographic assessment of skin or skin disease detection. However, existing methods cannot deal with the problem of shadowing in OCT images due to the presence of hair, scales, etc. In this work, we propose a method to segment the topmost layer of the skin (or the skin surface) using 3D graphs with a novel cost function to deal with shadowing in OCT images. 3D graph cuts use context information across B-scans when segmenting the skin surface, which improves the segmentation as compared to segmenting each B-scan separately. The proposed method reduces the segmentation error by more than 20% as compared to the best performing related work. The method has been applied to roughness estimation and shows a high correlation with a manual assessment. Promising results demonstrate the usefulness of the proposed method for skin layer segmentation and roughness estimation in both normal OCT images and OCT images with shadowing.

Fiber-bundle-basis sparse reconstruction for high resolution wide-field microendoscopy

In order to observe deep regions of the brain, we propose the use of a fiber bundle for microendoscopy. Fiber bundles allow for the excitation and collection of fluorescence as well as wide field imaging while remaining largely impervious to image distortions brought on by bending. Furthermore, their thin diameter, from 200-500 µm, means their impact on living tissue, though not absent, is minimal. Although wide field imaging with a bundle allows for a high temporal resolution since no scanning is involved, the largest criticism of bundle imaging is the drastically lowered spatial resolution. In this paper, we make use of sparsity in the object being imaged to up sample the low resolution images from the fiber bundle with compressive sensing. We take each image in a single shot by using a measurement basis dictated by the quasi-crystalline arrangement of the bundle's cores. We find that this technique allows us to increase the resolution of a typical image taken through a fiber bundle.

Quantitative biometry of zebrafish retinal vasculature using optical coherence tomographic angiography

The zebrafish is a robust model for studying human ophthalmic function and disease because of its fecundity, life-cycle, and similarities between its retinal structure and the human retina. Here, we demonstrate longitudinal in vivo imaging of retinal structure using optical coherence tomography (OCT) and noninvasive retinal vascular perfusion imaging using OCT angiography (OCT-A) in zebrafish. In addition, we present methods for retinal vascular segmentation and biometry to quantify vessel branch length, curvature, and angle. We further motivate retinal vascular biometry as a novel method for noninvasive zebrafish identification and demonstrated 99.9% accuracy for uniquely identifying eyes from a set of 200 longitudinal OCT/OCT-A volumes. The described methods enable the quantitative analysis of the vascular changes in zebrafish models of ophthalmic diseases and may broadly benefit large-scale zebrafish studies.

Vascular patterning of subcutaneous mouse fibrosarcomas expressing individual VEGF isoforms can be differentiated using angiographic optical coherence tomography

Subcutaneously implanted experimental tumors in mice are commonly used in cancer research. Despite their superficial location, they remain a challenge to image non-invasively at sufficient spatial resolution for microvascular studies. Here we evaluate the capabilities of optical coherence tomography (OCT) angiography for imaging such tumors directly through the murine skin in-vivo. Data sets were collected from mouse tumors derived from fibrosarcoma cells genetically engineered to express only single splice variant isoforms of vascular endothelial growth factor A (VEGF); either VEGF120 or VEGF188 (fs120 and fs188 tumors respectively). Measured vessel diameter was found to be significantly (p<0.001) higher for fs120 tumors (60.7 ± 4.9μm) compared to fs188 tumors (45.0 ± 4.0μm). The fs120 tumors also displayed significantly higher vessel tortuosity, fractal dimension and density. The ability to differentiate between tumor types with OCT suggests that the visible abnormal vasculature is representative of the tumor microcirculation, providing a robust, non-invasive method for observing the longitudinal dynamics of the subcutaneous tumor microcirculation.

Method for quantitative assessment of retinal vessel tortuosity in optical coherence tomography angiography applied to sickle cell retinopathy

Tortuosity is an important geometric vessel parameter and among the first microvascular alterations observed in various retinopathies. In the current study, a quantitative vessel tortuosity index (VTI) based on a combination of local and global centerline features is presented. Performance of VTI and previously established tortuosity indices were compared against human observers' evaluation of tortuosity. An image-processing pipeline was developed for application of VTI in retinal vessels imaged by optical coherence tomography angiography (OCTA) in perifoveal (6 mm × 6 mm) and parafoveal (3 mm × 3 mm) regions centered on the fovea. Forty-one subjects (12 healthy control (NC) and 29 sickle cell retinopathy (SCR)) and 10 subjects (5 NC and 5 SCR) were imaged in the perifoveal and parafoveal regions, respectively. The relationship between VTI and age was examined in the perifoveal regions in NC subjects. VTI was measured from the OCTA images and compared between NC and SCR subjects using generalized least square regression with and without adjusting for age and race. VTI was found to correlate better than the 4 previous indices with performance of human observers. In the perifoveal region, a significant correlation was observed between VTI and age (r = -0.4, P<0.001, N = 12). VTI was higher in SCR than NC subjects in perifoveal and parafoveal regions (P≤0.001). The results demonstrate that the proposed method shows promise for detection of increased tortuosity in vessels due to retinal disorders.

Noise-bias and polarization-artifact corrected optical coherence tomography by maximum a-posteriori intensity estimation

We propose using maximum a-posteriori (MAP) estimation to improve the image signal-to-noise ratio (SNR) in polarization diversity (PD) optical coherence tomography. PD-detection removes polarization artifacts, which are common when imaging highly birefringent tissue or when using a flexible fiber catheter. However, dividing the probe power to two polarization detection channels inevitably reduces the SNR. Applying MAP estimation to PD-OCT allows for the removal of polarization artifacts while maintaining and improving image SNR. The effectiveness of the MAP-PD method is evaluated by comparing it with MAP-non-PD, intensity averaged PD, and intensity averaged non-PD methods. Evaluation was conducted in vivo with human eyes. The MAP-PD method is found to be optimal, demonstrating high SNR and artifact suppression, especially for highly birefringent tissue, such as the peripapillary sclera. The MAP-PD based attenuation coefficient image also shows better differentiation of attenuation levels than non-MAP attenuation images.

Simultaneous multicolor imaging of wide-field epi-fluorescence microscopy with four-bucket detection

We demonstrate simultaneous imaging of multiple fluorophores using wide-field epi-fluorescence microscopy with a monochrome camera. The intensities of the three lasers are modulated by a sinusoidal waveform in order to excite each fluorophore with the same modulation frequency and a different time-delay. Then, the modulated fluorescence emissions are simultaneously detected by a camera operating at four times the excitation frequency. We show that two different fluorescence beads having crosstalk can be clearly separated using digital processing based on the phase information. In addition, multiple organelles within multi-stained single cells are shown with the phase mapping method, demonstrating an improved dynamic range and contrast compared to the conventional fluorescence image. These findings suggest that wide-field epi-fluorescence microscopy with four-bucket detection could be utilized for high-contrast multicolor imaging applications such as drug delivery and fluorescence in situ hybridization.

Embedding complementary imaging data in laser scanning microscopy micrographs by reversible watermarking

Complementary laser scanning microscopy micrographs are considered as pairs consisting in a master image (MI) and a slave image (SI), the latter with potential for facilitating the interpretation of the MI. We propose a strategy based on reversible watermarking for embedding a lossy compressed version of the SI into the MI. The use of reversible watermarking ensures the exact recovery of the host image. By storing and/or transmitting the watermarked MI in a single file, the information contained in both images that constitute the pair is made available to a potential end-user, which simplifies data association and transfer. Examples are presented using support images collected by two complementary techniques, confocal scanning laser microscopy and transmission laser scanning microscopy, on Hematoxylin and Eosin stained tissue fragments. A strategy for minimizing the watermarking distortions of the MI, while preserving the content of the SI, is discussed in detail.

Methodology for diagnosing of skin cancer on images of dermatologic spots by spectral analysis

In this paper a new methodology for the diagnosing of skin cancer on images of dermatologic spots using image processing is presented. Currently skin cancer is one of the most frequent diseases in humans. This methodology is based on Fourier spectral analysis by using filters such as the classic, inverse and k-law nonlinear. The sample images were obtained by a medical specialist and a new spectral technique is developed to obtain a quantitative measurement of the complex pattern found in cancerous skin spots. Finally a spectral index is calculated to obtain a range of spectral indices defined for skin cancer. Our results show a confidence level of 95.4%.

Anisotropic aberration correction using region of interest based digital adaptive optics in Fourier domain OCT

In this paper a numerical technique is presented to compensate for anisotropic optical aberrations, which are usually present across the lateral field of view in the out of focus regions, in high resolution optical coherence tomography and microscopy (OCT/OCM) setups. The recorded enface image field at different depths in the tomogram is digitally divided into smaller sub-regions or the regions of interest (ROIs), processed individually using subaperture based digital adaptive optics (DAO), and finally stitched together to yield a final image with a uniform diffraction limited resolution across the entire field of view (FOV). Using this method, a sub-micron lateral resolution is achieved over a depth range of 218 [Formula: see text]for a nano-particle phantom sample imaged using a fiber based point scanning spectral domain (SD) OCM system with a limited depth of focus (DOF) of ~7 [Formula: see text]at a numerical aperture (NA) of 0.6. Thus, an increase in DOF by ~30x is demonstrated in this case. The application of this method is also shown in ex vivo mouse adipose tissue.

Motion analysis and removal in intensity variation based OCT angiography

In this work, we investigated how bulk motion degraded the quality of optical coherence tomography (OCT) angiography that was obtained through calculating interframe signal variation, i.e., interframe signal variation based optical coherence angiography (isvOCA). We demonstrated theoretically and experimentally that the spatial average of isvOCA signal had an explicit functional dependency on bulk motion. Our result suggested that the bulk motion could lead to an increased background in angiography image. Based on our motion analysis, we proposed to reduce image artifact induced by transient bulk motion in isvOCA through adaptive thresholding. The motion artifact reduced angiography was demonstrated in a 1.3μm spectral domain OCT system. We implemented signal processing using graphic processing unit for real-time imaging and conducted in vivo microvasculature imaging on human skin. Our results clearly showed that the adaptive thresholding method was highly effective in the motion artifact removal for OCT angiography.

Dermascope guided multiple reference optical coherence tomography

In this paper, we report the feasibility of integrating a novel low cost optical coherence tomography (OCT) system with a dermascope for point-of-care applications. The proposed OCT system is based on an enhanced time-domain optical coherence tomographic system, called multiple reference OCT (MR-OCT), which uses a single miniature voice coil actuator and a partial mirror for extending the axial scan range. The system can simultaneously register both the superficial dermascope image and the depth-resolved OCT sub-surface information by an interactive beam steering method. A practitioner is able to obtain the depth resolved information of the point of interest by simply using the mouse cursor. The proposed approach of combining a dermascope with a low cost OCT provides a unique powerful optical imaging modality for a range of dermatological applications. Hand-held dermascopic OCT devices would also enable point of care and remote health monitoring.

Quantitative analysis of intrinsic skin aging in dermal papillae by in vivo harmonic generation microscopy

Chronological skin aging is associated with flattening of the dermal-epidermal junction (DEJ), but to date no quantitative analysis focusing on the aging changes in the dermal papillae (DP) has been performed. The aim of the study is to determine the architectural changes and the collagen density related to chronological aging in the dermal papilla zone (DPZ) by in vivo harmonic generation microscopy (HGM) with a sub-femtoliter spatial resolution. We recruited 48 Asian subjects and obtained in vivo images on the sun-protected volar forearm. Six parameters were defined to quantify 3D morphological changes of the DPZ, which we analyzed both manually and computationally to study their correlation with age. The depth of DPZ, the average height of isolated DP, and the 3D interdigitation index decreased with age, while DP number density, DP volume, and the collagen density in DP remained constant over time. In vivo high-resolution HGM technology has uncovered chronological aging-related variations in DP, and sheds light on real-time quantitative skin fragility assessment and disease diagnostics based on collagen density and morphology.

Calcium imaging at kHz frame rates resolves millisecond timing in neuronal circuits and varicosities

We have configured a widefield fast imaging system that allows imaging at 1000 frames per second (512x512 pixels). The system was extended with custom processing tools including a time correlation method to facilitate the analysis of static subcellular compartments (e.g. neuronal varicosities) with enhanced contrast, as well as a dynamic intensity processing (DIP) algorithm that aids in data size reduction and fast visualization and interpretation of timing and directionality in neuronal circuits. This system, together with our custom developed processing tools enables efficient detection of fast physiological events, such as action potential dependent calcium steps. We show, using a specific blocker of nerve communication, that with this setup it is possible to discriminate between a pre and post synaptic event in an all optical way.

Fully automated digital holographic processing for monitoring the dynamics of a vesicle suspension under shear flow

We investigate the dynamics of a vesicle suspension under shear flow between plates using DHM with a spatially reduced coherent source. Holograms are grabbed at a frequency of 24 frames/sec. The distribution of the vesicle suspension is obtained after numerical processing of the digital holograms sequence resulting in a 4D distribution. Obtaining this distribution is not straightforward and requires special processing to automate the analysis. We present an original method that fully automates the analysis and provides distributions that are further analyzed to extract physical properties of the fluid. Details of the numerical implementation, as well as sample experimental results are presented.

Repeatability of in vivo 3D lamina cribrosa microarchitecture using adaptive optics spectral domain optical coherence tomography

We demonstrate the repeatability of lamina cribrosa (LC) microarchitecture for in vivo 3D optical coherence tomography (OCT) scans of healthy, glaucoma suspects, and glaucomatous eyes. Eyes underwent two scans using a prototype adaptive optics spectral domain OCT (AO-SDOCT) device from which LC microarchitecture was semi-automatically segmented. LC segmentations were used to quantify pore and beam structure through several global microarchitecture parameters. Repeatability of LC microarchitecture was assessed qualitatively and quantitatively by calculating parameter imprecision. For all but one parameters (pore volume) measurement imprecision was <4.7% of the mean value, indicating good measurement reproducibility. Imprecision ranged between 27.3% and 54.5% of the population standard deviation for each parameter, while there was not a significant effect on imprecision due to disease status, indicating utility in testing for LC structural trends.

A combined machine-learning and graph-based framework for the segmentation of retinal surfaces in SD-OCT volumes

Optical coherence tomography is routinely used clinically for the detection and management of ocular diseases as well as in research where the studies may involve animals. This routine use requires that the developed automated segmentation methods not only be accurate and reliable, but also be adaptable to meet new requirements. We have previously proposed the use of a graph-theoretic approach for the automated 3-D segmentation of multiple retinal surfaces in volumetric human SD-OCT scans. The method ensures the global optimality of the set of surfaces with respect to a cost function. Cost functions have thus far been typically designed by hand by domain experts. This difficult and time-consuming task significantly impacts the adaptability of these methods to new models. Here, we describe a framework for the automated machine-learning based design of the cost function utilized by this graph-theoretic method. The impact of the learned components on the final segmentation accuracy are statistically assessed in order to tailor the method to specific applications. This adaptability is demonstrated by utilizing the method to segment seven, ten and five retinal surfaces from SD-OCT scans obtained from humans, mice and canines, respectively. The overall unsigned border position errors observed when using the recommended configuration of the graph-theoretic method was 6.45 ± 1.87 μm, 3.35 ± 0.62 μm and 9.75 ± 3.18 μm for the human, mouse and canine set of images, respectively.

Continuous real-time photoacoustic demodulation via field programmable gate array for dynamic imaging of zebrafish cardiac cycle

A four dimensional data set of the cardiac cycle of a zebrafish embryo was acquired using postacquisition synchronization of real time photoacoustic b-scans. Utilizing an off-axis photoacoustic microscopy (OA-PAM) setup, we have expanded upon our previous work with OA-PAM to develop a system that can sustain 100 kHz line rates while demodulating the bipolar photoacoustic signal in real-time. Real-time processing was accomplished by quadrature demodulation on a Field Programmable Gate Array (FPGA) in line with the signal digitizer. Simulated data acquisition verified the system is capable of real-time processing up to a line rate of 1 MHz. Galvanometer-scanning of the excitation laser inside the focus of the ultrasonic transducer enables real data acquisition of a 200 by 200 by 200 pixel, volumetric data set across a 2 millimeter field of view at a rate of 2.5 Hz.

Automated lamina cribrosa microstructural segmentation in optical coherence tomography scans of healthy and glaucomatous eyes

We demonstrate an automated segmentation method for in-vivo 3D optical coherence tomography (OCT) imaging of the lamina cribrosa (LC). Manual segmentations of coronal slices of the LC were used as a gold standard in parameter selection and evaluation of the automated technique. The method was validated using two prototype OCT devices; each had a subject cohort including both healthy and glaucomatous eyes. Automated segmentation of in-vivo 3D LC OCT microstructure performed comparably to manual segmentation and is useful for investigative research and in clinical quantification of the LC.

Motion-compensated hand-held common-path Fourier-domain optical coherence tomography probe for image-guided intervention

A motion-compensated, hand-held, common-path, Fourier-domain optical coherence tomography imaging probe has been developed for image-guided intervention during microsurgery. A hand-held prototype instrument was achieved by integrating an imaging fiber probe inside a stainless steel needle and attached to the ceramic shaft of a piezoelectric motor housed in an aluminum handle. The fiber probe obtains A-scan images. The distance information was extracted from the A-scans to track the sample surface distance and a fixed distance was maintained by a feedback motor control which effectively compensated hand tremor and target movements in the axial direction. Real-time data acquisition, processing, motion compensation, and image visualization and saving were implemented on a custom CPU-GPU hybrid architecture. We performed 10× zero padding to the raw spectrum to obtain 0.16 µm position accuracy with a compensation rate of 460 Hz. The root-mean-square error of hand-held distance variation from target position was measured to be 2.93 µm. We used a cross-correlation maximization-based shift correction algorithm for topology correction. To validate the system, we performed free-hand OCT M-scan imaging using various samples.

Real-time 3D and 4D Fourier domain Doppler optical coherence tomography based on dual graphics processing units

We present real-time 3D (2D cross-sectional image plus time) and 4D (3D volume plus time) phase-resolved Doppler OCT (PRDOCT) imaging based on configuration of dual graphics processing units (GPU). A GPU-accelerated phase-resolving processing algorithm was developed and implemented. We combined a structural image intensity-based thresholding mask and average window method to improve the signal-to-noise ratio of the Doppler phase image. A 2D simultaneous display of the structure and Doppler flow images was presented at a frame rate of 70 fps with an image size of 1000 × 1024 (X × Z) pixels. A 3D volume rendering of tissue structure and flow images-each with a size of 512 × 512 pixels-was presented 64.9 milliseconds after every volume scanning cycle with a volume size of 500 × 256 × 512 (X × Y × Z) voxels, with an acquisition time window of only 3.7 seconds. To the best of our knowledge, this is the first time that an online, simultaneous structure and Doppler flow volume visualization has been achieved. Maximum system processing speed was measured to be 249,000 A-scans per second with each A-scan size of 2048 pixels.

Motion correction of in vivo three-dimensional optical coherence tomography of human skin using a fiducial marker

This paper presents a novel method based on a fiducial marker for correction of motion artifacts in 3D, in vivo, optical coherence tomography (OCT) scans of human skin and skin scars. The efficacy of this method was compared against a standard cross-correlation intensity-based registration method. With a fiducial marker adhered to the skin, OCT scans were acquired using two imaging protocols: direct imaging from air into tissue; and imaging through ultrasound gel into tissue, which minimized the refractive index mismatch at the tissue surface. The registration methods were assessed with data from both imaging protocols and showed reduced distortion of skin features due to motion. The fiducial-based method was found to be more accurate and robust, with an average RMS error below 20 µm and success rate above 90%. In contrast, the intensity-based method had an average RMS error ranging from 36 to 45 µm, and a success rate from 50% to 86%. The intensity-based algorithm was found to be particularly confounded by corrugations in the skin. By contrast, tissue features did not affect the fiducial-based method, as the motion correction was based on delineation of the flat fiducial marker. The average computation time for the fiducial-based algorithm was approximately 21 times less than for the intensity-based algorithm.

Numerical comparison of X-ray differential phase contrast and attenuation contrast

We present a numerical tool to compare directly the contrast-to-noise-ratio (CNR) of the attenuation- and differential phase-contrast signals available from grating-based X-ray imaging for single radiographs. The attenuation projection is differentiated to bring it into a modality comparable to the differential phase projection using a Gaussian derivative filter. A Relative Contrast Gain (RCG) is then defined as the ratio of the CNR of image values in a region of interest (ROI) in the differential phase projection to the CNR of image values in the same ROI in the differential attenuation projection. We apply the method on experimental data of human breast tissue acquired using a grating interferometer to compare the two contrast modes for two regions of interest differing in the type of tissue. Our results indicate that the proposed method can be used as a local estimate of the spatial distribution of the ratio δ/β, i.e., real and imaginary part of the complex refractive index, across a sample.

Real-time intraoperative 4D full-range FD-OCT based on the dual graphics processing units architecture for microsurgery guidance

Real-time 4D full-range complex-conjugate-free Fourier-domain optical coherence tomography (FD-OCT) is implemented using a dual graphics processing units (dual-GPUs) architecture. One GPU is dedicated to the FD-OCT data processing while the second one is used for the volume rendering and display. GPU accelerated non-uniform fast Fourier transform (NUFFT) is also implemented to suppress the side lobes of the point spread function to improve the image quality. Using a 128,000 A-scan/second OCT spectrometer, we obtained 5 volumes/second real-time full-range 3D OCT imaging. A complete micro-manipulation of a phantom using a microsurgical tool is monitored by multiple volume renderings of the same 3D date set with different view angles. Compared to the conventional surgical microscope, this technology would provide the surgeons a more comprehensive spatial view of the microsurgical site and could serve as an effective intraoperative guidance tool.