Active Cell Appearance Model Induced Generative Adversarial Networks for Annotation-Efficient Cell Segmentation and Identification on Adaptive Optics Retinal Images

Revealing speckle obscured living human retinal cells with artificial intelligence assisted adaptive optics optical coherence tomography

BACKGROUND

In vivo imaging of the human retina using adaptive optics optical coherence tomography (AO-OCT) has transformed medical imaging by enabling visualization of 3D retinal structures at cellular-scale resolution, including the retinal pigment epithelial (RPE) cells, which are essential for maintaining visual function. However, because noise inherent to the imaging process (e.g., speckle) makes it difficult to visualize RPE cells from a single volume acquisition, a large number of 3D volumes are typically averaged to improve contrast, substantially increasing the acquisition duration and reducing the overall imaging throughput.

METHODS

Here, we introduce parallel discriminator generative adversarial network (P-GAN), an artificial intelligence (AI) method designed to recover speckle-obscured cellular features from a single AO-OCT volume, circumventing the need for acquiring a large number of volumes for averaging. The combination of two parallel discriminators in P-GAN provides additional feedback to the generator to more faithfully recover both local and global cellular structures. Imaging data from 8 eyes of 7 participants were used in this study.

RESULTS

We show that P-GAN not only improves RPE cell contrast by 3.5-fold, but also improves the end-to-end time required to visualize RPE cells by 99-fold, thereby enabling large-scale imaging of cells in the living human eye. RPE cell spacing measured across a large set of AI recovered images from 3 participants were in agreement with expected normative ranges.

CONCLUSIONS

The results demonstrate the potential of AI assisted imaging in overcoming a key limitation of RPE imaging and making it more accessible in a routine clinical setting.

Laser capture microdissection for biomedical research: towards high-throughput, multi-omics, and single-cell resolution

Spatial omics technologies have become powerful methods to provide valuable insights into cells and tissues within a complex context, significantly enhancing our understanding of the intricate and multifaceted biological system. With an increasing focus on spatial heterogeneity, there is a growing need for unbiased, spatially resolved omics technologies. Laser capture microdissection (LCM) is a cutting-edge method for acquiring spatial information that can quickly collect regions of interest (ROIs) from heterogeneous tissues, with resolutions ranging from single cells to cell populations. Thus, LCM has been widely used for studying the cellular and molecular mechanisms of diseases. This review focuses on the differences among four types of commonly used LCM technologies and their applications in omics and disease research. Key attributes of application cases are also highlighted, such as throughput and spatial resolution. In addition, we comprehensively discuss the existing challenges and the great potential of LCM in biomedical research, disease diagnosis, and targeted therapy from the perspective of high-throughput, multi-omics, and single-cell resolution.

Deep learning-enabled volumetric cone photoreceptor segmentation in adaptive optics optical coherence tomography images of normal and diseased eyes

Objective quantification of photoreceptor cell morphology, such as cell diameter and outer segment length, is crucial for early, accurate, and sensitive diagnosis and prognosis of retinal neurodegenerative diseases. Adaptive optics optical coherence tomography (AO-OCT) provides three-dimensional (3-D) visualization of photoreceptor cells in the living human eye. The current gold standard for extracting cell morphology from AO-OCT images involves the tedious process of 2-D manual marking. To automate this process and extend to 3-D analysis of the volumetric data, we propose a comprehensive deep learning framework to segment individual cone cells in AO-OCT scans. Our automated method achieved human-level performance in assessing cone photoreceptors of healthy and diseased participants captured with three different AO-OCT systems representing two different types of point scanning OCT: spectral domain and swept source.

Photoreceptor and Retinal Pigment Epithelium Relationships in Eyes With Vitelliform Macular Dystrophy Revealed by Multimodal Adaptive Optics Imaging

Purpose

To assess the structure of cone photoreceptors and retinal pigment epithelial (RPE) cells in vitelliform macular dystrophy (VMD) arising from various genetic etiologies.

Methods

Multimodal adaptive optics (AO) imaging was performed in 11 patients with VMD using a custom-assembled instrument. Non-confocal split detection and AO-enhanced indocyanine green were used to visualize the cone photoreceptor and RPE mosaics, respectively. Cone and RPE densities were measured and compared across BEST1-, PRPH2-, IMPG1-, and IMPG2-related VMD.

Results

Within macular lesions associated with VMD, both cone and RPE densities were reduced below normal, to 37% of normal cone density (eccentricity 0.2 mm) and to 8.4% of normal RPE density (eccentricity 0.5 mm). Outside of lesions, cone and RPE densities were slightly reduced (both to 92% of normal values), but with high degree of variability in the individual measurements. Comparison of juxtalesional cone and RPE measurements (<1 mm from the lesion edge) revealed significant differences in RPE density across the four genes (P < 0.05). Overall, cones were affected to a greater extent than RPE in patients with IMPG1 and IMPG2 pathogenic variants, but RPE was affected more than cones in BEST1 and PRPH2 VMD. This trend was observed even in contralateral eyes from a subset of five patients who presented with macular lesions in only one eye.

Conclusions

Assessment of cones and RPE in retinal locations outside of the macular lesions reveals a pattern of cone and RPE disruption that appears to be gene dependent in VMD. These findings provide insight into the cellular pathogenesis of disease in VMD.

Visualizing retinal cells with adaptive optics imaging modalities using a translational imaging framework

Adaptive optics reflectance-based retinal imaging has proved a valuable tool for the noninvasive visualization of cells in the living human retina. Many subcellular features that remain at or below the resolution limit of current in vivo techniques may be more easily visualized with the same modalities in an ex vivo setting. While most microscopy techniques provide significantly higher resolution, enabling the visualization of fine cellular detail in ex vivo retinal samples, they do not replicate the reflectance-based imaging modalities of in vivo retinal imaging. Here, we introduce a strategy for imaging ex vivo samples using the same imaging modalities as those used for in vivo retinal imaging, but with increased resolution. We also demonstrate the ability of this approach to perform protein-specific fluorescence imaging and reflectance imaging simultaneously, enabling the visualization of nearly transparent layers of the retina and the classification of cone photoreceptor types.