Depth-resolved optimization of a real-time sensorless adaptive optics optical coherence tomography

Image metric-based multi-observation single-step deep deterministic policy gradient for sensorless adaptive optics

Sensorless adaptive optics (SAO) has been widely used across diverse fields such as astronomy, microscopy, and ophthalmology. Recent advances have proved the feasibility of using the deep deterministic policy gradient (DDPG) for image metric-based SAO, achieving fast correction speeds compared to the coordinate search Zernike mode hill climbing (ZMHC) method. In this work, we present a multi-observation single-step DDPG (MOSS-DDPG) optimization framework for SAO on a confocal scanning laser ophthalmoscope (SLO) system with particular consideration for applications in preclinical retinal imaging. MOSS-DDPG optimizes N target Zernike coefficients in a single-step manner based on 2N + 1 observations of the image sharpness metric values. Through in silico simulations, MOSS-DDPG has demonstrated the capability to quickly achieve diffraction-limited resolution performance with long short-term memory (LSTM) network implementation. In situ tests suggest that knowledge learned through simulation adapts swiftly to imperfections in the real system by transfer learning, exhibiting comparable in situ performance to the ZMHC method with a greater than tenfold reduction in the required number of iterations.

Non-mydriatic ultra-widefield diffraction-limited retinal imaging

We demonstrate a new non-mydriatic ultra-widefield optical coherence tomography retinal imaging system, designed with custom optics to improve the imaging field of view, lateral resolution, and patient comfort. The key motivation is to address the challenge with conventional systems that require pupillary dilation, adding time, expense, discomfort, and medical risk to the examination of the retina. Our system provides an ultrawide 100° field of view (beam scanning angle at the scanning pivot point) and maintains a lateral resolution of 20 µm on the center. It also allows a generous working distance of 16 mm, 2-3 times longer than existing ultra-widefield OCT imaging systems. This advanced system was able to avoid iris vignetting artifacts without pharmacological dilation and ensure diffraction-limited ultra-widefield imaging under a generalized eye model. This enables a comprehensive evaluation of retina diseases, especially those affecting the peripheral regions.

Panretinal handheld OCT angiography for pediatric retinal imaging

Comprehensive visualization of retina morphology is essential in the diagnosis and management of retinal diseases in pediatric populations. Conventional imaging techniques often face challenges in effectively capturing the peripheral retina, primarily due to the limitations in current optical designs, which lack the necessary field of view to characterize the far periphery. To address this gap, our study introduces a novel ultra-widefield optical coherence tomography angiography (OCTA) system. This system, specifically tailored for pediatric applications, incorporates an ultrahigh-speed 800 kHz swept-source laser. The system's innovative design achieves a 140° field of view while maintaining excellent optical performance. Over the last 15 months, we have conducted 379 eye examinations on 96 babies using this system. It demonstrates marked efficacy in the diagnosis of retinopathy of prematurity, providing detailed and comprehensive peripheral retinal angiography. The capabilities of the ultra-widefield handheld OCTA system in enhancing the clarity and thoroughness of retina vascularization assessments have significantly improved the precision of diagnoses and the customization of treatment strategies. Our findings underscore the system's potential to advance pediatric ophthalmology and broaden the scope of retinal imaging.

Segmental biomechanics of the normal and glaucomatous human aqueous outflow pathway

The conventional aqueous outflow pathway, encompassing the trabecular meshwork (TM), juxtacanalicular connective tissue (JCT), and inner wall endothelium of Schlemm's canal (SC), governs intraocular pressure (IOP) regulation. This study targets the biomechanics of low-flow (LF) and high-flow (HF) regions within the aqueous humor outflow pathway in normal and glaucomatous human donor eyes, using a combined experimental and computational approach. LF and HF TM/JCT/SC complex tissues from normal and glaucomatous eyes underwent uniaxial tensile testing. Dynamic motion of the TM/JCT/SC complex was recorded using customized green-light optical coherence tomography during SC pressurization in cannulated anterior segment wedges. A hyperviscoelastic model quantified TM/JCT/SC complex properties. A fluid-structure interaction model simulated tissue-aqueous humor interaction. FluoSpheres were introduced into the pathway via negative pressure in the SC, with their motion tracked using two-photon excitation microscopy. Tensile test results revealed that the elastic moduli of the LF and HF regions in glaucomatous eyes are 3.5- and 1.5-fold stiffer than the normal eyes, respectively. The FE results also showed significantly larger shear moduli in the TM, JCT, and SC of the glaucomatous eyes compared to the normal subjects. The LF regions in normal eyes demonstrated larger elastic moduli compared to the HF regions in glaucomatous eyes. The resultant strain in the outflow tissues and velocity of the aqueous humor in the FSI models were in good agreement with the digital volume correlation and 3D particle image velocimetry data, respectively. This study uncovers stiffer biomechanical responses in glaucomatous eyes, with LF regions stiffer than HF regions in both normal and glaucomatous eyes. STATEMENT OF SIGNIFICANCE: This study delves into the biomechanics of the conventional aqueous outflow pathway, a crucial regulator of intraocular pressure and ocular health. By analyzing mechanical differences in low-flow and high-flow regions of normal and glaucomatous eyes, this research unveils the stiffer response in glaucomatous eyes. The distinction between regions' properties offers insights into aqueous humor outflow regulation, while the integration of experimental and computational methods enhances credibility. These findings have potential implications for disease management and present a vital step toward innovative ophthalmic interventions. This study advances our understanding of glaucoma's biomechanical basis and its broader impact on ocular health.

Panretinal Optical Coherence Tomography

We introduce a new concept of panoramic retinal (panretinal) optical coherence tomography (OCT) imaging system with a 140° field of view (FOV). To achieve this unprecedented FOV, a contact imaging approach was used which enabled faster, more efficient, and quantitative retinal imaging with measurement of axial eye length. The utilization of the handheld panretinal OCT imaging system could allow earlier recognition of peripheral retinal disease and prevent permanent vision loss. In addition, adequate visualization of the peripheral retina has a great potential for better understanding disease mechanisms regarding the periphery. To the best of our knowledge, the panretinal OCT imaging system presented in this manuscript has the widest FOV among all the retina OCT imaging systems and offers significant values in both clinical ophthalmology and basic vision science.

Developing an experimental-computational workflow to study the biomechanics of the human conventional aqueous outflow pathway

The aqueous humor actively interacts with the trabecular meshwork (TM), juxtacanalicular tissue (JCT), and Schlemm's canal (SC) through a dynamic fluid-structure interaction (FSI) coupling. Despite the fact that intraocular pressure (IOP) undergoes significant fluctuations, our understanding of the hyperviscoelastic biomechanical properties of the aqueous outflow tissues is limited. In this study, a quadrant of the anterior segment from a normal human donor eye was dynamically pressurized in the SC lumen, and imaged using a customized optical coherence tomography (OCT). The TM/JCT/SC complex finite element (FE) with embedded collagen fibrils was reconstructed based on the segmented boundary nodes in the OCT images. The hyperviscoelastic mechanical properties of the outflow tissues' extracellular matrix with embedded viscoelastic collagen fibrils were calculated using an inverse FE-optimization method. Thereafter, the 3D microstructural FE model of the TM, with adjacent JCT and SC inner wall, from the same donor eye was constructed using optical coherence microscopy and subjected to a flow load-boundary from the SC lumen. The resultant deformation/strain in the outflow tissues was calculated using the FSI method, and compared to the digital volume correlation (DVC) data. TM showed larger shear modulus (0.92 MPa) compared to the JCT (0.47 MPa) and SC inner wall (0.85 MPa). Shear modulus (viscoelastic) was larger in the SC inner wall (97.65 MPa) compared to the TM (84.38 MPa) and JCT (56.30 MPa). The conventional aqueous outflow pathway is subjected to a rate-dependent IOP load-boundary with large fluctuations. This necessitates addressing the biomechanics of the outflow tissues using hyperviscoelastic material-model. STATEMENT OF SIGNIFICANCE: While the human conventional aqueous outflow pathway is subjected to a large-deformation and time-dependent IOP load-boundary, we are not aware of any studies that have calculated the hyperviscoelastic mechanical properties of the outflow tissues with embedded viscoelastic collagen fibrils. A quadrant of the anterior segment of a normal humor donor eye was dynamically pressurized from the SC lumen with relatively large fluctuations. The TM/JCT/SC complex were OCT imaged and the mechanical properties of the tissues with embedded collagen fibrils were calculated using the inverse FE-optimization algorithm. The resultant displacement/strain in the FSI outflow model was validated versus the DVC data. The proposed experimental-computational workflow may significantly contribute to understanding of the effects of different drugs on the biomechanics of the conventional aqueous outflow pathway.

Wide-field sensorless adaptive optics swept-source optical coherence tomographic angiography in rodents

In this study, we present a sensorless adaptive optics swept-source optical coherence tomographic angiography (sAO-SS-OCTA) imaging system for mice. Real-time graphics processing unit (GPU)-based OCTA image acquisition and processing software were applied to guide wavefront correction using a deformable mirror based on signal strength index (SSI) from both OCT and OCTA images. High-resolution OCTA images with aberrations corrected and contrast enhanced were successfully acquired. Fifty-degree field of view high-resolution montaged OCTA images were also acquired.

Corneal imaging with blue-light optical coherence microscopy

Corneal imaging is important for the diagnostic and therapeutic evaluation of many eye diseases. Optical coherence tomography (OCT) is extensively used in ocular imaging due to its non-invasive and high-resolution volumetric imaging characteristics. Optical coherence microscopy (OCM) is a technical variation of OCT that can image the cornea with cellular resolution. Here, we demonstrate a blue-light OCM as a low-cost and easily reproducible system to visualize corneal cellular structures such as epithelial cells, endothelial cells, keratocytes, and collagen bundles within stromal lamellae. Our blue-light OCM system achieved an axial resolution of 12 µm in tissue over a 1.2 mm imaging depth, and a lateral resolution of 1.6 µm over a field of view of 750 µm × 750 µm.

Advances in Optical Coherence Tomography Imaging Technology and Techniques for Choroidal and Retinal Disorders

Optical coherence tomography (OCT) imaging has played a pivotal role in the field of retina. This light-based, non-invasive imaging modality provides high-quality, cross-sectional analysis of the retina and has revolutionized the diagnosis and management of retinal and choroidal diseases. Since its introduction in the early 1990s, OCT technology has continued to advance to provide quicker acquisition times and higher resolution. In this manuscript, we discuss some of the most recent advances in OCT technology and techniques for choroidal and retinal diseases. The emerging innovations discussed include wide-field OCT, adaptive optics OCT, polarization sensitive OCT, full-field OCT, hand-held OCT, intraoperative OCT, at-home OCT, and more. The applications of these rising OCT systems and techniques will allow for a closer monitoring of chorioretinal diseases and treatment response, more robust analysis in basic science research, and further insights into surgical management. In addition, these innovations to optimize visualization of the choroid and retina offer a promising future for advancing our understanding of the pathophysiology of chorioretinal diseases.

Application of Adaptive Optics in Ophthalmology

The eye, the photoreceptive organ used to perceive the external environment, is of great importance to humans. It has been proven that some diseases in humans are accompanied by fundus changes; therefore, the health status of people may be interpreted from retinal images. However, the human eye is not a perfect refractive system for the existence of ocular aberrations. These aberrations not only affect the ability of human visual discrimination and recognition, but restrict the observation of the fine structures of human eye and reduce the possibility of exploring the mechanisms of eye disease. Adaptive optics (AO) is a technique that corrects optical wavefront aberrations. Once integrated into ophthalmoscopes, AO enables retinal imaging at the cellular level. This paper illustrates the principle of AO in correcting wavefront aberrations in human eyes, and then reviews the applications and advances of AO in ophthalmology, including the adaptive optics fundus camera (AO-FC), the adaptive optics scanning laser ophthalmoscope (AO-SLO), the adaptive optics optical coherence tomography (AO-OCT), and their combined multimodal imaging technologies. The future development trend of AO in ophthalmology is also prospected.

Volumetric directional optical coherence tomography

Photoreceptor loss and resultant thinning of the outer nuclear layer (ONL) is an important pathological feature of retinal degenerations and may serve as a useful imaging biomarker for age-related macular degeneration. However, the demarcation between the ONL and the adjacent Henle's fiber layer (HFL) is difficult to visualize with standard optical coherence tomography (OCT). A dedicated OCT system that can precisely control and continuously and synchronously update the imaging beam entry points during scanning has not been realized yet. In this paper, we introduce a novel imaging technology, Volumetric Directional OCT (VD-OCT), which can dynamically adjust the incident beam on the pupil without manual adjustment during a volumetric OCT scan. We also implement a customized spoke-circular scanning pattern to observe the appearance of HFL with sufficient optical contrast in continuous cross-sectional scans through the entire volume. The application of VD-OCT for retinal imaging to exploit directional reflectivity properties of tissue layers has the potential to allow for early identification of retinal diseases.

Aberration Correction to Optimize the Performance of Two-Photon Fluorescence Microscopy Using the Genetic Algorithm

Due to less light scattering and a better signal-to-noise ratio in deep imaging, two-photon fluorescence microscopy (TPFM) has been widely used in biomedical photonics since its advent. However, optical aberrations degrade the performance of TPFM in terms of the signal intensity and the imaging depth and therefore restrict its application. Here, we introduce adaptive optics based on the genetic algorithm to detect the distorted wavefront of the excitation laser beam and then perform aberration correction to optimize the performance of TPFM. By using a spatial light modulator as the wavefront controller, the correction phase is obtained through a signal feedback loop and a process of natural selection. The experimental results show that the signal intensity and imaging depth of TPFM are improved after aberration correction. Finally, the method was applied to two-photon fluorescence lifetime imaging, which helps to improve the signal-to-noise ratio and the accuracy of lifetime analysis. Furthermore, the method can also be implemented in other experiments, such as three-photon microscopy, light-sheet microscopy, and super-resolution microscopy.

105° field of view non-contact handheld swept-source optical coherence tomography

We demonstrate a handheld swept-source optical coherence tomography (OCT) system with a 400 kHz vertical-cavity surface-emitting laser (VCSEL) light source, a non-contact approach, and an unprecedented single shot 105° field of view (FOV). We also implemented a spiral scanning pattern allowing real-time visualization with improved scanning efficiency. To the best of our knowledge, this is the widest FOV achieved in a portable non-contact OCT retinal imaging system to date. Improvements to the FOV may aid the evaluation of retinal diseases such as retinopathy of prematurity, where important vitreoretinal changes often occur in the peripheral retina.

Simulating scan formation in multimodal optical coherence tomography: angular-spectrum formulation based on ballistic scattering of arbitrary-form beams

We present a computationally highly efficient full-wave spectral model of OCT-scan formation with the following features: allowance of arbitrary phase-amplitude profile of illuminating beams; absence of paraxial approximation; utilization of broadly used approximation of ballistic scattering by discrete scatterers without limitations on their density/location and scattering strength. The model can easily incorporate the wave decay, dispersion, measurement noises with given signal-to-noise ratios and arbitrary inter-scan displacements of scatterers. We illustrate several of such abilities, including comparative simulations of OCT-scans for Bessel versus Gaussian beams, presence of arbitrary aberrations at the tissue boundary and various scatterer motions. The model flexibility and computational efficiency allow one to accurately study various properties of OCT-scans for developing new methods of their processing in various biomedical applications.

Sensorless astigmatism correction using a variable cross-cylinder for high lateral resolution optical coherence tomography in a human retina

High lateral resolution (∼5µm) optical coherence tomography (OCT) that employs a variable cross-cylinder (VCC) to compensate for astigmatism is presented for visualizing minute structures of the human retina. The VCC and its sensorless optimization process enable ocular astigmatism correction of up to -5.0 diopter within a few seconds. VCC correction has been proven to increase the signal-to-noise ratio and lateral resolution using a model eye. This process is also validated using the human eye by visualizing the capillary network and human cone mosaic. The proposed method is applicable to existing OCT, making high lateral resolution OCT practical in clinical settings.

Wavefront sensor-less adaptive optics using deep reinforcement learning

Image degradation due to wavefront aberrations can be corrected with adaptive optics (AO). In a typical AO configuration, the aberrations are measured directly using a Shack-Hartmann wavefront sensor and corrected with a deformable mirror in order to attain diffraction limited performance for the main imaging system. Wavefront sensor-less adaptive optics (SAO) uses the image information directly to determine the aberrations and provide guidance for shaping the deformable mirror, often iteratively. In this report, we present a Deep Reinforcement Learning (DRL) approach for SAO correction using a custom-built fluorescence confocal scanning laser microscope. The experimental results demonstrate the improved performance of the DRL approach relative to a Zernike Mode Hill Climbing algorithm for SAO.

High-speed and widefield handheld swept-source OCT angiography with a VCSEL light source

Optical coherence tomography (OCT) and OCT angiography (OCTA) enable noninvasive structural and angiographic imaging of the eye. Portable handheld OCT/OCTA systems are required for imaging patients in the supine position. Examples include infants in the neonatal intensive care unit (NICU) and operating room (OR). The speed of image acquisition plays a pivotal role in acquiring high-quality OCT/OCTA images, particularly with the handheld system, since both the operator hand tremor and subject motion can cause significant motion artifacts. In addition, having a large field of view and the ability of real-time data visualization are critical elements in rapid disease screening, reducing imaging time, and detecting peripheral retinal pathologies. The arrangement of optical components is less flexible in the handheld system due to the limitation of size and weight. In this paper, we introduce a 400-kHz, 55-degree field of view handheld OCT/OCTA system that has overcome many technical challenges as a portable OCT system as well as a high-speed OCTA system. We demonstrate imaging premature infants with retinopathy of prematurity (ROP) in the NICU, a patient with incontinentia pigmenti (IP), and a patient with X-linked retinoschisis (XLRS) in the OR using our handheld OCT system. Our design may have the potential for improving the diagnosis of retinal diseases and help provide a practical guideline for designing a flexible and portable OCT system.

Adaptive optics: principles and applications in ophthalmology

This is a comprehensive review of the principles and applications of adaptive optics (AO) in ophthalmology. It has been combined with flood illumination ophthalmoscopy, scanning laser ophthalmoscopy, as well as optical coherence tomography to image photoreceptors, retinal pigment epithelium (RPE), retinal ganglion cells, lamina cribrosa and the retinal vasculature. In this review, we highlight the clinical studies that have utilised AO to understand disease mechanisms. However, there are some limitations to using AO in a clinical setting including the cost of running an AO imaging service, the time needed to scan patients, the lack of normative databases and the very small size of area imaged. However, it is undoubtedly an exceptional research tool that enables visualisation of the retina at a cellular level.

Plexus-specific retinal vascular anatomy and pathologies as seen by projection-resolved optical coherence tomographic angiography

Optical coherence tomographic angiography (OCTA) is a novel technology capable of imaging retinal vasculature three-dimensionally at capillary scale without the need to inject any extrinsic dye contrast. However, projection artifacts cause superficial retinal vascular patterns to be duplicated in deeper layers, thus interfering with the clean visualization of some retinal plexuses and vascular pathologies. Projection-resolved OCTA (PR-OCTA) uses post-processing algorithms to reduce projection artifacts. With PR-OCTA, it is now possible to resolve up to 4 distinct retinal vascular plexuses in the living human eye. The technology also allows us to detect and distinguish between various retinal and optic nerve diseases. For example, optic nerve diseases such as glaucoma primarily reduces the capillary density in the superficial vascular complex, which comprises the nerve fiber layer plexus and the ganglion cell layer plexus. Outer retinal diseases such as retinitis pigmentosa primarily reduce the capillary density in the deep vascular complex, which comprises the intermediate capillary plexus and the deep capillary plexus. Retinal vascular diseases such as diabetic retinopathy and vein occlusion affect all plexuses, but with different patterns of capillary loss and vascular malformations. PR-OCTA is also useful in distinguishing various types of choroidal neovascularization and monitoring their response to anti-angiogenic medications. In retinal angiomatous proliferation and macular telangiectasia type 2, PR-OCTA can trace the pathologic vascular extension into deeper layers as the disease progress through stages. Plexus-specific visualization and measurement of retinal vascular changes are improving our ability to diagnose, stage, monitor, and assess treatment response in a wide variety of optic nerve and retinal diseases. These applications will be further enhanced with the continuing improvement of the speed and resolution of the OCT platforms, as well as the development of software algorithms to reduce artifacts, improve image quality, and make quantitative measurements.

Real-time retinal layer segmentation of OCT volumes with GPU accelerated inferencing using a compressed, low-latency neural network

Segmentation of retinal layers in optical coherence tomography (OCT) is an essential step in OCT image analysis for screening, diagnosis, and assessment of retinal disease progression. Real-time segmentation together with high-speed OCT volume acquisition allows rendering of en face OCT of arbitrary retinal layers, which can be used to increase the yield rate of high-quality scans, provide real-time feedback during image-guided surgeries, and compensate aberrations in adaptive optics (AO) OCT without using wavefront sensors. We demonstrate here unprecedented real-time OCT segmentation of eight retinal layer boundaries achieved by 3 levels of optimization: 1) a modified, low complexity, neural network structure, 2) an innovative scheme of neural network compression with TensorRT, and 3) specialized GPU hardware to accelerate computation. Inferencing with the compressed network U-NetRT took 3.5 ms, improving by 21 times the speed of conventional U-Net inference without reducing the accuracy. The latency of the entire pipeline from data acquisition to inferencing was only 41 ms, enabled by parallelized batch processing. The system and method allow real-time updating of en face OCT and OCTA visualizations of arbitrary retinal layers and plexuses in continuous mode scanning. To the best our knowledge, our work is the first demonstration of an ophthalmic imager with embedded artificial intelligence (AI) providing real-time feedback.

Sensorless adaptive-optics optical coherence tomographic angiography

Optical coherence tomographic angiography (OCTA) can image the retinal blood flow but visualization of the capillary caliber is limited by the low lateral resolution. Adaptive optics (AO) can be used to compensate ocular aberrations when using high numerical aperture (NA), and thus improve image resolution. However, previously reported AO-OCTA instruments were large and complex, and have a small sub-millimeter field of view (FOV) that hinders the extraction of biomarkers with clinical relevance. In this manuscript, we developed a sensorless AO-OCTA prototype with an intermediate numerical aperture to produce depth-resolved angiograms with high resolution and signal-to-noise ratio over a 2 × 2 mm FOV, with a focal spot diameter of 6 µm, which is about 3 times finer than typical commercial OCT systems. We believe these parameters may represent a better tradeoff between resolution and FOV compared to large-NA AO systems, since the spot size matches better that of capillaries. The prototype corrects defocus, astigmatism, and coma using a figure of merit based on the mean reflectance projection of a slab defined with real-time segmentation of retinal layers. AO correction with the ability to optimize focusing in arbitrary retinal depths - particularly the plexuses in the inner retina - could be achieved in 1.35 seconds. The AO-OCTA images showed greater flow signal, signal-to-noise ratio, and finer capillary caliber compared to commercial OCTA. Projection artifacts were also reduced in the intermediate and deep capillary plexuses. The instrument reported here improves OCTA image quality without excessive sacrifice in FOV and device complexity, and thus may have potential for clinical translation.