Electrical receptive fields of retinal ganglion cells: Influence of presynaptic neurons

Neural activity shaping in visual prostheses with deep learning

Objective.The visual perception provided by retinal prostheses is limited by the overlapping current spread of adjacent electrodes. This reduces the spatial resolution attainable with unipolar stimulation. Conversely, simultaneous multipolar stimulation guided by the measured neural responses-neural activity shaping (NAS)-can attenuate excessive spread of excitation allowing for more precise control over the pattern of neural activation. However, defining effective multipolar stimulus patterns is a challenging task. Previous attempts focused on analytical solutions based on an assumed linear nonlinear model of retinal response; an analytical model inversion (AMI) approach. Here, we propose a model-free solution for NAS, using artificial neural networks (ANNs) that could be trained with data acquired from the implant.Approach.Our method consists of two ANNs trained sequentially. The measurement predictor network (MPN) is trained on data from the implant and is used to predict how the retina responds to multipolar stimulation. The stimulus generator network is trained on a large dataset of natural images and uses the trained MPN to determine efficient multipolar stimulus patterns by learning its inverse model. We validate our methodin silicousing a realistic model of retinal response to multipolar stimulation.Main results.We show that our ANN-based NAS approach produces sharper retinal activations than the conventional unipolar stimulation strategy. As a theoretical bench-mark of optimal NAS results, we implemented AMI stimulation by inverting the model used to simulate the retina. Our ANN strategy produced equivalent results to AMI, while not being restricted to any specific type of retina model and being three orders of magnitude more computationally efficient.Significance.Our novel protocol provides a method for efficient and personalized retinal stimulation, which may improve the visual experience and quality of life of retinal prosthesis users.

Electrical Input Filters of Ganglion Cells in Wild Type and Degenerating rd10 Mouse Retina as a Template for Selective Electrical Stimulation

Bionic vision systems are currently limited by indiscriminate activation of all retinal ganglion cells (RGCs)- despite the dozens of known RGC types which each encode a different visual message. Here, we use spike-triggered averaging to explore how electrical responsiveness varies across RGC types toward the goal of using this variation to create type-selective electrical stimuli. A battery of visual stimuli and a randomly distributed sequence of electrical pulses were delivered to healthy and degenerating (4-week-old rd10) mouse retinas. Ganglion cell spike trains were recorded during stimulation using a 60-channel microelectrode array. Hierarchical clustering divided the recorded RGC populations according to their visual and electrical response patterns. Novel electrical stimuli were presented to assess type-specific selectivity. In healthy retinas, responses fell into 35 visual patterns and 14 electrical patterns. In degenerating retinas, responses fell into 12 visual and 23 electrical patterns. Few correspondences between electrical and visual response patterns were found except for the known correspondence of ON visual type with upward deflecting electrical type and OFF cells with downward electrical profiles. Further refinement of the approach presented here may yet yield the elusive nuances necessary for type-selective stimulation. This study greatly deepens our understanding of electrical input filters in the context of detailed visual response characterization and includes the most complete examination yet of degenerating electrical input filters.

Quantifying visual acuity for pre-clinical testing of visual prostheses

Objective.Visual prostheses currently restore only limited vision. More research and pre-clinical work are required to improve the devices and stimulation strategies that are used to induce neural activity that results in visual perception. Evaluation of candidate strategies and devices requires an objective way to convert measured and modelled patterns of neural activity into a quantitative measure of visual acuity.Approach.This study presents an approach that compares evoked patterns of neural activation with target and reference patterns. A d-prime measure of discriminability determines whether the evoked neural activation pattern is sufficient to discriminate between the target and reference patterns and thus provides a quantified level of visual perception in the clinical Snellen and MAR scales. The magnitude of the resulting value was demonstrated using scaled standardized 'C' and 'E' optotypes.Main results.The approach was used to assess the visual acuity provided by two alternative stimulation strategies applied to simulated retinal implants with different electrode pitch configurations and differently sized spreads of neural activity. It was found that when there is substantial overlap in neural activity generated by different electrodes, an estimate of acuity based only upon electrode pitch is incorrect; our proposed method gives an accurate result in both circumstances.Significance.Quantification of visual acuity using this approach in pre-clinical development will allow for more rapid and accurate prototyping of improved devices and neural stimulation strategies.

Preferential modulation of individual retinal ganglion cells by electrical stimulation

OBJECTIVE

Retinal prostheses have been able to recover partial vision in blind patients with retinal degeneration by electrically stimulating surviving cells in the retina, such as retinal ganglion cells (RGCs), but the restored vision is limited. This is partly due to non-preferential stimulation of all RGCs near a single stimulating electrode, which include cells that conflict in their response properties and their contribution to the vision process. Our study proposes a stimulation strategy to preferentially stimulate individual RGCs based on their temporal electrical receptive fields (tERFs).

APPROACH

We recorded the responses of RGCs using whole-cell current-clamp and demonstrated the stimulation strategy, first using intracellular stimulation, then via extracellular stimulation.

MAIN RESULTS

We successfully reconstructed the tERFs according to the RGC response to Gaussian white noise current stimulation. The characteristics of the tERFs were extracted and compared according to the morphological and light response types of the cells. By re-delivering stimulation trains that are composed of the tERFs obtained from different cells, we could target individual RGCs as the cells showed lower activation thresholds to their own tERFs.

SIGNIFICANCE

This proposed stimulation strategy implemented in the next generation of recording and stimulating retinal prostheses may improve the quality of artificial vision.

Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea

OBJECTIVE

Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities.

APPROACH

We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds.

MAIN RESULTS

Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations.

SIGNIFICANCE

This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.

Characterizing Retinal Ganglion Cell Responses to Electrical Stimulation Using Generalized Linear Models

The ability to preferentially stimulate different retinal pathways is an important area of research for improving visual prosthetics. Recent work has shown that different classes of retinal ganglion cells (RGCs) have distinct linear electrical input filters for low-amplitude white noise stimulation. The aim of this study is to provide a statistical framework for characterizing how RGCs respond to white-noise electrical stimulation. We used a nested family of Generalized Linear Models (GLMs) to partition neural responses into different components—progressively adding covariates to the GLM which captured non-stationarity in neural activity, a linear dependence on the stimulus, and any remaining non-linear interactions. We found that each of these components resulted in increased model performance, but that even the non-linear model left a substantial fraction of neural variability unexplained. The broad goal of this paper is to provide a much-needed theoretical framework to objectively quantify stimulus paradigms in terms of the types of neural responses that they elicit (linear vs. non-linear vs. stimulus-independent variability). In turn, this aids the prosthetic community in the search for optimal stimulus parameters that avoid indiscriminate retinal activation and adaptation caused by excessively large stimulus pulses, and avoid low fidelity responses (low signal-to-noise ratio) caused by excessively weak stimulus pulses.

Stimulation Strategies for Improving the Resolution of Retinal Prostheses

Electrical stimulation using implantable devices with arrays of stimulating electrodes is an emerging therapy for neurological diseases. The performance of these devices depends greatly on their ability to activate populations of neurons with high spatiotemporal resolution. To study electrical stimulation of populations of neurons, retina serves as a useful model because the neural network is arranged in a planar array that is easy to access. Moreover, retinal prostheses are under development to restore vision by replacing the function of damaged light sensitive photoreceptors, which makes retinal research directly relevant for curing blindness. Here we provide a progress review on stimulation strategies developed in recent years to improve the resolution of electrical stimulation in retinal prostheses. We focus on studies performed with explanted retinas, in which electrophysiological techniques are the most advanced. We summarize achievements in improving the spatial and temporal resolution of electrical stimulation of the retina and methods to selectively stimulate neurons with different visual functions. Future directions for retinal prostheses development are also discussed, which could provide insights for other types of neuromodulatory devices in which high-resolution electrical stimulation is required.

Probing and predicting ganglion cell responses to smooth electrical stimulation in healthy and blind mouse retina

Retinal implants are used to replace lost photoreceptors in blind patients suffering from retinopathies such as retinitis pigmentosa. Patients wearing implants regain some rudimentary visual function. However, it is severely limited compared to normal vision because non-physiological stimulation strategies fail to selectively activate different retinal pathways at sufficient spatial and temporal resolution. The development of improved stimulation strategies is rendered difficult by the large space of potential stimuli. Here we systematically explore a subspace of potential stimuli by electrically stimulating healthy and blind mouse retina in epiretinal configuration using smooth Gaussian white noise delivered by a high-density CMOS-based microelectrode array. We identify linear filters of retinal ganglion cells (RGCs) by fitting a linear-nonlinear-Poisson (LNP) model. Our stimulus evokes spatially and temporally confined spiking responses in RGC which are accurately predicted by the LNP model. Furthermore, we find diverse shapes of linear filters in the linear stage of the model, suggesting diverse preferred electrical stimuli of RGCs. The linear filter base identified by our approach could provide a starting point of a model-guided search for improved stimuli for retinal prosthetics.

New Features of Receptive Fields in Mouse Retina through Spike-triggered Covariance

Retinal ganglion cells (RGCs) encode various spatiotemporal features of visual information into spiking patterns. The receptive field (RF) of each RGC is usually calculated by spike-triggered average (STA), which is fast and easy to understand, but limited to simple and unimodal RFs. As an alternative, spike-triggered covariance (STC) has been proposed to characterize more complex patterns in RFs. This study compares STA and STC for the characterization of RFs and demonstrates that STC has an advantage over STA for identifying novel spatiotemporal features of RFs in mouse RGCs. We first classified mouse RGCs into ON, OFF, and ON/OFF cells according to their response to full-field light stimulus, and then investigated the spatiotemporal patterns of RFs with random checkerboard stimulation, using both STA and STC analysis. We propose five sub-types (T1–T5) in the STC of mouse RGCs together with their physiological implications. In particular, the relatively slow biphasic pattern (T1) could be related to excitatory inputs from bipolar cells. The transient biphasic pattern (T2) allows one to characterize complex patterns in RFs of ON/OFF cells. The other patterns (T3–T5), which are contrasting, alternating, and monophasic patterns, could be related to inhibitory inputs from amacrine cells. Thus, combining STA and STC and considering the proposed sub-types unveil novel characteristics of RFs in the mouse retina and offer a more holistic understanding of the neural coding mechanisms of mouse RGCs.

Cortical Interactions between Prosthetic and Natural Vision

Outer retinal degenerative diseases, such as retinitis pigmentosa (RP) and age-related macular degeneration (AMD), are among the leading causes of incurable blindness in the Western world [1]. Retinal prostheses have been shown to restore some useful vision by electrically stimulating the remaining retinal neurons [2]. In contrast to inherited retinal degenerative diseases (e.g., RP), typically leading to a complete loss of the visual field, in AMD patients the disease is localized to the macula, leaving the peripheral vision intact. Implanting a retinal prosthesis in the central macula in AMD patients [3, 4] leads to an intriguing situation where the patient's central retina is stimulated electrically, whereas the peripheral healthy retina responds to natural light stimulation. An important question is whether the visual cortex responds to these two concurrent stimuli similarly to the interaction between two adjacent natural light stimuli projected onto healthy retina. Here, we investigated the cortical interactions between prosthetic and natural vision based on visually evoked potentials (VEPs) recorded in rats implanted with photovoltaic subretinal implants. Using this model, where prosthetic and natural vision information are combined in the visual cortex, we observed striking similarities in the interactions of natural and prosthetic vision, including similar effect of background illumination, linear summation of non-patterned stimuli, and lateral inhibition with spatial patterns [5], which increased with target contrast. These results support the idea of combined prosthetic and natural vision in restoration of sight for AMD patients.