The effect of waveform asymmetry on perception with epiretinal prostheses

Learning to see via epiretinal implant stimulationin silicowith model-based deep reinforcement learning

OBJECTIVE

Diseases such as age-related macular degeneration and retinitis pigmentosa cause the degradation of the photoreceptor layer. One approach to restore vision is to electrically stimulate the surviving retinal ganglion cells with a microelectrode array such as epiretinal implants. Epiretinal implants are known to generate visible anisotropic shapes elongated along the axon fascicles of neighboring retinal ganglion cells. Recent work has demonstrated that to obtain isotropic pixel-like shapes, it is possible to map axon fascicles and avoid stimulating them by inactivating electrodes or lowering stimulation current levels. Avoiding axon fascicule stimulation aims to remove brushstroke-like shapes in favor of a more reduced set of pixel-like shapes.

APPROACH

In this study, we propose the use of isotropic and anisotropic shapes to render intelligible images on the retina of a virtual patient in a reinforcement learning environment named rlretina. The environment formalizes the task as using brushstrokes in a stroke-based rendering task.

MAIN RESULTS

We train a deep reinforcement learning agent that learns to assemble isotropic and anisotropic shapes to form an image. We investigate which error-based or perception-based metrics are adequate to reward the agent. The agent is trained in a model-based data generation fashion using the psychophysically validated axon map model to render images as perceived by different virtual patients. We show that the agent can generate more intelligible images compared to the naive method in different virtual patients.

SIGNIFICANCE

This work shares a new way to address epiretinal stimulation that constitutes a first step towards improving visual acuity in artificially-restored vision using anisotropic phosphenes.

Retinal ganglion cell desensitization is mitigated by varying parameter constant excitation pulse trains

Retinal prostheses partially restore vision in patients blinded by retinitis pigmentosa (RP) and age-related macular degeneration (AMD). One issue that limits the effectiveness of retinal stimulation is the desensitization of the retina response to repeated pulses. Rapid fading of percepts is reported in clinical studies. We studied the retinal output evoked by fixed pulse trains vs. pulse trains that have variable parameters pulse-to-pulse. We used the current clamp to record RGC spiking in the isolated mouse retina. Trains of biphasic current pulses at different frequencies and amplitudes were applied. The main results we report are: (1) RGC desensitization was induced by increasing stimulus frequency, but was unrelated to stimulus amplitude. Desensitization persisted when the 20 Hz stimulation pulses were applied to the retinal ganglion cells at 65 μA, 85 μA, and 105 μA. Subsequent pulses in the train evoked fewer spikes. There was no obvious desensitization when 2 Hz stimulation pulse trains were applied. (2) Blocking inhibitory GABA_A receptor increased spontaneous activity but did not reduce desensitization. (3) Pulse trains with constant charge or excitation (based on strength-duration curves) but varying pulse width, amplitude, and shape increased the number of evoked spikes/pulse throughout the pulse train. This suggests that retinal desensitization can be partially overcome by introducing variability into each pulse.

Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea

OBJECTIVE

Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities.

APPROACH

We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds.

MAIN RESULTS

Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations.

SIGNIFICANCE

This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.

An Anodic Phase Can Facilitate Rather Than Weaken a Cathodic Phase to Activate Neurons in Biphasic-Pulse Axonal Stimulations

Electrical pulses have been promisingly utilized in neural stimulations to treat various diseases. Usually, charge-balanced biphasic pulses are applied in the clinic to eliminate the possible side effects caused by charge accumulations. Because of its reversal action to the preceding cathodic phase, the subsequent anodic phase has been commonly considered to lower the activation efficiency of biphasic pulses. However, an anodic pulse itself can also activate axons with its “virtual cathode” effect. Therefore, we hypothesized that the anodic phase of a biphasic pulse could facilitate neuronal activation in some circumstances. To verify the hypothesis, we compared the activation efficiencies of cathodic pulse, biphasic pulse, and anodic pulse applied in both monopolar and bipolar modes in the axonal stimulation of alveus in rat hippocampal CA1 region in vivo. The antidromically evoked population spikes (APS) were recorded and used to evaluate the amount of integrated firing of pyramidal neurons induced by pulse stimulations. We also used a computational model to investigate the pulse effects on axons at various distances from the stimulation electrode. The experimental results showed that, with a small pulse intensity, a cathodic pulse recruited more neurons to fire than a biphasic pulse. However, the situation was reversed with an increased pulse intensity. In addition, setting an inter-phase gap of 100 μs was able to increase the activation efficiency of a biphasic pulse to exceed a cathodic pulse even with a relatively small pulse intensity. Furthermore, the latency of APS evoked by a cathodic pulse was always longer than that of APS evoked by a biphasic pulse, indicating different initial sites of the neuronal firing evoked by the different types of pulses. The computational results of axon modeling showed that the subsequent anodic phase was able to relieve the hyperpolarization block in the flanking regions generated by the preceding cathodic phase, thereby increasing rather than decreasing the activation efficiency of a biphasic pulse with a relatively great intensity. These results of both rat experiments and computational modeling firstly reveal a facilitation rather than an attenuation effect of the anodic phase on biphasic-pulse stimulations, which provides important information for designing electrical stimulations for neural therapies.

Intracortical microstimulation pulse waveform and frequency recruits distinct spatiotemporal patterns of cortical neuron and neuropil activation

OBJECTIVE

Neural prosthetics often use intracortical microstimulation (ICMS) for sensory restoration. To restore natural and functional feedback, we must first understand how stimulation parameters influence the recruitment of neural populations. ICMS waveform asymmetry modulates the spatial activation of neurons around an electrode at 10 Hz; however, it is unclear how asymmetry may differentially modulate population activity at frequencies typically employed in the clinic (e.g. 100 Hz). We hypothesized that stimulation waveform asymmetry would differentially modulate preferential activation of certain neural populations, and the differential population activity would be frequency-dependent.

APPROACH

We quantified how asymmetric stimulation waveforms delivered at 10 Hz or 100 Hz for 30s modulated spatiotemporal activity of cortical layer II/III pyramidal neurons using in vivo two-photon and mesoscale calcium imaging in anesthetized mice. Asymmetry is defined in terms of the ratio of the duration of the leading phase to the duration of the return phase of charge-balanced cathodal- and anodal-first waveforms (i.e. longer leading phase relative to return has larger asymmetry).

MAIN RESULTS

Neurons within 40-60µm of the electrode display stable stimulation-induced activity indicative of direct activation, which was independent of waveform asymmetry. The stability of 72% of activated neurons and the preferential activation of 20-90 % of neurons depended on waveform asymmetry. Additionally, this asymmetry-dependent activation of different neural populations was associated with differential progression of population activity. Specifically, neural activity tended to increase over time during 10 hz stimulation for some waveforms, whereas activity remained at the same level throughout stimulation for other waveforms. During 100 Hz stimulation, neural activity decreased over time for all waveforms, but decreased more for the waveforms that resulted in increasing neural activity during 10 Hz stimulation.

SIGNIFICANCE

These data demonstrate that at frequencies commonly used for sensory restoration, stimulation waveform alters the pattern of activation of different but overlapping populations of excitatory neurons. The impact of these waveform specific responses on the activation of different subtypes of neurons as well as sensory perception merits further investigation.

An in-silico analysis of electrically-evoked responses of midget and parasol retinal ganglion cells in different retinal regions

BACKGROUND

Visual outcomes provided by present retinal prostheses that primarily target retinal ganglion cells (RGCs) through epiretinal stimulation remain rudimentary, partly due to the limited knowledge of retinal responses under electrical stimulation. Better understanding of how different retinal regions can be quantitatively controlled with high spatial accuracy, will be beneficial to the design of micro-electrode arrays (MEAs) and stimulation strategies for next-generation wide-view, high-resolution epiretinal implants.

METHODS

A computational model was developed to assess neural activity at different eccentricities (2 mm and 5 mm) within the human retina. This model included midget and parasol RGCs with anatomically accurate cell distribution and cell-specific morphological information. We then performed in silico investigations of region-specific RGC responses to epiretinal electrical stimulation using varied electrode sizes (5 µm - 210 µm diameter), emulating both commercialized retinal implants and recently-developed prototype devices.

RESULTS

Our model of epiretinal stimulation predicted RGC population excitation analogous to the complex percepts reported in human subjects. Following this, our simulations suggest that midget and parasol RGCs have characteristic regional differences in excitation under preferred electrode sizes. Relatively central (2 mm) regions demonstrated higher number of excited RGCs but lower overall activated receptive field (RF) areas under the same stimulus amplitudes (two-way ANOVA, p < 0.05). Furthermore, the activated RGC numbers per unit active RF area (number-RF ratio) were significantly higher in central than in peripheral regions, and higher in the midget than in the parasol population under all tested electrode sizes (two-way ANOVA, p < 0.05). Our simulations also suggested that smaller electrodes exhibit a higher range of controllable stimulation parameters to achieve pre-defined performance of RGC excitation. ..

Real-Time Optimization of Retinal Ganglion Cell Spatial Activity in Response to Epiretinal Stimulation

Retinal prostheses aim to improve visual perception in patients blinded by photoreceptor degeneration. However, shape and letter perception with these devices is currently limited due to low spatial resolution. Previous research has shown the retinal ganglion cell (RGC) spatial activity and phosphene shapes can vary due to the complexity of retina structure and electrode-retina interactions. Visual percepts elicited by single electrodes differ in size and shapes for different electrodes within the same subject, resulting in interference between phosphenes and an unclear image. Prior work has shown that better patient outcomes correlate with spatially separate phosphenes. In this study we use calcium imaging, in vitro retina, neural networks (NN), and an optimization algorithm to demonstrate a method to iteratively search for optimal stimulation parameters that create focal RGC activation. Our findings indicate that we can converge to stimulation parameters that result in focal RGC activation by sampling less than 1/3 of the parameter space. A similar process implemented clinically can reduce time required for optimizing implant operation and enable personalized fitting of retinal prostheses.

Mechanisms underlying activation of retinal bipolar cells through targeted electrical stimulation: a computational study

Objective. Retinal implants have been developed to electrically stimulate healthy retinal neurons in the progressively degenerated retina. Several stimulation approaches have been proposed to improve the visual percept induced in patients with retinal prostheses. We introduce a computational model capable of simulating the effects of electrical stimulation on retinal neurons. Leveraging this computational platform, we delve into the underlying mechanisms influencing the sensitivity of retinal neurons' response to various stimulus waveforms.Approach. We implemented a model of spiking bipolar cells (BCs) in the magnocellular pathway of the primate retina, diffuse BC subtypes (DB4), and utilized our multiscale admittance method (AM)-NEURON computational platform to characterize the response of BCs to epiretinal electrical stimulation with monophasic, symmetric, and asymmetric biphasic pulses.Main results. Our investigations yielded four notable results: (a) the latency of BCs increases as stimulation pulse duration lengthens; conversely, this latency decreases as the current amplitude increases. (b) Stimulation with a long anodic-first symmetric biphasic pulse (duration > 8 ms) results in a significant decrease in spiking threshold compared to stimulation with similar cathodic-first pulses (from 98.2 to 57.5µA). (c) The hyperpolarization-activated cyclic nucleotide-gated channel was a prominent contributor to the reduced threshold of BCs in response to long anodic-first stimulus pulses. (d) Finally, extending the study to asymmetric waveforms, our results predict a lower BCs threshold using asymmetric long anodic-first pulses compared to that of asymmetric short cathodic-first stimulation.Significance. This study predicts the effects of several stimulation parameters on spiking BCs response to electrical stimulation. Of importance, our findings shed light on mechanisms underlying the experimental observations from the literature, thus highlighting the capability of the methodology to predict and guide the development of electrical stimulation protocols to generate a desired biological response, thereby constituting an ideal testbed for the development of electroceutical devices.

A Computational Model of Phosphene Appearance for Epiretinal Prostheses

Retinal neuroprostheses are the only FDA-approved treatment option for blinding degenerative diseases. A major outstanding challenge is to develop a computational model that can accurately predict the elicited visual percepts (phosphenes) across a wide range of electrical stimuli. Here we present a phenomenological model that predicts phosphene appearance as a function of stimulus amplitude, frequency, and pulse duration. The model uses a simulated map of nerve fiber bundles in the retina to produce phosphenes with accurate brightness, size, orientation, and elongation. We validate the model on psychophysical data from two independent studies, showing that it generalizes well to new data, even with different stimuli and on different electrodes. Whereas previous models focused on either spatial or temporal aspects of the elicited phosphenes in isolation, we describe a more comprehensive approach that is able to account for many reported visual effects. The model is designed to be flexible and extensible, and can be fit to data from a specific user. Overall this work is an important first step towards predicting visual outcomes in retinal prosthesis users across a wide range of stimuli.