A Patient-Specific Computational Framework for the Argus II Implant

Optimizing Phosphene Focality with Multi-Electrode Stimuli using Design of Experiments

Despite advancements in the field of artificial vision, retinal prostheses continue to face substantial limitations. The future success of these devices depends on their ability to activate target neurons with improved spatiotemporal resolution, while avoiding off-target stimulation. Manually programming these devices in clinic using a trial-and-error process will place an excessive burden on both clinicians and patients. We applied the Taguchi method for design of experiments to patient-specific field-cable models of retinal prostheses to identify multi-electrode stimuli that focalize retinal activation, thus improving spatial resolution. We improved focality in all eight tested regions with a unique return electrode configuration, supporting the need for individualized current focusing strategies. This work lays the foundation for personalized, automated device programming, which will be essential for future retinal prostheses with thousands of electrodes.

Retinal prosthesis edge detection (RPED) algorithm: Low-power and improved visual acuity strategy for artificial retinal implants

This paper proposes a retinal prosthesis edge detection (RPED) algorithm that can achieve high visual acuity and low power. Retinal prostheses have been used to stimulate retinal tissue by injecting charge via an electrode array, thereby artificially restoring the vision of visually impaired patients. The retinal prosthetic chip, which generates biphasic current pulses, should be located in the foveal area measuring 5 mm × 5 mm. When a high-density stimulation pixel array is realized in a limited area, the distance between the stimulation pixels narrows, resulting in current dispersion and high-power dissipation related to heat generation. Various edge detection methods have been proposed over the past decade to reduce these deleterious effects and achieve high-resolution pixels. However, conventional methods have the disadvantages of high-power consumption and long data processing times because many pixels are activated to detect edges. In this study, we propose a novel RPED algorithm that has a higher visual acuity and less power consumption despite using fewer active pixels than existing techniques. To verify the performance of the devised RPED algorithm, the peak signal-to-noise ratio and structural similarity index map, which evaluates the quantitative numerical value of the image are employed and compared with the Sobel, Canny, and past edge detection algorithms in MATLAB. Finally, we demonstrate the effectiveness of the proposed RPED algorithm using a 1600-pixel retinal stimulation chip fabricated using a 0.35 μm complementary metal-oxide-semiconductor process.

Explainable machine learning predictions of perceptual sensitivity for retinal prostheses

Objective.Retinal prostheses evoke visual precepts by electrically stimulating functioning cells in the retina. Despite high variance in perceptual thresholds across subjects, among electrodes within a subject, and over time, retinal prosthesis users must undergo 'system fitting', a process performed to calibrate stimulation parameters according to the subject's perceptual thresholds. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking.Approach.To address these challenges, we (1) fitted machine learning models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and (2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important.Main results.Our models accounted for up to 76% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and area under the ROC curve scores of up to 0.732 and 0.911, respectively. Our models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance.Significance.Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which has the potential to transform clinical practice in predicting visual outcomes.

Patient-specific computational models of retinal prostheses

Retinal prostheses stimulate inner retinal neurons to create visual perception for blind patients. Implanted arrays have many small electrodes. Not all electrodes induce perception at the same stimulus amplitude, requiring clinicians to manually establish a visual perception threshold for each one. Phosphenes created by single-electrode stimuli can also vary in shape, size, and brightness. Computational models provide a tool to predict inter-electrode variability and automate device programming. In this study, we created statistical and patient-specific field-cable models to investigate inter-electrode variability across seven epiretinal prosthesis users. Our statistical analysis revealed that retinal thickness beneath the electrode correlated with perceptual threshold, with a significant fixed effect across participants. Electrode-retina distance and electrode impedance also correlated with perceptual threshold for some participants, but these effects varied by individual. We developed a novel method to construct patient-specific field-cable models from optical coherence tomography images. Predictions with these models significantly correlated with perceptual threshold for 80% of participants. Additionally, we demonstrated that patient-specific field-cable models could predict retinal activity and phosphene size. These computational models could be beneficial for determining optimal stimulation settings in silico, circumventing the trial-and-error testing of a large parameter space in clinic.

Patient-specific computational models of retinal prostheses

Retinal prostheses stimulate inner retinal neurons to create visual perception for blind patients. Implanted arrays have many small electrodes, which act as pixels. Not all electrodes induce perception at the same stimulus amplitude, requiring clinicians to manually establish a visual perception threshold for each one. Phosphenes created by single-electrode stimuli can also vary in shape, size, and brightness. Computational models provide a tool to predict inter-electrode variability and automate device programming. In this study, we created statistical and patient-specific field-cable models to investigate inter-electrode variability across seven epiretinal prosthesis users. Our statistical analysis revealed that retinal thickness beneath the electrode correlated with perceptual threshold, with a significant fixed effect across participants. Electrode-retina distance and electrode impedance also correlated with perceptual threshold for some participants, but these effects varied by individual. We developed a novel method to construct patient-specific field-cable models from optical coherence tomography images. Predictions with these models significantly correlated with perceptual threshold for 80% of participants. Additionally, we demonstrated that patient-specific field-cable models could predict retinal activity and phosphene size. These computational models could be beneficial for determining optimal stimulation settings in silico, circumventing the trial-and-error testing of a large parameter space in clinic.

Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells

High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical sensitivity of a large population of target neurons, to precisely control their activity, can be difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale multielectrode stimulation and recording from retinal ganglion cells (RGCs) of male and female macaque monkeys ex vivo Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds across cell types, retinas, and eccentricities, with systematic and distinct trends for somas and axons. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by their recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These trends were quantitatively reproduced with biophysical simulations. Results from human RGCs were broadly similar. The inference of stimulation sensitivity from recorded electrical features was tested in a data-driven simulation of visual reconstruction, revealing that the approach could significantly improve the function of future high-fidelity retinal implants.SIGNIFICANCE STATEMENT This study demonstrates that individual in situ primate retinal ganglion cells of different types respond to artificially generated, external electrical fields in a systematic manner, in accordance with theoretical predictions, that allows for prediction of electrical stimulus sensitivity from recorded spontaneous activity. It also provides evidence that such an approach could be immensely helpful in the calibration of clinical retinal implants.

Modeling extracellular stimulation of retinal ganglion cells: theoretical and practical aspects

Objective.Retinal prostheses use electric current to activate inner retinal neurons, providing artificial vision for blind people. Epiretinal stimulation primarily targets retinal ganglion cells (RGCs), which can be modeled with cable equations. Computational models provide a tool to investigate the mechanisms of retinal activation, and improve stimulation paradigms. However, documentation of RGC model structure and parameters is limited, and model implementation can influence model predictions.Approach.We created a functional guide for building a mammalian RGC multi-compartment cable model and applying extracellular stimuli. Next, we investigated how the neuron's three-dimensional shape will influence model predictions. Finally, we tested several strategies to maximize computational efficiency.Main results.We conducted sensitivity analyses to examine how dendrite representation, axon trajectory, and axon diameter influence membrane dynamics and corresponding activation thresholds. We optimized the spatial and temporal discretization of our multi-compartment cable model. We also implemented several simplified threshold prediction theories based on activating function, but these did not match the prediction accuracy achieved by the cable equations.Significance.Through this work, we provide practical guidance for modeling the extracellular stimulation of RGCs to produce reliable and meaningful predictions. Robust computational models lay the groundwork for improving the performance of retinal prostheses.

Explainable Machine Learning Predictions of Perceptual Sensitivity for Retinal Prostheses

To provide appropriate levels of stimulation, retinal prostheses must be calibrated to an individual's perceptual thresholds ('system fitting'), despite thresholds varying drastically across subjects, across electrodes within a subject, and over time. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking. To address these challenges, we 1) fitted machine learning (ML) models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and 2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important. Our models accounted for up to 77% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and AUC scores of up to 0.740 and 0.913, respectively. Deactivation and threshold models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance. Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which may transform clinical practice in predicting visual outcomes.

Improving the spatial resolution of artificial vision using midget retinal ganglion cell populations modelled at the human fovea

OBJECTIVE

Retinal prostheses seek to create artificial vision by stimulating surviving retinal neurons of patients with profound vision impairment. Notwithstanding tremendous research efforts, the performance of all implants tested to date has remained rudimentary, incapable of overcoming the threshold for legal blindness. To maximize the perceptual efficacy of retinal prostheses, a device must be capable of controlling retinal neurons with greater spatiotemporal precision. Most studies of retinal stimulation were derived from either non-primate species or the peripheral primate retina. We investigated if artificial stimulation could leverage the high spatial resolution afforded by the neural substrates at the primate fovea and surrounding regions to achieve improved percept qualities.

APPROACH

We began by developing a new computational model capable of generating anatomically accurate retinal ganglion cell (RGC) populations within the human central retina. Next, multiple RGC populations across the central retina were stimulated in-silico to compare clinical and recently proposed neurostimulation configurations based on their ability to improve perceptual efficacy and reduce activation thresholds.

MAIN RESULTS

Our model uniquely upholds eccentricity-dependent characteristics such as RGC density and dendritic field diameter, whilst incorporating anatomically accurate features such as axon projection and three-dimensional RGC layering, features often forgone in favor of reduced computational complexity. Following epiretinal stimulation, the RGCs in our model produced response patterns in shapes akin to the complex percepts reported in clinical trials. Our results also demonstrated that even within the neuron-dense central retina, epiretinal stimulation using a multi-return hexapolar electrode arrangement could reliably achieve spatially focused RGC activation and could achieve single-cell excitation in 74% of all tested locations.

SIGNIFICANCE

This study establishes an anatomically accurate three-dimensional model of the human central retina and demonstrates the potential for an epiretinal hexapolar configuration to achieve consistent, spatially confined retinal responses, even within the neuron-dense foveal region. Our results promote the prospect and optimization of higher spatial resolution in future epiretinal implants.

An in-silico analysis of electrically-evoked responses of midget and parasol retinal ganglion cells in different retinal regions

BACKGROUND

Visual outcomes provided by present retinal prostheses that primarily target retinal ganglion cells (RGCs) through epiretinal stimulation remain rudimentary, partly due to the limited knowledge of retinal responses under electrical stimulation. Better understanding of how different retinal regions can be quantitatively controlled with high spatial accuracy, will be beneficial to the design of micro-electrode arrays (MEAs) and stimulation strategies for next-generation wide-view, high-resolution epiretinal implants.

METHODS

A computational model was developed to assess neural activity at different eccentricities (2 mm and 5 mm) within the human retina. This model included midget and parasol RGCs with anatomically accurate cell distribution and cell-specific morphological information. We then performed in silico investigations of region-specific RGC responses to epiretinal electrical stimulation using varied electrode sizes (5 µm - 210 µm diameter), emulating both commercialized retinal implants and recently-developed prototype devices.

RESULTS

Our model of epiretinal stimulation predicted RGC population excitation analogous to the complex percepts reported in human subjects. Following this, our simulations suggest that midget and parasol RGCs have characteristic regional differences in excitation under preferred electrode sizes. Relatively central (2 mm) regions demonstrated higher number of excited RGCs but lower overall activated receptive field (RF) areas under the same stimulus amplitudes (two-way ANOVA, p < 0.05). Furthermore, the activated RGC numbers per unit active RF area (number-RF ratio) were significantly higher in central than in peripheral regions, and higher in the midget than in the parasol population under all tested electrode sizes (two-way ANOVA, p < 0.05). Our simulations also suggested that smaller electrodes exhibit a higher range of controllable stimulation parameters to achieve pre-defined performance of RGC excitation. ..

Dorsal Root Ganglion Stimulation for Chronic Pain: Hypothesized Mechanisms of Action

Dorsal root ganglion stimulation (DRGS) is a neuromodulation therapy for chronic pain that is refractory to conventional medical management. Currently, the mechanisms of action of DRGS-induced pain relief are unknown, precluding both our understanding of why DRGS fails to provide pain relief to some patients and the design of neurostimulation technologies that directly target these mechanisms to maximize pain relief in all patients. Due to the heterogeneity of sensory neurons in the dorsal root ganglion (DRG), the analgesic mechanisms could be attributed to the modulation of one or many cell types within the DRG and the numerous brain regions that process sensory information. Here, we summarize the leading hypotheses of the mechanisms of DRGS-induced analgesia, and propose areas of future study that will be vital to improving the clinical implementation of DRGS. PERSPECTIVE: This article synthesizes the evidence supporting the current hypotheses of the mechanisms of action of DRGS for chronic pain and suggests avenues for future interdisciplinary research which will be critical to fully elucidate the analgesic mechanisms of the therapy.

Real-Time Optimization of Retinal Ganglion Cell Spatial Activity in Response to Epiretinal Stimulation

Retinal prostheses aim to improve visual perception in patients blinded by photoreceptor degeneration. However, shape and letter perception with these devices is currently limited due to low spatial resolution. Previous research has shown the retinal ganglion cell (RGC) spatial activity and phosphene shapes can vary due to the complexity of retina structure and electrode-retina interactions. Visual percepts elicited by single electrodes differ in size and shapes for different electrodes within the same subject, resulting in interference between phosphenes and an unclear image. Prior work has shown that better patient outcomes correlate with spatially separate phosphenes. In this study we use calcium imaging, in vitro retina, neural networks (NN), and an optimization algorithm to demonstrate a method to iteratively search for optimal stimulation parameters that create focal RGC activation. Our findings indicate that we can converge to stimulation parameters that result in focal RGC activation by sampling less than 1/3 of the parameter space. A similar process implemented clinically can reduce time required for optimizing implant operation and enable personalized fitting of retinal prostheses.

Morphological Factors that Underlie Neural Sensitivity to Stimulation in the Retina

Retinal prostheses are a promising therapeutic intervention for patients afflicted by outer retinal degenerative diseases like retinitis pigmentosa and age-related macular degeneration. While significant advances in the development of retinal implants have been made, the quality of vision elicited by these devices remains largely sub-optimal. The variability in the responses produced by retinal devices is most likely due to the differences between the natural cell type-specific signaling that occur in the healthy retina vs. the non-specific activation of multiple cell types arising from artificial stimulation. In order to replicate these natural signaling patterns, stimulation strategies must be capable of preferentially activating specific RGC types. To design more selective stimulation strategies, a better understanding of the morphological factors that underlie the sensitivity to prosthetic stimulation must be developed. This review will focus on the role that different anatomical components play in driving the direct activation of RGCs by extracellular stimulation. Briefly, it will (1) characterize the variability in morphological properties of α-RGCs, (2) detail the influence of morphology on the direct activation of RGCs by electric stimulation, and (3) describe some of the potential biophysical mechanisms that could explain differences in activation thresholds and electrically evoked responses between RGC types.

A Computational Model of Phosphene Appearance for Epiretinal Prostheses

Retinal neuroprostheses are the only FDA-approved treatment option for blinding degenerative diseases. A major outstanding challenge is to develop a computational model that can accurately predict the elicited visual percepts (phosphenes) across a wide range of electrical stimuli. Here we present a phenomenological model that predicts phosphene appearance as a function of stimulus amplitude, frequency, and pulse duration. The model uses a simulated map of nerve fiber bundles in the retina to produce phosphenes with accurate brightness, size, orientation, and elongation. We validate the model on psychophysical data from two independent studies, showing that it generalizes well to new data, even with different stimuli and on different electrodes. Whereas previous models focused on either spatial or temporal aspects of the elicited phosphenes in isolation, we describe a more comprehensive approach that is able to account for many reported visual effects. The model is designed to be flexible and extensible, and can be fit to data from a specific user. Overall this work is an important first step towards predicting visual outcomes in retinal prosthesis users across a wide range of stimuli.