A Phosphenotron Device for Sensoric Spatial Resolution of Phosphenes within the Visual Field Using Non-Invasive Transcranial Alternating Current Stimulation

This study presents phosphenotron, a device for enhancing the sensory spatial resolution of phosphenes in the visual field (VF). The phosphenotron employs a non-invasive transcranial alternating current stimulation (NITACS) to modulate brain activity by applying weak electrical currents to the scalp or face. NITACS's unique application induces phosphenes, a phenomenon where light is perceived without external stimuli. Unlike previous invasive methods, NITACS offers a non-invasive approach to create these effects. The study focused on assessing the spatial resolution of NITACS-induced phosphenes, crucial for advancements in visual aid technology and neuroscience. Eight participants were subjected to NITACS using a novel electrode arrangement around the eye orbits. Results showed that NITACS could generate spatially defined phosphene patterns in the VF, varying among individuals but consistently appearing within their VF and remaining stable through multiple stimulations. The study established optimal parameters for vibrant phosphene induction without discomfort and identified electrode positions that altered phosphene locations within different VF regions. Receiver Operating characteristics analysis indicated a specificity of 70.7%, sensitivity of 73.9%, and a control trial accuracy of 98.4%. These findings suggest that NITACS is a promising, reliable method for non-invasive visual perception modulation through phosphene generation.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Robot-assisted implantation of a microelectrode array in the occipital lobe as a visual prosthesis: technical note

The prospect of direct interaction between the brain and computers has been investigated in recent decades, revealing several potential applications. One of these is sight restoration in profoundly blind people, which is based on the ability to elicit visual perceptions while directly stimulating the occipital cortex. Technological innovation has led to the development of microelectrodes implantable on the brain surface. The feasibility of implanting a microelectrode on the visual cortex has already been shown in animals, with promising results. Current research has focused on the implantation of microelectrodes into the occipital brain of blind volunteers. The technique raises several technical challenges. In this technical note, the authors suggest a safe and effective approach for robot-assisted implantation of microelectrodes in the occipital lobe for sight restoration.

Neural activity of retinal ganglion cells under continuous, dynamically-modulated high frequency electrical stimulation

Objective.Current retinal prosthetics are limited in their ability to precisely control firing patterns of functionally distinct retinal ganglion cell (RGC) types. The aim of this study was to characterise RGC responses to continuous, kilohertz-frequency-varying stimulation to assess its utility in controlling RGC activity.Approach.We usedin vitropatch-clamp experiments to assess electrically-evoked ON and OFF RGC responses to frequency-varying pulse train sequences. In each sequence, the stimulation amplitude was kept constant while the stimulation frequency (0.5-10 kHz) was changed every 40 ms, in either a linearly increasing, linearly decreasing or randomised manner. The stimulation amplitude across sequences was increased from 10 to 300µA.Main results.We found that continuous stimulation without rest periods caused complex and irreproducible stimulus-response relationships, primarily due to strong stimulus-induced response adaptation and influence of the preceding stimulus frequency on the response to a subsequent stimulus. In addition, ON and OFF populations showed different sensitivities to continuous, frequency-varying pulse trains, with OFF cells generally exhibiting more dependency on frequency changes within a sequence. Finally, the ability to maintain spiking behaviour to continuous stimulation in RGCs significantly reduced over longer stimulation durations irrespective of the frequency order.Significance.This study represents an important step in advancing and understanding the utility of continuous frequency modulation in controlling functionally distinct RGCs. Our results indicate that continuous, kHz-frequency-varying stimulation sequences provide very limited control of RGC firing patterns due to inter-dependency between adjacent frequencies and generally, different RGC types do not display different frequency preferences under such stimulation conditions. For future stimulation strategies using kHz frequencies, careful consideration must be given to design appropriate pauses in stimulation, stimulation frequency order and the length of continuous stimulation duration.

Flexible Polymer Electrodes for Stable Prosthetic Visual Perception in Mice

Brain interfaces that can stimulate neurons, cause minimal damage, and work for a long time will be central for future neuroprosthetics. Here, the long-term performance of highly flexible, thin polyimide shanks with several small (<15 µm) electrodes during electrical microstimulation of the visual cortex, is reported. The electrodes exhibit a remarkable stability when several billions of electrical pulses are applied in vitro. When the devices are implanted in the primary visual cortex (area V1) of mice and the animals are trained to detect electrical microstimulation, it is found that the perceptual thresholds are 2-20 microamperes (µA), which is far below the maximal currents that the electrodes can withstand. The long-term functionality of the devices in vivo is excellent, with stable performance for up to more than a year and little damage to the brain tissue. These results demonstrate the potential of thin floating electrodes for the long-term restoration of lost sensory functions.

Intraoperative Iridectomy in Femto-Laser Assisted Smaller-Incision New Generation Implantable Miniature Telescope

BACKGROUND

In this study, we aimed to report the short-term (6 months) effects on visual functionality and safety of femto-laser assisted smaller-incision new-generation implantable miniature telescope (SING-IMT™) implanting, particularly related to postsurgical intraocular pressure increase, in patients suffering from end-stage age-related macular degeneration (AMD) and cataract. This device, designed for monocular use, aims to minimise the impact of the central scotoma by projecting the images onto a larger area of the photoreceptors surrounding the macula.

METHODS

In this prospective multicentric observational case series study, 6 eyes of 6 patients who underwent SING-IMT™ implantations were enrolled. At baseline and 6 months follow-up, best corrected distance visual acuity (BCDV) and best corrected near visual acuity (BCNVA), intraocular pressure (IOP), anterior chamber depth, endothelial cells count were assessed. In addition, IOP was also measured at 7, 15, 30, 45 days, and at 3 months follow-up. Finally, the incidence of complications was evaluated.

RESULTS

At final follow-up, in the study eyes, mean BCDVA improved by +10.0 letters (6.25; 13.8) letters and mean BCNVA improved by -0.30 logMAR (-0.55; -0.20). At postoperative month 6, we reported a mean IOP decrease of 4.50 mmHg (-5.75; -0.25). Interestingly, 83.3% of patients had an increased IOP value in at least one of the first two postoperative follow-ups (7 days and 15 days). In patients in whom intraoperative mechanical iridotomy was not performed, it was necessary to perform a postoperative YAG laser iridotomy to improve IOP management. Compared to the baseline, ECD loss at 6 months follow-up was 12.6%.

CONCLUSIONS

The SING IMT™ device was found to be effective in the distance and near vision improvement, without serious postoperative complications. We recommend intraoperative mechanical iridectomy in order to easily manage post-operative IOP and to avoid sudden IOP rise with its possible consequences. These good results can be a hope to partially improve the quality of life of patients suffering from severe end stage macular atrophy.

Prosthetic Visual Acuity with the PRIMA System in Patients with Atrophic Age-related Macular Degeneration at 4 years follow-up

Objective

To assess the efficacy and safety of the PRIMA subretinal neurostimulation system 48-months post-implantation for improving visual acuity (VA) in patients with geographic atrophy (GA) due to age-related macular degeneration (AMD) at 48-months post-implantation.

Design

First-in-human clinical trial of the PRIMA subretinal prosthesis in patients with atrophic AMD, measuring best-corrected ETDRS VA (Clinicaltrials.gov NCT03333954).

Subjects

Five patients with GA, no foveal light perception and VA of logMAR 1.3 to 1.7 in their worse-seeing "study" eye.

Methods

In patients implanted with a subretinal photovoltaic neurostimulation array containing 378 pixels of 100 μm in size, the VA was measured with and without the PRIMA system using ETDRS charts at 1 meter. The system's external components: augmented reality glasses and pocket computer, provide image processing capabilities, including zoom.

Main Outcome Measures

VA using ETDRS charts with and without the system. Light sensitivity in the central visual field, as measured by Octopus perimetry. Anatomical outcomes demonstrated by fundus photography and optical coherence tomography up to 48-months post-implantation.

Results

All five subjects met the primary endpoint of light perception elicited by the implant in the scotoma area. In one patient the implant was incorrectly inserted into the choroid. One subject died 18-months post-implantation due to study-unrelated reason. ETDRS VA results for the remaining three subjects are reported herein. Without zoom, VA closely matched the pixel size of the implant: 1.17 ± 0.13 pixels, corresponding to mean logMAR 1.39, or Snellen 20/500, ranging from 20/438 to 20/565. Using zoom at 48 months, subjects improved their VA by 32 ETDRS letters versus baseline (SE 5.1) 95% CI[13.4,49.9], p<0.0001. Natural peripheral visual function in the treated eye did not decline after surgery compared to the fellow eye (p=0.08) during the 48 months follow-up period.

Conclusions

Subretinal implantation of PRIMA in subjects with GA suffering from profound vision loss due to AMD is feasible and well tolerated, with no reduction of natural peripheral vision up to 48-months. Using prosthetic central vision through photovoltaic neurostimulation, patients reliably recognized letters and sequences of letters,and with zoom it provided a clinically meaningful improvement in VA of up to eight ETDRS lines.

Optical-Quality Assessment of a Miniaturized Intraocular Telescope

Age-related macular degeneration (AMD) causes severe vision impairments, including blindness. An option to improve vision in AMD patients is through intraocular lenses and optics. Among others, implantable miniaturized telescopes, which direct light to healthy lateral regions of the retina, can be highly effective in improving vision in AMD patients. Yet, the quality of the restored vision might be sensitive to the optical transmission and aberrations of the telescope. To shed light on these points, we studied the in vitro optical performance of an implantable miniaturized telescope, namely, the SING IMT™ (Samsara Vision Ltd., Far Hills, NJ, USA) designed to improve vision in patients affected by late-stage AMD. Specifically, we measured the optical transmission in the spectral range 350-750 nm of the implantable telescope with a fiber-optic spectrometer. Wavefront aberrations were studied by measuring the wavefront of a laser beam after passing through the telescope and expanding the measured wavefront into a Zernike polynomial basis. Wavefront concavity indicated that the SING IMT™ behaves as a diverging lens with a focal length of -111 mm. The device exhibited even optical transmission in the whole visible spectrum and effective curvature suitable for retinal images magnification with negligible geometrical aberrations. Optical spectrometry and in vitro wavefront analysis provide evidence supporting the feasibility of miniaturized telescopes as high-quality optical elements and a favorable option for AMD visual impairment treatments.

Three-Month Safety and Efficacy Outcomes for the Smaller-Incision New-Generation Implantable Miniature Telescope (SING IMT™)

The smaller-incision new-generation implantable miniature telescope (SING IMT™) is the second generation of the IMT™, a telescope prosthesis that is indicated for monocular implantation in patients with stable vision impairment caused by bilateral central scotomas associated with end-stage Age-related macular degeneration (AMD). This non-comparative retrospective study is the first and largest single-surgeon case series to evaluate the short-term (3 months) safety and efficacy of the device in patients with disciform scars or geographic atrophy at baseline. The main outcome measures included best-corrected distance and near visual acuity (CDVA and CDNVA, respectively), endothelial cell density (ECD) loss, and the incidence of complications. At postoperative month 3 in the study eyes, mean CDVA and CDNVA improved by +14.9 ± 7.1 letters and +7.7 ± 3.2 Jaeger levels, respectively. Importantly, 70.83% of patients gained ≥ 2 lines, 58.33% ≥ 3 lines, and 25.00% ≥ 4 lines of CDVA. From baseline, ECD loss in the study eyes was 10.4 ± 13.3% at 3 months, however, ECD was comparable between the study and fellow eyes at all time points. The most common complication was corneal edema. In all, these short-term outcomes suggest that the SING IMT™ delivers lower ECD loss than the first-generation IMT ™, but similar visual outcomes and safety.

Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness

Objective.How can we return a functional form of sight to people who are living with incurable blindness? Despite recent advances in the development of visual neuroprostheses, the quality of current prosthetic vision is still rudimentary and does not differ much across different device technologies.Approach.Rather than aiming to represent the visual scene as naturally as possible, aSmart Bionic Eyecould provide visual augmentations through the means of artificial intelligence-based scene understanding, tailored to specific real-world tasks that are known to affect the quality of life of people who are blind, such as face recognition, outdoor navigation, and self-care.Main results.Complementary to existing research aiming to restore natural vision, we propose a patient-centered approach to incorporate deep learning-based visual augmentations into the next generation of devices.Significance.The ability of a visual prosthesis to support everyday tasks might make the difference between abandoned technology and a widely adopted next-generation neuroprosthetic device.

Ultrasound Retinal Stimulation: A Mini-Review of Recent Developments

Ultrasound neuromodulation is an emerging technology. A significant amount of effort has been devoted to investigating the feasibility of noninvasive ultrasound retinal stimulation. Recent studies have shown that ultrasound can activate neurons in healthy and degenerated retinas. Specifically, high-frequency ultrasound can evoke localized neuron responses and generate patterns in visual circuits. In this review, we recapitulate pilot studies on ultrasound retinal stimulation, compare it with other neuromodulation technologies, and discuss its advantages and limitations. An overview of the opportunities and challenges to develop a noninvasive retinal prosthesis using high-frequency ultrasound is also provided.

Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses

Visual prostheses, used to assist in restoring functional vision to the visually impaired, convert captured external images into corresponding electrical stimulation patterns that are stimulated by implanted microelectrodes to induce phosphenes and eventually visual perception. Detecting and providing useful visual information to the prosthesis wearer under limited artificial vision has been an important concern in the field of visual prosthesis. Along with the development of prosthetic device design and stimulus encoding methods, researchers have explored the possibility of the application of computer vision by simulating visual perception under prosthetic vision. Effective image processing in computer vision is performed to optimize artificial visual information and improve the ability to restore various important visual functions in implant recipients, allowing them to better achieve their daily demands. This paper first reviews the recent clinical implantation of different types of visual prostheses, summarizes the artificial visual perception of implant recipients, and especially focuses on its irregularities, such as dropout and distorted phosphenes. Then, the important aspects of computer vision in the optimization of visual information processing are reviewed, and the possibilities and shortcomings of these solutions are discussed. Ultimately, the development direction and emphasis issues for improving the performance of visual prosthesis devices are summarized.

Micro-magnetic stimulation of primary visual cortex induces focal and sustained activation of secondary visual cortex

Cortical visual prostheses that aim to restore sight to the blind require the ability to create neural activity in the visual cortex. Electric stimulation delivered via microelectrodes implanted in the primary visual cortex (V1) has been the most common approach, although conventional electrodes may not effectively confine activation to focal regions and thus the acuity they create may be limited. Magnetic stimulation from microcoils confines activation to single cortical columns of V1 and thus may prove to be more effective than conventional microelectrodes, but the ability of microcoils to drive synaptic connections has not been explored. Here, we show that magnetic stimulation of V1 using microcoils induces spatially confined activation in the secondary visual cortex (V2) in mouse brain slices. Single-loop microcoils were fabricated using platinum-iridium flat microwires, and their effectiveness was evaluated using calcium imaging and compared with that of monopolar and bipolar electrodes. Our results show that compared to the electrodes, the microcoils better confined activation to a small region in V1. In addition, they produced more precise and sustained activation in V2. The finding that microcoil-based stimulation propagates to higher visual centres raises the possibility that complex visual perception, e.g. that requiring sustained synaptic inputs, may be achievable. This article is part of the theme issue 'Advanced neurotechnologies: translating innovation for health and well-being'.

Electrical devices for visual restoration

Given the rising number of patients with blindness from macular, optic nerve, and visual pathway disease, there is considerable interest in the potential of electrical stimulation devices to restore vision. Electrical devices for restoration of visual function can be grouped into three categories: (1) visual prostheses whose goal is to bypass damaged areas and directly activate downstream intact portions of the visual pathway; (2) electric field stimulation whose goal is to activate endogenous transcriptional and molecular signaling pathways to promote neuroprotection and neuro-regeneration; and (3) neuromodulation whose stimulation would resuscitate neural circuits vital to coordinating responses to visual input.  In this review, we discuss these three approaches, describe advances made in the different fields, and comment on limitations and potential future directions.

The application of computer vision to visual prosthesis

A visual prosthesis is an auxiliary device for patients with blinding diseases that cannot be treated with conventional surgery or drugs. It converts captured images into corresponding electrical stimulation patterns, according to which phosphenes are generated through the action of internal electrodes on the visual pathway to form visual perception. However, due to some restrictions such as the few implantable electrodes that the biological tissue can accommodate, the induced perception is far from ideal. Therefore, an important issue in visual prosthesis research is how to detect and present useful information in low-resolution prosthetic vision to improve the visual function of the wearer. In recent years, with the development and broad application of computer vision methods, researchers have investigated the possibility of their utilization in visual prostheses by simulating prosthetic visual percepts. Through the optimization of visual perception by image processing, the efficiency of visual prosthesis devices can be further improved to better meet the needs of prosthesis wearers. In this article, recent works on prosthetic vision centering on implementing computer vision methods are reviewed. Differences, strengths, and weaknesses of the mentioned methods are discussed. The development directions of optimizing prosthetic vision and improving methods of visual perception are analyzed.

Toward the development of a color visual prosthesis

Objective. All of the human prosthetic visual systems implanted so far have been achromatic. Schmidtet al(1996Brain119507-22) reported that at low stimulation intensities their subject reported that phosphenes usually had a specific hue, but when the stimulus intensity was increased, they desaturated to white. We speculate here that previous B/W prosthetic systems were unnecessarily over-stimulating the visual cortex to obtain white phosphenes, which may be why unexpected alterations in phosphenes and seizures were not an uncommon occurrence. A color prosthesis would have the advantage of being elicited by lower levels of stimulation, reducing the probability of causing epileptogenic responses.Approach.A 'hybrid' mode of stimulation is suggested, involving a combination of B/W and color stimulation, which could provide color information without reducing spatial resolution.Main results.Colors in the real world are spread along intensity and chromatic gradients.Significance.Software implementation strategies are discussed, as are the advantages and challenges for possible color prosthetic systems.

Oculomotor Responses to Dynamic Stimuli in a 44-Channel Suprachoroidal Retinal Prosthesis

Purpose

To investigate oculomotor behavior in response to dynamic stimuli in retinal implant recipients.

Methods

Three suprachoroidal retinal implant recipients performed a four-alternative forced-choice motion discrimination task over six sessions longitudinally. Stimuli were a single white bar (“moving bar”) or a series of white bars (“moving grating”) sweeping left, right, up, or down across a 42″ monitor. Performance was compared with normal video processing and scrambled video processing (randomized image-to-electrode mapping to disrupt spatiotemporal structure). Eye and head movement was monitored throughout the task.

Results

Two subjects had diminished performance with scrambling, suggesting retinotopic discrimination was used in the normal condition and made smooth pursuit eye movements congruent to the moving bar stimulus direction. These two subjects also made stimulus-related eye movements resembling optokinetic reflex (OKR) for moving grating stimuli, but the movement was incongruent with stimulus direction. The third subject was less adept at the task, appeared primarily reliant on head position cues (head movements were congruent to stimulus direction), and did not exhibit retinotopic discrimination and associated eye movements.

Conclusions

Our observation of smooth pursuit indicates residual functionality of cortical direction-selective circuits and implies a more naturalistic perception of motion than expected. A distorted OKR implies improper functionality of retinal direction-selective circuits, possibly due to retinal remodeling or the non-selective nature of the electrical stimulation.

Translational Relevance

Retinal implant users can make naturalistic eye movements in response to moving stimuli, highlighting the potential for eye tracker feedback to improve perceptual localization and image stabilization in camera-based visual prostheses.

Retinal Prostheses and Artificial Vision

In outer retinal degenerative diseases such as retinitis pigmentosa, choroideremia, and geographic atrophy, 30% of the ganglion cell layer in the macula remains intact. With subretinal and epiretinal prostheses, these inner retinal cells are stimulated with controlled electrical current by either a microphotodiode placed in the subretinal area or a microelectrode array tacked to the epiretinal region. As the patient learns to interpret the resulting phosphene patterns created in the brain through special rehabilitation exercises, their orientation, mobility, and quality of life increase. Implants that stimulate the lateral geniculate nucleus or visual cortex are currently being studied for diseases in which the ganglion cells and optic nerve are completely destroyed.

Trade-Off Between Field-of-View and Resolution in the Thermal-Integrated Argus II System

Purpose

To investigate the effect of a wider field-of-view (FOV) of a retinal prosthesis on the users' performance in locating objects.

Methods

One female and four male subjects who were blind due to end-stage retinitis pigmentosa and had been implanted with the Argus II retinal prosthesis participated (aged 63.4 ± 15.4). Thermal imaging was captured by an external sensor and converted to electrical stimulation to the retina. Subjects were asked to localize and to reach for heat-emitting objects using two different FOV mappings: a normal 1:1 mapping (no zoom) that provided 18° × 11° FOV and a 3:1 mapping (zoom out) that provided 49° × 35° FOV. Their accuracy and response time were recorded.

Results

Subjects were less accurate and took longer to complete the tasks with zoom out compared to no zoom. Localization accuracy decreased from 83% (95% confidence interval, 75%, 90%) with no zoom to 76% (67%, 83%) with zoom out (P = 0.07). Reaching accuracy differed between the two mappings only in one subject. Response time increased by 43% for the localization task (24%, 66%; P < 0.001) and by 20% for the reaching task (0%, 45%; P = 0.055).

Conclusions

Argus II wearers can efficiently find heat-emitting objects with the default 18° × 11° FOV of the current Argus II. For spatial localization, a higher spatial resolution may be preferred over a wider FOV.

Translational Relevance

Understanding the trade-off between FOV and spatial resolution in retinal prosthesis users can guide device optimization.

Phosphene perceptions and safety of chronic visual cortex stimulation in a blind subject

Stimulation of primary visual cortices has the potential to restore some degree of vision to blind individuals. Developing safe and reliable visual cortical prostheses requires assessment of the long-term stability, feasibility, and safety of generating stimulation-evoked perceptions.A NeuroPace responsive neurostimulation system was implanted in a blind individual with an 8-year history of bare light perception, and stimulation-evoked phosphenes were evaluated over 19 months (41 test sessions). Electrical stimulation was delivered via two four-contact subdural electrode strips implanted over the right medial occipital cortex. Current and charge thresholds for eliciting visual perception (phosphenes) were measured, as were the shape, size, location, and intensity of the phosphenes. Adverse events were also assessed.Stimulation of all contacts resulted in phosphene perception. Phosphenes appeared completely or partially in the left hemifield. Stimulation of the electrodes below the calcarine sulcus elicited phosphenes in the superior hemifield and vice versa. Changing the stimulation parameters of frequency, pulse width, and burst duration affected current thresholds for eliciting phosphenes, and increasing the amplitude or frequency of stimulation resulted in brighter perceptions. While stimulation thresholds decreased between an average of 5% and 12% after 19 months, spatial mapping of phosphenes remained consistent over time. Although no serious adverse events were observed, the subject experienced mild headaches and dizziness in three instances, symptoms that did not persist for more than a few hours and for which no clinical intervention was required.Using an off-the-shelf neurostimulator, the authors were able to reliably generate phosphenes in different areas of the visual field over 19 months with no serious adverse events, providing preliminary proof of feasibility and safety to proceed with visual epicortical prosthetic clinical trials. Moreover, they systematically explored the relationship between stimulation parameters and phosphene thresholds and discovered the direct relation of perception thresholds based on primary visual cortex (V1) neuronal population excitation thresholds.

Motion Parallax Improves Object Recognition in the Presence of Clutter in Simulated Prosthetic Vision

Purpose

Efficacy of current visual prostheses in object recognition is limited. Among various limitations to be addressed, such as low resolution and low dynamic range, here we focus on reducing the impact of background clutter on object recognition. We have proposed the use of motion parallax via head-mounted camera lateral scanning and computationally stabilizing the object of interest (OI) to support neural background decluttering. Simulations in head-mounted displays (HMD), mimicking the proposed effect, were used to test object recognition in normally sighted subjects.

Methods

Images (24° field of view) were captured from multiple viewpoints and presented at a low resolution (20 × 20). All viewpoints were centered on the OI. Experimental conditions (2 × 3) included clutter (with or without) × head scanning (single viewpoint, 9 coherent viewpoints corresponding to subjects' head positions, and 9 randomly associated viewpoints). Subjects used lateral head movements to view OIs in the HMD. Each object was displayed only once for each subject.

Results

The median recognition rate without clutter was 40% for all head scanning conditions. Performance with synthetic background clutter dropped to 10% in the static condition, but it was improved to 20% with the coherent and random head scanning (corrected P = 0.005 and P = 0.049, respectively).

Conclusions

Background decluttering using motion parallax cues but not the coherent multiple views of the OI improved object recognition in low-resolution images. The improvement did not fully eliminate the impact of background.

Translational Relevance

Motion parallax is an effective but incomplete decluttering solution for object recognition with visual prostheses.

The Argus-II Retinal Prosthesis Implantation; From the Global to Local Successful Experience

Over the past few years, visual prostheses (namely, Argus II retinal implant) and gene therapy have obtained FDA approval in treating blindness resulting from retinitis pigmentosa. Compared to gene therapy; Argus II is less costly with a demonstrated favorable outcome, though the vision is yet artificial. To obtain better results, expectation counseling and preoperative retinal assessment are critical. The global experience with Argus II has enrolled no more than 300 cases so far. The first Argus II retinal prosthesis in Iran was successfully implanted in Shiraz (October 2017). To date, Argus II artificial retina is implanted in four patients in Iran. Beside successful surgery and post-operative care, rehabilitation efforts with validated outcome measures including visual rehabilitation together with neurovisual, visuo-constructive and cognitive rehabilitation/empowerment approaches are expected to boost the functional outcome. A multidisciplinary approach within a cross-functional team would optimize strategies toward better patient outcomes. As such, establishing a collaborative network will foster organized research efforts to better define outcome assessment and rehabilitation strategies. This technology report paper has been an attempt to provide an overview of Argus-II retinal implant global experience as well as the clinical outcome of the so far cases in Iran. Insights from this report were communicated during the first “Brain Engineering and Computational Neuroscience Conference,” 31 January-2 February 2018 in Tehran.

Gaze Compensation as a Technique for Improving Hand-Eye Coordination in Prosthetic Vision

Purpose

Shifting the region-of-interest within the input image to compensate for gaze shifts (“gaze compensation”) may improve hand–eye coordination in visual prostheses that incorporate an external camera. The present study investigated the effects of eye movement on hand-eye coordination under simulated prosthetic vision (SPV), and measured the coordination benefits of gaze compensation.

Methods

Seven healthy-sighted subjects performed a target localization-pointing task under SPV. Three conditions were tested, modeling: retinally stabilized phosphenes (uncompensated); gaze compensation; and no phosphene movement (center-fixed). The error in pointing was quantified for each condition.

Results

Gaze compensation yielded a significantly smaller pointing error than the uncompensated condition for six of seven subjects, and a similar or smaller pointing error than the center-fixed condition for all subjects (two-way ANOVA, P < 0.05). Pointing error eccentricity and gaze eccentricity were moderately correlated in the uncompensated condition (azimuth: R² = 0.47; elevation: R² = 0.51) but not in the gaze-compensated condition (azimuth: R² = 0.01; elevation: R² = 0.00). Increased variability in gaze at the time of pointing was correlated with greater reduction in pointing error in the center-fixed condition compared with the uncompensated condition (R² = 0.64).

Conclusions

Eccentric eye position impedes hand–eye coordination in SPV. While limiting eye eccentricity in uncompensated viewing can reduce errors, gaze compensation is effective in improving coordination for subjects unable to maintain fixation.

Translational Relevance

The results highlight the present necessity for suppressing eye movement and support the use of gaze compensation to improve hand–eye coordination and localization performance in prosthetic vision.

Visual Prosthesis: Interfacing Stimulating Electrodes with Retinal Neurons to Restore Vision

The bypassing of degenerated photoreceptors using retinal neurostimulators is helping the blind to recover functional vision. Researchers are investigating new ways to improve visual percepts elicited by these means as the vision produced by these early devices remain rudimentary. However, several factors are hampering the progression of bionic technologies: the charge injection limits of metallic electrodes, the mechanical mismatch between excitable tissue and the stimulating elements, neural and electric crosstalk, the physical size of the implanted devices, and the inability to selectively activate different types of retinal neurons. Electrochemical and mechanical limitations are being addressed by the application of electromaterials such as conducting polymers, carbon nanotubes and nanocrystalline diamonds, among other biomaterials, to electrical neuromodulation. In addition, the use of synthetic hydrogels and cell-laden biomaterials is promising better interfaces, as it opens a door to establishing synaptic connections between the electrode material and the excitable cells. Finally, new electrostimulation approaches relying on the use of high-frequency stimulation and field overlapping techniques are being developed to better replicate the neural code of the retina. All these elements combined will bring bionic vision beyond its present state and into the realm of a viable, mainstream therapy for vision loss.

Advances in Retinal Prosthetic Research: A Systematic Review of Engineering and Clinical Characteristics of Current Prosthetic Initiatives

PURPOSE

To date, reviews of retinal prostheses have focused primarily on devices undergoing human trials in the Western Hemisphere and fail to capture significant advances in materials and engineering research in countries such as Japan and Korea, as well as projects in early stages of development. To address these gaps, this systematic review examines worldwide advances in retinal prosthetic research, evaluates engineering characteristics and clinical progress of contemporary device initiatives, and identifies potential directions for future research in the field of retinal prosthetics.

METHODS

A literature search using PubMed, Google Scholar, and IEEExplore was conducted following the PRISMA Guidelines for Systematic Review. Inclusion criteria were peer-reviewed papers demonstrating progress in human or animal trials and papers discussing the prosthetic engineering design. For each initiative, a description of the device, its engineering considerations, and recent clinical results were provided.

RESULTS

Ten prosthetic initiatives met our inclusion criteria and were organized by stimulation location. Of these initiatives, four have recently completed human trials, three are undergoing multi- or single-center human trials, and three are undergoing preclinical animal testing. Only the Argus II (FDA 2013, CE 2011) has obtained FDA approval for use in the United States; the Alpha-IMS (CE 2013) has achieved the highest visual acuity using a Landolt-C test to date and is the only device presently undergoing a multicenter clinical trial.

CONCLUSION

Several distinct approaches to retinal stimulation have been successful in eliciting visual precepts in animals and/or humans. However, many clinical needs are still not met and engineering challenges must be addressed before a retinal prosthesis with the capability to fully and safely restore functional vision can be realized.

Prototype chemical synapse chip for spatially patterned neurotransmitter stimulation of the retina ex vivo

Biomimetic stimulation of the retina with neurotransmitters, the natural agents of communication at chemical synapses, could be more effective than electrical stimulation for treating blindness from photoreceptor degenerative diseases. Recent studies have demonstrated the feasibility of neurotransmitter stimulation by injecting glutamate, a primary retinal neurotransmitter, into the retina at isolated single sites. Here, we demonstrate spatially patterned multisite stimulation of the retina with glutamate, offering the first experimental evidence for applicability of this strategy for translating visual patterns into afferent neural signals. To accomplish pattern stimulation, we fabricated a special microfluidic device comprising an array of independently addressable microports connected to tiny on-chip glutamate reservoirs via microchannels. The device prefilled with glutamate was interfaced with explanted rat retinas placed over a multielectrode array (MEA) with the retinal ganglion cells (RGC) contacting the electrodes and photoreceptor surface contacting the microports. By independently and simultaneously activating a subset of the microports with modulated pressure pulses, small boluses of glutamate were convectively injected at multiple sites in alphabet patterns over the photoreceptor surface. We found that the glutamate-driven RGC responses recorded through the MEA system were robust and spatially laid out in patterns strongly resembling the injection patterns. The stimulations were also highly localized with spatial resolutions comparable to or better than electrical retinal prostheses. Our findings suggest that surface stimulation of the retina with neurotransmitters in pixelated patterns of visual images is feasible and an artificial chemical synapse chip based on this approach could potentially circumvent the limitations of electrical retinal prostheses.

Argus II retinal prosthesis implantation with scleral flap and autogenous temporalis fascia as alternative patch graft material: a 4-year follow-up

Introduction

The Argus II retinal prosthesis is composed of an epiretinal electrode array positioned over the macula and connected to an extrascleral electronics case via a silicone cable, running through a sclerotomy. During implantation, the manufacturer recommends to cover the sclerotomy site with a patch of processed human pericardium to prevent postoperative hypotony and conjunctival erosion by the underlying electronics case. Due to biomedical regulations prohibiting the use of this material in France, we developed an alternative technique combining a scleral flap protecting the sclerotomy and an autogenous graft of superior temporalis fascia overlying the electronics case.

Methods

The purpose of this study is to describe the 4-year outcomes of this modified procedure in three subjects who underwent Argus II Retinal Prosthesis System implantation. Clinical data consisting of intraocular pressure measurements and tolerance in terms of conjunctival erosion or inflammation were retrospectively assessed over a 4-year postoperative follow-up.

Results

None of the three patients implanted with the modified technique developed ocular hypotony over 4 years. A normal, transient conjunctival inflammation occurred during the first postoperative month but conjunctival erosion was not observed in any of the three patients over 4 years. Four years after implantation, the autogenous temporalis fascia graft remained well tolerated and the retinal prosthesis was functional in all three patients.

Conclusion

The combination of an autograft of superficial temporalis fascia and a scleral flap efficiently prevented leakage through the sclerotomy site, ocular hypotony, and conjunctival erosion by the extrascleral electronics case. This modified technique is suitable for the implantation of existing and forthcoming retinal prostheses. Superficial temporalis fascia may also be used as alternative to commercial tectonic tissues for scleral wound repair in clinical settings where they are not available.

Hand-Camera Coordination Varies over Time in Users of the Argus(®) II Retinal Prosthesis System

INTRODUCTION

Most visual neuroprostheses use an external camera for image acquisition. This adds two complications to phosphene perception: (1) stimulation locus will not change with eye movements; and (2) external cameras can be aimed in directions different from the user's intended direction of gaze. Little is known about the stability of where users perceive light sources to be or whether they will adapt to changes in camera orientation.

METHODS

Three end-stage retinitis pigmentosa patients implanted with the Argus II participated in this study. This prosthesis stimulated the retina based on an 18° × 11° area selected within the camera's 66° × 49° field of view. The center of the electrode array's field of view mapped within the camera's field of view is the camera alignment position (CAP). Proper camera alignments minimize errors in localizing visual percepts in space. Subjects touched single white squares in random locations on a darkened touchscreen 40 or more times. To study adaptation, subjects were given intentional CAP misalignments of 15-40° for 5-6 months. Subjects performed this test with auditory feedback during (bi-)weekly lab sessions. Misaligned CAPs were maintained for another 5-6 months without auditory feedback. Touch alignment was tracked to detect any adaptation. To estimate localization stability, data for when CAPs were set to minimize errors were tracked. The same localization test as above was used. Localization errors were tracked every 1-2 weeks for up to 40 months.

RESULTS

Two of three subjects used auditory feedback to improve accuracy with misaligned CAPs at an average rate of 0.02°/day (p < 0.05, bootstrap analysis of linear regression). The rates observed here were ~4000 times slower than those seen in normally-sighted subjects adapting to prism glasses. Removal of auditory feedback precipitated error increases for all subjects. Optimal CAPs varied significantly across test sessions (p < 10(-4), bootstrap multivariate analysis of variance (MANOVA)), up to 21-29° within subjects over the observed period. Across subjects, optimal CAPs showed an average rate of change of 0.39°/day (SD 0.36°/day).

CONCLUSIONS

Optimal CAPs varied dramatically over time for all subjects. Subjects displayed no adaptation to misaligned CAPs without feedback. Regular recalibration of CAPs may be required to maintain hand-camera coordination.

neuroBi: A Highly Configurable Neurostimulator for a Retinal Prosthesis and Other Applications

To evaluate the efficacy of a suprachoroidal retinal prosthesis, a highly configurable external neurostimulator is required. In order to meet functional and safety specifications, it was necessary to develop a custom device. A system is presented which can deliver charge-balanced, constant-current biphasic pulses, with widely adjustable parameters, to arbitrary configurations of output electrodes. This system is shown to be effective in eliciting visual percepts in a patient with approximately 20 years of light perception vision only due to retinitis pigmentosa, using an electrode array implanted in the suprachoroidal space of the eye. The flexibility of the system also makes it suitable for use in a number of other emerging clinical neurostimulation applications, including epileptic seizure suppression and closed-loop deep brain stimulation. Clinical trial registration number NCT01603576 (www.clinicaltrials.gov).

Simulation of thalamic prosthetic vision: reading accuracy, speed, and acuity in sighted humans

The psychophysics of reading with artificial sight has received increasing attention as visual prostheses are becoming a real possibility to restore useful function to the blind through the coarse, pseudo-pixelized vision they generate. Studies to date have focused on simulating retinal and cortical prostheses; here we extend that work to report on thalamic designs. This study examined the reading performance of normally sighted human subjects using a simulation of three thalamic visual prostheses that varied in phosphene count, to help understand the level of functional ability afforded by thalamic designs in a task of daily living. Reading accuracy, reading speed, and reading acuity of 20 subjects were measured as a function of letter size, using a task based on the MNREAD chart. Results showed that fluid reading was feasible with appropriate combinations of letter size and phosphene count, and performance degraded smoothly as font size was decreased, with an approximate doubling of phosphene count resulting in an increase of 0.2 logMAR in acuity. Results here were consistent with previous results from our laboratory. Results were also consistent with those from the literature, despite using naive subjects who were not trained on the simulator, in contrast to other reports.

Safety and efficacy of explanting or replacing suprachoroidal electrode arrays in a feline model

BACKGROUND

A key requirement for retinal prostheses is the ability for safe removal or replacement. We examined whether suprachoroidal electrode arrays can be removed or replaced after implantation.

METHODS

Suprachoroidal electrode arrays were unilaterally implanted into 13 adult felines. After 1 month, arrays were surgically explanted (n = 6), replaced (n = 5) or undisturbed (n = 2). The retina was assessed periodically using fundus photography and optical coherence tomography. Three months after the initial implantation, the function of replaced or undisturbed arrays was assessed by measuring the responses of the visual cortex to retinal electrical stimulation. The histopathology of tissues surrounding the implant was examined.

RESULTS

Array explantation or replacement was successful in all cases. Fundus photography showed localized disruption to the tapetum lucidum near the implant's tip in seven subjects following implantation. Although optical coherence tomography showed localized retinal changes, there were no widespread statistically significant differences in the thickness of the retinal layers or choroid. The distance between the electrodes and retina increased after device replacement but returned to control values within eight weeks (P < 0.03). Staphylomas developed near the scleral wound in five animals after device explantation. Device replacement did not alter the cortical evoked potential threshold. Histopathology showed localized outer nuclear layer thinning, tapetal disruption and pseudo-rosette formation, but the overall retinal morphology was preserved.

CONCLUSIONS

It is feasible to remove or replace conformable medical grade silicone electrode arrays implanted suprachoroidally. The scleral wound requires careful closure to minimize the risk of staphylomas.

Artificial vision support system (AVS(2)) for improved prosthetic vision

State-of-the-art and upcoming camera-driven, implanted artificial vision systems provide only tens to hundreds of electrodes, affording only limited visual perception for blind subjects. Therefore, real time image processing is crucial to enhance and optimize this limited perception. Since tens or hundreds of pixels/electrodes allow only for a very crude approximation of the typically megapixel optical resolution of the external camera image feed, the preservation and enhancement of contrast differences and transitions, such as edges, are especially important compared to picture details such as object texture. An Artificial Vision Support System (AVS(2)) is devised that displays the captured video stream in a pixelation conforming to the dimension of the epi-retinal implant electrode array. AVS(2), using efficient image processing modules, modifies the captured video stream in real time, enhancing 'present but hidden' objects to overcome inadequacies or extremes in the camera imagery. As a result, visual prosthesis carriers may now be able to discern such objects in their 'field-of-view', thus enabling mobility in environments that would otherwise be too hazardous to navigate. The image processing modules can be engaged repeatedly in a user-defined order, which is a unique capability. AVS(2) is directly applicable to any artificial vision system that is based on an imaging modality (video, infrared, sound, ultrasound, microwave, radar, etc.) as the first step in the stimulation/processing cascade, such as: retinal implants (i.e. epi-retinal, sub-retinal, suprachoroidal), optic nerve implants, cortical implants, electric tongue stimulators, or tactile stimulators.

Optogenetic approaches to retinal prosthesis

The concept of visual restoration via retinal prosthesis arguably started in 1992 with the discovery that some of the retinal cells were still intact in those with the retinitis pigmentosa disease. Two decades later, the first commercially available devices have the capability to allow users to identify basic shapes. Such devices are still very far from returning vision beyond the legal blindness. Thus, there is considerable continued development of electrode materials, and structures and electronic control mechanisms to increase both resolution and contrast. In parallel, the field of optogenetics--the genetic photosensitization of neural tissue holds particular promise for new approaches. Given that the eye is transparent, photosensitizing remaining neural layers of the eye and illuminating from the outside could prove to be less invasive, cheaper, and more effective than present approaches. As we move toward human trials in the coming years, this review explores the core technological and biological challenges related to the gene therapy and the high radiance optical stimulation requirement.

Electrically elicited visual evoked potentials in Argus II retinal implant wearers

PURPOSE

We characterized electrically elicited visual evoked potentials (eVEPs) in Argus II retinal implant wearers.

METHODS

eVEPs were recorded in four subjects, and analyzed by determining amplitude and latency of the first two positive peaks (P1 and P2). Subjects provided subjective feedback by rating the brightness and size of the phosphenes. We established eVEP input-output relationships, eVEP variability between and within subjects, the effect of stimulating different areas of the retina, and the maximal pulse rate to record eVEPs reliably.

RESULTS

eVEP waveforms had low signal-to-noise ratios, requiring long recording times and substantial signal processing. Waveforms varied between subjects, but showed good reproducibility and consistent parameter dependence within subjects. P2 amplitude overall was the most robust outcome measure and proved an accurate indicator of subjective threshold. Peak latencies showed small within-subject variability, yet their correlation with stimulus level and subjective rating were more variable than that of peak amplitudes. Pulse rates of up to (2)/3 Hz resulted in reliable eVEP recordings. Perceived phosphene brightness declined over time, as reflected in P1 amplitude, but not in P2 amplitude or peak latencies. Stimulating-electrode location significantly affected P1 and P2 amplitude and latency, but not subjective percepts.

CONCLUSIONS

While recording times and signal processing are more demanding than for standard visually evoked potential (VEP) recordings, the eVEP has proven to be a reliable tool to verify retinal implant functionality. eVEPs correlated with various stimulus parameters and with perceptual ratings. In view of these findings, eVEPs may become an important tool in functional investigations of retinal prostheses. (ClinicalTrials.gov number NCT00407602.) Dutch Abstract.

Accurate reading with sequential presentation of single letters

Rapid, accurate reading is possible when isolated, single words from a sentence are sequentially presented at a fixed spatial location. We investigated if reading of words and sentences is possible when single letters are rapidly presented at the fovea under user-controlled or automatically controlled rates. When tested with complete sentences, trained participants achieved reading rates of over 60 wpm and accuracies of over 90% with the single letter reading (SLR) method and naive participants achieved average reading rates over 30 wpm with greater than 90% accuracy. Accuracy declined as individual letters were presented for shorter periods of time, even when the overall reading rate was maintained by increasing the duration of spaces between words. Words in the lexicon that occur more frequently were identified with higher accuracy and more quickly, demonstrating that trained participants have lexical access. In combination, our data strongly suggest that comprehension is possible and that SLR is a practicable form of reading under conditions in which normal scanning of text is not possible, or for scenarios with limited spatial and temporal resolution such as patients with low vision or prostheses.

Retinal implants: emergence of a multidisciplinary field

PURPOSE OF REVIEW

This review summarizes the current status of retinal prostheses, recent accomplishments, and major remaining research, engineering, and rehabilitation challenges.

RECENT FINDINGS

Retinal research, materials and biocompatibility studies, and clinical trials in patients blind from retinitis pigmentosa are representative of an emerging field with considerable promise and sobering challenges. A summary of progress in dozens of laboratories, companies, and clinics around the world is presented through a synopsis of relevant studies, not only to summarize the progress but also to convey the remarkable increase in interest, effort, and outside funding this field has enjoyed.

SUMMARY

At present, clinical applications of retinal implant technology are dominated by one or two groups/companies, but the field is wide open for others to take the lead through novel approaches in technology, tissue interfacing, information transfer paradigms, and rehabilitation. Where the field will go in the next few years is almost anybody's guess, but that it will move forward is a certainty.

Getting signals into the brain: visual prosthetics through thalamic microstimulation

Common causes of blindness are diseases that affect the ocular structures, such as glaucoma, retinitis pigmentosa, and macular degeneration, rendering the eyes no longer sensitive to light. The visual pathway, however, as a predominantly central structure, is largely spared in these cases. It is thus widely thought that a device-based prosthetic approach to restoration of visual function will be effective and will enjoy similar success as cochlear implants have for restoration of auditory function. In this article the authors review the potential locations for stimulation electrode placement for visual prostheses, assessing the anatomical and functional advantages and disadvantages of each. Of particular interest to the neurosurgical community is placement of deep brain stimulating electrodes in thalamic structures that has shown substantial promise in an animal model. The theory of operation of visual prostheses is discussed, along with a review of the current state of knowledge. Finally, the visual prosthesis is proposed as a model for a general high-fidelity machine-brain interface.

Simulations of electrode placement for a thalamic visual prosthesis

In this paper, placement parameters for microstimulation electrodes in a visual prosthesis are evaluated based on retinotopic models of macaque and human lateral geniculate nucleus. Phosphene patterns were simulated for idealized microwire electrodes as well as for currently available clinical electrodes. For idealized microwire electrodes, spacing as large as 600 microm in three dimensions would allow for over 250 phosphenes per visual hemifield in macaques, and over 800 in humans.