Artificial human vision

Development of a bio-inspired optical system that mimics accommodation and lighting regulation like the human eye

Bio-inspired optical systems have recently been developed using polarizers and liquid or rigid lenses. In this work, we propose a bio-inspired opto-mechatronic system that imitates the accommodation and regulation of light intensity as the human eye does. The system uses a polymeric lens as a cornea, an adjustable diaphragm as an iris, a tunable solid elastic lens as a crystalline lens, and a commercial sensor as a retina. We also present the development of the electronic control system to accommodate and regulate the amount of light that enters the system, for which two stepper motors, an Arduino control system, and light and movement sensors are used. The characterization of the system is presented together with the results obtained, where it can be seen that the system works in an acceptable range as the human eye does.

Silicon-Nanomembrane-Based Broadband Synaptic Phototransistors for Neuromorphic Vision

Neuromorphic vision has been attracting much attention due to its advantages over conventional machine vision (e.g., lower data redundancy and lower power consumption). Here we develop synaptic phototransistors based on the silicon nanomembrane (Si NM), which are coupled with lead sulfide quantum dots (PbS QDs) and poly(3-hexylthiophene) (P3HT) to form a heterostructure with distinct photogating. Synaptic phototransistors with optical stimulation have outstanding synaptic functionalities ranging from ultraviolet (UV) to near-infrared (NIR). The broadband synaptic functionalities enable an array of synaptic phototransistors to achieve the perception of brightness and color. In addition, an array of synaptic phototransistors is capable of simultaneous sensing, processing, and memory, which well mimics human vision.

Development of visual Neuroprostheses: trends and challenges

Visual prostheses are implantable medical devices that are able to provide some degree of vision to individuals who are blind. This research field is a challenging subject in both ophthalmology and basic science that has progressed to a point where there are already several commercially available devices. However, at present, these devices are only able to restore a very limited vision, with relatively low spatial resolution. Furthermore, there are still many other open scientific and technical challenges that need to be solved to achieve the therapeutic benefits envisioned by these new technologies. This paper provides a brief overview of significant developments in this field and introduces some of the technical and biological challenges that still need to be overcome to optimize their therapeutic success, including long-term viability and biocompatibility of stimulating electrodes, the selection of appropriate patients for each artificial vision approach, a better understanding of brain plasticity and the development of rehabilitative strategies specifically tailored for each patient.

Electronic retinal implants and artificial vision: journey and present

Retinitis pigmentosa and age-related macular degeneration are two significant causes of severe visual dysfunction. In both, the retinal photoreceptors degenerate, preventing successful conversion of light into electrical energy that is interpreted in the visual cortex as visual function. Artificial vision or visual function began over two centuries ago with the idea of creating artificial light pulses, or phosphenes, through cortical stimulation. The pursuit is now on to improve artificial visual function. Two retinal implants appear the most likely to succeed in the future having undergone multicentre human trials: the Argus II electronic epiretinal device (Second Sight Medical Products, CA, USA) and Alpha-IMS electronic subretinal device (Retina Implant AG, Germany). The trial results to date are encouraging with visual improvement and acceptable safety profiles reported for both devices. At present, the visual function generated by either device does not offer high enough resolution or acuity for a patient to regain a fully functional life. Despite this, both devices not only have the potential, but have actually improved the vision-related quality of life in a significant number of patients implanted. With this in mind, the economic argument is clear. Provided device-life is long enough, its cost should be acceptable for the obtained improvement in the quality of life. The aim of this Review Article is to assist those readers that may be considering offering any of these devices as a treatment for blindness in Retinitis Pigmentosa.

Navigating from a Depth Image Converted into Sound

Background. Common manufactured depth sensors generate depth images that humans normally obtain from their eyes and hands. Various designs converting spatial data into sound have been recently proposed, speculating on their applicability as sensory substitution devices (SSDs). Objective. We tested such a design as a travel aid in a navigation task. Methods. Our portable device (MeloSee) converted 2D array of a depth image into melody in real-time. Distance from the sensor was translated into sound intensity, stereo-modulated laterally, and the pitch represented verticality. Twenty-one blindfolded young adults navigated along four different paths during two sessions separated by one-week interval. In some instances, a dual task required them to recognize a temporal pattern applied through a tactile vibrator while they navigated. Results. Participants learnt how to use the system on both new paths and on those they had already navigated from. Based on travel time and errors, performance improved from one week to the next. The dual task was achieved successfully, slightly affecting but not preventing effective navigation. Conclusions. The use of Kinect-type sensors to implement SSDs is promising, but it is restricted to indoor use and it is inefficient on too short range.

Proceedings of the First International Optogenetic Therapies for Vision Symposium

Optogenetics is a research field that uses gene therapy to deliver a gene encoding a light-activated protein to cells providing light-regulated control of targeted cell pathways. The technology is a popular tool in many fields of neuroscience, used to transiently switch cells on and off, for example, to map neural circuits. In inherited retinal degenerative diseases, where loss of vision results from the loss of photoreceptors, optogenetics can be applied to either augment the function of surviving photoreceptors or confer light sensitivity to naturally nonlight sensitive retinal cells, such as a bipolar cells. This can be achieved either by the light sensitive protein integrating with native internal signaling pathways, or by using a dual function membrane protein that integrates light signaling with an ion channel or pump activity. Exposing treated cells to light of the correct wavelength activates the protein, resulting in cellular depolarization or hyperpolarization that triggers neurological signaling to the visual cortex. While there is a lot of interest in optogenetics as a pan-disease clinical treatment for end-stage application in the inherited degenerative diseases of the retina, research to date has been limited to nonhuman clinical studies. To address the clinical translational needs of this technology, the Foundation Fighting Blindness and Massachusetts Eye and Ear Infirmary cohosted an International Optogenetic Therapies for Vision Workshop, which was held at Massachusetts Eye and Ear Infirmary, Boston, Massachusetts on June 1, 2012.

Strength-duration relationship for intra- versus extracellular stimulation with microelectrodes

Chronaxie, a historically introduced excitability time parameter for electrical stimulation, has been assumed to be closely related to the time constant of the cell membrane. Therefore, it is perplexing that significantly larger chronaxies have been found for intracellular than for extracellular stimulation. Using compartmental model analysis, this controversy is explained on the basis that extracellular stimulation also generates hyperpolarized regions of the cell membrane hindering a steady excitation as seen in the intracellular case. The largest inside/outside chronaxie ratio for microelectrode stimulation is found in close vicinity of the cell. In the case of monophasic cathodic stimulation, the length of the primarily excited zone which is situated between the hyperpolarized regions increases with electrode-cell distance. For distant electrodes this results in an excitation process comparable to the temporal behavior of intracellular stimulation. Chronaxie also varies along the neural axis, being small for electrode positions at the nodes of Ranvier and axon initial segment and larger at the soma and dendrites. As spike initiation site can change for short and long pulses, in some cases strength-duration curves have a bimodal shape, and thus, they deviate from a classical monotonic curve as described by the formulas of Lapicque or Weiss.

Consistent phosphenes generated by electrical microstimulation of the visual thalamus. An experimental approach for thalamic visual neuroprostheses

Most work on visual prostheses has centered on developing retinal or cortical devices. However, when retinal implants are not feasible, neuroprostheses could be implanted in the lateral geniculate nucleus (LGN) of the thalamus, the intermediate relay station of visual information from the retina to the visual cortex (V1). The objective of the present study was to determine the types of artificial stimuli that when delivered to the visual thalamus can generate reliable responses of the cortical neurons similar to those obtained when the eye perceives a visual image. Visual stimuli {S(i)} were presented to one eye of an experimental animal and both, the thalamic {RTh(i)} and cortical responses {RV1(i)} to such stimuli were recorded. Electrical patterns {RTh(i)*} resembling {RTh(i)} were then injected into the visual thalamus to obtain cortical responses {RV1(i)*} similar to {RV1(i)}. Visually- and electrically generated V1 responses were compared.

RESULTS

During the course of this work we: (i) characterized the response of V1 neurons to visual stimuli according to response magnitude, duration, spiking rate, and the distribution of interspike intervals; (ii) experimentally tested the dependence of V1 responses on stimulation parameters such as intensity, frequency, duration, etc., and determined the ranges of these parameters generating the desired cortical activity; (iii) identified similarities between responses of V1 useful to compare the naturally and artificially generated neuronal activity of V1; and (iv) by modifying the stimulation parameters, we generated artificial V1 responses similar to those elicited by visual stimuli. Generation of predictable and consistent phosphenes by means of artificial stimulation of the LGN is important for the feasibility of visual prostheses. Here we proved that electrical stimuli to the LGN can generate V1 neural responses that resemble those elicited by natural visual stimuli.

Building the bionic eye: an emerging reality and opportunity

Once the topic of folklore and science fiction, the notion of restoring vision to the blind is now approaching a tractable reality. Technological advances have inspired numerous multidisciplinary groups worldwide to develop visual neuroprosthetic devices that could potentially provide useful vision and improve the quality of life of profoundly blind individuals. While a variety of approaches and designs are being pursued, they all share a common principle of creating visual percepts through the stimulation of visual neural elements using appropriate patterns of electrical stimulation. Human clinical trials are now well underway and initial results have been met with a balance of excitement and cautious optimism. As remaining technical and surgical challenges continue to be solved and clinical trials move forward, we now enter a phase of development that requires careful consideration of a new set of issues. Establishing appropriate patient selection criteria, methods of evaluating long-term performance and effectiveness, and strategies to rehabilitate implanted patients will all need to be considered in order to achieve optimal outcomes and establish these devices as viable therapeutic options.

Viability of the inner retina in a novel mouse model of retinitis pigmentosa

Retinal prostheses aim to restore vision to patients who are blind from photoreceptor diseases such as Retinitis Pigmentosa (RP). All implants target the neural cells in the inner retina, the retinal ganglion cells (RGCs). Our research focuses on further understanding the disease process of RP during mid to late stages when total loss of photoreceptors has occurred and significant remodeling of inner retinal neurons has taken place. We have used a novel transgenic mouse, Rd1-FTL, to observe different degenerative stages of RP. Notably, in the aged retina we have evidence that there was gross inner retinal remodeling as well as glial dysfunction that occurred in confined regions in the central retina that worsened overtime. Consequently, the timing of implantation and location of the prosthesis both need to account for the state of the retina at different stages in the disease process.

Artificial neural interfaces for bionic cardiovascular treatments

An artificial nerve, in the broad sense, may be conceptualized as a physical and logical interface system that reestablishes the information traffic between the central nervous system and peripheral organs. Studies on artificial nerves targeting the autonomic nervous system are in progress to explore new treatment strategies for several cardiovascular diseases. In this article, we will review our research targeting the autonomic nervous system to treat cardiovascular diseases. First, we identified the rule for decoding native sympathetic nerve activity into a heart rate using transfer function analysis, and established a framework for a neurally regulated cardiac pacemaker. Second, we designed a bionic baroreflex system to restore the baroreflex buffering function using electrical stimulation of the celiac ganglion in a rat model of orthostatic hypotension. Third, based on the hypothesis that autonomic imbalance aggravates chronic heart failure, we implanted a neural interface into the right vagal nerve and demonstrated that intermittent vagal stimulation significantly improved the survival rate in rats with chronic heart failure following myocardial infarction. Although several practical problems need to be resolved, such as those relating to the development of electrodes feasible for long-term nerve activity recording, studies of artificial neural interfaces with the autonomic nervous system have great possibilities in the field of cardiovascular treatment. We expect further development of artificial neural interfaces as novel strategies to cope with cardiovascular diseases resistant to conventional therapeutics.

Brain-machine interactions for assessing the dynamics of neural systems

A critical advance for brain–machine interfaces is the establishment of bi-directional communications between the nervous system and external devices. However, the signals generated by a population of neurons are expected to depend in a complex way upon poorly understood neural dynamics. We report a new technique for the identification of the dynamics of a neural population engaged in a bi-directional interaction with an external device. We placed in vitro preparations from the lamprey brainstem in a closed-loop interaction with simulated dynamical devices having different numbers of degrees of freedom. We used the observed behaviors of this composite system to assess how many independent parameters − or state variables − determine at each instant the output of the neural system. This information, known as the dynamical dimension of a system, allows predicting future behaviors based on the present state and the future inputs. A relevant novelty in this approach is the possibility to assess a computational property – the dynamical dimension of a neuronal population – through a simple experimental technique based on the bi-directional interaction with simulated dynamical devices. We present a set of results that demonstrate the possibility of obtaining stable and reliable measures of the dynamical dimension of a neural preparation.

A non-invasive retinal prosthesis - testing the concept

We have developed a testing platform for a novel type of retinal prosthesis. Our system uses an array of light sources as non-contact stimulators. The platform consists of an imaging system based on a CMOS camera, PC based image processing, and a stimulation address system carried out on a Field Programmable Gated Array which addresses a matrix array of LEDs. Special optics are used to focus the light from the LED array onto light sensitized cells.

Brain-computer interface systems: progress and prospects

Brain-computer interface (BCI) systems support communication through direct measures of neural activity without muscle activity. BCIs may provide the best and sometimes the only communication option for users disabled by the most severe neuromuscular disorders and may eventually become useful to less severely disabled and/or healthy individuals across a wide range of applications. This review discusses the structure and functions of BCI systems, clarifies terminology and addresses practical applications. Progress and opportunities in the field are also identified and explicated.

Retinal neurostimulator for a multifocal vision prosthesis

A neurostimulator application-specific integrated circuit (ASIC) with scalable circuitry that can stimulate 14 channels, has been developed for an epi-retinal vision prosthesis. This ASIC was designed to allow seven identical units to be connected to control up to 98 channels, with the ability to stimulate 14 electrodes simultaneously. The neurostimulator forms part of a vision prosthesis, designed to restore vision to patients who have lost their sight due to retinal diseases such as retinitis pigmentosa and macular degeneration. For charge balance, the neurostimulator was designed to stimulate with current sources and sinks operating together, and with the ability to drive a hexagonal mosaic of electrodes to reduce the electrical crosstalk that occurs when multiple bipolar stimulation sites are active simultaneously. A hexagonal mosaic of electrodes surrounds each stimulation site and has been shown to effectively isolate each site, increasing the ability to inject localized independent charge into multiple regions simultaneously.

'Who is the ideal candidate?': decisions and issues relating to visual neuroprosthesis development, patient testing and neuroplasticity

Appropriate delivery of electrical stimulation to intact visual structures can evoke patterned sensations of light in individuals who have been blind for many years. This pivotal finding has lent credibility to the concept of restoring functional vision by artificial means. As numerous groups worldwide pursue human clinical testing with visual prosthetic devices, it is becoming increasingly clear that there remains a considerable gap between the challenges of prosthetic device development and the rehabilitative strategies needed to implement this new technology in patients. An important area of future work will be the development of appropriate pre- and post-implantation measures of performance and establishing candidate selection criteria in order to quantify technical advances, guide future device design and optimize therapeutic success. We propose that the selection of an 'ideal' candidate should also be considered within the context of the variable neuroplastic changes that follow vision loss. Specifically, an understanding of the adaptive and compensatory changes that occur within the brain could assist in guiding the development of post-implantation rehabilitative strategies and optimize behavioral outcomes.

Retinal charge sensitivity and spatial discrimination obtainable by subretinal implants: key lessons learned from isolated chicken retina

In order to obtain functional parameters relevant to the designing of a subretinal implant, we carried out electrical stimulation experiments with isolated chicken retina. The median threshold for network activation with planar disc electrodes (diameter 10 microm) was 0.5 nC (625 microC cm(-2)) for anodal voltage impulses and 1.6 nC (2 mC cm(-2)) for cathodal impulses. Above threshold, the number of spikes evoked by a single voltage impulse increased up to saturation within a range of injected charge from 0.1 nC to 1 nC for anodal impulses and from 1 nC to 10 nC for cathodal impulses. Using needle electrodes with a tip diameter of 1 microm, we determined the electrical point spread function (EPSF) for subretinal stimulation. It had a half width in the range of 100 microm, which corresponds to a visual angle of 21' and to a visual acuity of 20/417 in the human eye. It is reasonable to conclude that with subretinal implants the minimum separable will be of the same dimension.

Thresholds for activation of rabbit retinal ganglion cells with a subretinal electrode

The ultimate success of a retinal prosthesis to create vision will likely depend upon developing a base of knowledge of how best to electrically stimulate the retina. Previously, we studied the responses of rabbit retinal ganglion cells (RGCs) to current pulses applied with an electrode placed on the epiretinal surface. In the present study, we examined the responses of rabbit RGCs to current pulses applied with a subretinal electrode. Single-unit extracellular recordings were made from OFF RGCs and ON RGCs in isolated retinas, which were stimulated with monophasic current pulses (0.1-50ms in duration), delivered through a 500-mum diameter electrode. All RGCs elicited one or more bursts of action potentials upon electrical stimulation of the retina. The timing of the bursts depended upon both the polarity of the electrical stimulus and the RGC type. With near-threshold current pulses, the response latencies of OFF RGCs to anodal stimulation were comparable to those of ON RGCs to cathodal stimulation, whereas the response latencies of OFF RGCs to cathodal stimulation were comparable to those of ON RGCs to anodal stimulation. Threshold currents for activation of RGCs decreased with increased pulse duration. For OFF RGCs, threshold currents for cathodal current pulses were, on average, 2-7.5 times higher (depending upon pulse duration) than the threshold currents for anodal current pulses. For ON RGCs, threshold currents for cathodal and anodal current pulses were, on average, nearly identical for all pulse durations and were equivalent to threshold currents of OFF RGCs to anodal stimulation. With respect to a subretinal prosthesis, our findings suggest the possibility that cathodal current pulses may bias activation of ON RGCs in blind patients.