Closed-loop optogenetic control of the dynamics of neural activity in non-human primates

Electrical neurostimulation is effective in the treatment of neurological disorders, but associated recording artefacts generally limit its applications to open-loop stimuli. Real-time and continuous closed-loop control of brain activity can, however, be achieved by pairing concurrent electrical recordings and optogenetics. Here we show that closed-loop optogenetic stimulation with excitatory opsins enables the precise manipulation of neural dynamics in brain slices from transgenic mice and in anaesthetized non-human primates. The approach generates oscillations in quiescent tissue, enhances or suppresses endogenous patterns in active tissue and modulates seizure-like bursts elicited by the convulsant 4-aminopyridine. A nonlinear model of the phase-dependent effects of optical stimulation reproduced the modulation of cycles of local-field potentials associated with seizure oscillations, as evidenced by the systematic changes in the variability and entropy of the phase-space trajectories of seizures, which correlated with changes in their duration and intensity. We also show that closed-loop optogenetic neurostimulation could be delivered using intracortical optrodes incorporating light-emitting diodes. Closed-loop optogenetic approaches may be translatable to therapeutic applications in humans.

A Closed-Loop Optogenetic Platform

Neuromodulation is an established treatment for numerous neurological conditions, but to expand the therapeutic scope there is a need to improve the spatial, temporal and cell-type specificity of stimulation. Optogenetics is a promising area of current research, enabling optical stimulation of genetically-defined cell types without interfering with concurrent electrical recording for closed-loop control of neural activity. We are developing an open-source system to provide a platform for closed-loop optogenetic neuromodulation, incorporating custom integrated circuitry for recording and stimulation, real-time closed-loop algorithms running on a microcontroller and experimental control via a PC interface. We include commercial components to validate performance, with the ultimate aim of translating this approach to humans. In the meantime our system is flexible and expandable for use in a variety of preclinical neuroscientific applications. The platform consists of a Controlling Abnormal Network Dynamics using Optogenetics (CANDO) Control System (CS) that interfaces with up to four CANDO headstages responsible for electrical recording and optical stimulation through custom CANDO LED optrodes. Control of the hardware, inbuilt algorithms and data acquisition is enabled via the CANDO GUI (Graphical User Interface). Here we describe the design and implementation of this system, and demonstrate how it can be used to modulate neuronal oscillations in vitro and in vivo.

What is Ultrasound Can and Cannot Do in The Communication of Biomedical Implanted Medical Devices

Modern Active Medical Implantable Devices require communications to transmit information to the outside world or other implantable sub-systems. This can include physiological data, diagnostics, and parameters to optimise the therapeutic protocol. The available options are to use optical, radiofrequency, or ultrasonic communications. However, in all cases, transmission becomes more difficult with deeper transmission through tissue. Challenges include absorption and scattering by tissue, and the need to ensure there are no undesirable heating effects. As such, this paper aims to review research progress in using ultrasound as an alternative for deep tissue communications. We provide an empirical review of the technology and communication protocols that different groups have used, as well as comparing the implications in terms of penetration depth, implant size, and data rate. We conclude that this technique has promise for deeper implants and for intrabody communications between implantable devices (intrabody networks).

Detection of Simulated Tactile Gratings by Electro-Static Friction Show a Dependency on Bar Width for Blind and Sighted Observers, and Preliminary Neural Correlates in Sighted Observers

The three-dimensional micro-structure of physical surfaces produces frictional forces that provide sensory cues about properties of felt surfaces such as roughness. This tactile information activates somatosensory cortices, and frontal and temporal brain regions. Recent advances in haptic-feedback technologies allow the simulation of surface micro-structures via electro-static friction to produce touch sensations on otherwise flat screens. These sensations may benefit those with visual impairment or blindness. The primary aim of the current study was to test blind and sighted participants' perceptual sensitivity to simulated tactile gratings. A secondary aim was to explore which brain regions were involved in simulated touch to further understand the somatosensory brain network for touch. We used a haptic-feedback touchscreen which simulated tactile gratings using digitally manipulated electro-static friction. In Experiment 1, we compared blind and sighted participants' ability to detect the gratings by touch alone as a function of their spatial frequency (bar width) and intensity. Both blind and sighted participants showed high sensitivity to detect simulated tactile gratings, and their tactile sensitivity functions showed both linear and quadratic dependency on spatial frequency. In Experiment 2, using functional magnetic resonance imaging, we conducted a preliminary investigation to explore whether brain activation to physical vibrations correlated with blindfolded (but sighted) participants' performance with simulated tactile gratings outside the scanner. At the neural level, blindfolded (but sighted) participants' detection performance correlated with brain activation in bi-lateral supplementary motor cortex, left frontal cortex and right occipital cortex. Taken together with previous studies, these results suggest that there are similar perceptual and neural mechanisms for real and simulated touch sensations.

A novel hybrid technique to fabricate silicon-based micro-implants with near defect-free quality for neuroprosthetics application

This paper introduces a new hybrid microfabrication technique which combines ultra-precision micro-milling and a ductile sacrificial material deposition process to fabricate a silicon-based implant for neuroprosthetics applications with near defect-free quality at several hundreds of micrometres in thickness. The sacrificial materials can influence the quality of silicon during machining. The cutting mechanism and feasibility of the hybrid technique are studied by molecular dynamics (MD) simulations and experiments. Due to the complexity of modelling PMMA and SU-8 structures in MD environment, only copper was modelled as the simulation is intended to understand the performance of using a ductile sacrificial layer structure in silicon machining. MD analysis shows that the reduced stress intensity and subsurface damage were mainly attributed to workpiece plasticity enhancement, where its mechanism was contributed by better deformability of the ductile sacrificial layer and enhanced thermal softening from the heat generated by the high interfacial stress between the sacrificial layer and silicon substrate. Despite the MD simulation and experiment having different machining scale in terms of cutting parameters, phenomenal behaviours of the cutting performance when observed under the experimental conditions are in good agreement with simulation. Experimental verification shows that near defect-free quality was achieved at large cutting depth of 150 μm when silicon is coated either with PMMA or SU-8. An exemplary implant structure was also fabricated to better demonstrate the hybrid technique's capability. In addition, the hybrid technique will be beneficial for low volume high customisation applications as it is a serial process.

The Neural Engine: A Reprogrammable Low Power Platform for Closed-Loop Optogenetics

Brain-machine Interfaces (BMI) hold great potential for treating neurological disorders such as epilepsy. Technological progress is allowing for a shift from open-loop, pacemaker-class, intervention towards fully closed-loop neural control systems. Low power programmable processing systems are therefore required which can operate within the thermal window of 2° C for medical implants and maintain long battery life. In this work, we have developed a low power neural engine with an optimized set of algorithms which can operate under a power cycling domain. We have integrated our system with a custom-designed brain implant chip and demonstrated the operational applicability to the closed-loop modulating neural activities in in-vitro and in-vivo brain tissues: the local field potentials can be modulated at required central frequency ranges. Also, both a freely-moving non-human primate (24-hour) and a rodent (1-hour) in-vivo experiments were performed to show system reliable recording performance. The overall system consumes only 2.93 mA during operation with a biological recording frequency 50 Hz sampling rate (the lifespan is approximately 56 hours). A library of algorithms has been implemented in terms of detection, suppression and optical intervention to allow for exploratory applications in different neurological disorders. Thermal experiments demonstrated that operation creates minimal heating as well as battery performance exceeding 24 hours on a freely moving rodent. Therefore, this technology shows great capabilities for both neuroscience in-vitro/in-vivo applications and medical implantable processing units.

Wireless Ultrasonic Communication for Biomedical Injectable Implantable Device

This paper presents a design and implementation of an ultrasonic wireless communication link for an injectable biomedical implanted device. The results address how the ultrasound link encounter from the multiple paths propagation effect. The ultrasound link characterized in term of channel impulse response and power transmission losses against the depth of the implant, the achieved data transmission rate was 70 Kbps and the signal to noise ratio was (30, 35 and 47) dB at a transmission voltage of (1.8, 3.3 and 20) V peak to peak in 12 cm depth. The transmission loss increases as the depth of the implant increases. The ultrasound link represented by two piezoelectric transducers that operate in 320 KHz radial resonance frequency.

Modelling Optogenetic Subthreshold Effects

We develop a system-level approach to modelling optogenetic-neurons firing behaviour in in-vivo conditions. This approach contains three sub-modules: 1) a Mie/Rayleigh scattering mode of light penetration in tissue; 2) a classic likelihood Poisson spiking train model; 3) a 4-state model of the Channelrhodopsin-2 (ChR2) channel added to a CA3 neuron Hodgkin-Huxley model. We first investigate opto-neurons lightto-spike mechanisms in an in-vivo model: the background noise (synaptic currents) play a dominant role in generating spikes rather than light intensities as for in-vitro conditions (Typically the required light intensity is less than 0.3 mW/mm² for in-vivo). Then the spiking fidelity is analyzed for different background noise levels. Next, by combining light penetration profiles, we show how neuron firing rates decay as tissue distance increases, for a 2D dimensional cross-section. This preliminary data clearly demonstrate that at given light stimulation protocol, the maximum effected distance in-vivo is 250 μm with small frequency decay rates, while for in-vitro is 50μm with considerable frequency decay rates. Therefore, the developed model can be used for designing sensible light stimulation strategies in-vivo and opto-electronics systems.

Comparison between Different Optical Systems for Optogenetics based Head Mounted Device for Retina Pigmentosa

Optogenetics is a fast growing neuromodulation techniques as it can remotely stimulate neural activities of a genetically modified cells. The advantage of remotely controlling the neural activity triggered researchers to implement a headset to externally stimulate retina cells for people with retina pigmentosa. The wearable device requires an efficient optical system to focus the transmitted light pattern into the retina surface. In this work, three different lenses; contact lens, folded prism and linear lenses are used to evaluate the headset performance. A 90x90 μLED display is used as a light source and the optical efficiency for each lens is measured for different points over the lens area. Moreover, the impact of each lens on the headset performance in power and processing will be discussed in this work.

Ultrasound Intra Body Multi Node Communication System for Bioelectronic Medicine

The coming years may see the advent of distributed implantable devices to support bioelectronic medicinal treatments. Communication between implantable components and between deep implants and the outside world can be challenging. Percutaneous wired connectivity is undesirable and both radiofrequency and optical methods are limited by tissue absorption and power safety limits. As such, there is a significant potential niche for ultrasound communications in this domain. In this paper, we present the design and testing of a reliable and efficient ultrasonic communication telemetry scheme using piezoelectric transducers that operate at 320 kHz frequency. A key challenge results from the multi-propagation path effect. Therefore, we present a method, using short pulse sequences with relaxation intervals. To counter an increasing bit, and thus packet, error rate with distance, we have incorporated an error correction encoding scheme. We then demonstrate how the communication scheme can scale to a network of implantable devices. We demonstrate that we can achieve an effective, error-free, data rate of 0.6 kbps, which is sufficient for low data rate bioelectronic medicine applications. Transmission can be achieved at an energy cost of 642 nJ per bit data packet using on/off power cycling in the electronics.

A high-performance 8 nV/√Hz 8-channel wearable and wireless system for real-time monitoring of bioelectrical signals

BACKGROUND

It is widely accepted by the scientific community that bioelectrical signals, which can be used for the identification of neurophysiological biomarkers indicative of a diseased or pathological state, could direct patient treatment towards more effective therapeutic strategies. However, the design and realisation of an instrument that can precisely record weak bioelectrical signals in the presence of strong interference stemming from a noisy clinical environment is one of the most difficult challenges associated with the strategy of monitoring bioelectrical signals for diagnostic purposes. Moreover, since patients often have to cope with the problem of limited mobility being connected to bulky and mains-powered instruments, there is a growing demand for small-sized, high-performance and ambulatory biopotential acquisition systems in the Intensive Care Unit (ICU) and in High-dependency wards. Finally, to the best of our knowledge, there are no commercial, small, battery-powered, wearable and wireless recording-only instruments that claim the capability of recording electrocorticographic (ECoG) signals.

METHODS

To address this problem, we designed and developed a low-noise (8 nV/√Hz), eight-channel, battery-powered, wearable and wireless instrument (55 × 80 mm2). The performance of the realised instrument was assessed by conducting both ex vivo and in vivo experiments.

RESULTS

To provide ex vivo proof-of-function, a wide variety of high-quality bioelectrical signal recordings are reported, including electroencephalographic (EEG), electromyographic (EMG), electrocardiographic (ECG), acceleration signals, and muscle fasciculations. Low-noise in vivo recordings of weak local field potentials (LFPs), which were wirelessly acquired in real time using segmented deep brain stimulation (DBS) electrodes implanted in the thalamus of a non-human primate, are also presented.

CONCLUSIONS

The combination of desirable features and capabilities of this instrument, namely its small size (~one business card), its enhanced recording capabilities, its increased processing capabilities, its manufacturability (since it was designed using discrete off-the-shelf components), the wide bandwidth it offers (0.5-500 Hz) and the plurality of bioelectrical signals it can precisely record, render it a versatile and reliable tool to be utilized in a wide range of applications and environments.

A current-mode system to self-measure temperature on implantable optoelectronics

BACKGROUND

One of the major concerns in implantable optoelectronics is the heat generated by emitters such as light emitting diodes (LEDs). Such devices typically produce more heat than light, whereas medical regulations state that the surface temperature change of medical implants must stay below + 2 °C. The LED's reverse current can be employed as a temperature-sensitive parameter to measure the temperature change at the implant's surface, and thus, monitor temperature rises. The main challenge in this approach is to bias the LED with a robust voltage since the reverse current is strongly and nonlinearly sensitive to the bias voltage.

METHODS

To overcome this challenge, we have developed an area-efficient LED-based temperature sensor using the LED as its own sensor and a CMOS electronic circuit interface to ensure stable bias and current measurement. The circuit utilizes a second-generation current conveyor (CCII) configuration to achieve this and has been implemented in 0.35 μm CMOS technology.

RESULTS

The developed circuits have been experimentally characterized, and the temperature-sensing functionality has been tested by interfacing different mini-LEDs in saline models of tissue prior to in vivo operation. The experimental results show the functionality of the CMOS electronics and the efficiency of the CCII-based technique with an operational frequency up to 130 kHz in achieving a resolution of 0.2 °C for the surface temperature up to + 45 °C.

CONCLUSIONS

We developed a robust CMOS current-mode sensor interface which has a reliable CCII to accurately convey the LED's reverse current. It is low power and robust against power supply ripple and transistor mismatch which makes it reliable for sensor interface. The achieved results from the circuit characterization and in vivo experiments show the feasibility of the whole sensor interface in monitoring the tissue surface temperature in optogenetics.

A high-performance 4 nV (√Hz)-1 analog front-end architecture for artefact suppression in local field potential recordings during deep brain stimulation

OBJECTIVE

Recording of local field potentials (LFPs) during deep brain stimulation (DBS) is necessary to investigate the instantaneous brain response to stimulation, minimize time delays for closed-loop neurostimulation and maximise the available neural data. To our knowledge, existing recording systems lack the ability to provide artefact-free high-frequency (>100 Hz) LFP recordings during DBS in real time primarily because of the contamination of the neural signals of interest by the stimulation artefacts.

APPROACH

To solve this problem, we designed and developed a novel, low-noise and versatile analog front-end (AFE) that uses a high-order (8th) analog Chebyshev notch filter to suppress the artefacts originating from the stimulation frequency. After defining the system requirements for concurrent LFP recording and DBS artefact suppression, we assessed the performance of the realised AFE by conducting both in vitro and in vivo experiments using unipolar and bipolar DBS (monophasic pulses, amplitude ranging from 3 to 6 V peak-to-peak, frequency 140 Hz and pulse width 100 µs). A full performance comparison between the proposed AFE and an identical AFE, equipped with an 8th order analog Bessel notch filter, was also conducted.

MAIN RESULTS

A high-performance, 4 nV ([Formula: see text])^-1 AFE that is capable of recording nV-scale signals was designed in accordance with the imposed specifications. Under both in vitro and in vivo experimental conditions, the proposed AFE provided real-time, low-noise and artefact-free LFP recordings (in the frequency range 0.5-250 Hz) during stimulation. Its sensing and stimulation artefact suppression capabilities outperformed the capabilities of the AFE equipped with the Bessel notch filter.

SIGNIFICANCE

The designed AFE can precisely record LFP signals, in and without the presence of either unipolar or bipolar DBS, which renders it as a functional and practical AFE architecture to be utilised in a wide range of applications and environments. This work paves the way for the development of externalized research tools for closed-loop neuromodulation that use low- and higher-frequency LFPs as control signals.

Self-sensing of temperature rises on light emitting diode based optrodes

Objective. This work presents a method to determine the surface temperature of microphotonic medical implants like LEDs. Our inventive step is to use the photonic emitter (LED) employed in an implantable device as its own sensor and develop readout circuitry to accurately determine the surface temperature of the device. Approach. There are two primary classes of applications where microphotonics could be used in implantable devices; opto-electrophysiology and fluorescence sensing. In such scenarios, intense light needs to be delivered to the target. As blue wavelengths are scattered strongly in tissue, such delivery needs to be either via optic fibres, two-photon approaches or through local emitters. In the latter case, as light emitters generate heat, there is a potential for probe surfaces to exceed the 2 °C regulatory. However, currently, there are no convenient mechanisms to monitor this in situ. Main results. We present the electronic control circuit and calibration method to monitor the surface temperature change of implantable optrode. The efficacy is demonstrated in air, saline, and brain. Significance. This paper, therefore, presents a method to utilize the light emitting diode as its own temperature sensor.

Design Considerations for Artefact-Free Optoelectronic Systems

This paper proposes design considerations that need to be followed in order to eliminate potential sources of artefact that could distort a recorded neural signal. The artefact that appears in a recorded signal has a combination of potential sources each of which contributes towards its formation. As such, these sources of artefact have been addressed in three main categories: a) electronics artefact, b) encapsulation artefact and c) interface artefact. Each source (component) is analyzed further and appropriate design techniques and considerations are suggested towards its mitigation.

Opto-electro-thermal optimization of photonic probes for optogenetic neural stimulation

Implantable photonic probes are of increasing interest to the field of biophotonics and in particular, optogenetic neural stimulation. Active probes with onboard light emissive elements allow for electronic multiplexing and can be manufactured through existing microelectronics methods. However, as the optogenetics field moves towards clinical practice, an important question arises as to whether such probes will cause excessive thermal heating of the surrounding tissue. Light emitting diodes typically produce more heat than light. The resultant temperature rise of the probe surface therefore needs to be maintained under the regulatory limit of 2°C. This work combines optical and thermal modelling, which have been experimental verified. Analysis has been performed on the effect of probe/emitter geometries, emitter, and radiance requirements. Finally, the effective illumination volume has been calculated within thermal limits for different probe emitter types and required thresholds.

A head mounted device stimulator for optogenetic retinal prosthesis

Objective. Our main objective is to demonstrate that compact high radiance gallium nitride displays can be used with conventional virtual reality optics to stimulate an optogenetic retina. Hence, we aim to introduce a non-invasive approach to restore vision for people with conditions such as retinitis pigmentosa where there is a remaining viable communication link between the retina and the visual cortex. Approach. We design and implement the headset using a high-density µLED matrix, Raspberry Pi, microcontroller from NXP and virtual reality lens. Then, a test platform is developed to evaluate the performance of the headset and the optical system. Furthermore, image simplification algorithms are used to simplify the scene to be sent to the retina. Moreover, in vivo evaluation of the genetically modified retina response at different light intensity is discussed to prove the reliability of the proposed system. Main results. We demonstrate that in keeping with regulatory guidance, the headset displays need to limit their luminance to 90 kcd m⁻². We demonstrate an optical system with 5.75% efficiency which allows for 0.16 mW mm⁻² irradiance on the retina within the regulatory guidance, but which is capable of an average peak irradiance of 1.35 mW mm⁻². As this is lower than the commonly accepted threshold for channelrhodopsin-2, we demonstrate efficacy through an optical model of an eye onto a biological retina. Significance. We demonstrate a fully functional 8100-pixel headset system including software/hardware which can operate on a standard consumer battery for periods exceeding a 24 h recharge cycle. The headset is capable of delivering enough light to stimulate the genetically modified retina cells and also keeping the amount of light below the regulation threshold for safety.

A Scalable Optoelectronic Neural Probe Architecture With Self-Diagnostic Capability

There is a growing demand for the development of new types of implantable optoelectronics to support both basic neuroscience and optogenetic treatments for neurological disorders. Target specification requirements include multi-site optical stimulation, programmable radiance profile, safe operation, and miniaturization. It is also preferable to have a simple serial interface rather than large numbers of control lines. This paper demonstrates an optrode structure comprising of a standard complementary metal-oxide-semiconductor process with 18 optical stimulation drivers. Furthermore, diagnostic sensing circuitry is incorporated to determine the long-term functionality of the photonic elements. A digital control system is incorporated to allow independent multisite control and serial communication with external control units.

On-Probe Neural Interface ASIC for Combined Electrical Recording and Optogenetic Stimulation

Neuromodulation technologies are progressing from pacemaking and sensory operations to full closed-loop control. In particular, optogenetics-the genetic modification of light sensitivity into neural tissue allows for simultaneous optical stimulation and electronic recording. This paper presents a neural interface application-specified integrated circuit (ASIC) for intelligent optoelectronic probes. The architecture is designed to enable simultaneous optical neural stimulation and electronic recording. It provides four low noise (2.08  μV) recording channels optimized for recording local field potentials (LFPs) (0.1-300 Hz bandwidth, 5 mV range, sampled 10-bit@4 kHz), which are more stable for chronic applications. For stimulation, it provides six independently addressable optical driver circuits, which can provide both intensity (8-bit resolution across a 1.1 mA range) and pulse-width modulation for high-radiance light emitting diodes (LEDs). The system includes a fully digital interface using a serial peripheral interface (SPI) protocol to allow for use with embedded controllers. The SPI interface is embedded within a finite state machine (FSM), which implements a command interpreter that can send out LFP data whilst receiving instructions to control LED emission. The circuit has been implemented in a commercially available 0.35  μm CMOS technology occupying a 1.95 mm 1.10 mm footprint for mounting onto the head of a silicon probe. Measured results are given for a variety of bench-top, in vitro and in vivo experiments, quantifying system performance and also demonstrating concurrent recording and stimulation within relevant experimental models.

A low power flash-FPGA based brain implant micro-system of PID control

In this paper, we demonstrate that a low power flash FPGA based micro-system can provide a low power programmable interface for closed-loop brain implant inter- faces. The proposed micro-system receives recording local field potential (LFP) signals from an implanted probe, performs closed-loop control using a first order control system, then converts the signal into an optogenetic control stimulus pattern. Stimulus can be implemented through optoelectronic probes. The long term target is for both fundamental neuroscience applications and for clinical use in treating epilepsy. Utilizing our device, closed-loop processing consumes only 14nJ of power per PID cycle compared to 1.52μJ per cycle for a micro-controller implementation. Compared to an application specific digital integrated circuit, flash FPGA's are inherently programmable.

Deep learning-based artificial vision for grasp classification in myoelectric hands

OBJECTIVE

Computer vision-based assistive technology solutions can revolutionise the quality of care for people with sensorimotor disorders. The goal of this work was to enable trans-radial amputees to use a simple, yet efficient, computer vision system to grasp and move common household objects with a two-channel myoelectric prosthetic hand.

APPROACH

We developed a deep learning-based artificial vision system to augment the grasp functionality of a commercial prosthesis. Our main conceptual novelty is that we classify objects with regards to the grasp pattern without explicitly identifying them or measuring their dimensions. A convolutional neural network (CNN) structure was trained with images of over 500 graspable objects. For each object, 72 images, at [Formula: see text] intervals, were available. Objects were categorised into four grasp classes, namely: pinch, tripod, palmar wrist neutral and palmar wrist pronated. The CNN setting was first tuned and tested offline and then in realtime with objects or object views that were not included in the training set.

MAIN RESULTS

The classification accuracy in the offline tests reached [Formula: see text] for the seen and [Formula: see text] for the novel objects; reflecting the generalisability of grasp classification. We then implemented the proposed framework in realtime on a standard laptop computer and achieved an overall score of [Formula: see text] in classifying a set of novel as well as seen but randomly-rotated objects. Finally, the system was tested with two trans-radial amputee volunteers controlling an i-limb Ultra^TM prosthetic hand and a motion control^TM prosthetic wrist; augmented with a webcam. After training, subjects successfully picked up and moved the target objects with an overall success of up to [Formula: see text]. In addition, we show that with training, subjects' performance improved in terms of time required to accomplish a block of 24 trials despite a decreasing level of visual feedback.

SIGNIFICANCE

The proposed design constitutes a substantial conceptual improvement for the control of multi-functional prosthetic hands. We show for the first time that deep-learning based computer vision systems can enhance the grip functionality of myoelectric hands considerably.

High Density, High Radiance $\mu$ LED Matrix for Optogenetic Retinal Prostheses and Planar Neural Stimulation

Optical neuron stimulation arrays are important for both in-vitro biology and retinal prosthetic biomedical applications. Hence, in this work, we present an 8100 pixel high radiance photonic stimulator. The chip module vertically combines custom made gallium nitride μ LEDs with a CMOS application specific integrated circuit. This is designed with active pixels to ensure random access and to allow continuous illumination of all required pixels. The μLEDs have been assembled on the chip using a solder ball flip-chip bonding technique which has allowed for reliable and repeatable manufacture. We have evaluated the performance of the matrix by measuring the different factors including the static, dynamic power consumption, the illumination, and the current consumption by each LED. We show that the power consumption is within a range suitable for portable use. Finally, the thermal behavior of the matrix is monitored and the matrix proved to be thermally stable.

Optogenetics in Silicon: A Neural Processor for Predicting Optically Active Neural Networks

We present a reconfigurable neural processor for real-time simulation and prediction of opto-neural behaviour. We combined a detailed Hodgkin-Huxley CA3 neuron integrated with a four-state Channelrhodopsin-2 (ChR2) model into reconfigurable silicon hardware. Our architecture consists of a Field Programmable Gated Array (FPGA) with a custom-built computing data-path, a separate data management system and a memory approach based router. Advancements over previous work include the incorporation of short and long-term calcium and light-dependent ion channels in reconfigurable hardware. Also, the developed processor is computationally efficient, requiring only 0.03 ms processing time per sub-frame for a single neuron and 9.7 ms for a fully connected network of 500 neurons with a given FPGA frequency of 56.7 MHz. It can therefore be utilized for exploration of closed loop processing and tuning of biologically realistic optogenetic circuitry.

Real-Time Simulation of Passage-of-Time Encoding in Cerebellum Using a Scalable FPGA-Based System

The cerebellum plays a critical role for sensorimotor control and learning. However, dysmetria or delays in movements' onsets consequent to damages in cerebellum cannot be cured completely at the moment. Neuroprosthesis is an emerging technology that can potentially substitute such motor control module in the brain. A pre-requisite for this to become practical is the capability to simulate the cerebellum model in real-time, with low timing distortion for proper interfacing with the biological system. In this paper, we present a frame-based network-on-chip (NoC) hardware architecture for implementing a bio-realistic cerebellum model with  ∼ 100 000 neurons, which has been used for studying timing control or passage-of-time (POT) encoding mediated by the cerebellum. The simulation results verify that our implementation reproduces the POT representation by the cerebellum properly. Furthermore, our field-programmable gate array (FPGA)-based system demonstrates excellent computational speed that it can complete 1sec real world activities within 25.6 ms. It is also highly scalable such that it can maintain approximately the same computational speed even if the neuron number increases by one order of magnitude. Our design is shown to outperform three alternative approaches previously used for implementing spiking neural network model. Finally, we show a hardware electronic setup and illustrate how the silicon cerebellum can be adapted as a potential neuroprosthetic platform for future biological or clinical application.

Blockade of pathological retinal ganglion cell hyperactivity improves optogenetically evoked light responses in rd1 mice

Retinitis pigmentosa (RP) is a progressive retinal dystrophy that causes visual impairment and eventual blindness. Retinal prostheses are the best currently available vision-restoring treatment for RP, but only restore crude vision. One possible contributing factor to the poor quality of vision achieved with prosthetic devices is the pathological retinal ganglion cell (RGC) hyperactivity that occurs in photoreceptor dystrophic disorders. Gap junction blockade with meclofenamic acid (MFA) was recently shown to diminish RGC hyperactivity and improve the signal-to-noise ratio (SNR) of RGC responses to light flashes and electrical stimulation in the rd10 mouse model of RP. We sought to extend these results to spatiotemporally patterned optogenetic stimulation in the faster-degenerating rd1 model and compare the effectiveness of a number of drugs known to disrupt rd1 hyperactivity. We crossed rd1 mice with a transgenic mouse line expressing the light-sensitive cation channel channelrhodopsin2 (ChR2) in RGCs, allowing them to be stimulated directly using high-intensity blue light. We used 60-channel ITO multielectrode arrays to record ChR2-mediated RGC responses from wholemount, ex-vivo retinas to full-field and patterned stimuli before and after application of MFA, 18-β-glycyrrhetinic acid (18BGA, another gap junction blocker) or flupirtine (Flu, a Kv7 potassium channel opener). All three drugs decreased spontaneous RGC firing, but 18BGA and Flu also decreased the sensitivity of RGCs to optogenetic stimulation. Nevertheless, all three drugs improved the SNR of ChR2-mediated responses. MFA also made it easier to discern motion direction of a moving bar from RGC population responses. Our results support the hypothesis that reduction of pathological RGC spontaneous activity characteristic in retinal degenerative disorders may improve the quality of visual responses in retinal prostheses and they provide insights into how best to achieve this for optogenetic prostheses.

Wireless data and power transfer of an optogenetic implantable visual cortex stimulator

In this paper, the wireless data and power transfer for a novel optogenetic visual cortex implant system was demonstrated by using pork tissue mimic in-vitro at the ISM 2.4 GHz and 13.5 MHz frequency band respectively. The observed data rate was 120 kbps with no loss in data for up to a thickness of 35 mm in both water & pork. To increase the power level of the implant a Class E power amplifier is separately designed and simulated for the transmitter end and has an output power of around 223 mW with an efficiency of 81.83%. The transferred power at the receiver was measured to be 66.80 mW for the pork tissue medium considering a distance of 5 mm between the transmitter and the receiver coils, with a coupling coefficient of ~0.8. This serves the power requirement of the visual cortex implant.

A scalable FPGA-based cerebellum for passage-of-time representation

The cerebellum plays a critical role for sensorimotor control and learning. However dysmertria or delays in movements' onsets consequent to damages in cerebellum cannot be cured completely at the moment. To foster a potential cure based on neuroprosthetic technology, we present a frame-based Network-on-Chip (NoC) hardware architecture for implementing a bio-realistic cerebellum model with 100,000 neurons, which has been used for studying timing control or passage-of-time (POT) encoding mediated by the cerebellum. The results demonstrate that our implementation can reproduce the POT functionality properly. The computational speed can achieve to 25.6 ms for simulating 1 sec real world activities. Furthermore, we show a hardware electronic setup and illustrate how the silicon cerebellum can be adapted as a potential neuroprosthetic platform for future biological or clinical applications.

FPGA design for dual-spectrum Visual Scene Preparation in retinal prosthesis

A method of Visual Scene Preparation for the patients suffering Retinitis Pigmentosa is implemented in hardware for the first time. The scene is captured with two cameras, one visible spectrum and one infra-red, in order to distinguish between the live and non-live objects. The live objects are subsequently emphasized in the output image, thus helping a patient to see the most significant detail with the healthy part of the retina. The implementation uses Verilog language and FPGA platform. A system prototype is analyzed and compared to MATLAB results.

Arrays of microLEDs and astrocytes: biological amplifiers to optogenetically modulate neuronal networks reducing light requirement

In the modern view of synaptic transmission, astrocytes are no longer confined to the role of merely supportive cells. Although they do not generate action potentials, they nonetheless exhibit electrical activity and can influence surrounding neurons through gliotransmitter release. In this work, we explored whether optogenetic activation of glial cells could act as an amplification mechanism to optical neural stimulation via gliotransmission to the neural network. We studied the modulation of gliotransmission by selective photo-activation of channelrhodopsin-2 (ChR2) and by means of a matrix of individually addressable super-bright microLEDs (μLEDs) with an excitation peak at 470 nm. We combined Ca2+ imaging techniques and concurrent patch-clamp electrophysiology to obtain subsequent glia/neural activity. First, we tested the μLEDs efficacy in stimulating ChR2-transfected astrocyte. ChR2-induced astrocytic current did not desensitize overtime, and was linearly increased and prolonged by increasing μLED irradiance in terms of intensity and surface illumination. Subsequently, ChR2 astrocytic stimulation by broad-field LED illumination with the same spectral profile, increased both glial cells and neuronal calcium transient frequency and sEPSCs suggesting that few ChR2-transfected astrocytes were able to excite surrounding not-ChR2-transfected astrocytes and neurons. Finally, by using the μLEDs array to selectively light stimulate ChR2 positive astrocytes we were able to increase the synaptic activity of single neurons surrounding it. In conclusion, ChR2-transfected astrocytes and μLEDs system were shown to be an amplifier of synaptic activity in mixed corticalneuronal and glial cells culture.

High-frequency limit of neural stimulation with ChR2

Optogenetic technology based on light activation of genetically targeted single component opsins such as Channelrhodopsin-2 (ChR2) has been changing the way neuroscience research is conducted. This technology is becoming increasingly important for neural engineering as well. The efficiency of neural stimulation with ChR2 drops at high frequencies, often before the natural limit of the neuron is reached. This study aims to investigate the underlying mechanisms that limit the efficiency of the stimulation at high frequencies. The study analyzes the dynamics of the spikes induced by ChR2 in comparison to control stimulations using patch clamp current injection. It shows that the stimulation dynamics is limited by two mechanisms: 1) a frequency independent reduction in the conductance-to-irradiance yield due to the ChR2 light adaptation process and 2) a frequency dependent reduction in the conductance-to-current yield due to a decrease in membrane re-polarization level between spikes that weakens the ionic driving force. The effect of the first mechanism can be minimized by using ChR2 mutants with lower irradiance threshold. In contrast the effect of the second mechanism is fundamentally limited by the rate the native ion channels re-polarize the membrane potential.

A processing platform for optoelectronic/optogenetic retinal prosthesis

The field of retinal prosthesis has been steadily developing over the last two decades. Despite the many obstacles, clinical trials for electronic approaches are in progress and already demonstrating some success. Optogenetic/optoelectronic retinal prosthesis may prove to have even greater capabilities. Although resolutions are now moving beyond recognition of simple shapes, it will nevertheless be poor compared to normal vision. If we define the aim to be to return mobility and natural scene recognition to the patient, it is important to maximize the useful visual information we attempt to transfer. In this paper, we highlight a method to simplify the scene, perform spatial image compression, and then apply spike coding. We then show the potential for translation on standard consumer processors. The algorithms are applicable to all forms of visual prosthesis, but we particularly focus on optogenetic approaches.

Modeling study of the light stimulation of a neuron cell with channelrhodopsin-2 mutants

Channelrhodopsin-2 (ChR2) has become a widely used tool for stimulating neurons with light. Nevertheless, the underlying dynamics of the ChR2-evoked spikes are still not yet fully understood. Here, we develop a model that describes the response of ChR2-expressing neurons to light stimuli and use the model to explore the light-to-spike process. We show that an optimal stimulation yield is achieved when the optical energies are delivered in short pulses. The model allows us to theoretically examine the effects of using various types of ChR2 mutants. We show that while increasing the lifetime and shuttering speed of ChR2 have limited effect, reducing the threshold irradiance by increased conductance will eliminate adaptation and allow constant dynamic range. The model and the conclusion presented in this study can help to interpret experimental results, design illumination protocols, and seek improvement strategies in the nascent optogenetic field.

A New Individually Addressable Micro-LED Array for Photogenetic Neural Stimulation

Here, we demonstrate the use of a micro light emitting diode (LED) array as a powerful tool for complex spatiotemporal control of photosensitized neurons. The array can generate arbitrary, 2-D, excitation patterns with millisecond and micrometer resolution. In particular, we describe an active matrix control address system to allow simultaneous control of 256 individual micro LEDs. We present the system optically integrated into a microscope environment and patch clamp electrophysiology. The results show that the emitters have sufficient radiance at the required wavelength to stimulate neurons expressing channelrhodopsin-2 (ChR2).

A stochastic model of the single photon response in Drosophila photoreceptors

We present a quantitative model for the phototransduction cascade in Drosophila photoreceptors. The process consists of four stages: (1) light absorption by Rhodopsin, (2) signal amplification phase mediated by a G-protein coupled cascade, (3) closed/open state kinetics of the transient receptor potential (TRP) ion channels which regulate the ionic current in/out of the cell and (4) Ca regulated positive and negative feedbacks. The model successfully reproduces the experimental results for: single photon absorption "quantum bump" (QB), statistical features for QB (average shape, peak current average value and variance, the latency distribution, etc.), arrestin mutant behaviour, low extracellular Ca(2+) cases, etc. The TRP channel activity is modeled by a Monod-Wyman-Changeux (MWC) model for allosteric interaction, instead of using the usual ad hoc Hill equation. This approach allows for a plausible physical explanation of how Ca/calmodulin regulate the protein activity. The cooperative nature of the TRP channel activation leads to "dark current" suppression at the output allowing for reliable detection of a single photon. Stochastic simulations were produced by using the standard rate equations combined with the Poisson distribution for generating random events from the forward and reverse reaction rates. Noise is inherent to the system but appears to be crucial for producing such reliable responses in this complex, highly non-linear system. The approach presented here may serve as a useful example how to treat complex cellular mechanisms underlying sensory processes.

Multi-site optical excitation using ChR2 and micro-LED array

Studying neuronal processes such as synaptic summation, dendritic physiology and neural network dynamics requires complex spatiotemporal control over neuronal activities. The recent development of neural photosensitization tools, such as channelrhodopsin-2 (ChR2), offers new opportunities for non-invasive, flexible and cell-specific neuronal stimulation. Previously, complex spatiotemporal control of photosensitized neurons has been limited by the lack of appropriate optical devices which can provide 2D stimulation with sufficient irradiance. Here we present a simple and powerful solution that is based on an array of high-power micro light-emitting diodes (micro-LEDs) that can generate arbitrary optical excitation patterns on a neuronal sample with micrometre and millisecond resolution. We first describe the design and fabrication of the system and characterize its capabilities. We then demonstrate its capacity to elicit precise electrophysiological responses in cultured and slice neurons expressing ChR2.

Multi-site optical excitation using ChR2 and micro-LED array

Studying neuronal processes such as synaptic summation, dendritic physiology and neural network dynamics requires complex spatiotemporal control over neuronal activities. The recent development of neural photosensitization tools, such as channelrhodopsin-2 (ChR2), offers new opportunities for non-invasive, flexible and cell-specific neuronal stimulation. Previously, complex spatiotemporal control of photosensitized neurons has been limited by the lack of appropriate optical devices which can provide 2D stimulation with sufficient irradiance. Here we present a simple and powerful solution that is based on an array of high-power micro light-emitting diodes (micro-LEDs) that can generate arbitrary optical excitation patterns on a neuronal sample with micrometre and millisecond resolution. We first describe the design and fabrication of the system and characterize its capabilities. We then demonstrate its capacity to elicit precise electrophysiological responses in cultured and slice neurons expressing ChR2.

Insertion experiments of a biologically inspired microtextured and multi-part probe based on reciprocal motion

While there have been significant advances in minimally invasive surgical instrumentation, the majority of tools still rely on a push from the back to aid insertion into the tissue, whether the process is manual or servo assisted. In this work, a novel approach to tool insertion is proposed which is based on the concept of a multi-part probe with at least three interlocking segments. By means of a sequential insertion process, where each segment is pushed further into the tissue while stabilized by the remaining stationary parts, the multi-part probe concept is shown to successfully "insinuate itself" within a synthetic soft tissue specimen without the need for an overall forward push. The presence of an anisotropic microtextured outer probe surface is also shown to affect the overall speed of insertion and can thus be used to optimize the interaction forces at the probe-tissue interface. A measured reduction in the force transferred to the back of the specimen also suggests that this approach to tool insertion may result in reduced tissue disruption, a result which could lead to less tissue damage and a reduction in target displacement.

Biologically inspired microtexturing: investigation into the surface topography of next-generation neurosurgical probes

Minimally Invasive (MI) surgery represents the future of many types of medical intervention (keyhole neurosurgery, natural orifice trans-luminal endoscopic surgery, etc.). However, the shortcomings of today's surgical tools fuel the need for the development of next-generation 'smart instrumentation', which will be more accurate and safer for the patient. This paper presents the preliminary results of a biologically inspired microtexturing method, based on UV-lithography, and its application to MI neurosurgery. These results suggest that the size and geometry of the texture 'printed' on the outer surface of a neurosurgical probe clearly affect the insertion and extraction forces generated at the brain-probe interface. Thus, by carefully choosing an appropriate microtexture, unique insertion characteristics can be obtained, which can improve the performance of existing instruments (e.g. reducing slippage in permanent electrodes such as those used in deep brain stimulation) or enable the development of novel designs altogether.

Photocycles of channelrhodopsin-2

Recent developments have used light-activated channels or transporters to modulate neuronal activity. One such genetically-encoded modulator of activity, channelrhodopsin-2 (ChR2), depolarizes neurons in response to blue light. In this work, we first conducted electrophysiological studies of the photokinetics of hippocampal cells expressing ChR2, for various light stimulations. These and other experimental results were then used for systematic investigation of the previously proposed three-state and four-state models of the ChR2 photocycle. We show the limitations of the previously suggested three-state models and identify a four-state model that accurately follows the ChR2 photocurrents. We find that ChR2 currents decay biexponentially, a fact that can be explained by the four-state model. The model is composed of two closed (C1 and C2) and two open (O1 and O2) states, and our simulation results suggest that they might represent the dark-adapted (C1-O1) and light-adapted (C2-O2) branches. The crucial insight provided by the analysis of the new model is that it reveals an adaptation mechanism of the ChR2 molecule. Hence very simple organisms expressing ChR2 can use this form of light adaptation.

A non-invasive retinal prosthesis - testing the concept

We have developed a testing platform for a novel type of retinal prosthesis. Our system uses an array of light sources as non-contact stimulators. The platform consists of an imaging system based on a CMOS camera, PC based image processing, and a stimulation address system carried out on a Field Programmable Gated Array which addresses a matrix array of LEDs. Special optics are used to focus the light from the LED array onto light sensitized cells.

Modeling and engineering aspects of channelrhodopsin2 system for neural photostimulation

It is desirable to be able to stimulate neural cells for many different therapeutic applications. Light stimulation has many advantages over electrical stimulation if it can be achieved. Neural cells are not naturally light sensitive but they can be transformed using different strategies. Here we examine the case of genetically engineered neurons expressing green algae light-gated ion channels, Channelrhodopsin-2. We have developed a mathematical model for the photocycle of this protein, which gives results which are in good agreement with experimental measurements. We have also examined engineering aspects of using this ChR2 system as a phototransduction mechanism. The response characteristics were calculated and potentials of this system-device are discussed.

Enzyme-Linked Sensitive Fluorometric Imaging of Glutamate Release from Cerebral Neurons of Chick Embryos

This paper describes a method for imaging the endogenous release of glutamate from cerebral neurons. This method is based on the reactions of glutamate oxidase and peroxidase, and on the detection of hydrogen peroxide by a fluorescent substrate of peroxidase. Glutamate has been sensitively measured in vitro in the range of 20 nM to 1 microM. We used two types of Ca(2+) channel inhibitors, MK-801 and omega-Conotoxin GVIA, which act to suppress Ca(2+) transport at postsynaptic and presynaptic neurons, respectively. MK-801 did not inhibit the increase in glutamate release after KCl stimulation, while there was no increase in glutamate release after KCl stimulation when omega-Conotoxin GVIA was used, probably due to the inhibition of voltage-activated Ca(2+) channels in the presynapse. Glutamate release and Ca(2+) flow in the synaptic regions were imaged using a laser confocal fluorescence microscope. KCl-evoked glutamate release was localized around cell bodies linked to axon terminals. This procedure allows imaging that can be sensitively detected by the fluorometric enzymatic assay of endogenous glutamate release in synapses.

A method for micrometer resolution patterning of primary culture neurons for SPM analysis

In this work we present a method for ultra-fine patterning of primary culture neuron cell growth, which is compatible for scanning near-field optical atomic force microscopy (SNOAM) analysis. SNOAM uses near-field optics to break the fundamental diffraction limit imposed on normal microscopy. SNOAM can achieve sub-100 nm optical resolutions, but requires transparent, open substrates. The ability to do physiological measurements on patterns of neurons, combined with ultra high resolution optical and fluorescent analysis, is useful in the study of long-term potentiation. The patterning method consists of chemical guidance with an element of physical confinement and allows for ultra-fine patterning of neural growth on transparent glass substrates. Substrates consist of microfabricated perfluoropolymer barrier structures on glass. Poly-L-lysine was selectively deposited using a silicone-based microfluidic stencil aligned to the perfluoropolymer/glass substrate. Primary culture neurons were extracted from 8-day-old chicks and grown for 3 days to form good networks. This patterning system shows very specific growth with patterning separations down to the level of individual neurites. Fluorescent imaging was carried out on both cell viability during growth and immuno-tagged microtubule-associated proteins on the neurites. Neurons inside the patterned structures were imaged and analyzed with a tapping mode SNOAM.