Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays

Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses

BACKGROUND

Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts.

NEW METHOD

Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario.

RESULTS

We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials.

CONCLUSION

Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

Removing direct photocurrent artifacts in optogenetic connectivity mapping data via constrained matrix factorization

Monosynaptic connectivity mapping is crucial for building circuit-level models of neural computation. Two-photon optogenetic stimulation, when combined with whole-cell recording, enables large-scale mapping of physiological circuit parameters. In this experimental setup, recorded postsynaptic currents are used to infer the presence and strength of connections. For many cell types, nearby connections are those we expect to be strongest. However, when the postsynaptic cell expresses opsin, optical excitation of nearby cells can induce direct photocurrents in the postsynaptic cell. These photocurrent artifacts contaminate synaptic currents, making it difficult or impossible to probe connectivity for nearby cells. To overcome this problem, we developed a computational tool, Photocurrent Removal with Constraints (PhoRC). Our method is based on a constrained matrix factorization model which leverages the fact that photocurrent kinetics are less variable than those of synaptic currents. We demonstrate on real and simulated data that PhoRC consistently removes photocurrents while preserving synaptic currents, despite variations in photocurrent kinetics across datasets. Our method allows the discovery of synaptic connections which would have been otherwise obscured by photocurrent artifacts, and may thus reveal a more complete picture of synaptic connectivity. PhoRC runs faster than real time and is available as open source software.

Spike sorting in the presence of stimulation artifacts: a dynamical control systems approach

Objective. Bi-directional electronic neural interfaces, capable of both electrical recording and stimulation, communicate with the nervous system to permit precise calibration of electrical inputs by capturing the evoked neural responses. However, one significant challenge is that stimulation artifacts often mask the actual neural signals. To address this issue, we introduce a novel approach that employs dynamical control systems to detect and decipher electrically evoked neural activity despite the presence of electrical artifacts.Approach. Our proposed method leverages the unique spatiotemporal patterns of neural activity and electrical artifacts to distinguish and identify individual neural spikes. We designed distinctive dynamical models for both the stimulation artifact and each neuron observed during spontaneous neural activity. We can estimate which neurons were active by analyzing the recorded voltage responses across multiple electrodes post-stimulation. This technique also allows us to exclude signals from electrodes heavily affected by stimulation artifacts, such as the stimulating electrode itself, yet still accurately differentiate between evoked spikes and electrical artifacts.Main results. We applied our method to high-density multi-electrode recordings from the primate retina in anex vivosetup, using a grid of 512 electrodes. Through repeated electrical stimulations at varying amplitudes, we were able to construct activation curves for each neuron. The curves obtained with our method closely resembled those derived from manual spike sorting. Additionally, the stimulation thresholds we estimated strongly agreed with those determined through manual analysis, demonstrating high reliability (R2=0.951for human 1 andR2=0.944for human 2).Significance. Our method can effectively separate evoked neural spikes from stimulation artifacts by exploiting the distinct spatiotemporal propagation patterns captured by a dense, large-scale multi-electrode array. This technique holds promise for future applications in real-time closed-loop stimulation systems and for managing multi-channel stimulation strategies.

Single-pulse electrical stimulation artifact removal using the novel matching pursuit-based artifact reconstruction and removal method (MPARRM)

Objective.Single-pulse electrical stimulation (SPES) has been widely used to probe effective connectivity. However, analysis of the neural response is often confounded by stimulation artifacts. We developed a novel matching pursuit-based artifact reconstruction and removal method (MPARRM) capable of removing artifacts from stimulation-artifact-affected electrophysiological signals.Approach.To validate MPARRM across a wide range of potential stimulation artifact types, we performed a bench-top experiment in which we suspended electrodes in a saline solution to generate 110 types of real-world stimulation artifacts. We then added the generated stimulation artifacts to ground truth signals (stereoelectroencephalography signals from nine human subjects recorded during a receptive speech task), applied MPARRM to the combined signal, and compared the resultant denoised signal with the ground truth signal. We further applied MPARRM to artifact-affected neural signals recorded from the hippocampus while performing SPES on the ipsilateral basolateral amygdala in nine human subjects.Main results.MPARRM could remove stimulation artifacts without introducing spectral leakage or temporal spread. It accommodated variable stimulation parameters and recovered the early response to SPES within a wide range of frequency bands. Specifically, in the early response period (5-10 ms following stimulation onset), we found that the broadband gamma power (70-170 Hz) of the denoised signal was highly correlated with the ground truth signal (R=0.98±0.02, Pearson), and the broadband gamma activity of the denoised signal faithfully revealed the responses to the auditory stimuli within the ground truth signal with94%±1.47%sensitivity and99%±1.01%specificity. We further found that MPARRM could reveal the expected temporal progression of broadband gamma activity along the anterior-posterior axis of the hippocampus in response to the ipsilateral amygdala stimulation.Significance.MPARRM could faithfully remove SPES artifacts without confounding the electrophysiological signal components, especially during the early-response period. This method can facilitate the understanding of the neural response mechanisms of SPES.

An unsupervised real-time spike sorting system based on optimized OSort

Objective. The OSort algorithm, a pivotal unsupervised spike sorting method, has been implemented in dedicated hardware devices for real-time spike sorting. However, due to the inherent complexity of neural recording environments, OSort still grapples with numerous transient cluster occurrences during the practical sorting process. This leads to substantial memory usage, heavy computational load, and complex hardware architectures, especially in noisy recordings and multi-channel systems.Approach. This study introduces an optimized OSort algorithm (opt-OSort) which utilizes correlation coefficient (CC), instead of Euclidean distance as classification criterion. TheCCmethod not only bolsters the robustness of spike classification amidst the diverse and ever-changing conditions of physiological and recording noise environments, but also can finish the entire sorting procedure within a fixed number of cluster slots, thus preventing a large number of transient clusters. Moreover, the opt-OSort incorporates two configurable validation loops to efficiently reject cluster outliers and track recording variations caused by electrode drifting in real-time.Main results. The opt-OSort significantly reduces transient cluster occurrences by two orders of magnitude and decreases memory usage by 2.5-80 times in the number of pre-allocated transient clusters compared with other hardware implementations of OSort. The opt-OSort maintains an accuracy comparable to offline OSort and other commonly-used algorithms, with a sorting time of 0.68µs as measured by the hardware-implemented system in both simulated datasets and experimental data. The opt-OSort's ability to handle variations in neural activity caused by electrode drifting is also demonstrated.Significance. These results present a rapid, precise, and robust spike sorting solution suitable for integration into low-power, portable, closed-loop neural control systems and brain-computer interfaces.

DualSort: online spike sorting with a running neural network

Objective.Spike sorting, i.e. the detection and separation of measured action potentials from different extracellularly recorded neurons, remains one of the bottlenecks in deciphering the brain. In recent years, the application of neural networks (NNs) for spike sorting has garnered significant attention. Most methods focus on specific sub-problems within the conventional spike sorting pipeline, such as spike detection or feature extraction, and attempt to solve them with complex network architectures. This paper presents DualSort, a simple NN that gets combined with downstream post-processing for real-time spike sorting. It shows high efficiency, low complexity, and requires a comparatively small amount of human interaction.Approach.Synthetic and experimentally obtained extracellular single-channel recordings were utilized to train and evaluate the proposed NN. For training, spike waveforms were labeled with respect to their associated neuron and position in the signal, allowing the detection and categorization of spikes in unison. DualSort classifies a single spike multiple times in succession, as it runs over the signal in a step-by-step manner and uses a post-processing algorithm that transmits the network output into spike trains. Main results.With the used datasets, DualSort was able to detect and distinguish different spike waveforms and separate them from background activity. The post-processing algorithm significantly strengthened the overall performance of the model, making the system more robust as a whole. Although DualSort is an end-to-end solution that efficiently transforms filtered signals into spike trains, it competes with contemporary state-of-the-art technologies that exclusively target single sub-problems in the conventional spike sorting pipeline.Significance.This work demonstrates that even under high noise levels, complex NNs are not necessary by any means to achieve high performance in spike detection and sorting. The utilization of data augmentation on a limited quantity of spikes could substantially decrease hand-labeling compared to other studies. Furthermore, the proposed framework can be utilized without human interaction when combined with an unsupervised technique that provides pseudo labels for DualSort. Due to the low complexity of our network, it works efficiently and enables real-time processing on basic hardware. The proposed approach is not limited to spike sorting, as it may also be used to process different signals, such as electroencephalogram (EEG), which needs to be investigated in future research.

Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells

High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical sensitivity of a large population of target neurons, to precisely control their activity, can be difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale multielectrode stimulation and recording from retinal ganglion cells (RGCs) of male and female macaque monkeys ex vivo Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds across cell types, retinas, and eccentricities, with systematic and distinct trends for somas and axons. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by their recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These trends were quantitatively reproduced with biophysical simulations. Results from human RGCs were broadly similar. The inference of stimulation sensitivity from recorded electrical features was tested in a data-driven simulation of visual reconstruction, revealing that the approach could significantly improve the function of future high-fidelity retinal implants.SIGNIFICANCE STATEMENT This study demonstrates that individual in situ primate retinal ganglion cells of different types respond to artificially generated, external electrical fields in a systematic manner, in accordance with theoretical predictions, that allows for prediction of electrical stimulus sensitivity from recorded spontaneous activity. It also provides evidence that such an approach could be immensely helpful in the calibration of clinical retinal implants.

An improved platform for cultured neuronal network electrophysiology: multichannel optogenetics integrated with MEAs

Cultured neuronal networks (CNNs) are powerful tools for studying how neuronal representation and adaptation emerge in networks of controlled populations of neurons. To ensure the interaction of a CNN and an artificial setting, reliable operation in both open and closed loops should be provided. In this study, we integrated optogenetic stimulation with microelectrode array (MEA) recordings using a digital micromirror device and developed an improved research tool with a 64-channel interface for neuronal network control and data acquisition. We determined the ideal stimulation parameters including light intensity, frequency, and duty cycle for our configuration. This resulted in robust and reproducible neuronal responses. We also demonstrated both open and closed loop configurations in the new platform involving multiple bidirectional channels. Unlike previous approaches that combined optogenetic stimulation and MEA recordings, we did not use binary grid patterns, but assigned an adjustable-size, non-binary optical spot to each electrode. This approach allowed simultaneous use of multiple input-output channels and facilitated adaptation of the stimulation parameters. Hence, we advanced a 64-channel interface in that each channel can be controlled individually in both directions simultaneously without any interference or interrupts. The presented setup meets the requirements of research in neuronal plasticity, network encoding and representation, closed-loop control of firing rate and synchronization. Researchers who develop closed-loop control techniques and adaptive stimulation strategies for network activity will benefit much from this novel setup.

From End to End: Gaining, Sorting, and Employing High-Density Neural Single Unit Recordings

The meaning behind neural single unit activity has constantly been a challenge, so it will persist in the foreseeable future. As one of the most sourced strategies, detecting neural activity in high-resolution neural sensor recordings and then attributing them to their corresponding source neurons correctly, namely the process of spike sorting, has been prevailing so far. Support from ever-improving recording techniques and sophisticated algorithms for extracting worthwhile information and abundance in clustering procedures turned spike sorting into an indispensable tool in electrophysiological analysis. This review attempts to illustrate that in all stages of spike sorting algorithms, the past 5 years innovations' brought about concepts, results, and questions worth sharing with even the non-expert user community. By thoroughly inspecting latest innovations in the field of neural sensors, recording procedures, and various spike sorting strategies, a skeletonization of relevant knowledge lays here, with an initiative to get one step closer to the original objective: deciphering and building in the sense of neural transcript.

Tracking connectivity maps in human stem cell-derived neuronal networks by holographic optogenetics

Holographic optogenetic stimulation of human iPSC–derived neuronal networks was exploited to map precise functional connectivity motifs and their long-term dynamics during network development.

Neuronal networks derived from human induced pluripotent stem cells have been exploited widely for modeling neuronal circuits, neurological diseases, and drug screening. As these networks require extended culturing periods to functionally mature in vitro, most studies are based on immature networks. To obtain insights on long-term functional features, we improved a glia–neuron co-culture protocol within multi-electrode arrays, facilitating continuous assessment of electrical features in weekly intervals. By full-field optogenetic stimulation, we detected an earlier onset of neuronal firing and burst activity compared with spontaneous activity. Full-field stimulation enhanced the number of active neurons and their firing rates. Compared with full-field stimulation, which evoked synchronized activity across all neurons, holographic stimulation of individual neurons resulted in local activity. Single-cell holographic stimulation facilitated to trace propagating evoked activities of 400 individually stimulated neurons per multi-electrode array. Thereby, we revealed precise functional neuronal connectivity motifs. Holographic stimulation data over time showed increasing connection numbers and strength with culture age. This holographic stimulation setup has the potential to establish a profound functional testbed for in-depth analysis of human-induced pluripotent stem cell-derived neuronal networks.

Objective evaluation of stimulation artefact removal techniques in the context of neural spike sorting

Objective - We present a framework to objectively test and compare stimulation artefact removal techniques in the context of neural spike sorting. Approach - To this end, we used realistic hybrid ground-truth spiking data, with superimposed artefacts from in vivo recordings. We used the framework to evaluate and compare several techniques: blanking, template subtraction by averaging, linear regression, and a multi-channel Wiener filter (MWF). Main results - Our study demonstrates that blanking and template subtraction result in a poorer spike sorting performance than linear regression and MWF, while the latter two perform similarly. Finally, to validate the conclusions found from the hybrid evaluation framework, we also performed a qualitative analysis on in vivo recordings without artificial manipulations. Significance - Our framework allows direct quantification of the impact of the residual artefact on the spike sorting accuracy, thereby allowing for a more objective and more relevant comparison compared to indirect signal quality metrics that are estimated from the signal statistics. Furthermore, the availability of a ground truth in the form of single-unit spiking activity also facilitates a better estimation of such signal quality metrics.

Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis

Objective:

Retinal prostheses must be able to activate cells in a selective way in order to restore high-fidelity vision. However, inadvertent activation of far-away retinal ganglion cells (RGCs) through electrical stimulation of axon bundles can produce irregular and poorly controlled percepts, limiting artificial vision. In this work, we aim to provide an algorithmic solution to the problem of detecting axon bundle activation with a bi-directional epiretinal prostheses.

Methods:

The algorithm utilizes electrical recordings to determine the stimulation current amplitudes above which axon bundle activation occurs. Bundle activation is defined as the axonal stimulation of RGCs with unknown soma and receptive field locations, typically beyond the electrode array. The method exploits spatiotemporal characteristics of electrically-evoked spikes to overcome the challenge of detecting small axonal spikes.

Results:

The algorithm was validated using large-scale, single-electrode and short pulse, ex vivo stimulation and recording experiments in macaque retina, by comparing algorithmically and manually identified bundle activation thresholds. For 88% of the electrodes analyzed, the threshold identified by the algorithm was within ±10% of the manually identified threshold, with a correlation coefficient of 0.95.

Conclusion:

This works presents a simple, accurate and efficient algorithm to detect axon bundle activation in epiretinal prostheses.

Significance:

The algorithm could be used in a closed-loop manner by a future epiretinal prosthesis to reduce poorly controlled visual percepts associated with bundle activation. Activation of distant cells via axonal stimulation will likely occur in other types of retinal implants and cortical implants, and the method may therefore be broadly applicable.

Spatially patterned bi-electrode epiretinal stimulation for axon avoidance at cellular resolution

Objective.Epiretinal prostheses are designed to restore vision to people blinded by photoreceptor degenerative diseases by stimulating surviving retinal ganglion cells (RGCs), which carry visual signals to the brain. However, inadvertent stimulation of RGCs at their axons can result in non-focal visual percepts, limiting the quality of artificial vision. Theoretical work has suggested that axon activation can be avoided with current stimulation designed to minimize the second spatial derivative of the induced extracellular voltage along the axon. However, this approach has not been verified experimentally at the resolution of single cells.Approach.In this work, a custom multi-electrode array (512 electrodes, 10μm diameter, 60μm pitch) was used to stimulate and record RGCs in macaque retinaex vivoat single-cell, single-spike resolution. RGC activation thresholds resulting from bi-electrode stimulation, which consisted of bipolar currents simultaneously delivered through two electrodes straddling an axon, were compared to activation thresholds from traditional single-electrode stimulation.Main results.On average, across three retinal preparations, the bi-electrode stimulation strategy reduced somatic activation thresholds (∼21%) while increasing axonal activation thresholds (∼14%), thus favoring selective somatic activation. Furthermore, individual examples revealed rescued selective activation of somas that was not possible with any individual electrode.Significance.This work suggests that a bi-electrode epiretinal stimulation strategy can reduce inadvertent axonal activation at cellular resolution, for high-fidelity artificial vision.

A 32-Channel Time-Multiplexed Artifact-Aware Neural Recording System

This paper presents a low-power, low-noise microsystem for the recording of neural local field potentials or intracranial electroencephalographic signals. It features 32 time-multiplexed channels at the electrode interface and offers the possibility to spatially delta encode data to take advantage of the large correlation of signals captured from nearby channels. The circuit also implements a mixed-signal voltage-triggered auto-ranging algorithm which allows to attenuate large interferers in digital domain while preserving neural information. This effectively increases the system dynamic range and avoids the onset of saturation. A prototype, fabricated in a standard 180 nm CMOS process, has been experimentally verified in-vitro with cellular cultures of primary cortical neurons from mice. The system shows an integrated input-referred noise in the 0.5-200 Hz band of 1.4 μV_rms for a spot noise of about 85 nV /√{Hz}. The system draws 1.5 μW per channel from 1.2 V supply and obtains 71 dB + 26 dB dynamic range when the artifact-aware auto-ranging mechanism is enabled, without penalising other critical specifications such as crosstalk between channels or common-mode and power supply rejection ratios.

Uncovering biomarkers during therapeutic neuromodulation with PARRM: Period-based Artifact Reconstruction and Removal Method

Advances in therapeutic neuromodulation devices have enabled concurrent stimulation and electrophysiology in the central nervous system. However, stimulation artifacts often obscure the sensed underlying neural activity. Here, we develop a method, termed Period-based Artifact Reconstruction and Removal Method (PARRM), to remove stimulation artifacts from neural recordings by leveraging the exact period of stimulation to construct and subtract a high-fidelity template of the artifact. Benchtop saline experiments, computational simulations, five unique in vivo paradigms across animal and human studies, and an obscured movement biomarker are used for validation. Performance is found to exceed that of state-of-the-art filters in recovering complex signals without introducing contamination. PARRM has several advantages: (1) it is superior in signal recovery; (2) it is easily adaptable to several neurostimulation paradigms; and (3) it has low complexity for future on-device implementation. Real-time artifact removal via PARRM will enable unbiased exploration and detection of neural biomarkers to enhance efficacy of closed-loop therapies.

Computational challenges and opportunities for a bi-directional artificial retina

A future artificial retina that can restore high acuity vision in blind people will rely on the capability to both read (observe) and write (control) the spiking activity of neurons using an adaptive, bi-directional and high-resolution device. Although current research is focused on overcoming the technical challenges of building and implanting such a device, exploiting its capabilities to achieve more acute visual perception will also require substantial computational advances. Using high-density large-scale recording and stimulation in the primate retina with an ex vivo multi-electrode array lab prototype, we frame several of the major computational problems, and describe current progress and future opportunities in solving them. First, we identify cell types and locations from spontaneous activity in the blind retina, and then efficiently estimate their visual response properties by using a low-dimensional manifold of inter-retina variability learned from a large experimental dataset. Second, we estimate retinal responses to a large collection of relevant electrical stimuli by passing current patterns through an electrode array, spike sorting the resulting recordings and using the results to develop a model of evoked responses. Third, we reproduce the desired responses for a given visual target by temporally dithering a diverse collection of electrical stimuli within the integration time of the visual system. Together, these novel approaches may substantially enhance artificial vision in a next-generation device.

Optimal Multichannel Artifact Prediction and Removal for Neural Stimulation and Brain Machine Interfaces

Neural implants that deliver multi-site electrical stimulation to the nervous systems are no longer the last resort but routine treatment options for various neurological disorders. Multi-site electrical stimulation is also widely used to study nervous system function and neural circuit transformations. These technologies increasingly demand dynamic electrical stimulation and closed-loop feedback control for real-time assessment of neural function, which is technically challenging since stimulus-evoked artifacts overwhelm the small neural signals of interest. We report a novel and versatile artifact removal method that can be applied in a variety of settings, from single- to multi-site stimulation and recording and for current waveforms of arbitrary shape and size. The method capitalizes on linear electrical coupling between stimulating currents and recording artifacts, which allows us to estimate a multi-channel linear Wiener filter to predict and subsequently remove artifacts via subtraction. We confirm and verify the linearity assumption and demonstrate feasibility in a variety of recording modalities, including in vitro sciatic nerve stimulation, bilateral cochlear implant stimulation, and multi-channel stimulation and recording between the auditory midbrain and cortex. We demonstrate a vast enhancement in the recording quality with a typical artifact reduction of 25-40 dB. The method is efficient and can be scaled to arbitrary number of stimulus and recording sites, making it ideal for applications in large-scale arrays, closed-loop implants, and high-resolution multi-channel brain-machine interfaces.

Signal recovery from stimulation artifacts in intracranial recordings with dictionary learning

OBJECTIVE

Electrical stimulation of the human brain is commonly used for eliciting and inhibiting neural activity for clinical diagnostics, modifying abnormal neural circuit function for therapeutics, and interrogating cortical connectivity. However, recording electrical signals with concurrent stimulation results in dominant electrical artifacts that mask the neural signals of interest. Here we develop a method to reproducibly and robustly recover neural activity during concurrent stimulation. We concentrate on signal recovery across an array of electrodes without channel-wise fine-tuning of the algorithm. Our goal includes signal recovery with trains of stimulation pulses, since repeated, high-frequency pulses are often required to induce desired effects in both therapeutic and research domains. We have made all of our code and data publicly available.

APPROACH

We developed an algorithm that automatically detects templates of artifacts across many channels of recording, creating a dictionary of learned templates using unsupervised clustering. The artifact template that best matches each individual artifact pulse is subtracted to recover the underlying activity. To assess the success of our method, we focus on whether it extracts physiologically interpretable signals from real recordings.

MAIN RESULTS

We demonstrate our signal recovery approach on invasive electrophysiologic recordings from human subjects during stimulation. We show the recovery of meaningful neural signatures in both electrocorticographic (ECoG) arrays and deep brain stimulation (DBS) recordings. In addition, we compared cortical responses induced by the stimulation of primary somatosensory (S1) by natural peripheral touch, as well as motor cortex activity with and without concurrent S1 stimulation.

SIGNIFICANCE

Our work will enable future advances in neural engineering with simultaneous stimulation and recording.

A novel approach for removing micro-stimulation artifacts and reconstruction of broad-band neuronal signals

BACKGROUND

Electrical stimulation is a widely used method in the neurosciences with a variety of application fields. However, stimulation frequently induces large and long-lasting artifacts, which superimpose on the actual neuronal signal. Existing methods were developed for analyzing fast events such as spikes, but are not well suited for the restoration of LFP signals.

NEW METHOD

We developed a method that extracts artifact components while also leaving the LFP components of the neuronal signal intact. We based it on an exponential fit of the average artifact shape, which is subsequently adapted to the individual artifacts amplitude and then subtracted. Importantly, we used for fitting of the individual artifact only a short initial time window, in which the artifact is dominating the superimposition with the neuronal signal. Using this short period ensures that LFP components are not part of the fit, which leaves them unaffected by the subsequent artifact removal.

RESULTS

By using the method presented here, we could diminish the substantial distortions of neuronal signals caused by electrical stimulation to levels that were statistically indistinguishable from the original data. Furthermore, the effect of stimulation on the phases of γ- and β- oscillations was reduced by 85 and 75 %, respectively.

COMPARISON WITH EXISTING METHODS

This approach avoids signal loss as caused by methods cutting out artifacts and minimizes the distortion of the signal's temporal structure as compared to other approaches.

CONCLUSION

The method presented here allows for a successful reconstruction of broad-band signals.

Stimulation and Artifact-Suppression Techniques for In Vitro High-Density Microelectrode Array Systems

We present novel voltage stimulation buffers with controlled output current, along with recording circuits featuring adjustable high-pass cut-off filtering to perform efficient stimulation while actively suppressing stimulation artifacts in high-density microelectrode arrays. Owing to the dense packing and close proximity of the electrodes in such systems, a stimulation through one electrode can cause large electrical artifacts on neighboring electrodes that easily saturate the corresponding recording amplifiers. To suppress such artifacts, the high-pass corner frequencies of all available 2048 recording channels can be raised from several Hz to several kHz by applying a "soft-reset" or pole-shifting technique. With the implemented artifact suppression technique, the saturation time of the recording circuits, connected to electrodes in immediate vicinity to the stimulation site, could be reduced to less than 150 μs. For the stimulation buffer, we developed a circuit, which can operate in two modes: either control of only the stimulation voltage or control of current and voltage during stimulation. The voltage-only controlled mode employs a local common-mode feedback operational transconductance amplifier with a near rail-to-rail input/output range, suitable for driving high-capacitive loads. The current/voltage controlled mode is based on a positive current conveyor generating adjustable output currents, whereas its upper and lower output voltages are limited by two feedback loops. The current/voltage controlled circuit can generate stimulation pulses up to 30 μA with less than ±0.1% linearity error in the low-current mode and up to 300 μA with less than ±0.2% linearity error in the high-current mode.

Towards neural co-processors for the brain: combining decoding and encoding in brain-computer interfaces

The field of brain-computer interfaces is poised to advance from the traditional goal of controlling prosthetic devices using brain signals to combining neural decoding and encoding within a single neuroprosthetic device. Such a device acts as a 'co-processor' for the brain, with applications ranging from inducing Hebbian plasticity for rehabilitation after brain injury to reanimating paralyzed limbs and enhancing memory. We review recent progress in simultaneous decoding and encoding for closed-loop control and plasticity induction. To address the challenge of multi-channel decoding and encoding, we introduce a unifying framework for developing brain co-processors based on artificial neural networks and deep learning. These 'neural co-processors' can be used to jointly optimize cost functions with the nervous system to achieve desired behaviors ranging from targeted neuro-rehabilitation to augmentation of brain function.

Neural data science: accelerating the experiment-analysis-theory cycle in large-scale neuroscience

Modern large-scale multineuronal recording methodologies, including multielectrode arrays, calcium imaging, and optogenetic techniques, produce single-neuron resolution data of a magnitude and precision that were the realm of science fiction twenty years ago. The major bottlenecks in systems and circuit neuroscience no longer lie in simply collecting data from large neural populations, but also in understanding this data: developing novel scientific questions, with corresponding analysis techniques and experimental designs to fully harness these new capabilities and meaningfully interrogate these questions. Advances in methods for signal processing, network analysis, dimensionality reduction, and optimal control-developed in lockstep with advances in experimental neurotechnology-promise major breakthroughs in multiple fundamental neuroscience problems. These trends are clear in a broad array of subfields of modern neuroscience; this review focuses on recent advances in methods for analyzing neural time-series data with single-neuronal precision.

Epiretinal stimulation with local returns enhances selectivity at cellular resolution

OBJECTIVE

Epiretinal prostheses are designed to restore vision in people blinded by photoreceptor degenerative diseases, by directly activating retinal ganglion cells (RGCs) using an electrode array implanted on the retina. In present-day clinical devices, current spread from the stimulating electrode to a distant return electrode often results in the activation of many cells, potentially limiting the quality of artificial vision. In the laboratory, epiretinal activation of RGCs with cellular resolution has been demonstrated with small electrodes, but distant returns may still cause undesirable current spread. Here, the ability of local return stimulation to improve the selective activation of RGCs at cellular resolution was evaluated.

APPROACH

A custom multi-electrode array (512 electrodes, 10 μm diameter, 60 μm pitch) was used to simultaneously stimulate and record from RGCs in isolated primate retina. Stimulation near the RGC soma with a single electrode and a distant return was compared to stimulation in which the return was provided by six neighboring electrodes.

MAIN RESULTS

Local return stimulation enhanced the capability to activate cells near the central electrode (<30 μm) while avoiding cells farther away (>30 μm). This resulted in an improved ability to selectively activate ON and OFF cells, including cells encoding immediately adjacent regions in the visual field.

SIGNIFICANCE

These results suggest that a device that restricts the electric field through local returns could optimize activation of neurons at cellular resolution, improving the quality of artificial vision.

Recovery of early neural spikes from stimulation electrodes using a DC-coupled low gain high resolution data acquisition system

BACKGROUND

Neural responses to electrical stimulation provide valuable information to probe and study the network function. Especially, recording neural responses from the stimulated site provides improved neural interfacing method. However, it is difficult to measure short-delayed responses at the stimulated electrode due to the saturation of the amplifier after stimulation which is called "stimulus artifact". Despite the advances in handling stimulation artifacts, it is still very challenging to deal with the artifacts if one tries to stimulate and record from the same electrode.

NEW METHOD

In this paper, we developed a system consisting of 24 bit ADC and low gain DC-amplifier which allows us to record the entire responses including saturation-free stimulus artifact and neural responses with excellent resolution.

RESULTS

Our approach showed saturation-free recording after stimulation, which makes it possible to recover neural spike as early as in 2 ms at the stimulating electrode with digital elimination methods.

COMPARISON WITH EXISTING METHODS

With our system we could record neural signals after stimulation that was difficult with high gain and high pass filtered recording system due to amplifier saturation.

CONCLUSIONS

Our new system can enhance interface performance with its higher robustness and with simple system configuration.

ERAASR: an algorithm for removing electrical stimulation artifacts from multielectrode array recordings

OBJECTIVE

Electrical stimulation is a widely used and effective tool in systems neuroscience, neural prosthetics, and clinical neurostimulation. However, electrical artifacts evoked by stimulation prevent the detection of spiking activity on nearby recording electrodes, which obscures the neural population response evoked by stimulation. We sought to develop a method to clean artifact-corrupted electrode signals recorded on multielectrode arrays in order to recover the underlying neural spiking activity.

APPROACH

We created an algorithm, which performs estimation and removal of array artifacts via sequential principal components regression (ERAASR). This approach leverages the similar structure of artifact transients, but not spiking activity, across simultaneously recorded channels on the array, across pulses within a train, and across trials. The ERAASR algorithm requires no special hardware, imposes no requirements on the shape of the artifact or the multielectrode array geometry, and comprises sequential application of straightforward linear methods with intuitive parameters. The approach should be readily applicable to most datasets where stimulation does not saturate the recording amplifier.

MAIN RESULTS

The effectiveness of the algorithm is demonstrated in macaque dorsal premotor cortex using acute linear multielectrode array recordings and single electrode stimulation. Large electrical artifacts appeared on all channels during stimulation. After application of ERAASR, the cleaned signals were quiescent on channels with no spontaneous spiking activity, whereas spontaneously active channels exhibited evoked spikes which closely resembled spontaneously occurring spiking waveforms.

SIGNIFICANCE

We hope that enabling simultaneous electrical stimulation and multielectrode array recording will help elucidate the causal links between neural activity and cognition and facilitate naturalistic sensory protheses.

A spike sorting toolbox for up to thousands of electrodes validated with ground truth recordings in vitro and in vivo

In recent years, multielectrode arrays and large silicon probes have been developed to record simultaneously between hundreds and thousands of electrodes packed with a high density. However, they require novel methods to extract the spiking activity of large ensembles of neurons. Here, we developed a new toolbox to sort spikes from these large-scale extracellular data. To validate our method, we performed simultaneous extracellular and loose patch recordings in rodents to obtain 'ground truth' data, where the solution to this sorting problem is known for one cell. The performance of our algorithm was always close to the best expected performance, over a broad range of signal-to-noise ratios, in vitro and in vivo. The algorithm is entirely parallelized and has been successfully tested on recordings with up to 4225 electrodes. Our toolbox thus offers a generic solution to sort accurately spikes for up to thousands of electrodes.