Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia

Reconnecting the Hand and Arm to the Brain: Efficacy of Neural Interfaces for Sensorimotor Restoration After Tetraplegia

BACKGROUND AND OBJECTIVES

Paralysis after spinal cord injury involves damage to pathways that connect neurons in the brain to peripheral nerves in the limbs. Re-establishing this communication using neural interfaces has the potential to bridge the gap and restore upper extremity function to people with high tetraplegia. We report a novel approach for restoring upper extremity function using selective peripheral nerve stimulation controlled by intracortical microelectrode recordings from sensorimotor networks, along with restoration of tactile sensation of the hand using intracortical microstimulation.

METHODS

A 27-year-old right-handed man with AIS-B (motor-complete, sensory-incomplete) C3-C4 tetraplegia was enrolled into the clinical trial. Six 64-channel intracortical microelectrode arrays were implanted into left hemisphere regions involved in upper extremity function, including primary motor and sensory cortices, inferior frontal gyrus, and anterior intraparietal area. Nine 16-channel extraneural peripheral nerve electrodes were implanted to allow targeted stimulation of right median, ulnar (2), radial, axillary, musculocutaneous, suprascapular, lateral pectoral, and long thoracic nerves, to produce selective muscle contractions on demand. Proof-of-concept studies were performed to demonstrate feasibility of using a brain-machine interface to read from and write to the brain for restoring motor and sensory functions of the participant's own arm and hand.

RESULTS

Multiunit neural activity that correlated with intended motor action was successfully recorded from intracortical arrays. Microstimulation of electrodes in somatosensory cortex produced repeatable sensory percepts of individual fingers for restoration of touch sensation. Selective electrical activation of peripheral nerves produced antigravity muscle contractions, resulting in functional movements that the participant was able to command under brain control to perform virtual and actual arm and hand movements. The system was well tolerated with no operative complications.

CONCLUSION

The combination of implanted cortical electrodes and nerve cuff electrodes has the potential to create bidirectional restoration of motor and sensory functions of the arm and hand after neurological injury.

An Investigation of Manifold-Based Direct Control for a Brain-to-Body Neural Bypass

Objective: Brain-body interfaces (BBIs) have emerged as a very promising solution for restoring voluntary hand control in people with upper-limb paralysis. The BBI module decoding motor commands from brain signals should provide the user with intuitive, accurate, and stable control. Here, we present a preliminary investigation in a monkey of a brain decoding strategy based on the direct coupling between the activity of intrinsic neural ensembles and output variables, aiming at achieving ease of learning and long-term robustness. Results: We identified an intrinsic low-dimensional space (called manifold) capturing the co-variation patterns of the monkey's neural activity associated to reach-to-grasp movements. We then tested the animal's ability to directly control a computer cursor using cortical activation along the manifold axes. By daily recalibrating only scaling factors, we achieved rapid learning and stable high performance in simple, incremental 2D tasks over more than 12 weeks of experiments. Finally, we showed that this brain decoding strategy can be effectively coupled to peripheral nerve stimulation to trigger voluntary hand movements. Conclusions: These results represent a proof of concept of manifold-based direct control for BBI applications.

Measuring instability in chronic human intracortical neural recordings towards stable, long-term brain-computer interfaces

Intracortical brain-computer interfaces (iBCIs) enable people with tetraplegia to gain intuitive cursor control from movement intentions. To translate to practical use, iBCIs should provide reliable performance for extended periods of time. However, performance begins to degrade as the relationship between kinematic intention and recorded neural activity shifts compared to when the decoder was initially trained. In addition to developing decoders to better handle long-term instability, identifying when to recalibrate will also optimize performance. We propose a method to measure instability in neural data without needing to label user intentions. Longitudinal data were analyzed from two BrainGate2 participants with tetraplegia as they used fixed decoders to control a computer cursor spanning 142 days and 28 days, respectively. We demonstrate a measure of instability that correlates with changes in closed-loop cursor performance solely based on the recorded neural activity (Pearson r = 0.93 and 0.72, respectively). This result suggests a strategy to infer online iBCI performance from neural data alone and to determine when recalibration should take place for practical long-term use.

Comparative analysis of energy transfer mechanisms for neural implants

As neural implant technologies advance rapidly, a nuanced understanding of their powering mechanisms becomes indispensable, especially given the long-term biocompatibility risks like oxidative stress and inflammation, which can be aggravated by recurrent surgeries, including battery replacements. This review delves into a comprehensive analysis, starting with biocompatibility considerations for both energy storage units and transfer methods. The review focuses on four main mechanisms for powering neural implants: Electromagnetic, Acoustic, Optical, and Direct Connection to the Body. Among these, Electromagnetic Methods include techniques such as Near-Field Communication (RF). Acoustic methods using high-frequency ultrasound offer advantages in power transmission efficiency and multi-node interrogation capabilities. Optical methods, although still in early development, show promising energy transmission efficiencies using Near-Infrared (NIR) light while avoiding electromagnetic interference. Direct connections, while efficient, pose substantial safety risks, including infection and micromotion disturbances within neural tissue. The review employs key metrics such as specific absorption rate (SAR) and energy transfer efficiency for a nuanced evaluation of these methods. It also discusses recent innovations like the Sectored-Multi Ring Ultrasonic Transducer (S-MRUT), Stentrode, and Neural Dust. Ultimately, this review aims to help researchers, clinicians, and engineers better understand the challenges of and potentially create new solutions for powering neural implants.

A spiking neural network with continuous local learning for robust online brain machine interface

Objective.Spiking neural networks (SNNs) are powerful tools that are well suited for brain machine interfaces (BMI) due to their similarity to biological neural systems and computational efficiency. They have shown comparable accuracy to state-of-the-art methods, but current training methods require large amounts of memory, and they cannot be trained on a continuous input stream without pausing periodically to perform backpropagation. An ideal BMI should be capable training continuously without interruption to minimize disruption to the user and adapt to changing neural environments.Approach.We propose a continuous SNN weight update algorithm that can be trained to perform regression learning with no need for storing past spiking events in memory. As a result, the amount of memory needed for training is constant regardless of the input duration. We evaluate the accuracy of the network on recordings of neural data taken from the premotor cortex of a primate performing reaching tasks. Additionally, we evaluate the SNN in a simulated closed loop environment and observe its ability to adapt to sudden changes in the input neural structure.Main results.The continuous learning SNN achieves the same peak correlation (ρ=0.7) as existing SNN training methods when trained offline on real neural data while reducing the total memory usage by 92%. Additionally, it matches state-of-the-art accuracy in a closed loop environment, demonstrates adaptability when subjected to multiple types of neural input disruptions, and is capable of being trained online without any prior offline training.Significance.This work presents a neural decoding algorithm that can be trained rapidly in a closed loop setting. The algorithm increases the speed of acclimating a new user to the system and also can adapt to sudden changes in neural behavior with minimal disruption to the user.

Decoding the Spike-Band Subthreshold Motor Cortical Activity

Intracortical Brain-Computer Interfaces (iBCI) use single-unit activity (SUA), multiunit activity (MUA) and local field potentials (LFP) to control neuroprosthetic devices. SUA and MUA are usually extracted from the bandpassed recording through amplitude thresholding, while subthreshold data are ignored. Here, we show that subthreshold data can actually be decoded to determine behavioral variables with test set accuracy of up to 100%. Although the utility of SUA, MUA and LFP for decoding behavioral variables has been explored previously, this study investigates the utility of spike-band subthreshold activity exclusively. We provide evidence suggesting that this activity can be used to keep decoding performance at acceptable levels even when SUA quality is reduced over time. To the best of our knowledge, the signals that we derive from the subthreshold activity may be the weakest neural signals that have ever been extracted from extracellular neural recordings, while still being decodable with test set accuracy of up to 100%. These results are relevant for the development of fully data-driven and automated methods for amplitude thresholding spike-band extracellular neural recordings in iBCIs containing thousands of electrodes.

Distinct neural representations during a brain-machine interface and manual reaching task in motor cortex, prefrontal cortex, and striatum

Although brain-machine interfaces (BMIs) are directly controlled by the modulation of a select local population of neurons, distributed networks consisting of cortical and subcortical areas have been implicated in learning and maintaining control. Previous work in rodents has demonstrated the involvement of the striatum in BMI learning. However, the prefrontal cortex has been largely ignored when studying motor BMI control despite its role in action planning, action selection, and learning abstract tasks. Here, we compare local field potentials simultaneously recorded from primary motor cortex (M1), dorsolateral prefrontal cortex (DLPFC), and the caudate nucleus of the striatum (Cd) while nonhuman primates perform a two-dimensional, self-initiated, center-out task under BMI control and manual control. Our results demonstrate the presence of distinct neural representations for BMI and manual control in M1, DLPFC, and Cd. We find that neural activity from DLPFC and M1 best distinguishes control types at the go cue and target acquisition, respectively, while M1 best predicts target-direction at both task events. We also find effective connectivity from DLPFC → M1 throughout both control types and Cd → M1 during BMI control. These results suggest distributed network activity between M1, DLPFC, and Cd during BMI control that is similar yet distinct from manual control.

Distinct neural representations during a brain-machine interface and manual reaching task in motor cortex, prefrontal cortex, and striatum

Although brain-machine interfaces (BMIs) are directly controlled by the modulation of a select local population of neurons, distributed networks consisting of cortical and subcortical areas have been implicated in learning and maintaining control. Previous work in rodent BMI has demonstrated the involvement of the striatum in BMI learning. However, the prefrontal cortex has been largely ignored when studying motor BMI control despite its role in action planning, action selection, and learning abstract tasks. Here, we compare local field potentials simultaneously recorded from the primary motor cortex (M1), dorsolateral prefrontal cortex (DLPFC), and the caudate nucleus of the striatum (Cd) while nonhuman primates perform a two-dimensional, self-initiated, center-out task under BMI control and manual control. Our results demonstrate the presence of distinct neural representations for BMI and manual control in M1, DLPFC, and Cd. We find that neural activity from DLPFC and M1 best distinguish between control types at the go cue and target acquisition, respectively. We also found effective connectivity from DLPFC→M1 throughout trials across both control types and Cd→M1 during BMI control. These results suggest distributed network activity between M1, DLPFC, and Cd during BMI control that is similar yet distinct from manual control.

Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex

Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.

Reconnecting the Hand and Arm to the Brain: Efficacy of Neural Interfaces for Sensorimotor Restoration after Tetraplegia

Background

Paralysis after spinal cord injury involves damage to pathways that connect neurons in the brain to peripheral nerves in the limbs. Re-establishing this communication using neural interfaces has the potential to bridge the gap and restore upper extremity function to people with high tetraplegia.

Objective

We report a novel approach for restoring upper extremity function using selective peripheral nerve stimulation controlled by intracortical microelectrode recordings from sensorimotor networks, along with restoration of tactile sensation of the hand using intracortical microstimulation.

Methods

A right-handed man with motor-complete C3-C4 tetraplegia was enrolled into the clinical trial. Six 64-channel intracortical microelectrode arrays were implanted into left hemisphere regions involved in upper extremity function, including primary motor and sensory cortices, inferior frontal gyrus, and anterior intraparietal area. Nine 16-channel extraneural peripheral nerve electrodes were implanted to allow targeted stimulation of right median, ulnar (2), radial, axillary, musculocutaneous, suprascapular, lateral pectoral, and long thoracic nerves, to produce selective muscle contractions on demand. Proof-of-concept studies were performed to demonstrate feasibility of a bidirectional brain-machine interface to restore function of the participant's own arm and hand.

Results

Multi-unit neural activity that correlated with intended motor action was successfully recorded from intracortical arrays. Microstimulation of electrodes in somatosensory cortex produced repeatable sensory percepts of individual fingers for restoration of touch sensation. Selective electrical activation of peripheral nerves produced antigravity muscle contractions. The system was well tolerated with no operative complications.

Conclusion

The combination of implanted cortical electrodes and nerve cuff electrodes has the potential to allow restoration of motor and sensory functions of the arm and hand after neurological injury.

Translating deep learning to neuroprosthetic control

Advances in deep learning have given rise to neural network models of the relationship between movement and brain activity that appear to far outperform prior approaches. Brain-computer interfaces (BCIs) that enable people with paralysis to control external devices, such as robotic arms or computer cursors, might stand to benefit greatly from these advances. We tested recurrent neural networks (RNNs) on a challenging nonlinear BCI problem: decoding continuous bimanual movement of two computer cursors. Surprisingly, we found that although RNNs appeared to perform well in offline settings, they did so by overfitting to the temporal structure of the training data and failed to generalize to real-time neuroprosthetic control. In response, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously, far outperforming standard linear methods. Our results provide evidence that preventing models from overfitting to temporal structure in training data may, in principle, aid in translating deep learning advances to the BCI setting, unlocking improved performance for challenging applications.

Translational opportunities and challenges of invasive electrodes for neural interfaces

Invasive brain-machine interfaces can restore motor, sensory and cognitive functions. However, their clinical adoption has been hindered by the surgical risk of implantation and by suboptimal long-term reliability. In this Review, we highlight the opportunities and challenges of invasive technology for clinically relevant electrophysiology. Specifically, we discuss the characteristics of neural probes that are most likely to facilitate the clinical translation of invasive neural interfaces, describe the neural signals that can be acquired or produced by intracranial electrodes, the abiotic and biotic factors that contribute to their failure, and emerging neural-interface architectures.

Gene Expression Changes in Cultured Reactive Rat Astrocyte Models and Comparison to Device-Associated Effects in the Brain

Implanted microelectrode arrays hold immense therapeutic potential for many neurodegenerative diseases. However, a foreign body response limits long-term device performance. Recent literature supports the role of astrocytes in the response to damage to the central nervous system (CNS) and suggests that reactive astrocytes exist on a spectrum of phenotypes, from beneficial to neurotoxic. The goal of our study was to gain insight into the subtypes of reactive astrocytes responding to electrodes implanted in the brain. In this study, we tested the transcriptomic profile of two reactive astrocyte culture models (cytokine cocktail or lipopolysaccharide, LPS) utilizing RNA sequencing, which we then compared to differential gene expression surrounding devices inserted into rat motor cortex via spatial transcriptomics. We interpreted changes in the genetic expression of the culture models to that of 24 hour, 1 week and 6 week rat tissue samples at multiple distances radiating from the injury site. We found overlapping expression of up to ∼250 genes between in vitro models and in vivo effects, depending on duration of implantation. Cytokine-induced cells shared more genes in common with chronically implanted tissue (≥1 week) in comparison to LPS-exposed cells. We revealed localized expression of a subset of these intersecting genes (e.g., Serping1, Chi3l1, and Cyp7b1) in regions of device-encapsulating, glial fibrillary acidic protein (GFAP)-expressing astrocytes identified with immunohistochemistry. We applied a factorization approach to assess the strength of the relationship between reactivity markers and the spatial distribution of GFAP-expressing astrocytes in vivo . We also provide lists of hundreds of differentially expressed genes between reactive culture models and untreated controls, and we observed 311 shared genes between the cytokine induced model and the LPS-reaction induced control model. Our results show that comparisons of reactive astrocyte culture models with spatial transcriptomics data can reveal new biomarkers of the foreign body response to implantable neurotechnology. These comparisons also provide a strategy to assess the development of in vitro models of the tissue response to implanted electrodes.

Training-Free Deep Generative Networks for Compressed Sensing of Neural Action Potentials

Energy consumption is an important issue for resource-constrained wireless neural recording applications with limited data bandwidth. Compressed sensing (CS) is a promising framework for addressing this challenge because it can compress data in an energy-efficient way. Recent work has shown that deep neural networks (DNNs) can serve as valuable models for CS of neural action potentials (APs). However, these models typically require impractically large datasets and computational resources for training, and they do not easily generalize to novel circumstances. Here, we propose a new CS framework, termed APGen, for the reconstruction of APs in a training-free manner. It consists of a deep generative network and an analysis sparse regularizer. We validate our method on two in vivo datasets. Even without any training, APGen outperformed model-based and data-driven methods in terms of reconstruction accuracy, computational efficiency, and robustness to AP overlap and misalignment. The computational efficiency of APGen and its ability to perform without training make it an ideal candidate for long-term, resource-constrained, and large-scale wireless neural recording. It may also promote the development of real-time, naturalistic brain-computer interfaces.

Validation of a non-invasive, real-time, human-in-the-loop model of intracortical brain-computer interfaces

Objective. Despite the tremendous promise of invasive brain-computer interfaces (iBCIs), the associated study costs, risks, and ethical considerations limit the opportunity to develop and test the algorithms that decode neural activity into a user's intentions. Our goal was to address this challenge by designing an iBCI model capable of testing many human subjects in closed-loop.Approach. We developed an iBCI model that uses artificial neural networks (ANNs) to translate human finger movements into realistic motor cortex firing patterns, which can then be decoded in real time. We call the model the joint angle BCI, or jaBCI. jaBCI allows readily recruited, healthy subjects to perform closed-loop iBCI tasks using any neural decoder, preserving subjects' control-relevant short-latency error correction and learning dynamics.Main results. We validated jaBCI offline through emulated neuron firing statistics, confirming that emulated neural signals have firing rates, low-dimensional PCA geometry, and rotational jPCA dynamics that are quite similar to the actual neurons (recorded in monkey M1) on which we trained the ANN. We also tested jaBCI in closed-loop experiments, our single study examining roughly as many subjects as have been tested world-wide with iBCIs (n= 25). Performance was consistent with that of the paralyzed, human iBCI users with implanted intracortical electrodes. jaBCI allowed us to imitate the experimental protocols (e.g. the same velocity Kalman filter decoder and center-out task) and compute the same seven behavioral measures used in three critical studies.Significance. These encouraging results suggest the jaBCI's real-time firing rate emulation is a useful means to provide statistically robust sample sizes for rapid prototyping and optimization of decoding algorithms, the study of bi-directional learning in iBCIs, and improving iBCI control.

Neural Decoders Using Reinforcement Learning in Brain Machine Interfaces: A Technical Review

Creating flexible and robust brain machine interfaces (BMIs) is currently a popular topic of research that has been explored for decades in medicine, engineering, commercial, and machine-learning communities. In particular, the use of techniques using reinforcement learning (RL) has demonstrated impressive results but is under-represented in the BMI community. To shine more light on this promising relationship, this article aims to provide an exhaustive review of RL's applications to BMIs. Our primary focus in this review is to provide a technical summary of various algorithms used in RL-based BMIs to decode neural intention, without emphasizing preprocessing techniques on the neural signals and reward modeling for RL. We first organize the literature based on the type of RL methods used for neural decoding, and then each algorithm's learning strategy is explained along with its application in BMIs. A comparative analysis highlighting the similarities and uniqueness among neural decoders is provided. Finally, we end this review with a discussion about the current stage of RLBMIs including their limitations and promising directions for future research.

Probing the Relationship Between Latent Linear Dynamical Systems and Low-Rank Recurrent Neural Network Models

A large body of work has suggested that neural populations exhibit low-dimensional dynamics during behavior. However, there are a variety of different approaches for modeling low-dimensional neural population activity. One approach involves latent linear dynamical system (LDS) models, in which population activity is described by a projection of low-dimensional latent variables with linear dynamics. A second approach involves low-rank recurrent neural networks (RNNs), in which population activity arises directly from a low-dimensional projection of past activity. Although these two modeling approaches have strong similarities, they arise in different contexts and tend to have different domains of application. Here we examine the precise relationship between latent LDS models and linear low-rank RNNs. When can one model class be converted to the other, and vice versa? We show that latent LDS models can only be converted to RNNs in specific limit cases, due to the non-Markovian property of latent LDS models. Conversely, we show that linear RNNs can be mapped onto LDS models, with latent dimensionality at most twice the rank of the RNN. A surprising consequence of our results is that a partially observed RNN is better represented by an LDS model than by an RNN consisting of only observed units.

Atomic Force Microscope Characterization of the Bending Stiffness and Surface Topography of Silicon and Polymeric Electrodes

Implanted electrodes in the brain are increasingly used in research and clinical settings to understand and treat neurological conditions. However, a foreign body response typically occurs after implantation, and glial encapsulation of the device is a commonly observed. Multiple factors affect how gliosis surrounding the implantable electrodes evolves. Characterizing and measuring the surface features and mechanical properties of these devices may allow us to predict where gliosis will occur, and understanding how electrode design features may impact astrogliosis may give researchers a set of design guidelines to follow to maximize chronic performance. In this study, we used atomic force microscopy to measure surface roughness on parylene, polyimide, and silicon devices. Multiple features on microelectrode arrays were measured, including electrode sites, traces, and the bulk substrate. We found differences in surface roughness according to device material, but not device features. We also directly measured the bending stiffness of silicon devices, providing a more exact quantification of this property to corroborate calculated estimates.

Continuous Decoding of Hand Movement From EEG Signals Using Phase-Based Connectivity Features

The principal goal of the brain-computer interface (BCI) is to translate brain signals into meaningful commands to control external devices or neuroprostheses to restore lost functions of patients with severe motor disabilities. The invasive recording of brain signals involves numerous health issues. Therefore, BCIs based on non-invasive recording modalities such as electroencephalography (EEG) are safer and more comfortable for the patients. The BCI requires reconstructing continuous movement parameters such as position or velocity for practical application of neuroprostheses. The BCI studies in continuous decoding have extensively relied on extracting features from the amplitude of brain signals, whereas the brain connectivity features have rarely been explored. This study aims to investigate the feasibility of using phase-based connectivity features in decoding continuous hand movements from EEG signals. To this end, the EEG data were collected from seven healthy subjects performing a 2D center-out hand movement task in four orthogonal directions. The phase-locking value (PLV) and magnitude-squared coherence (MSC) are exploited as connectivity features along with multiple linear regression (MLR) for decoding hand positions. A brute-force search approach is employed to find the best channel pairs for extracting features related to hand movements. The results reveal that the regression models based on PLV and MSC features achieve the average Pearson correlations of 0.43 ± 0.03 and 0.42 ± 0.06, respectively, between predicted and actual trajectories over all subjects. The delta and alpha band features have the most contribution in regression analysis. The results also demonstrate that both PLV and MSC decoding models lead to superior results on our data compared to two recently proposed feature extraction methods solely based on the amplitude or phase of recording signals (p < 0.05). This study verifies the ability of PLV and MSC features in the continuous decoding of hand movements with linear regression. Thus, our findings suggest that extracting features based on brain connectivity can improve the accuracy of trajectory decoder BCIs.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Algorithm and hardware considerations for real-time neural signal on-implant processing

Objective Various on-workstation neural-spike-based brain machine interface(BMI) systems have reached the point of in-human trials, but on-node and on-implant BMI systems are still under exploration. Such systems are constrained by the area and battery. Researchers should consider the algorithm complexity, available resources, power budgets, CMOS technologies, and the choice of platforms when designing BMI systems. However, the effect of these factors is currently still unclear. Approaches. Here we have proposed a novel real-time 128 channel spike detection algorithm and optimised it on Microcontroller(MCU) and Field Programmable Gate Array(FPGA) platforms towards consuming minimal power and memory/resources. It is presented as a use case to explore the different considerations in system design. Main results. The proposed spike detection algorithm achieved over 97% sensitivity and a smaller than 3% false detection rate. The MCU implementation occupies less than 3KB RAM and consumes 31.5μW/ch. The FPGA platform only occupies 299 logic cells and 3KB RAM for 128 channels and consumes 0.04μW/ch. Significance. On the spike detection algorithm front, we have eliminated the processing bottleneck by reducing the dynamic power consumption to lower than the hardware static power, without sacrificing detection performance. More importantly, we have explored the considerations in algorithm and hardware design with respect to scalability, portability, and costs. These findings can facilitate and guide the future development of real-time on-implant neural signal processing platforms.

Effects of Peripheral Haptic Feedback on Intracortical Brain-Computer Interface Control and Associated Sensory Responses in Motor Cortex

Intracortical brain-computer interfaces (iBCIs) provide people with paralysis a means to control devices with signals decoded from brain activity. Despite recent impressive advances, these devices still cannot approach able-bodied levels of control. To achieve naturalistic control and improved performance of neural prostheses, iBCIs will likely need to include proprioceptive feedback. With the goal of providing proprioceptive feedback via mechanical haptic stimulation, we aim to understand how haptic stimulation affects motor cortical neurons and ultimately, iBCI control. We provided skin shear haptic stimulation as a substitute for proprioception to the back of the neck of a person with tetraplegia. The neck location was determined via assessment of touch sensitivity using a monofilament test kit. The participant was able to correctly report skin shear at the back of the neck in 8 unique directions with 65% accuracy. We found motor cortical units that exhibited sensory responses to shear stimuli, some of which were strongly tuned to the stimuli and well modeled by cosine-shaped functions. In this article, we also demonstrated online iBCI cursor control with continuous skin-shear feedback driven by decoded command signals. Cursor control performance increased slightly but significantly when the participant was given haptic feedback, compared to the purely visual feedback condition.

Intracortical Microelectrode Array Unit Yield under Chronic Conditions: A Comparative Evaluation

While microelectrode arrays (MEAs) offer the promise of elucidating functional neural circuitry and serve as the basis for a cortical neuroprosthesis, the challenge of designing and demonstrating chronically reliable technology remains. Numerous studies report “chronic” data but the actual time spans and performance measures corresponding to the experimental work vary. In this study, we reviewed the experimental durations that constitute chronic studies across a range of MEA types and animal species to gain an understanding of the widespread variability in reported study duration. For rodents, which are the most commonly used animal model in chronic studies, we examined active electrode yield (AEY) for different array types as a means to contextualize the study duration variance, as well as investigate and interpret the performance of custom devices in comparison to conventional MEAs. We observed wide-spread variance within species for the chronic implantation period and an AEY that decayed linearly in rodent models that implanted commercially-available devices. These observations provide a benchmark for comparing the performance of new technologies and highlight the need for consistency in chronic MEA studies. Additionally, to fully derive performance under chronic conditions, the duration of abiotic failure modes, biological processes induced by indwelling probes, and intended application of the device are key determinants.

Neuropathological effects of chronically implanted, intracortical microelectrodes in a tetraplegic patient

Objective.Intracortical microelectrode arrays (MEA) can be used as part of a brain-machine interface system to provide sensory feedback control of an artificial limb to assist persons with tetraplegia. Variability in functionality of electrodes has been reported but few studies in humans have examined the impact of chronic brain tissue responses revealed postmortem on electrode performancein vivo. Approach.In a tetraplegic man, recording MEAs were implanted into the anterior intraparietal area and Brodmann's area 5 (BA5) of the posterior parietal cortex and a recording and stimulation array was implanted in BA1 of the primary somatosensory cortex (S1). The participant expired from unrelated causes seven months after MEA implantation. The underlying tissue of two of the three devices was processed for histology and electrophysiological recordings were assessed.Main results.Recordings of neuronal activity were obtained from all three MEAs despite meningeal encapsulation. However, the S1 array had a greater encapsulation, yielded lower signal quality than the other arrays and failed to elicit somatosensory percepts with electrical stimulation. Histological examination of tissues underlying S1 and BA5 implant sites revealed localized leptomeningeal proliferation and fibrosis, lymphocytic infiltrates, astrogliosis, and foreign body reaction around the electrodes. The BA5 recording site showed focal cerebral microhemorrhages and leptomeningeal vascular ectasia. The S1 site showed focal tissue damage including vascular recanalization, neuronal loss, and extensive subcortical white matter necrosis. The tissue response at the S1 site included hemorrhagic-induced injury suggesting a likely mechanism for reduced function of the S1 implant.Significance.Our findings are similar to those from animal studies with chronic intracortical implants and suggest that vascular disruption and microhemorrhage during device implantation are important contributors to overall array and individual electrode performance and should be a topic for future device development to mitigate tissue responses. Neurosurgical considerations are also discussed.

Inter-stimulus phase coherence in steady-state somatosensory evoked potentials and its application in improving the performance of single-channel MI-BCI

Objective. With the development of clinical applications of motor imagery-based brain-computer interfaces (MI-BCIs), a single-channel MI-BCI system that can be easily assembled is an attractive goal. However, due to the low quality of the spectral power features in the traditional MI-BCI paradigm, the recognition performance of current single-channel systems is far lower than that of multi-channel systems, impeding their use in clinical applications.Approach.In this study, the subjects' right and left hands were stimulated simultaneously at different frequencies to induce steady-state somatosensory evoked potentials (SSSEP). Subjects then performed motor imagery (MI) tasks. A new electroencephalography (EEG) index, inter-stimulus phase coherence (ISPC), was built to measure phase desynchronization of SSSEP caused by MI. Then, ISPC is introduced as a feature into left-hand and right-hand MI recognition.Main results.ISPC analysis found that left-handed MI can cause a significant decrease in phase synchronization in contralateral sensorimotor SSSEP, while right-handed MI has little effect on it, and vice versa. Combining ISPC features with traditional spectral power features, the single-channel left-hand versus right-hand MI recognition accuracy reaches 81.0%, which is much higher than that observed with traditional MI paradigms (about 60%).Significance.This work shows that the hybrid MI-SSSEP paradigm can provide more sensitive EEG features to decode motor intentions, demonstrating its potential for clinical applications.

Replay of Learned Neural Firing Sequences during Rest in Human Motor Cortex

The offline “replay” of neural firing patterns underlying waking experience, previously observed in non-human animals, is thought to be a mechanism for memory consolidation. Here, we test for replay in the human brain by recording spiking activity from the motor cortex of two participants who had intracortical microelectrode arrays placed chronically as part of a brain-computer interface pilot clinical trial. Participants took a nap before and after playing a neurally controlled sequence-copying game that consists of many repetitions of one “repeated” sequence sparsely interleaved with varying “control” sequences. Both participants performed repeated sequences more accurately than control sequences, consistent with learning. We compare the firing rate patterns that caused the cursor movements when performing each sequence to firing rate patterns throughout both rest periods. Correlations with repeated sequences increase more from pre- to post-task rest than do correlations with control sequences, providing direct evidence of learning-related replay in the human brain.

Eichenlaub et al. show that in the motor cortex of brain-computer interface trial participants, the firing rate patterns corresponding to a previously learned motor sequence are replayed during rest. These findings provide direct evidence of memory replay in the human brain.

An artificial intelligence that increases simulated brain-computer interface performance

Objective.Brain-computer interfaces (BCIs) translate neural activity into control signals for assistive devices in order to help people with motor disabilities communicate effectively. In this work, we introduce a new BCI architecture that improves control of a BCI computer cursor to type on a virtual keyboard.Approach.Our BCI architecture incorporates an external artificial intelligence (AI) that beneficially augments the movement trajectories of the BCI. This AI-BCI leverages past user actions, at both long (100 s of seconds ago) and short (100 s of milliseconds ago) timescales, to modify the BCI's trajectories.Main results.We tested our AI-BCI in a closed-loop BCI simulator with nine human subjects performing a typing task. We demonstrate that our AI-BCI achieves: (1) categorically higher information communication rates, (2) quicker ballistic movements between targets, (3) improved precision control to 'dial in' on targets, and (4) more efficient movement trajectories. We further show that our AI-BCI increases performance across a wide control quality spectrum from poor to proficient control.Significance.This AI-BCI architecture, by increasing BCI performance across all key metrics evaluated, may increase the clinical viability of BCI systems.

The Neural Representation of Force across Grasp Types in Motor Cortex of Humans with Tetraplegia

Intracortical brain-computer interfaces (iBCIs) have the potential to restore hand grasping and object interaction to individuals with tetraplegia. Optimal grasping and object interaction require simultaneous production of both force and grasp outputs. However, since overlapping neural populations are modulated by both parameters, grasp type could affect how well forces are decoded from motor cortex in a closed-loop force iBCI. Therefore, this work quantified the neural representation and offline decoding performance of discrete hand grasps and force levels in two human participants with tetraplegia. Participants attempted to produce three discrete forces (light, medium, hard) using up to five hand grasp configurations. A two-way Welch ANOVA was implemented on multiunit neural features to assess their modulation to force and grasp Demixed principal component analysis (dPCA) was used to assess for population-level tuning to force and grasp and to predict these parameters from neural activity. Three major findings emerged from this work: (1) force information was neurally represented and could be decoded across multiple hand grasps (and, in one participant, across attempted elbow extension as well); (2) grasp type affected force representation within multiunit neural features and offline force classification accuracy; and (3) grasp was classified more accurately and had greater population-level representation than force. These findings suggest that force and grasp have both independent and interacting representations within cortex, and that incorporating force control into real-time iBCI systems is feasible across multiple hand grasps if the decoder also accounts for grasp type.

Robust and accurate decoding of hand kinematics from entire spiking activity using deep learning

OBJECTIVE

Brain-machine interfaces (BMIs) seek to restore lost motor functions in individuals with neurological disorders by enabling them to control external devices directly with their thoughts. This work aims to improve robustness and decoding accuracy that currently become major challenges in the clinical translation of intracortical BMIs.

APPROACH

We propose entire spiking activity (ESA) -an envelope of spiking activity that can be extracted by a simple, threshold-less, and automated technique- as the input signal. We couple ESA with deep learning-based decoding algorithm that uses quasi-recurrent neural network (QRNN) architecture. We evaluate comprehensively the performance of ESA-driven QRNN decoder for decoding hand kinematics from neural signals chronically recorded from the primary motor cortex area of three non-human primates performing different tasks.

MAIN RESULTS

Our proposed method yields consistently higher decoding performance than any other combinations of the input signal and decoding algorithm previously reported across long term recording sessions. It can sustain high decoding performance even when removing spikes from the raw signals, when using the different number of channels, and when using a smaller amount of training data.

SIGNIFICANCE

Overall results demonstrate exceptionally high decoding accuracy and chronic robustness, which is highly desirable given it is an unresolved challenge in BMIs.

Auditory cues reveal intended movement information in middle frontal gyrus neuronal ensemble activity of a person with tetraplegia

Intracortical brain-computer interfaces (iBCIs) allow people with paralysis to directly control assistive devices using neural activity associated with the intent to move. Realizing the full potential of iBCIs critically depends on continued progress in understanding how different cortical areas contribute to movement control. Here we present the first comparison between neuronal ensemble recordings from the left middle frontal gyrus (MFG) and precentral gyrus (PCG) of a person with tetraplegia using an iBCI. As expected, PCG was more engaged in selecting and generating intended movements than in earlier perceptual stages of action planning. By contrast, MFG displayed movement-related information during the sensorimotor processing steps preceding the appearance of the action plan in PCG, but only when the actions were instructed using auditory cues. These results describe a previously unreported function for neurons in the human left MFG in auditory processing contributing to motor control.

Compressed sensing of large-scale local field potentials using adaptive sparsity analysis and Non-convex Optimization

OBJECTIVE

Energy consumption is a critical issue in resource-constrained wireless neural recording applications with limited data bandwidth. Compressed sensing (CS) has emerged as a powerful framework in addressing this issue owing to its highly efficient data compression procedure. In this paper, a CS-based approach termed Simultaneous Analysis Non-Convex Optimization (SANCO) is proposed for large-scale, multi-channel local field potentials (LFPs) recording.

APPROACH

The SANCO method consists of three parts: (1) the analysis model is adopted to reinforce sparsity of the multi-channel LFPs, therefore overcoming the drawbacks of conventional synthesis models. (2) An optimal continuous order difference matrix is constructed as the analysis operator, enhancing the recovery performance while saving both computational resources and data storage space. (3) A non-convex optimizer that can by efficiently solved with alternating direction method of multipliers (ADMM) is developed for multi-channel LFPs reconstruction.

MAIN RESULTS

Experimental results on real datasets reveal that the proposed approach outperforms state-of-the-art CS methods in terms of both recovery quality and computational efficiency.

SIGNIFICANCE

Energy efficiency of the SANCO make it an ideal candidate for resource-constrained, large scale wireless neural recording. Particularly, the proposed method ensures that the key features of LFPs had little degradation even when data are compressed by 16x, making it very suitable for long term wireless neural recording applications.

Shared Prosthetic Control Based on Multiple Movement Intent Decoders

SIGNIFICANCE

A number of movement intent decoders exist in the literature that typically differ in the algorithms used and the nature of the outputs generated. Each approach comes with its own advantages and disadvantages. Combining the estimates of multiple algorithms may have better performance than any of the individual methods.

OBJECTIVE

This paper presents and evaluates a shared controller framework for prosthetic limbs based on multiple decoders of volitional movement intent.

METHODS

An algorithm to combine multiple estimates to control the prosthesis is developed in this paper. The capabilities of the approach are validated using a system that combines a Kalman filter-based decoder with a multilayer perceptron classifier-based decoder. The shared controller's performance is validated in online experiments where a virtual limb is controlled in real-time by amputee and intact-arm subjects. During the testing phase subjects controlled a virtual hand in real time to move digits to instructed positions using either a Kalman filter decoder, a multilayer perceptron decoder, or a linear combination of the two.

RESULTS

The shared controller results in statistically significant improvements over the component decoders. Specifically, certain degrees of shared control result in increases in the time-in-target metric and decreases in unintended movements.

CONCLUSION

The shared controller of this paper combines the good qualities of component decoders tested in this paper. Herein, combining a Kalman filter decoder with a classifier-based decoder inherits the flexibility of the Kalman filter decoder and the limited unwanted movements from the classifier-based decoder, resulting in a system that may be able to perform the tasks of everyday life more naturally and reliably.

Real-Time Point Process Filter for Multidimensional Decoding Problems Using Mixture Models

There is an increasing demand for a computationally efficient and accurate point process filter solution for real-time decoding of population spiking activity in multidimensional spaces. Real-time tools for neural data analysis, specifically real-time neural decoding solutions open doors for developing experiments in a closed-loop setting and more versatile brain-machine interfaces. Over the past decade, the point process filter has been successfully applied in the decoding of behavioral and biological signals using spiking activity of an ensemble of cells; however, the filter solution is computationally expensive in multi-dimensional filtering problems. Here, we propose an approximate filter solution for a general point-process filter problem when the conditional intensity of a cell's spiking activity is characterized using a Mixture of Gaussians. We propose the filter solution for a broader class of point process observation called marked point-process, which encompasses both clustered - mainly, called sorted - and clusterless - generally called unsorted or raw- spiking activity. We assume that the posterior distribution on each filtering time-step can be approximated using a Gaussian Mixture Model and propose a computationally efficient algorithm to estimate the optimal number of mixture components and their corresponding weights, mean, and covariance estimates. This algorithm provides a real-time solution for multi-dimensional point-process filter problem and attains accuracy comparable to the exact solution. Our solution takes advantage of mixture dropping and merging algorithms, which collectively control the growth of mixture components on each filtering time-step. We apply this methodology in decoding a rat's position in both 1-D and 2-D spaces using clusterless spiking data of an ensemble of rat hippocampus place cells. The approximate solution in 1-D and 2-D decoding is more than 20 and 4,000 times faster than the exact solution, while their accuracy in decoding a rat position only drops by less than 9% and 4% in RMSE and 95% highest probability coverage area (HPD) performance metrics. Though the marked-point filter solution is better suited for real-time decoding problems, we discuss how the filter solution can be applied to sorted spike data to better reflect the proposed methodology versatility.

Decoding Kinematic Information From Primary Motor Cortex Ensemble Activities Using a Deep Canonical Correlation Analysis

The control of arm movements through intracortical brain–machine interfaces (BMIs) mainly relies on the activities of the primary motor cortex (M1) neurons and mathematical models that decode their activities. Recent research on decoding process attempts to not only improve the performance but also simultaneously understand neural and behavioral relationships. In this study, we propose an efficient decoding algorithm using a deep canonical correlation analysis (DCCA), which maximizes correlations between canonical variables with the non-linear approximation of mappings from neuronal to canonical variables via deep learning. We investigate the effectiveness of using DCCA for finding a relationship between M1 activities and kinematic information when non-human primates performed a reaching task with one arm. Then, we examine whether using neural activity representations from DCCA improves the decoding performance through linear and non-linear decoders: a linear Kalman filter (LKF) and a long short-term memory in recurrent neural networks (LSTM-RNN). We found that neural representations of M1 activities estimated by DCCA resulted in more accurate decoding of velocity than those estimated by linear canonical correlation analysis, principal component analysis, factor analysis, and linear dynamical system. Decoding with DCCA yielded better performance than decoding the original FRs using LSTM-RNN (6.6 and 16.0% improvement on average for each velocity and position, respectively; Wilcoxon rank sum test, p < 0.05). Thus, DCCA can identify the kinematics-related canonical variables of M1 activities, thus improving the decoding performance. Our results may help advance the design of decoding models for intracortical BMIs.

Dorsolateral prefrontal cortex-based control with an implanted brain-computer interface

The objective of this study was to test the feasibility of using the dorsolateral prefrontal cortex as a signal source for brain-computer interface control in people with severe motor impairment. We implanted two individuals with locked-in syndrome with a chronic brain-computer interface designed to restore independent communication. The implanted system (Utrecht NeuroProsthesis) included electrode strips placed subdurally over the dorsolateral prefrontal cortex. In both participants, counting backwards activated the dorsolateral prefrontal cortex consistently over the course of 47 and 22 months, respectively. Moreover, both participants were able to use this signal to control a cursor in one dimension, with average accuracy scores of 78 ± 9% (standard deviation) and 71 ± 11% (chance level: 50%), respectively. Brain-computer interface control based on dorsolateral prefrontal cortex activity is feasible in people with locked-in syndrome and may become of relevance for those unable to use sensorimotor signals for control.

Sensor Modalities for Brain-Computer Interface Technology: A Comprehensive Literature Review

Brain-computer interface (BCI) technology is rapidly developing and changing the paradigm of neurorestoration by linking cortical activity with control of an external effector to provide patients with tangible improvements in their ability to interact with the environment. The sensor component of a BCI circuit dictates the resolution of brain pattern recognition and therefore plays an integral role in the technology. Several sensor modalities are currently in use for BCI applications and are broadly either electrode-based or functional neuroimaging-based. Sensors vary in their inherent spatial and temporal resolutions, as well as in practical aspects such as invasiveness, portability, and maintenance. Hybrid BCI systems with multimodal sensory inputs represent a promising development in the field allowing for complimentary function. Artificial intelligence and deep learning algorithms have been applied to BCI systems to achieve faster and more accurate classifications of sensory input and improve user performance in various tasks. Neurofeedback is an important advancement in the field that has been implemented in several types of BCI systems by showing users a real-time display of their recorded brain activity during a task to facilitate their control over their own cortical activity. In this way, neurofeedback has improved BCI classification and enhanced user control over BCI output. Taken together, BCI systems have progressed significantly in recent years in terms of accuracy, speed, and communication. Understanding the sensory components of a BCI is essential for neurosurgeons and clinicians as they help advance this technology in the clinical setting.

Decoding hand kinematics from population responses in sensorimotor cortex during grasping

OBJECTIVE

The hand-a complex effector comprising dozens of degrees of freedom of movement-endows us with the ability to flexibly, precisely, and effortlessly interact with objects. The neural signals associated with dexterous hand movements in primary motor cortex (M1) and somatosensory cortex (SC) have received comparatively less attention than have those associated with proximal upper limb control.

APPROACH

To fill this gap, we trained two monkeys to grasp objects varying in size and shape while tracking their hand postures and recording single-unit activity from M1 and SC. We then decoded their hand kinematics across tens of joints from population activity in these areas.

MAIN RESULTS

We found that we could accurately decode kinematics with a small number of neural signals and that different cortical fields carry different amounts of information about hand kinematics. In particular, neural signals in rostral M1 led to better performance than did signals in caudal M1, whereas Brodmann's area 3a outperformed areas 1 and 2 in SC. Moreover, decoding performance was higher for joint angles than joint angular velocities, in contrast to what has been found with proximal limb decoders.

SIGNIFICANCE

We conclude that cortical signals can be used for dexterous hand control in brain machine interface applications and that postural representations in SC may be exploited via intracortical stimulation to close the sensorimotor loop.

A state-based probabilistic method for decoding hand position during movement from ECoG signals in non-human primate

OBJECTIVE

In this study, we proposed a state-based probabilistic method for decoding hand positions during unilateral and bilateral movements using the ECoG signals recorded from the brain of Rhesus monkey.

APPROACH

A customized electrode array was implanted subdurally in the right hemisphere of the brain covering from the primary motor cortex to the frontal cortex. Three different experimental paradigms were considered: ipsilateral, contralateral, and bilateral movements. During unilateral movement, the monkey was trained to get food with one hand, while during bilateral movement, the monkey used its left and right hands alternately to get food. To estimate the hand positions, a state-based probabilistic method was introduced which was based on the conditional probability of the hand movement state (i.e. idle, right hand movement, and left hand movement) and the conditional expectation of the hand position for each state. Moreover, a hybrid feature extraction method based on linear discriminant analysis and partial least squares (PLS) was introduced.

MAIN RESULTS

The proposed method could successfully decode the hand positions during ipsilateral, contralateral, and bilateral movements and significantly improved the decoding performance compared to the conventional Kalman and PLS regression methods [Formula: see text]. The proposed hybrid feature extraction method was found to outperform both the PLS and PCA methods [Formula: see text]. Investigating the kinematic information of each frequency band shows that more informative frequency bands were [Formula: see text] (15-30 Hz) and [Formula: see text](50-100 Hz) for ipsilateral and [Formula: see text] and [Formula: see text] (100-200 Hz) for contralateral movements. It is observed that ipsilateral movement was decoded better than contralateral movement for [Formula: see text] (5-15 Hz) and [Formula: see text] bands, while contralateral movements was decoded better for [Formula: see text] (30-200 Hz) and hfECoG (200-400 Hz) bands.

SIGNIFICANCE

Accurate decoding the bilateral movement using the ECoG recorded from one brain hemisphere is an important issue toward real-life applications of the brain-machine interface technologies.

The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models

The Kalman filter provides a simple and efficient algorithm to compute the posterior distribution for state-space models where both the latent state and measurement models are linear and gaussian. Extensions to the Kalman filter, including the extended and unscented Kalman filters, incorporate linearizations for models where the observation model p ( observation | state ) is nonlinear. We argue that in many cases, a model for p ( state | observation ) proves both easier to learn and more accurate for latent state estimation. Approximating p ( state | observation ) as gaussian leads to a new filtering algorithm, the discriminative Kalman filter (DKF), which can perform well even when p ( observation | state ) is highly nonlinear and/or nongaussian. The approximation, motivated by the Bernstein-von Mises theorem, improves as the dimensionality of the observations increases. The DKF has computational complexity similar to the Kalman filter, allowing it in some cases to perform much faster than particle filters with similar precision, while better accounting for nonlinear and nongaussian observation models than Kalman-based extensions. When the observation model must be learned from training data prior to filtering, off-the-shelf nonlinear and nonparametric regression techniques can provide a gaussian model for p ( observation | state ) that cleanly integrates with the DKF. As part of the BrainGate2 clinical trial, we successfully implemented gaussian process regression with the DKF framework in a brain-computer interface to provide real-time, closed-loop cursor control to a person with a complete spinal cord injury. In this letter, we explore the theory underlying the DKF, exhibit some illustrative examples, and outline potential extensions.

Linear Predictive Approaches Separate Field Potentials in Animal Model of Parkinson's Disease

Parkinson's disease (PD) causes impaired movement and cognition. PD can involve profound changes in cortical and subcortical brain activity as measured by electroencephalography or intracranial recordings of local field potentials (LFP). Such signals can adaptively guide deep-brain stimulation (DBS) as part of PD therapy. However, adaptive DBS requires the identification of triggers of neuronal activity dependent on real time monitoring and analysis. Current methods do not always identify PD-related signals and can entail delays. We test an alternative approach based on linear predictive coding (LPC), which fits autoregressive (AR) models to time-series data. Parameters of these AR models can be calculated by fast algorithms in real time. We compare LFPs from the striatum in an animal model of PD with dopamine depletion in the absence and presence of the dopamine precursor levodopa, which is used to treat motor symptoms of PD. We show that in dopamine-depleted mice a first order AR model characterized by a single LPC parameter obtained by LFP sampling at 1 kHz for just 1 min can distinguish between levodopa-treated and saline-treated mice and outperform current methods. This suggests that LPC may be useful in online analysis of neuronal signals to guide DBS in real time and could contribute to DBS-based treatment of PD.

Glymphatic clearance of simulated silicon dispersion in mouse brain analyzed by laser induced breakdown spectroscopy

Silicon-based devices, such as neural probes, are increasingly used as electrodes for receiving electrical signals from neural tissue. Neural probes used chronically have been known to induce inflammation and elicit an immune response. The current study detects and evaluates silicon dispersion from a concentrated source in the mouse brain using laser induced breakdown spectroscopy. Element lines for Si (I) were found at the injection site at approximately 288 nm at 3hr post-implantation, even with tissue perfusion, indicating possible infusion into neural tissue. At 24hr and 1-week post-implantation, no silicon lines were found, indicating clearance. An isolated immune response was found by CD68 macrophage response at 24hr post injection. Future studies should measure chronic silicon exposure to determine if the inflammatory response is proportional to silicon administration. The present type of protocol, coupling laser induced breakdown spectroscopy, neuroimaging, histology, immunohistochemistry, and determination of clearance could be used to investigate the glymphatic system and different tissue states such as in disease (e.g. Alzheimer's).

Toward guiding principles for the design of biologically-integrated electrodes for the central nervous system

Innovation in electrode design has produced a myriad of new and creative strategies for interfacing the nervous system with softer, less invasive, more broadly distributed sites with high spatial resolution. However, despite rapid growth in the use of implanted electrode arrays in research and clinical applications, there are no broadly accepted guiding principles for the design of biocompatible chronic recording interfaces in the central nervous system (CNS). Studies suggest that the architecture and flexibility of devices play important roles in determining effective tissue integration: device feature dimensions (varying from 'sub'- to 'supra'-cellular scales, <10 µm to  >100 µm), Young's modulus, and bending modulus have all been identified as key features of design. However, critical knowledge gaps remain in the field with respect to the underlying motivation for these designs: (1) a systematic study of the relationship between device design features (materials, architecture, flexibility), biointegration, and signal quality needs to be performed, including controls for interaction effects between design features, (2) benchmarks for success need to be determined (biological integration, recording performance, longevity, stability), and (3) user results, particularly those that champion a specific design or electrode modification, need to be replicated across laboratories. Finally, the ancillary effects of factors such as tethering, site impedance and insertion method need to be considered. Here, we briefly review observations to-date of device design effects on tissue integration and performance, and then highlight the need for comprehensive and systematic testing of these effects moving forward.

Neural Representation of Observed, Imagined, and Attempted Grasping Force in Motor Cortex of Individuals with Chronic Tetraplegia

Hybrid kinetic and kinematic intracortical brain-computer interfaces (iBCIs) have the potential to restore functional grasping and object interaction capabilities in individuals with tetraplegia. This requires an understanding of how kinetic information is represented in neural activity, and how this representation is affected by non-motor parameters such as volitional state (VoS), namely, whether one observes, imagines, or attempts an action. To this end, this work investigates how motor cortical neural activity changes when three human participants with tetraplegia observe, imagine, and attempt to produce three discrete hand grasping forces with the dominant hand. We show that force representation follows the same VoS-related trends as previously shown for directional arm movements; namely, that attempted force production recruits more neural activity compared to observed or imagined force production. Additionally, VoS-modulated neural activity to a greater extent than grasping force. Neural representation of forces was lower than expected, possibly due to compromised somatosensory pathways in individuals with tetraplegia, which have been shown to influence motor cortical activity. Nevertheless, attempted forces (but not always observed or imagined forces) could be decoded significantly above chance, thereby potentially providing relevant information towards the development of a hybrid kinetic and kinematic iBCI.

Ipsilateral primary motor cortex and behavioral compensation after stroke: a case series study

Arm motor recovery after stroke is mainly attributed to reorganization of the primary motor cortex (M1). While M1 contralateral to the paretic arm (cM1) is critical for recovery, the role of ipsilateral M1 (iM1) is still inconclusive. Whether iM1 activity is related to recovery, behavioral compensation, or both is still far from settled. We hypothesized that the magnitude of iM1 activity in chronic stroke survivors will increase or decrease in direct proportion to the degree that movements of the paretic arm are compensated. Movement kinematics (VICON, Oxford Metrics) and functional MRI data (3T MR system) were collected in 11 patients before and after a 4-week training designed to improve motor control of the paretic arm and decrease compensatory trunk recruitment. Twelve matched controls underwent similar evaluations and training. Relationships between iM1 activity and trunk motion were analyzed. At baseline, patients exhibited increased iM1 activity (p = 0.001) and relied more on trunk movement (p = 0.02) than controls. These two variables were directly and significantly related in patients (r = 0.74, p = 0.01) but not in controls (r = 0.28, p = 0.4). After training, patients displayed a significant reduction in iM1 activity (p = 0.008) and a trend toward decreased trunk use (p = 0.1). The relationship between these two variables remained significant (r = 0.66, p = 0.03) and different from controls (r = 0.26, p = 0.4). Our preliminary results suggest that iM1 may play a role in compensating for brain damage rather than directly gaining control of the paretic arm. However, we recommend caution in interpreting these results until more work is completed.

Agency and Accountability: Ethical Considerations for Brain-Computer Interfaces

Brain-computer interfaces (BCIs) are systems in which a user's real-time brain activity is used to control an external device, such as a prosthetic limb. BCIs have great potential for restoring lost motor functions in a wide range of patients. However, this futuristic technology raises several ethical questions, especially concerning the degree of agency a BCI affords its user and the extent to which a BCI user ought to be accountable for actions undertaken via the device. This paper examines these and other ethical concerns found at each of the three major parts of the BCI system: the sensor that records neural activity, the decoder that converts raw data into usable signals, and the translator that uses these signals to control the movement of an external device.

Neurorestoration: Advances in human brain–computer interface using microelectrode arrays

Neural damage has been a great challenge to the medical field for a very long time. The emergence of brain–computer interfaces (BCIs) offered a new possibility to enhance the activity of daily living and provide a new formation of entertainment for those with disabilities. Intracortical BCIs, which require the implantation of microelectrodes, can receive neuronal signals with a high spatial and temporal resolution from the individual’s cortex. When BCI decoded cortical signals and mapped them to external devices, it displayed the ability not only to replace part of the human motor function but also to help individuals restore certain neurological functions. In this review, we focus on human intracortical BCI research using microelectrode arrays and summarize the main directions and the latest results in this field. In general, we found that intracortical BCI research based on motor neuroprosthetics and functional electrical stimulation have already achieved some simple functional replacement and treatment of motor function. Pioneering work in the posterior parietal cortex has given us a glimpse of the potential that intracortical BCIs have to control external devices and receive various sensory information.

Longitudinal multimodal assessment of neurodegeneration and vascular remodeling correlated with signal degradation in chronic cortical silicon microelectrodes

Significance: Cortically implanted microelectrode arrays provide a direct interface with neuronal populations and are used to restore movement capabilities and provide sensory feedback to patients with paralysis or amputation. Penetrating electrodes experience high rates of signal degradation within the first year that limit effectiveness and lead to eventual device failure. Aim: To assess vascular and neuronal changes over time in mice with implanted electrodes and examine the contribution of the brain tissue response to electrode performance. Approach: We used a multimodal approach combining in vivo electrophysiology and subcellular-level optical imaging. Results: At acute timescales, we observed structural damage from the mechanical trauma of electrode insertion, evidenced by severed dendrites in the electrode path and local hypofluorescence. Superficial vessel growth and remodeling occurred within the first few weeks in both electrode-implanted and window-only animals, but the deeper capillary growth evident in window-only animals was suppressed in electrode-implanted animals. After longer implantation periods, there was evidence of degeneration of transected dendrites superficial to the electrode path and localized neuronal cell body loss, along with deep vascular velocity changes near the electrode. Total spike rate (SR) across all animals reached a peak between 3 and 9 months postimplantation, then decreased. The local field potential signal remained relatively constant for up to 6 months, particularly in the high-gamma band, indicating long-term electrode viability and neuronal functioning at further distances from the electrode, but it showed a reduction in some animals at later time points. Most importantly, we found that progressive high-gamma and SR reductions both correlate positively with localized cell loss and decreasing capillary density within 100    μ m of the electrode. Conclusions: This multifaceted approach provided a more comprehensive picture of the ongoing biological response at the brain-electrode interface than can be achieved with postmortem histology alone and established a real-time relationship between electrophysiology and tissue damage.

Brain-computer interfaces for communication

Locked-in syndrome (LIS) is characterized by an inability to move or speak in the presence of intact cognition and can be caused by brainstem trauma or neuromuscular disease. Quality of life (QoL) in LIS is strongly impaired by the inability to communicate, which cannot always be remedied by traditional augmentative and alternative communication (AAC) solutions if residual muscle activity is insufficient to control the AAC device. Brain-computer interfaces (BCIs) may offer a solution by employing the person's neural signals instead of relying on muscle activity. Here, we review the latest communication BCI research using noninvasive signal acquisition approaches (electroencephalography, functional magnetic resonance imaging, functional near-infrared spectroscopy) and subdural and intracortical implanted electrodes, and we discuss current efforts to translate research knowledge into usable BCI-enabled communication solutions that aim to improve the QoL of individuals with LIS.