Interfacing with the computational brain

The role of the nucleus basalis of Meynert in neuromodulation therapy: a systematic review from the perspective of neural network oscillations

As a crucial component of the cerebral cholinergic system and the Papez circuit in the basal forebrain, dysfunction of the nucleus basalis of Meynert (NBM) is associated with various neurodegenerative disorders. However, no drugs, including existing cholinesterase inhibitors, have been shown to reverse this dysfunction. Due to advancements in neuromodulation technology, researchers are exploring the use of deep brain stimulation (DBS) therapy targeting the NBM (NBM-DBS) to treat mental and neurological disorders as well as the related mechanisms. Herein, we provided an update on the research progress on cognition-related neural network oscillations and complex anatomical and projective relationships between the NBM and other cognitive structures and circuits. Furthermore, we reviewed previous animal studies of NBM lesions, NBM-DBS models, and clinical case studies to summarize the important functions of the NBM in neuromodulation. In addition to elucidating the mechanism of the NBM neural network, future research should focus on to other types of neurons in the NBM, despite the fact that cholinergic neurons are still the key target for cell type-specific activation by DBS.

Responses of Cortical Neurons to Intracortical Microstimulation in Awake Primates

Intracortical microstimulation (ICMS) is commonly used in many experimental and clinical paradigms; however, its effects on the activation of neurons are still not completely understood. To document the responses of cortical neurons in awake nonhuman primates to stimulation, we recorded single-unit activity while delivering single-pulse stimulation via Utah arrays implanted in primary motor cortex (M1) of three macaque monkeys. Stimuli between 5 and 50 μA delivered to single channels reliably evoked spikes in neurons recorded throughout the array with delays of up to 12 ms. ICMS pulses also induced a period of inhibition lasting up to 150 ms that typically followed the initial excitatory response. Higher current amplitudes led to a greater probability of evoking a spike and extended the duration of inhibition. The likelihood of evoking a spike in a neuron was dependent on the spontaneous firing rate as well as the delay between its most recent spike time and stimulus onset. Tonic repetitive stimulation between 2 and 20 Hz often modulated both the probability of evoking spikes and the duration of inhibition; high-frequency stimulation was more likely to change both responses. On a trial-by-trial basis, whether a stimulus evoked a spike did not affect the subsequent inhibitory response; however, their changes over time were often positively or negatively correlated. Our results document the complex dynamics of cortical neural responses to electrical stimulation that need to be considered when using ICMS for scientific and clinical applications.

Volitional control of single-electrode high gamma local field potentials by people with paralysis

Intracortical brain-computer interfaces (BCIs) can enable individuals to control effectors, such as a computer cursor, by directly decoding the user's movement intentions from action potentials and local field potentials (LFPs) recorded within the motor cortex. However, the accuracy and complexity of effector control achieved with such "biomimetic" BCIs will depend on the degree to which the intended movements used to elicit control modulate the neural activity. In particular, channels that do not record distinguishable action potentials and only record LFP modulations may be of limited use for BCI control. In contrast, a biofeedback approach may surpass these limitations by letting the participants generate new control signals and learn strategies that improve the volitional control of signals used for effector control. Here, we show that, by using a biofeedback paradigm, three individuals with tetraplegia achieved volitional control of gamma LFPs (40-400 Hz) recorded by a single microelectrode implanted in the precentral gyrus. Control was improved over a pair of consecutive sessions up to 3 days apart. In all but one session, the channel used to achieve control lacked distinguishable action potentials. Our results indicate that biofeedback LFP-based BCIs may potentially contribute to the neural modulation necessary to obtain reliable and useful control of effectors. NEW & NOTEWORTHY Our study demonstrates that people with tetraplegia can volitionally control individual high-gamma local-field potential (LFP) channels recorded from the motor cortex, and that this control can be improved using biofeedback. Motor cortical LFP signals are thought to be both informative and stable intracortical signals and, thus, of importance for future brain-computer interfaces.

Brain-machine interface cursor position only weakly affects monkey and human motor cortical activity in the absence of arm movements

Brain-machine interfaces (BMIs) that decode movement intentions should ignore neural modulation sources distinct from the intended command. However, neurophysiology and control theory suggest that motor cortex reflects the motor effector's position, which could be a nuisance variable. We investigated motor cortical correlates of BMI cursor position with or without concurrent arm movement. We show in two monkeys that subtracting away estimated neural correlates of position improves online BMI performance only if the animals were allowed to move their arm. To understand why, we compared the neural variance attributable to cursor position when the same task was performed using arm reaching, versus arms-restrained BMI use. Firing rates correlated with both BMI cursor and hand positions, but hand positional effects were greater. To examine whether BMI position influences decoding in people with paralysis, we analyzed data from two intracortical BMI clinical trial participants and performed an online decoder comparison in one participant. We found only small motor cortical correlates, which did not affect performance. These results suggest that arm movement and proprioception are the major contributors to position-related motor cortical correlates. Cursor position visual feedback is therefore unlikely to affect the performance of BMI-driven prosthetic systems being developed for people with paralysis.

Data-Driven Transducer Design and Identification for Internally-Paced Motor Brain Computer Interfaces: A Review

Brain-Computer Interfaces (BCIs) are systems that establish a direct communication pathway between the users' brain activity and external effectors. They offer the potential to improve the quality of life of motor-impaired patients. Motor BCIs aim to permit severely motor-impaired users to regain limb mobility by controlling orthoses or prostheses. In particular, motor BCI systems benefit patients if the decoded actions reflect the users' intentions with an accuracy that enables them to efficiently interact with their environment. One of the main challenges of BCI systems is to adapt the BCI's signal translation blocks to the user to reach a high decoding accuracy. This paper will review the literature of data-driven and user-specific transducer design and identification approaches and it focuses on internally-paced motor BCIs. In particular, continuous kinematic biomimetic and mental-task decoders are reviewed. Furthermore, static and dynamic decoding approaches, linear and non-linear decoding, offline and real-time identification algorithms are considered. The current progress and challenges related to the design of clinical-compatible motor BCI transducers are additionally discussed.

Parsing learning in networks using brain-machine interfaces

Brain-machine interfaces (BMIs) define new ways to interact with our environment and hold great promise for clinical therapies. Motor BMIs, for instance, re-route neural activity to control movements of a new effector and could restore movement to people with paralysis. Increasing experience shows that interfacing with the brain inevitably changes the brain. BMIs engage and depend on a wide array of innate learning mechanisms to produce meaningful behavior. BMIs precisely define the information streams into and out of the brain, but engage wide-spread learning. We take a network perspective and review existing observations of learning in motor BMIs to show that BMIs engage multiple learning mechanisms distributed across neural networks. Recent studies demonstrate the advantages of BMI for parsing this learning and its underlying neural mechanisms. BMIs therefore provide a powerful tool for studying the neural mechanisms of learning that highlights the critical role of learning in engineered neural therapies.

Switching Markov decoders for asynchronous trajectory reconstruction from ECoG signals in monkeys for BCI applications

Brain-Computer Interfaces (BCIs) are systems which translate brain neural activity into commands for external devices. BCI users generally alternate between No-Control (NC) and Intentional Control (IC) periods. NC/IC discrimination is crucial for clinical BCIs, particularly when they provide neural control over complex effectors such as exoskeletons. Numerous BCI decoders focus on the estimation of continuously-valued limb trajectories from neural signals. The integration of NC support into continuous decoders is investigated in the present article. Most discrete/continuous BCI hybrid decoders rely on static state models which don't exploit the dynamic of NC/IC state succession. A hybrid decoder, referred to as Markov Switching Linear Model (MSLM), is proposed in the present article. The MSLM assumes that the NC/IC state sequence is generated by a first-order Markov chain, and performs dynamic NC/IC state detection. Linear continuous movement models are probabilistically combined using the NC and IC state posterior probabilities yielded by the state decoder. The proposed decoder is evaluated for the task of asynchronous wrist position decoding from high dimensional space-time-frequency ElectroCorticoGraphic (ECoG) features in monkeys. The MSLM is compared with another dynamic hybrid decoder proposed in the literature, namely a Switching Kalman Filter (SKF). A comparison is additionally drawn with a Wiener filter decoder which infers NC states by thresholding trajectory estimates. The MSLM decoder is found to outperform both the SKF and the thresholded Wiener filter decoder in terms of False Positive Ratio and NC/IC state detection error. It additionally surpasses the SKF with respect to the Pearson Correlation Coefficient and Root Mean Squared Error between true and estimated continuous trajectories.

Decoding Local Field Potentials for Neural Interfaces

The stability and frequency content of local field potentials (LFPs) offer key advantages for long-term, low-power neural interfaces. However, interpreting LFPs may require new signal processing techniques which should be informed by a scientific understanding of how these recordings arise from the coordinated activity of underlying neuronal populations. We review current approaches to decoding LFPs for brain-machine interface (BMI) applications, and suggest several directions for future research. To facilitate an improved understanding of the relationship between LFPs and spike activity, we share a dataset of multielectrode recordings from monkey motor cortex, and describe two unsupervised analysis methods we have explored for extracting a low-dimensional feature space that is amenable to biomimetic decoding and biofeedback training.

What Turns Assistive into Restorative Brain-Machine Interfaces?

Brain-machine interfaces (BMI) may support motor impaired patients during activities of daily living by controlling external devices such as prostheses (assistive BMI). Moreover, BMIs are applied in conjunction with robotic orthoses for rehabilitation of lost motor function via neurofeedback training (restorative BMI). Using assistive BMI in a rehabilitation context does not automatically turn them into restorative devices. This perspective article suggests key features of restorative BMI and provides the supporting evidence: In summary, BMI may be referred to as restorative tools when demonstrating subsequently (i) operant learning and progressive evolution of specific brain states/dynamics, (ii) correlated modulations of functional networks related to the therapeutic goal, (iii) subsequent improvement in a specific task, and (iv) an explicit correlation between the modulated brain dynamics and the achieved behavioral gains. Such findings would provide the rationale for translating BMI-based interventions into clinical settings for reinforcement learning and motor rehabilitation following stroke.

Reinforcement learning of self-regulated sensorimotor β-oscillations improves motor performance

Self-regulation of sensorimotor oscillations is currently researched in neurorehabilitation, e.g. for priming subsequent physiotherapy in stroke patients, and may be modulated by neurofeedback or transcranial brain stimulation. It has still to be demonstrated, however, whether and under which training conditions such brain self-regulation could also result in motor gains. Thirty-two right-handed, healthy subjects participated in a three-day intervention during which they performed 462 trials of kinesthetic motor-imagery while a brain-robot interface (BRI) turned event-related β-band desynchronization of the left sensorimotor cortex into the opening of the right hand by a robotic orthosis. Different training conditions were compared in a parallel-group design: (i) adaptive classifier thresholding and contingent feedback, (ii) adaptive classifier thresholding and non-contingent feedback, (iii) non-adaptive classifier thresholding and contingent feedback, and (iv) non-adaptive classifier thresholding and non-contingent feedback. We studied the task-related cortical physiology with electroencephalography and the behavioral performance in a subsequent isometric motor task. Contingent neurofeedback and adaptive classifier thresholding were critical for learning brain self-regulation which, in turn, led to behavioral gains after the intervention. The acquired skill for sustained sensorimotor β-desynchronization correlated significantly with subsequent motor improvement. Operant learning of brain self-regulation with a BRI may offer a therapeutic perspective for severely affected stroke patients lacking residual hand function.

Reinforcement learning of self-regulated β-oscillations for motor restoration in chronic stroke

Neurofeedback training of Motor imagery (MI)-related brain-states with brain-computer/brain-machine interfaces (BCI/BMI) is currently being explored as an experimental intervention prior to standard physiotherapy to improve the motor outcome of stroke rehabilitation. The use of BCI/BMI technology increases the adherence to MI training more efficiently than interventions with sham or no feedback. Moreover, pilot studies suggest that such a priming intervention before physiotherapy might—like some brain stimulation techniques—increase the responsiveness of the brain to the subsequent physiotherapy, thereby improving the general clinical outcome. However, there is little evidence up to now that these BCI/BMI-based interventions have achieved operate conditioning of specific brain states that facilitate task-specific functional gains beyond the practice of primed physiotherapy. In this context, we argue that BCI/BMI technology provides a valuable neurofeedback tool for rehabilitation but needs to aim at physiological features relevant for the targeted behavioral gain. Moreover, this therapeutic intervention has to be informed by concepts of reinforcement learning to develop its full potential. Such a refined neurofeedback approach would need to address the following issues: (1) Defining a physiological feedback target specific to the intended behavioral gain, e.g., β-band oscillations for cortico-muscular communication. This targeted brain state could well be different from the brain state optimal for the neurofeedback task, e.g., α-band oscillations for differentiating MI from rest; (2) Selecting a BCI/BMI classification and thresholding approach on the basis of learning principles, i.e., balancing challenge and reward of the neurofeedback task instead of maximizing the classification accuracy of the difficulty level device; and (3) Adjusting the difficulty level in the course of the training period to account for the cognitive load and the learning experience of the participant. Here, we propose a comprehensive neurofeedback strategy for motor restoration after stroke that addresses these aspects, and provide evidence for the feasibility of the suggested approach by demonstrating that dynamic threshold adaptation based on reinforcement learning may lead to frequency-specific operant conditioning of β-band oscillations paralleled by task-specific motor improvement; a proposal that requires investigation in a larger cohort of stroke patients.

Encoder-decoder optimization for brain-computer interfaces

Neuroprosthetic brain-computer interfaces are systems that decode neural activity into useful control signals for effectors, such as a cursor on a computer screen. It has long been recognized that both the user and decoding system can adapt to increase the accuracy of the end effector. Co-adaptation is the process whereby a user learns to control the system in conjunction with the decoder adapting to learn the user's neural patterns. We provide a mathematical framework for co-adaptation and relate co-adaptation to the joint optimization of the user's control scheme ("encoding model") and the decoding algorithm's parameters. When the assumptions of that framework are respected, co-adaptation cannot yield better performance than that obtainable by an optimal initial choice of fixed decoder, coupled with optimal user learning. For a specific case, we provide numerical methods to obtain such an optimized decoder. We demonstrate our approach in a model brain-computer interface system using an online prosthesis simulator, a simple human-in-the-loop pyschophysics setup which provides a non-invasive simulation of the BCI setting. These experiments support two claims: that users can learn encoders matched to fixed, optimal decoders and that, once learned, our approach yields expected performance advantages.

Combining decoder design and neural adaptation in brain-machine interfaces

Brain-machine interfaces (BMIs) aim to help people with paralysis by decoding movement-related neural signals into control signals for guiding computer cursors, prosthetic arms, and other assistive devices. Despite compelling laboratory experiments and ongoing FDA pilot clinical trials, system performance, robustness, and generalization remain challenges. We provide a perspective on how two complementary lines of investigation, that have focused on decoder design and neural adaptation largely separately, could be brought together to advance BMIs. This BMI paradigm should also yield new scientific insights into the function and dysfunction of the nervous system.

Real-time estimation and biofeedback of single-neuron firing rates using local field potentials

The long-term stability and low-frequency composition of local field potentials (LFPs) offer important advantages for robust and efficient neuroprostheses. However, cortical LFPs recorded by multi-electrode arrays are often assumed to contain only redundant information arising from the activity of large neuronal populations. Here we show that multichannel LFPs in monkey motor cortex each contain a slightly different mixture of distinctive slow potentials that accompany neuronal firing. As a result, the firing rates of individual neurons can be estimated with surprising accuracy. We implemented this method in a real-time biofeedback brain–machine interface, and found that monkeys could learn to modulate the activity of arbitrary neurons using feedback derived solely from LFPs. These findings provide a principled method for monitoring individual neurons without long-term recording of action potentials.

The use of local field potential (LFP) brain signals may allow development of more efficient and robust neural prosthetic devices. Here, Hall et al. develop a method for estimation and biofeedback control of single-neuron firing rates using signals extracted from multiple low-frequency LFPs.

Closed-loop decoder adaptation shapes neural plasticity for skillful neuroprosthetic control

Neuroplasticity may play a critical role in developing robust, naturally controlled neuroprostheses. This learning, however, is sensitive to system changes such as the neural activity used for control. The ultimate utility of neuroplasticity in real-world neuroprostheses is thus unclear. Adaptive decoding methods hold promise for improving neuroprosthetic performance in nonstationary systems. Here, we explore the use of decoder adaptation to shape neuroplasticity in two scenarios relevant for real-world neuroprostheses: nonstationary recordings of neural activity and changes in control context. Nonhuman primates learned to control a cursor to perform a reaching task using semistationary neural activity in two contexts: with and without simultaneous arm movements. Decoder adaptation was used to improve initial performance and compensate for changes in neural recordings. We show that beneficial neuroplasticity can occur alongside decoder adaptation, yielding performance improvements, skill retention, and resistance to interference from native motor networks. These results highlight the utility of neuroplasticity for real-world neuroprostheses.

Neural correlates of the rubber hand illusion in amputees: a report of two cases

One of the current challenges in the field of advanced prosthetics is the development of artificial limbs that provide the user with detailed sensory feedback. Sensory feedback from our limbs is not only important for proprioceptive awareness and motor control, but also essential for providing us with a feeling of ownership or simply put, the sensation that our limbs actually belong to ourselves. The strong link between sensory feedback and ownership has been repeatedly demonstrated with the so-called rubber hand illusion (RHI), during which individuals are induced with the illusory sensation that an artificial hand is their own. In healthy participants, this occurs via integration of visual and tactile signals, which is primarily supported by multisensory regions in premotor and intraparietal cortices. Here, we describe a functional magnetic resonance imaging (fMRI) study with two upper limb amputees, showing for the first time that the same brain regions underlie ownership sensations of an artificial hand in this population. Albeit preliminary, these findings are interesting from both a theoretical as well as a clinical point of view. From a theoretical perspective, they imply that even years after the amputation, a few seconds of synchronous visuotactile stimulation are sufficient to activate hand-centered multisensory integration mechanisms. From a clinical perspective, they show that a very basic sensation of touch from an artificial hand can be obtained by simple but precisely targeted stimulation of the stump, and suggest that a similar mechanism implemented in prosthetic hands would greatly facilitate ownership sensations and in turn, acceptance of the prosthesis.

Brain-machine interfaces can accelerate clarification of the principal mysteries and real plasticity of the brain

This perspective emphasizes that the brain-machine interface (BMI) research has the potential to clarify major mysteries of the brain and that such clarification of the mysteries by neuroscience is needed to develop BMIs. I enumerate five principal mysteries. The first is “how is information encoded in the brain?” This is the fundamental question for understanding what our minds are and is related to the verification of Hebb’s cell assembly theory. The second is “how is information distributed in the brain?” This is also a reconsideration of the functional localization of the brain. The third is “what is the function of the ongoing activity of the brain?” This is the problem of how the brain is active during no-task periods and what meaning such spontaneous activity has. The fourth is “how does the bodily behavior affect the brain function?” This is the problem of brain-body interaction, and obtaining a new “body” by a BMI leads to a possibility of changes in the owner’s brain. The last is “to what extent can the brain induce plasticity?” Most BMIs require changes in the brain’s neuronal activity to realize higher performance, and the neuronal operant conditioning inherent in the BMIs further enhances changes in the activity.

A bidirectional brain-machine interface algorithm that approximates arbitrary force-fields

We examine bidirectional brain-machine interfaces that control external devices in a closed loop by decoding motor cortical activity to command the device and by encoding the state of the device by delivering electrical stimuli to sensory areas. Although it is possible to design this artificial sensory-motor interaction while maintaining two independent channels of communication, here we propose a rule that closes the loop between flows of sensory and motor information in a way that approximates a desired dynamical policy expressed as a field of forces acting upon the controlled external device. We previously developed a first implementation of this approach based on linear decoding of neural activity recorded from the motor cortex into a set of forces (a force field) applied to a point mass, and on encoding of position of the point mass into patterns of electrical stimuli delivered to somatosensory areas. However, this previous algorithm had the limitation that it only worked in situations when the position-to-force map to be implemented is invertible. Here we overcome this limitation by developing a new non-linear form of the bidirectional interface that can approximate a virtually unlimited family of continuous fields. The new algorithm bases both the encoding of position information and the decoding of motor cortical activity on an explicit map between spike trains and the state space of the device computed with Multi-Dimensional-Scaling. We present a detailed computational analysis of the performance of the interface and a validation of its robustness by using synthetic neural responses in a simulated sensory-motor loop.

Creating new functional circuits for action via brain-machine interfaces

Brain-machine interfaces (BMIs) are an emerging technology with great promise for developing restorative therapies for those with disabilities. BMIs also create novel, well-defined functional circuits for action that are distinct from the natural sensorimotor apparatus. Closed-loop control of BMI systems can also actively engage learning and adaptation. These properties make BMIs uniquely suited to study learning of motor and non-physical, abstract skills. Recent work used motor BMIs to shed light on the neural representations of skill formation and motor adaptation. Emerging work in sensory BMIs, and other novel interface systems, also highlight the promise of using BMI systems to study fundamental questions in learning and sensorimotor control. This paper outlines the interpretation of BMIs as novel closed-loop systems and the benefits of these systems for studying learning. We review BMI learning studies, their relation to motor control, and propose future directions for this nascent field. Understanding learning in BMIs may both elucidate mechanisms of natural motor and abstract skill learning, and aid in developing the next generation of neuroprostheses.

Experiencing your brain: neurofeedback as a new bridge between neuroscience and phenomenology

Neurophenomenology is a scientific research program aimed to combine neuroscience with phenomenology in order to study human experience. Nevertheless, despite several explicit implementations, the integration of first-person data into the experimental protocols of cognitive neuroscience still faces a number of epistemological and methodological challenges. Notably, the difficulties to simultaneously acquire phenomenological and neuroscientific data have limited its implementation into research projects. In our paper, we propose that neurofeedback paradigms, in which subjects learn to self-regulate their own neural activity, may offer a pragmatic way to integrate first-person and third-person descriptions. Here, information from first- and third-person perspectives is braided together in the iterative causal closed loop, creating experimental situations in which they reciprocally constrain each other. In real-time, the subject is not only actively involved in the process of data acquisition, but also assisted to directly influence the neural data through conscious experience. Thus, neurofeedback may help to gain a deeper phenomenological-physiological understanding of downward causations whereby conscious activities have direct causal effects on neuronal patterns. We discuss possible mechanisms that could mediate such effects and indicate a number of directions for future research.

Infrared neural stimulation of primary visual cortex in non-human primates

Infrared neural stimulation (INS) is an alternative neurostimulation modality that uses pulsed infrared light to evoke spatially precise neural activity that does not require direct contact with neural tissue. With these advantages INS has the potential to increase our understanding of specific neural pathways and impact current diagnostic and therapeutic clinical applications. In order to develop this technique, we investigate the feasibility of INS (λ=1.875μm, fiber diameter=100-400μm) to activate and modulate neural activity in primary visual cortex (V1) of Macaque monkeys. Infrared neural stimulation was found to evoke localized neural responses as evidenced by both electrophysiology and intrinsic signal optical imaging (OIS). Single unit recordings acquired during INS indicated statistically significant increases in neuron firing rates that demonstrate INS evoked excitatory neural activity. Consistent with this, INS stimulation led to focal intensity-dependent reflectance changes recorded with OIS. We also asked whether INS is capable of stimulating functionally specific domains in visual cortex and of modulating visually evoked activity in visual cortex. We found that application of INS via 100μm or 200μm fiber optics produced enhancement of visually evoked OIS response confined to the eye column where INS was applied and relative suppression of the other eye column. Stimulating the cortex with a 400μm fiber, exceeding the ocular dominance width, led to relative suppression, consistent with involvement of inhibitory surrounds. This study is the first to demonstrate that INS can be used to either enhance or diminish visual cortical response and that this can be done in a functional domain specific manner. INS thus holds great potential for use as a safe, non-contact, focally specific brain stimulation technology in primate brains.

Brain rhythms and neural syntax: implications for efficient coding of cognitive content and neuropsychiatric disease

The perpetual activity of the cerebral cortex is largely supported by the variety of oscillations the brain generates, spanning a number of frequencies and anatomical locations, as well as behavioral correlates. First, we review findings from animal studies showing that most forms of brain rhythms are inhibition-based, producing rhythmic volleys of inhibitory inputs to principal cell populations, thereby providing alternating temporal windows of relatively reduced and enhanced excitability in neuronal networks. These inhibition-based mechanisms offer natural temporal frames to group or "chunk" neuronal activity into cell assemblies and sequences of assemblies, with more complex multi-oscillation interactions creating syntactical rules for the effective exchange of information among cortical networks. We then review recent studies in human psychiatric patients demonstrating a variety alterations in neural oscillations across all major psychiatric diseases, and suggest possible future research directions and treatment approaches based on the fundamental properties of brain rhythms.

Long term, stable brain machine interface performance using local field potentials and multiunit spikes

OBJECTIVE

Brain machine interfaces (BMIs) have the potential to restore movement to people with paralysis. However, a clinically-viable BMI must enable consistently accurate control over time spans ranging from years to decades, which has not yet been demonstrated. Most BMIs that use single-unit spikes as inputs will experience degraded performance over time without frequent decoder re-training. Two other signals, local field potentials (LFPs) and multi-unit spikes (MSPs), may offer greater reliability over long periods and better performance stability than single-unit spikes. Here, we demonstrate that LFPs can be used in a biomimetic BMI to control a computer cursor.

APPROACH

We implanted two rhesus macaques with intracortical microelectrodes in primary motor cortex. We recorded LFP and MSP signals from the monkeys while they performed a continuous reaching task, moving a cursor to randomly-placed targets on a computer screen. We then used the LFP and MSP signals to construct biomimetic decoders for control of the cursor.

MAIN RESULTS

Both monkeys achieved high-performance, continuous control that remained stable or improved over nearly 12 months using an LFP decoder that was not retrained or adapted. In parallel, the monkeys used MSPs to control a BMI without retraining or adaptation and had similar or better performance, and that predominantly remained stable over more than six months. In contrast to their stable online control, both LFP and MSP signals showed substantial variability when used offline to predict hand movements.

SIGNIFICANCE

Our results suggest that the monkeys were able to stabilize the relationship between neural activity and cursor movement during online BMI control, despite variability in the relationship between neural activity and hand movements.

Advances in neuroprosthetic learning and control

This essay summarizes recent advances in the field of brain-machine interfaces, with a focus on the learning and acquisition of neuroprosthetic skills.

Significant progress has occurred in the field of brain–machine interfaces (BMI) since the first demonstrations with rodents, monkeys, and humans controlling different prosthetic devices directly with neural activity. This technology holds great potential to aid large numbers of people with neurological disorders. However, despite this initial enthusiasm and the plethora of available robotic technologies, existing neural interfaces cannot as yet master the control of prosthetic, paralyzed, or otherwise disabled limbs. Here I briefly discuss recent advances from our laboratory into the neural basis of BMIs that should lead to better prosthetic control and clinically viable solutions, as well as new insights into the neurobiology of action.

Conditioned enhancement of firing rates and synchrony of hippocampal neurons and firing rates of motor cortical neurons in rats

The aim of this study was to examine the potential ability of neuronal groups to enhance their activities by conditioning without behaviors. We employed a method of neuronal operant conditioning in which increments in the firing rates and synchrony of closely neighboring neurons in the motor cortex and hippocampus were rewarded in the absence of behaviors. Rats were trained to engage in a free-operant task in which nose-poke behaviors were rewarded in session 1, and firing rates and synchrony above preset criteria were rewarded in sessions 2 and 3, respectively. The firing rates of motor cortical and hippocampal neuron groups were found to increase rapidly in session 2 similarly to the nose-poke behavior in session 1. Placing contingency of reward on firing synchrony resulted in selective enhancement of firing synchrony of only hippocampal neurons in session 3. Control experiments revealed that the enhancement of neuronal firing was not attributable to increments of superstitious behaviors or excitation caused by reward delivery. Analysis of the firing rates and synchrony of individual neurons and neuron pairs in each group revealed that the firing rates and synchrony of some but not all neurons and neuron pairs increased in each group. No enhancement was observed in any neurons and neuron pairs recorded by neighboring electrodes not used for conditioning. These results suggest that neuronal operant conditioning enhances the firing rates and synchrony of only some neurons in small restricted areas. The present findings are expected to contribute to further research into neurorehabilitation and neuroprosthesis.

Flexible cortical control of task-specific muscle synergies

Correlation structure in the activity of muscles across movements is often interpreted as evidence for low-level, hardwired constraints on upper-limb function. However, muscle synergies may also emerge from optimal strategies to achieve high-level task goals within a redundant control space. To distinguish these contrasting interpretations, we examined the structure of muscle variability during operation of a myoelectric interface in which task constraints were dissociated from natural limb biomechanics. We found that, with practice, human subjects learned to shape patterns of covariation between arbitrary pairs of hand and forearm muscles appropriately for elliptical targets whose orientation varied on a trial-by-trial basis. Thus, despite arriving at the same average location in the effector space, performance was improved by buffering variability into those dimensions that least impacted task success. Task modulation of beta-frequency intermuscular coherence indicated that differential recruitment of divergent corticospinal pathways contributed to positive correlations among muscles. However, this feedforward mechanism could not account for negative correlations observed in the presence of visual feedback. A second experiment revealed the development of fast, target-dependent visual responses consistent with "minimum intervention" control correcting predominantly task-relevant errors. Together, these mechanisms contribute to the dynamic emergence of task-specific muscle synergies appropriate for a wide range of abstract task goals.

Neural interfaces for the brain and spinal cord--restoring motor function

Regaining motor function is of high priority to patients with spinal cord injury (SCI). A variety of electronic devices that interface with the brain or spinal cord, which have applications in neural prosthetics and neurorehabilitation, are in development. Owing to our advancing understanding of activity-dependent synaptic plasticity, new technologies to monitor, decode and manipulate neural activity are being translated to patient populations, and have demonstrated clinical efficacy. Brain-machine interfaces that decode motor intentions from cortical signals are enabling patient-driven control of assistive devices such as computers and robotic prostheses, whereas electrical stimulation of the spinal cord and muscles can aid in retraining of motor circuits and improve residual capabilities in patients with SCI. Next-generation interfaces that combine recording and stimulating capabilities in so-called closed-loop devices will further extend the potential for neuroelectronic augmentation of injured motor circuits. Emerging evidence suggests that integration of closed-loop interfaces into intentional motor behaviours has therapeutic benefits that outlast the use of these devices as prostheses. In this Review, we summarize this evidence and propose that several known plasticity mechanisms, operating in a complementary manner, might underlie the therapeutic effects that are achieved by closing the loop between electronic devices and the nervous system.

Facilitation and restoration of cognitive function in primate prefrontal cortex by a neuroprosthesis that utilizes minicolumn-specific neural firing

OBJECTIVE

Maintenance of cognitive control is a major concern for many human disease conditions; therefore, a major goal of human neuroprosthetics is to facilitate and/or recover the cognitive function when such circumstances impair appropriate decision making.

APPROACH

Minicolumnar activity from the prefrontal cortex (PFC) was recorded from nonhuman primates trained to perform a delayed match to sample (DMS), via custom-designed conformal multielectrode arrays that provided inter-laminar recordings from neurons in the PFC layer 2/3 and layer 5. Such recordings were analyzed via a previously demonstrated nonlinear multi-input-multi-output (MIMO) neuroprosthesis in rodents, which extracted and characterized multicolumnar firing patterns during DMS performance.

MAIN RESULTS

The MIMO model verified that the conformal recorded individual PFC minicolumns responded to entrained target selections in patterns critical for successful DMS performance. This allowed the substitution of task-related layer 5 neuron firing patterns with electrical stimulation in the same recording regions during columnar transmission from layer 2/3 at the time of target selection. Such stimulation improved normal task performance, but more importantly, recovered performance when applied as a neuroprosthesis following the pharmacological disruption of decision making in the same task.

SIGNIFICANCE

These findings provide the first successful application of neuroprosthesis in the primate brain designed specifically to restore or repair the disrupted cognitive function.

Closed-loop control of epilepsy by transcranial electrical stimulation

Many neurological and psychiatric diseases are associated with clinically detectable, altered brain dynamics. The aberrant brain activity, in principle, can be restored through electrical stimulation. In epilepsies, abnormal patterns emerge intermittently, and therefore, a closed-loop feedback brain control that leaves other aspects of brain functions unaffected is desirable. Here, we demonstrate that seizure-triggered, feedback transcranial electrical stimulation (TES) can dramatically reduce spike-and-wave episodes in a rodent model of generalized epilepsy. Closed-loop TES can be an effective clinical tool to reduce pathological brain patterns in drug-resistant patients.

Reprogramming movements: extraction of motor intentions from cortical ensemble activity when movement goals change

The ability to inhibit unwanted movements and change motor plans is essential for behaviors of advanced organisms. The neural mechanisms by which the primate motor system rejects undesired actions have received much attention during the last decade, but it is not well understood how this neural function could be utilized to improve the efficiency of brain-machine interfaces (BMIs). Here we employed linear discriminant analysis (LDA) and a Wiener filter to extract motor plan transitions from the activity of ensembles of sensorimotor cortex neurons. Two rhesus monkeys, chronically implanted with multielectrode arrays in primary motor (M1) and primary sensory (S1) cortices, were overtrained to produce reaching movements with a joystick toward visual targets upon their presentation. Then, the behavioral task was modified to include a distracting target that flashed for 50, 150, or 250 ms (25% of trials each) followed by the true target that appeared at a different screen location. In the remaining 25% of trials, the initial target stayed on the screen and was the target to be approached. M1 and S1 neuronal activity represented both the true and distracting targets, even for the shortest duration of the distracting event. This dual representation persisted both when the monkey initiated movements toward the distracting target and then made corrections and when they moved directly toward the second, true target. The Wiener filter effectively decoded the location of the true target, whereas the LDA classifier extracted the location of both targets from ensembles of 50–250 neurons. Based on these results, we suggest developing real-time BMIs that inhibit unwanted movements represented by brain activity while enacting the desired motor outcome concomitantly.

ERD-based online brain-machine interfaces (BMI) in the context of neurorehabilitation: optimizing BMI learning and performance

Event-related desynchronization (ERD) of sensori-motor rhythms (SMR) can be used for online brain-machine interface (BMI) control, but yields challenges related to the stability of ERD and feedback strategy to optimize BMI learning.Here, we compared two approaches to this challenge in 20 right-handed healthy subjects (HS, five sessions each, S1-S5) and four stroke patients (SP, 15 sessions each, S1-S15). ERD was recorded from a 275-sensor MEG system. During daily training,motor imagery-induced ERD led to visual and proprioceptive feedback delivered through an orthotic device attached to the subjects' hand and fingers. Group A trained with a heterogeneous reference value (RV) for ERD detection with binary feedback and Group B with a homogenous RV and graded feedback (10 HS and 2 SP in each group). HS in Group B showed better BMI performance than Group A (p < 0.001) and improved BMI control from S1 to S5 (p = 0.012) while Group A did not. In spite of the small n, SP in Group B showed a trend for a higher BMI performance (p = 0.06) and learning was significantly better (p < 0.05). Using a homogeneous RV and graded feedback led to improved modulation of ipsilesional activity resulting in superior BMI learning relative to use of a heterogeneous RV and binary feedback.