Prediction of muscle activities from electrocorticograms in primary motor cortex of primates

Future spinal reflex is embedded in primary motor cortex output

Mammals can execute intended limb movements despite the fact that spinal reflexes involuntarily modulate muscle activity. To generate appropriate muscle activity, the cortical descending motor output must coordinate with spinal reflexes, yet the underlying neural mechanism remains unclear. We simultaneously recorded activities in motor-related cortical areas, afferent neurons, and forelimb muscles of monkeys performing reaching movements. Motor-related cortical areas, predominantly primary motor cortex (M1), encode subsequent afferent activities attributed to forelimb movement. M1 also encodes a subcomponent of muscle activity evoked by these afferent activities, corresponding to spinal reflexes. Furthermore, selective disruption of the afferent pathway specifically reduced this subcomponent of muscle activity, suggesting that M1 output drives muscle activity not only through direct descending pathways but also through the "transafferent" pathway composed of descending plus subsequent spinal reflex pathways. Thus, M1 provides optimal motor output based on an internal forward model that prospectively computes future spinal reflexes.

Enhancing Brain Machine Interface Decoding Accuracy through Domain Knowledge Integration

This paper introduces a novel decoding approach for Brain Machine Interface (BMI) that enhances the estimation accuracy and stability of muscle activity by incorporating domain knowledge of motor control. Our approach uniquely integrates domain knowledge, focusing on the relationship between torque direction and muscle activity in isometric wrist tasks. We demonstrate the effectiveness of our approach through decoding analysis with non-human primates performing a wrist torque tracking task. By implementing a Kalman filter augmented with models of muscle activity and torque for specific movement directions, we show significant improvements compared to vanilla Kalman filter in the accuracy of muscle activity estimation. The proposed approach presents a promising direction for enhancing the performance of BMI by leveraging domain-specific insights into motor control.

A New Nonlinear Autoregressive Exogenous (NARX)-based Intra-spinal Stimulation Approach to Decode Brain Electrical Activity for Restoration of Leg Movement in Spinally-injured Rabbits

Introduction

This study aimed at investigating the stimulation by intra-spinal signals decoded from electrocorticography (ECoG) assessments to restore the movements of the leg in an animal model of spinal cord injury (SCI).

Methods

The present work is comprised of three steps. First, ECoG signals and the associated leg joint changes (hip, knee, and ankle) in sedated healthy rabbits were recorded in different trials. Second, an appropriate set of intra-spinal electric stimuli was discovered to restore natural leg movements, using the three leg joint movements under a fuzzy-controlled strategy in spinally-injured rabbits under anesthesia. Third, a nonlinear autoregressive exogenous (NARX) neural network model was developed to produce appropriate intra-spinal stimulation developed from decoded ECoG information. The model was able to correlate the ECoG signal data to the intra-spinal stimulation data and finally, induced desired leg movements. In this study, leg movements were also developed from offline ECoG signals (deciphered from rabbits that were not injured) as well as online ECoG data (extracted from the same rabbit after SCI induction).

Results

Based on our data, the correlation coefficient was 0.74±0.15 and the normalized root means square error of the brain-spine interface was 0.22±0.10.

Conclusion

Overall, we found that using NARX, appropriate information from ECoG recordings can be extracted and used for the generation of proper intra-spinal electric stimulations for restoration of natural leg movements lost due to SCI.

Temporal dynamics of the sensorimotor convergence underlying voluntary limb movement

Descending motor drive and somatosensory feedback play important roles in modulating muscle activity. Numerous studies have characterized the organization of neuronal connectivity in which descending motor pathways and somatosensory afferents converge on spinal motor neurons as a final common pathway. However, how inputs from these two pathways are integrated into spinal motor neurons to generate muscle activity during actual motor behavior is unknown. Here, we simultaneously recorded activity in the motor cortices (MCx), somatosensory afferent neurons, and forelimb muscles in monkeys performing reaching and grasping movements. We constructed a linear model to explain the instantaneous muscle activity using the activity of MCx (descending input) and peripheral afferents (afferent input). Decomposition of the reconstructed muscle activity into each subcomponent indicated that muscle activity before movement onset could first be explained by descending input from mainly the primary motor cortex and muscle activity after movement onset by both descending and afferent inputs. Descending input had a facilitative effect on all muscles, whereas afferent input had a facilitative or suppressive effect on each muscle. Such antagonistic effects of afferent input can be explained by reciprocal effects of the spinal reflex. These results suggest that descending input contributes to the initiation of limb movement, and this initial movement subsequently affects muscle activity via the spinal reflex in conjunction with the continuous descending input. Thus, spinal motor neurons are subjected to temporally organized modulation by direct activation through the descending pathway and the lagged action of the spinal reflex during voluntary limb movement.

The ventral striatum contributes to the activity of the motor cortex and motor outputs in monkeys

The ventral striatum (VSt) is thought to be involved in the vigor of motivated behavior and is suggested to be a limbic-motor interface between limbic areas involved in motivational processes and neural circuits regulating behavioral outputs. However, there is little direct evidence demonstrating the involvement of the VSt in motor control for motivated behaviors. To clarify the functional role of the VSt in motor control, we investigated the effect of reversible pharmacological inactivation of the VSt on the oscillatory activity of the sensorimotor cortices and motor outputs in two macaque monkeys. VSt inactivation reduced movement-related activities of the primary motor cortex and premotor area at 15–120 Hz and increased those at 5–7 Hz. These changes were accompanied by reduced torque outputs but had no effect on the correct performance rate. The present study provides direct evidence that the VSt regulates activities of the motor cortices and motor output.

A Design of Biomimetic Prosthetic Hand

Many patients with upper limb defects desire myoelectric prosthetic hands, but they are still not used for some reasons. One of the most significant reasons is its external appearance, which has the discomfort caused by the structural difference between a human hand and a robotic link. The structure must be based on human anatomy to create a more natural-looking prosthesis. This study designed a biomimetic prosthetic hand with bones, ligaments, tendons, and multiple muscles based on the human musculoskeletal system. We verified the proposed prosthetic hand using the viscoelastic angle sensor to determine whether it works like a human hand. We also compared the finger force of the prosthetic hand with that of a human finger. It could be capable of controlling the angle and the stiffness of the joint by multiple extensor and flexor muscles, like humans.

Decoding Continuous Kinetic Information of Grasp from Stereo-electroencephalographic (SEEG) Recordings

OBJECTIVE

Brain-computer interfaces (BCIs) have the potential to bypass damaged neural pathways and restore functionality lost due to injury or disease. Approaches to decoding kinematic information are well documented; however, the decoding of kinetic information has received less attention. Additionally, the possibility of using stereo-electroencephalography (SEEG) for kinetic decoding during hand grasping tasks is still largely unknown. Thus, the objective of this paper is to demonstrate kinetic parameter decoding using SEEG in patients performing a grasping task with two different force levels under two different ascending rates.

APPROACH

Temporal-spectral representations were studied to investigate frequency modulation under different force tasks. Then, force amplitude was decoded from SEEG recordings using multiple decoders, including a linear model, a partial least squares (PLS) model, an unscented Kalman filter, and three deep learning models (shallow convolutional neural network, deep convolutional neural network and the proposed CNN+RNN neural network).

MAIN RESULTS

The current study showed that: 1) for some channel, both low-frequency modulation (event-related desynchronization (ERD)) and high-frequency modulation (event-related synchronization (ERS)) were sustained during prolonged force holding periods; 2) continuously changing grasp force can be decoded from the SEEG signals; 3) the novel CNN+RNN deep learning model achieved the best decoding performance, with the predicted force magnitude closely aligned to the ground truth under different force amplitudes and changing rates.

SIGNIFICANCE

This work verified the possibility of decoding continuously changing grasp force using SEEG recordings. The result presented in this study demonstrated the potential of SEEG recordings for future BCI application.

Decoding Neural Activity in Sulcal and White Matter Areas of the Brain to Accurately Predict Individual Finger Movement and Tactile Stimuli of the Human Hand

Millions of people worldwide suffer motor or sensory impairment due to stroke, spinal cord injury, multiple sclerosis, traumatic brain injury, diabetes, and motor neuron diseases such as ALS (amyotrophic lateral sclerosis). A brain-computer interface (BCI), which links the brain directly to a computer, offers a new way to study the brain and potentially restore impairments in patients living with these debilitating conditions. One of the challenges currently facing BCI technology, however, is to minimize surgical risk while maintaining efficacy. Minimally invasive techniques, such as stereoelectroencephalography (SEEG) have become more widely used in clinical applications in epilepsy patients since they can lead to fewer complications. SEEG depth electrodes also give access to sulcal and white matter areas of the brain but have not been widely studied in brain-computer interfaces. Here we show the first demonstration of decoding sulcal and subcortical activity related to both movement and tactile sensation in the human hand. Furthermore, we have compared decoding performance in SEEG-based depth recordings versus those obtained with electrocorticography electrodes (ECoG) placed on gyri. Initial poor decoding performance and the observation that most neural modulation patterns varied in amplitude trial-to-trial and were transient (significantly shorter than the sustained finger movements studied), led to the development of a feature selection method based on a repeatability metric using temporal correlation. An algorithm based on temporal correlation was developed to isolate features that consistently repeated (required for accurate decoding) and possessed information content related to movement or touch-related stimuli. We subsequently used these features, along with deep learning methods, to automatically classify various motor and sensory events for individual fingers with high accuracy. Repeating features were found in sulcal, gyral, and white matter areas and were predominantly phasic or phasic-tonic across a wide frequency range for both HD (high density) ECoG and SEEG recordings. These findings motivated the use of long short-term memory (LSTM) recurrent neural networks (RNNs) which are well-suited to handling transient input features. Combining temporal correlation-based feature selection with LSTM yielded decoding accuracies of up to 92.04 ± 1.51% for hand movements, up to 91.69 ± 0.49% for individual finger movements, and up to 83.49 ± 0.72% for focal tactile stimuli to individual finger pads while using a relatively small number of SEEG electrodes. These findings may lead to a new class of minimally invasive brain-computer interface systems in the future, increasing its applicability to a wide variety of conditions.

Computational approaches to decode grasping force and velocity level in upper-limb amputee from intraneural peripheral signals

Objective. Recent results have shown the potentials of neural interfaces to provide sensory feedback to subjects with limb amputation increasing prosthesis usability. However, their advantages for decoding motor control signals over current methods based on electromyography (EMG) are still debated. In this study we compared a standard EMG-based method with approaches that use peripheral intraneural data to infer distinct levels of grasping force and velocity in a trans-radial amputee.Approach. Surface EMG (three channels) and intraneural signals (collected with transverse intrafascicular multichannel electrodes, TIMEs, 56 channels) were simultaneously recorded during the amputee's intended grasping movements. We sorted single unit activity (SUA) from each neural signal and then we identified the most informative units. EMG envelopes were extracted from the recorded EMG signals. A reference support vector machine (SVM) classifier was used to map EMG envelopes into desired force and velocity levels. Two decoding approaches using SUA were then tested and compared to the EMG-based reference classifier: (a) SVM classification of firing rates into desired force and velocity levels; (b) reconstruction of covariates (the grasp cue level or EMG envelopes) from neural data and use of covariates for classification into desired force and velocity levels.Main results.Using EMG envelopes as reconstructed covariates from SUA yielded significantly better results than the other approaches tested, with performance similar to that of the EMG-based reference classifier, and stable over three different recording days. Of the two reconstruction algorithms used in this approach, a linear Kalman filter and a nonlinear point process adaptive filter, the nonlinear filter gave better results.Significance.This study presented a new effective approach for decoding grasping force and velocity from peripheral intraneural signals in a trans-radial amputee, which relies on using SUA to reconstruct EMG envelopes. Being dependent on EMG recordings only for the training phase, this approach can fully exploit the advantages of implanted neural interfaces and potentially overcome, in the medium to long term, current state-of-the-art methods. (Clinical trial's registration number: NCT02848846).

Application of a neural interface for restoration of leg movements: Intra-spinal stimulation using the brain electrical activity in spinally injured rabbits

This study aimed to design a neural interface that extracts movement commands from the brain to generate appropriate intra-spinal stimulation to restore leg movement. This study comprised four steps: (1) Recording electrocorticographic (ECoG) signals and corresponding leg movements in different trials. (2) Partial laminectomy to induce spinal cord injury (SCI) and detect motor modules in the spinal cord. (3) Delivering appropriate intra-spinal stimulation to the motor modules for restoration of the movements to those documented before SCI. (4) Development of a neural interface created by sparse linear regression (SLiR) model to detect movement commands transmitted from the brain to the modules. Correlation coefficient (CC) and normalized root mean square (NRMS) error was calculated to evaluate the neural interface effectiveness. It was found that by stimulating detected spinal cord modules, joint angle evaluated before SCI was not significantly different from that of post-SCI (P > 0.05). Based on results of SLiR model, overall CC and NRMS values were 0.63 ± 0.14 and 0.34 ± 0.16 (mean ± SD), respectively. These results indicated that ECoG data contained information about intra-spinal stimulations and the developed neural interface could produce intra-spinal stimulation based on ECoG data, for restoration of leg movements after SCI.

A state-based probabilistic method for decoding hand position during movement from ECoG signals in non-human primate

OBJECTIVE

In this study, we proposed a state-based probabilistic method for decoding hand positions during unilateral and bilateral movements using the ECoG signals recorded from the brain of Rhesus monkey.

APPROACH

A customized electrode array was implanted subdurally in the right hemisphere of the brain covering from the primary motor cortex to the frontal cortex. Three different experimental paradigms were considered: ipsilateral, contralateral, and bilateral movements. During unilateral movement, the monkey was trained to get food with one hand, while during bilateral movement, the monkey used its left and right hands alternately to get food. To estimate the hand positions, a state-based probabilistic method was introduced which was based on the conditional probability of the hand movement state (i.e. idle, right hand movement, and left hand movement) and the conditional expectation of the hand position for each state. Moreover, a hybrid feature extraction method based on linear discriminant analysis and partial least squares (PLS) was introduced.

MAIN RESULTS

The proposed method could successfully decode the hand positions during ipsilateral, contralateral, and bilateral movements and significantly improved the decoding performance compared to the conventional Kalman and PLS regression methods [Formula: see text]. The proposed hybrid feature extraction method was found to outperform both the PLS and PCA methods [Formula: see text]. Investigating the kinematic information of each frequency band shows that more informative frequency bands were [Formula: see text] (15-30 Hz) and [Formula: see text](50-100 Hz) for ipsilateral and [Formula: see text] and [Formula: see text] (100-200 Hz) for contralateral movements. It is observed that ipsilateral movement was decoded better than contralateral movement for [Formula: see text] (5-15 Hz) and [Formula: see text] bands, while contralateral movements was decoded better for [Formula: see text] (30-200 Hz) and hfECoG (200-400 Hz) bands.

SIGNIFICANCE

Accurate decoding the bilateral movement using the ECoG recorded from one brain hemisphere is an important issue toward real-life applications of the brain-machine interface technologies.

Power Modulations of ECoG Alpha/Beta and Gamma Bands Correlate With Time-Derivative of Force During Hand Grasp

It is well-known that motor cortical oscillatory components are modulated in their amplitude during voluntary and imagined movements. These patterns have been used to develop brain-machine interfaces (BMI) which focused mostly on movement kinematics. In contrast, there have been only a few studies on the relation between brain oscillatory activity and the control of force, in particular, grasping force, which is of primary importance for common daily activities. In this study, we recorded intraoperative high-density electrocorticography (ECoG) from the sensorimotor cortex of four patients while they executed a voluntary isometric hand grasp following verbal instruction. The grasp was held for 2 to 3 s before being instructed to relax. We studied the power modulations of neural oscillations during the whole time-course of the grasp (onset, hold, and offset phases). Phasic event-related desynchronization (ERD) in the low-frequency band (LFB) from 8 to 32 Hz and event-related synchronization (ERS) in the high-frequency band (HFB) from 60 to 200 Hz were observed at grasp onset and offset. However, during the grasp holding period, the magnitude of LFB-ERD and HFB-ERS decreased near or at the baseline level. Overall, LFB-ERD and HFB-ERS show phasic characteristics related to the changes of grasp force (onset/offset) in all four patients. More precisely, the fluctuations of HFB-ERS primarily, and of LFB-ERD to a lesser extent, correlated with the time-course of the first time-derivative of force (yank), rather than with force itself. To the best of our knowledge, this is the first study that establishes such a correlation. These results have fundamental implications for the decoding of grasp in brain oscillatory activity-based neuroprosthetics.

Bypassing stroke-damaged neural pathways via a neural interface induces targeted cortical adaptation

Regaining the function of an impaired limb is highly desirable in paralyzed individuals. One possible avenue to achieve this goal is to bridge the interrupted pathway between preserved neural structures and muscles using a brain–computer interface. Here, we demonstrate that monkeys with subcortical stroke were able to learn to use an artificial cortico-muscular connection (ACMC), which transforms cortical activity into electrical stimulation to the hand muscles, to regain volitional control of a paralysed hand. The ACMC induced an adaptive change of cortical activities throughout an extensive cortical area. In a targeted manner, modulating high-gamma activity became localized around an arbitrarily-selected cortical site controlling stimulation to the muscles. This adaptive change could be reset and localized rapidly to a new cortical site. Thus, the ACMC imparts new function for muscle control to connected cortical sites and triggers cortical adaptation to regain impaired motor function after stroke.

Monkeys were trained to use an artificial cortico-muscular connection (ACMC) to regain control over a paralyzed hand following subcortical stroke. Control over the paralyzed hand was accompanied by the appearance of localized high-gamma modulation in the cortex, which could be rapidly reset and relocalized to a different cortical site to reactivate motor control.

Somatosensation Evoked by Cortical Surface Stimulation of the Human Primary Somatosensory Cortex

Electrical stimulation of the primary somatosensory cortex using intracranial electrodes is crucial for the evocation of artificial somatosensations, typically tactile sensations associated with specific regions of the body, in brain-machine interface (BMI) applications. The qualitative characteristics of these artificially evoked somatosensations has been well documented. As of yet, however, the quantitative aspects of these evoked somatosensations, that is to say the quantitative relationship between intensity of electrical stimulation and perceived intensity of the resultant somatosensation remains obscure. This study aimed to explore this quantitative relationship by surface electrical stimulation of the primary somatosensory cortex in two human participants undergoing electrocorticographic monitoring prior to surgical treatment of intractable epilepsy. Electrocorticogram electrodes on the primary somatosensory cortical surface were stimulated with varying current intensities, and a visual analogue scale was employed to provide a quantitative measure of intensity of the evoked sensations. Evoked sensations included those of the thumb, tongue, and hand. A clear linear relationship between current intensity and perceived intensity of sensation was observed. These findings provide novel insight into the quantitative nature of primary somatosensory cortex electrical stimulation-evoked sensation for development of somatosensory neuroprosthetics for clinical use.

Encoding of kinetic and kinematic movement parameters in the sensorimotor cortex: A Brain-Computer Interface perspective

For severely paralyzed people, Brain-Computer Interfaces (BCIs) can potentially replace lost motor output and provide a brain-based control signal for augmentative and alternative communication devices or neuroprosthetics. Many BCIs focus on neuronal signals acquired from the hand area of the sensorimotor cortex, employing changes in the patterns of neuronal firing or spectral power associated with one or more types of hand movement. Hand and finger movement can be described by two groups of movement features, namely kinematics (spatial and motion aspects) and kinetics (muscles and forces). Despite extensive primate and human research, it is not fully understood how these features are represented in the SMC and how they lead to the appropriate movement. Yet, the available information may provide insight into which features are most suitable for BCI control. To that purpose, the current paper provides an in-depth review on the movement features encoded in the SMC. Even though there is no consensus on how exactly the SMC generates movement, we conclude that some parameters are well represented in the SMC and can be accurately used for BCI control with discrete as well as continuous feedback. However, the vast evidence also suggests that movement should be interpreted as a combination of multiple parameters rather than isolated ones, pleading for further exploration of sensorimotor control models for accurate BCI control.

High-frequency band temporal dynamics in response to a grasp force task

OBJECTIVE

Brain-computer interfaces (BCIs) are being developed to restore reach and grasping movements of paralyzed individuals. Recent studies have shown that the kinetics of grasping movement, such as grasp force, can be successfully decoded from electrocorticography (ECoG) signals, and that the high-frequency band (HFB) power changes provide discriminative information that contribute to an accurate decoding of grasp force profiles. However, as the models used in these studies contained simultaneous information from multiple spectral features over multiple areas in the brain, it remains unclear what parameters of movement and force are encoded by the HFB signals and how these are represented temporally and spatially in the SMC.

APPROACH

To investigate this, and to gain insight in the temporal dynamics of the HFB during grasping, we continuously modelled the ECoG HFB response recorded from nine individuals with epilepsy temporarily implanted with ECoG grids, who performed three different grasp force tasks.

MAIN RESULTS

We show that a model based on the force onset and offset consistently provides a better fit to the HFB power responses when compared with a model based on the force magnitude, irrespective of electrode location.

SIGNIFICANCE

Our results suggest that HFB power, although potentially useful for continuous decoding, is more closely related to the changes in movement. This finding may potentially contribute to the more natural decoding of grasping movement in neural prosthetics.

Prediction of Forelimb EMGs and Movement Phases from Corticospinal Signals in the Rat During the Reach-to-Pull Task

Brain-computer interfaces access the volitional command signals from various brain areas in order to substitute for the motor functions lost due to spinal cord injury or disease. As the final common pathway of the central nervous system (CNS) outputs, the descending tracts of the spinal cord offer an alternative site to extract movement-related command signals. Using flexible 2D microelectrode arrays, we have recorded the corticospinal tract (CST) signals in rats during a reach-to-pull task. The CST activity was then classified by the forelimb movement phases into two or three classes in a training dataset and cross validated in a test set. The average classification accuracies were [Formula: see text] (min: [Formula: see text] to max: [Formula: see text]) and [Formula: see text] (min: 43% to max: 71%) for two-class and three-class cases, respectively. The forelimb flexor and extensor EMG envelopes were also predicted from the CST signals using linear regression. The average correlation coefficient between the actual and predicted EMG signals was [Formula: see text] [Formula: see text], whereas the highest correlation was 0.81 for the biceps EMG. Although the forelimb motor function cannot be explained completely by the CST activity alone, the success rates obtained in reconstructing the EMG signals support the feasibility of a spinal-cord-computer interface as a concept.

The somatosensory cortex receives information about motor output

During voluntary movement, the somatosensory system not only passively receives signals from the external world but also actively processes them via interactions with the motor system. However, it is still unclear how and what information the somatosensory system receives during movement. Using simultaneous recordings of activities of the primary somatosensory cortex (S1), the motor cortex (MCx), and an ensemble of afferent neurons in behaving monkeys combined with a decoding algorithm, we reveal the temporal profiles of signal integration in S1. While S1 activity before movement initiation is accounted for by MCx activity alone, activity during movement is accounted for by both MCx and afferent activities. Furthermore, premovement S1 activity encodes information about imminent activity of forelimb muscles slightly after MCx does. Thus, S1 receives information about motor output before the arrival of sensory feedback signals, suggesting that S1 executes online processing of somatosensory signals via interactions with the anticipatory information.

Decoding of muscle activity from the sensorimotor cortex in freely behaving monkeys

Remarkable advances have recently been made in the development of Brain-Machine Interface (BMI) technologies for restoring or enhancing motor function. However, the application of these technologies may be limited to patients in static conditions, as these developments have been largely based on studies of animals (e.g., non-human primates) in constrained movement conditions. The ultimate goal of BMI technology is to enable individuals to move their bodies naturally or control external devices without physical constraints. Here, we demonstrate accurate decoding of muscle activity from electrocorticogram (ECoG) signals in unrestrained, freely behaving monkeys. We recorded ECoG signals from the sensorimotor cortex as well as electromyogram signals from multiple muscles in the upper arm while monkeys performed two types of movements with no physical restraints, as follows: forced forelimb movement (lever-pull task) and natural whole-body movement (free movement within the cage). As in previous reports using restrained monkeys, we confirmed that muscle activity during forced forelimb movement was accurately predicted from simultaneously recorded ECoG data. More importantly, we demonstrated that accurate prediction of muscle activity from ECoG data was possible in monkeys performing natural whole-body movement. We found that high-gamma activity in the primary motor cortex primarily contributed to the prediction of muscle activity during natural whole-body movement as well as forced forelimb movement. In contrast, the contribution of high-gamma activity in the premotor and primary somatosensory cortices was significantly larger during natural whole-body movement. Thus, activity in a larger area of the sensorimotor cortex was needed to predict muscle activity during natural whole-body movement. Furthermore, decoding models obtained from forced forelimb movement could not be generalized to natural whole-body movement, which suggests that decoders should be built individually and according to different behavior types. These results contribute to the future application of BMI systems in unrestrained individuals.

Implantable Neural Probes for Brain-Machine Interfaces - Current Developments and Future Prospects

A Brain-Machine interface (BMI) allows for direct communication between the brain and machines. Neural probes for recording neural signals are among the essential components of a BMI system. In this report, we review research regarding implantable neural probes and their applications to BMIs. We first discuss conventional neural probes such as the tetrode, Utah array, Michigan probe, and electroencephalography (ECoG), following which we cover advancements in next-generation neural probes. These next-generation probes are associated with improvements in electrical properties, mechanical durability, biocompatibility, and offer a high degree of freedom in practical settings. Specifically, we focus on three key topics: (1) novel implantable neural probes that decrease the level of invasiveness without sacrificing performance, (2) multi-modal neural probes that measure both electrical and optical signals, (3) and neural probes developed using advanced materials. Because safety and precision are critical for practical applications of BMI systems, future studies should aim to enhance these properties when developing next-generation neural probes.

Control of a Robot Arm Using Decoded Joint Angles from Electrocorticograms in Primate

Electrocorticogram (ECoG) is a well-known recording method for the less invasive brain machine interface (BMI). Our previous studies have succeeded in predicting muscle activities and arm trajectories from ECoG signals. Despite such successful studies, there still remain solving works for the purpose of realizing an ECoG-based prosthesis. We suggest a neuromuscular interface to control robot using decoded muscle activities and joint angles. We used sparse linear regression to find the best fit between band-passed ECoGs and electromyograms (EMG) or joint angles. The best coefficient of determination for 100 s continuous prediction was 0.6333 ± 0.0033 (muscle activations) and 0.6359 ± 0.0929 (joint angles), respectively. We also controlled a 4 degree of freedom (DOF) robot arm using only decoded 4 DOF angles from the ECoGs in this study. Consequently, this study shows the possibility of contributing to future advancements in neuroprosthesis and neurorehabilitation technology.

Data-Driven Transducer Design and Identification for Internally-Paced Motor Brain Computer Interfaces: A Review

Brain-Computer Interfaces (BCIs) are systems that establish a direct communication pathway between the users' brain activity and external effectors. They offer the potential to improve the quality of life of motor-impaired patients. Motor BCIs aim to permit severely motor-impaired users to regain limb mobility by controlling orthoses or prostheses. In particular, motor BCI systems benefit patients if the decoded actions reflect the users' intentions with an accuracy that enables them to efficiently interact with their environment. One of the main challenges of BCI systems is to adapt the BCI's signal translation blocks to the user to reach a high decoding accuracy. This paper will review the literature of data-driven and user-specific transducer design and identification approaches and it focuses on internally-paced motor BCIs. In particular, continuous kinematic biomimetic and mental-task decoders are reviewed. Furthermore, static and dynamic decoding approaches, linear and non-linear decoding, offline and real-time identification algorithms are considered. The current progress and challenges related to the design of clinical-compatible motor BCI transducers are additionally discussed.

Fast Multiway Partial Least Squares Regression

OBJECTIVE

Multiway array decomposition has been successful in providing a better understanding of the structure underlying data and in discovering potentially hidden feature dependences serving high-performance decoder applications. However, the computational cost of multiway algorithms can become prohibitive, especially when considering large datasets, rendering them unsuitable for time-critical applications.

METHODS

We propose a multiway regression model for large-scale tensors with optimized performance in terms of time complexity, called fast higher order partial least squares (fHOPLS).

RESULTS

We compare fHOPLS with its native version, higher order partial least squares (HOPLS), the state-of-the-art in multilinear regression, under different noise conditions and tensor dimensionalities using synthetic data. We also compare their performance when used for predicting scalp-recorded electroencephalography signals from invasively recorded electrocorticography signals in an oddball experiment. For the sake of exposition, we evaluated the performance of standard unfolded partial least squares (PLS) and linear regression.

CONCLUSION

Our results show that fHOPLS is significantly faster than HOPLS, in particular for big data. In addition, the regression performances of fHOPLS and HOPLS are comparable and outperform both unfolded PLS and linear regression. Another interesting result is that multiway array decoding yields more accurate results than epoch-based averaging procedures traditionally used in the brain computer interfacing community.

Decoding unconstrained arm movements in primates using high-density electrocorticography signals for brain-machine interface use

Motor deficit is among the most debilitating aspects of injury to the central nervous system. Despite ongoing progress in brain-machine interface (BMI) development and in the functional electrical stimulation of muscles and nerves, little is understood about how neural signals in the brain may be used to potentially control movement in one’s own unconstrained paralyzed limb. We recorded from high-density electrocorticography (ECoG) electrode arrays in the ventral premotor cortex (PMv) of a rhesus macaque and used real-time motion tracking techniques to correlate spatial-temporal changes in neural activity with arm movements made towards objects in three-dimensional space at millisecond precision. We found that neural activity from a small number of electrodes within the PMv can be used to accurately predict reach-return movement onset and directionality. Also, whereas higher gamma frequency field activity was more predictive about movement direction during performance, mid-band (beta and low gamma) activity was more predictive of movement prior to onset. We speculate these dual spatiotemporal signals may be used to optimize both planning and execution of movement during natural reaching, with prospective relevance to the future development of neural prosthetics aimed at restoring motor control over one’s own paralyzed limb.

A piecewise probabilistic regression model to decode hand movement trajectories from epidural and subdural ECoG signals

OBJECTIVE

The primary concern of this study is to develop a probabilistic regression method that would improve the decoding of the hand movement trajectories from epidural ECoG as well as from subdural ECoG signals.

APPROACH

The model is characterized by the conditional expectation of the hand position given the ECoG signals. The conditional expectation of the hand position is then modeled by a linear combination of the conditional probability density functions defined for each segment of the movement. Moreover, a spatial linear filter is proposed for reducing the dimension of the feature space. The spatial linear filter is applied to each frequency band of the ECoG signals and extract the features with highest decoding performance.

MAIN RESULTS

For evaluating the proposed method, a dataset including 28 ECoG recordings from four adult Japanese macaques is used. The results show that the proposed decoding method outperforms the results with respect to the state of the art methods using this dataset. The relative kinematic information of each frequency band is also investigated using mutual information and decoding performance. The decoding performance shows that the best performance was obtained for high gamma bands from 50 to 200 Hz as well as high frequency ECoG band from 200 to 400 Hz for subdural recordings. However, the decoding performance was decreased for these frequency bands using epidural recordings. The mutual information shows that, on average, the high gamma band from 50 to 200 Hz and high frequency ECoG band from 200 to 400 Hz contain significantly more information than the average of the rest of the frequency bands [Formula: see text] for both subdural and epidural recordings. The results of high resolution time-frequency analysis show that ERD/ERS patterns in all frequency bands could reveal the dynamics of the ECoG responses during the movement. The onset and offset of the movement can be clearly identified by the ERD/ERS patterns.

SIGNIFICANCE

Reliable decoding the kinematic information from the brain signals paves the way for robust control of external devices.

Upper limb movements can be decoded from the time-domain of low-frequency EEG

How neural correlates of movements are represented in the human brain is of ongoing interest and has been researched with invasive and non-invasive methods. In this study, we analyzed the encoding of single upper limb movements in the time-domain of low-frequency electroencephalography (EEG) signals. Fifteen healthy subjects executed and imagined six different sustained upper limb movements. We classified these six movements and a rest class and obtained significant average classification accuracies of 55% (movement vs movement) and 87% (movement vs rest) for executed movements, and 27% and 73%, respectively, for imagined movements. Furthermore, we analyzed the classifier patterns in the source space and located the brain areas conveying discriminative movement information. The classifier patterns indicate that mainly premotor areas, primary motor cortex, somatosensory cortex and posterior parietal cortex convey discriminative movement information. The decoding of single upper limb movements is specially interesting in the context of a more natural non-invasive control of e.g., a motor neuroprosthesis or a robotic arm in highly motor disabled persons.

Physiological properties of brain-machine interface input signals

Brain-machine interfaces (BMIs), also called brain-computer interfaces (BCIs), decode neural signals and use them to control some type of external device. Despite many experimental successes and terrific demonstrations in animals and humans, a high-performance, clinically viable device has not yet been developed for widespread usage. There are many factors that impact clinical viability and BMI performance. Arguably, the first of these is the selection of brain signals used to control BMIs. In this review, we summarize the physiological characteristics and performance-including movement-related information, longevity, and stability-of multiple types of input signals that have been used in invasive BMIs to date. These include intracortical spikes as well as field potentials obtained inside the cortex, at the surface of the cortex (electrocorticography), and at the surface of the dura mater (epidural signals). We also discuss the potential for future enhancements in input signal performance, both by improving hardware and by leveraging the knowledge of the physiological characteristics of these signals to improve decoding and stability.

Mapping ECoG channel contributions to trajectory and muscle activity prediction in human sensorimotor cortex

Studies on brain-machine interface techniques have shown that electrocorticography (ECoG) is an effective modality for predicting limb trajectories and muscle activity in humans. Motor control studies have also identified distributions of “extrinsic-like” and “intrinsic-like” neurons in the premotor (PM) and primary motor (M1) cortices. Here, we investigated whether trajectories and muscle activity predicted from ECoG were obtained based on signals derived from extrinsic-like or intrinsic-like neurons. Three participants carried objects of three different masses along the same counterclockwise path on a table. Trajectories of the object and upper arm muscle activity were predicted using a sparse linear regression. Weight matrices for the predictors were then compared to determine if the ECoG channels contributed more information about trajectory or muscle activity. We found that channels over both PM and M1 contributed highly to trajectory prediction, while a channel over M1 was the highest contributor for muscle activity prediction.

Decoding Lower Limb Muscle Activity and Kinematics from Cortical Neural Spike Trains during Monkey Performing Stand and Squat Movements

Extensive literatures have shown approaches for decoding upper limb kinematics or muscle activity using multichannel cortical spike recordings toward brain machine interface (BMI) applications. However, similar topics regarding lower limb remain relatively scarce. We previously reported a system for training monkeys to perform visually guided stand and squat tasks. The current study, as a follow-up extension, investigates whether lower limb kinematics and muscle activity characterized by electromyography (EMG) signals during monkey performing stand/squat movements can be accurately decoded from neural spike trains in primary motor cortex (M1). Two monkeys were used in this study. Subdermal intramuscular EMG electrodes were implanted to 8 right leg/thigh muscles. With ample data collected from neurons from a large brain area, we performed a spike triggered average (SpTA) analysis and got a series of density contours which revealed the spatial distributions of different muscle-innervating neurons corresponding to each given muscle. Based on the guidance of these results, we identified the locations optimal for chronic electrode implantation and subsequently carried on chronic neural data recordings. A recursive Bayesian estimation framework was proposed for decoding EMG signals together with kinematics from M1 spike trains. Two specific algorithms were implemented: a standard Kalman filter and an unscented Kalman filter. For the latter one, an artificial neural network was incorporated to deal with the nonlinearity in neural tuning. High correlation coefficient and signal to noise ratio between the predicted and the actual data were achieved for both EMG signals and kinematics on both monkeys. Higher decoding accuracy and faster convergence rate could be achieved with the unscented Kalman filter. These results demonstrate that lower limb EMG signals and kinematics during monkey stand/squat can be accurately decoded from a group of M1 neurons with the proposed algorithms. Our findings provide new insights for extending current BMI design concepts and techniques on upper limbs to lower limb circumstances. Brain controlled exoskeleton, prostheses or neuromuscular electrical stimulators for lower limbs are expected to be developed, which enables the subject to manipulate complex biomechatronic devices with mind in more harmonized manner.

Continuous decoding of human grasp kinematics using epidural and subdural signals

OBJECTIVE

Restoring or replacing function in paralyzed individuals will one day be achieved through the use of brain-machine interfaces. Regaining hand function is a major goal for paralyzed patients. Two competing prerequisites for the widespread adoption of any hand neuroprosthesis are accurate control over the fine details of movement, and minimized invasiveness. Here, we explore the interplay between these two goals by comparing our ability to decode hand movements with subdural and epidural field potentials (EFPs).

APPROACH

We measured the accuracy of decoding continuous hand and finger kinematics during naturalistic grasping motions in five human subjects. We recorded subdural surface potentials (electrocorticography; ECoG) as well as with EFPs, with both standard- and high-resolution electrode arrays.

MAIN RESULTS

In all five subjects, decoding of continuous kinematics significantly exceeded chance, using either EGoG or EFPs. ECoG decoding accuracy compared favorably with prior investigations of grasp kinematics (mean ± SD grasp aperture variance accounted for was 0.54 ± 0.05 across all subjects, 0.75 ± 0.09 for the best subject). In general, EFP decoding performed comparably to ECoG decoding. The 7-20 Hz and 70-115 Hz spectral bands contained the most information about grasp kinematics, with the 70-115 Hz band containing greater information about more subtle movements. Higher-resolution recording arrays provided clearly superior performance compared to standard-resolution arrays.

SIGNIFICANCE

To approach the fine motor control achieved by an intact brain-body system, it will be necessary to execute motor intent on a continuous basis with high accuracy. The current results demonstrate that this level of accuracy might be achievable not just with ECoG, but with EFPs as well. Epidural placement of electrodes is less invasive, and therefore may incur less risk of encephalitis or stroke than subdural placement of electrodes. Accurately decoding motor commands at the epidural level may be an important step towards a clinically viable brain-machine interface.

Penalized Multi-Way Partial Least Squares for Smooth Trajectory Decoding from Electrocorticographic (ECoG) Recording

In the current paper the decoding algorithms for motor-related BCI systems for continuous upper limb trajectory prediction are considered. Two methods for the smooth prediction, namely Sobolev and Polynomial Penalized Multi-Way Partial Least Squares (PLS) regressions, are proposed. The methods are compared to the Multi-Way Partial Least Squares and Kalman Filter approaches. The comparison demonstrated that the proposed methods combined the prediction accuracy of the algorithms of the PLS family and trajectory smoothness of the Kalman Filter. In addition, the prediction delay is significantly lower for the proposed algorithms than for the Kalman Filter approach. The proposed methods could be applied in a wide range of applications beyond neuroscience.

Flexible adaptation to an artificial recurrent connection from muscle to peripheral nerve in man

Controlling a neuroprosthesis requires learning a novel input-output transformation; however, how subjects incorporate this into limb control remains obscure. To elucidate the underling mechanisms, we investigated the motor adaptation process to a novel artificial recurrent connection (ARC) from a muscle to a peripheral nerve in healthy humans. In this paradigm, the ulnar nerve was electrically stimulated in proportion to the activation of the flexor carpi ulnaris (FCU), which is ulnar-innervated and monosynaptically innervated from Ia afferents of the FCU, defined as the "homonymous muscle," or the palmaris longus (PL), which is not innervated by the ulnar nerve and produces similar movement to the FCU, defined as the "synergist muscle." The ARC boosted the activity of the homonymous muscle and wrist joint movement during a visually guided reaching task. Participants could control muscle activity to utilize the ARC for the volitional control of wrist joint movement and then readapt to the absence of the ARC to either input muscle. Participants reduced homonymous muscle recruitment with practice, regardless of the input muscle. However, the adaptation process in the synergist muscle was dependent on the input muscle. The activity of the synergist muscle decreased when the input was the homonymous muscle, whereas it increased when it was the synergist muscle. This reorganization of the neuromotor map, which was maintained as an aftereffect of the ARC, was observed only when the input was the synergist muscle. These findings demonstrate that the ARC induced reorganization of neuromotor map in a targeted and sustainable manner.

Brain-controlled muscle stimulation for the restoration of motor function

Loss of the ability to move, as a consequence of spinal cord injury or neuromuscular disorder, has devastating consequences for the paralyzed individual, and great economic consequences for society. Functional electrical stimulation (FES) offers one means to restore some mobility to these individuals, improving not only their autonomy, but potentially their general health and well-being as well. FES uses electrical stimulation to cause the paralyzed muscles to contract. Existing clinical systems require the stimulation to be preprogrammed, with the patient typically using residual voluntary movement of another body part to trigger and control the patterned stimulation. The rapid development of neural interfacing in the past decade offers the promise of dramatically improved control for these patients, potentially allowing continuous control of FES through signals recorded from motor cortex, as the patient attempts to control the paralyzed body part. While application of these 'brain-machine interfaces' (BMIs) has undergone dramatic development for control of computer cursors and even robotic limbs, their use as an interface for FES has been much more limited. In this review, we consider both FES and BMI technologies and discuss the prospect for combining the two to provide important new options for paralyzed individuals.

Studying brain functions with mesoscopic measurements: Advances in electrocorticography for non-human primates

Our brain is organized in a modular structure. Information in different modalities is processed within distinct cortical areas. However, individual cortical areas cannot enable complex cognitive functions without interacting with other cortical areas. Electrocorticography (ECoG) has recently become an important tool for studying global network activity across cortical areas in animal models. With stable recordings of electrical field potentials from multiple cortical areas, ECoG provides an opportunity to systematically study large-scale cortical activity at a mesoscopic spatiotemporal resolution under various experimental conditions. Recent developments in thin, flexible ECoG electrodes permit recording field potentials from not only gyral but intrasulcal cortical surfaces. Our review here focuses on the recent advances of ECoG applications to non-human primates.

Brain oscillatory signatures of motor tasks

Noninvasive brain-computer-interfaces (BCI) coupled with prosthetic devices were recently introduced in the rehabilitation of chronic stroke and other disorders of the motor system. These BCI systems and motor rehabilitation in general involve several motor tasks for training. This study investigates the neurophysiological bases of an EEG-oscillation-driven BCI combined with a neuroprosthetic device to define the specific oscillatory signature of the BCI task. Controlling movements of a hand robotic orthosis with motor imagery of the same movement generates sensorimotor rhythm oscillation changes and involves three elements of tasks also used in stroke motor rehabilitation: passive and active movement, motor imagery, and motor intention. We recorded EEG while nine healthy participants performed five different motor tasks consisting of closing and opening of the hand as follows: 1) motor imagery without any external feedback and without overt hand movement, 2) motor imagery that moves the orthosis proportional to the produced brain oscillation change with online proprioceptive and visual feedback of the hand moving through a neuroprosthetic device (BCI condition), 3) passive and 4) active movement of the hand with feedback (seeing and feeling the hand moving), and 5) rest. During the BCI condition, participants received contingent online feedback of the decrease of power of the sensorimotor rhythm, which induced orthosis movement and therefore proprioceptive and visual information from the moving hand. We analyzed brain activity during the five conditions using time-frequency domain bootstrap-based statistical comparisons and Morlet transforms. Activity during rest was used as a reference. Significant contralateral and ipsilateral event-related desynchronization of sensorimotor rhythm was present during all motor tasks, largest in contralateral-postcentral, medio-central, and ipsilateral-precentral areas identifying the ipsilateral precentral cortex as an integral part of motor regulation. Changes in task-specific frequency power compared with rest were similar between motor tasks, and only significant differences in the time course and some narrow specific frequency bands were observed between motor tasks. We identified EEG features representing active and passive proprioception (with and without muscle contraction) and active intention and passive involvement (with and without voluntary effort) differentiating brain oscillations during motor tasks that could substantially support the design of novel motor BCI-based rehabilitation therapies. The BCI task induced significantly different brain activity compared with the other motor tasks, indicating neural processes unique to the use of body actuators control in a BCI context.

Extracting kinetic information from human motor cortical signals

Brain machine interfaces (BMIs) have the potential to provide intuitive control of neuroprostheses to restore grasp to patients with paralyzed or amputated upper limbs. For these neuroprostheses to function, the ability to accurately control grasp force is critical. Grasp force can be decoded from neuronal spikes in monkeys, and hand kinematics can be decoded using electrocorticogram (ECoG) signals recorded from the surface of the human motor cortex. We hypothesized that kinetic information about grasping could also be extracted from ECoG, and sought to decode continuously-graded grasp force. In this study, we decoded isometric pinch force with high accuracy from ECoG in 10 human subjects. The predicted signals explained from 22% to 88% (60 ± 6%, mean ± SE) of the variance in the actual force generated. We also decoded muscle activity in the finger flexors, with similar accuracy to force decoding. We found that high gamma band and time domain features of the ECoG signal were most informative about kinetics, similar to our previous findings with intracortical LFPs. In addition, we found that peak cortical representations of force applied by the index and little fingers were separated by only about 4mm. Thus, ECoG can be used to decode not only kinematics, but also kinetics of movement. This is an important step toward restoring intuitively-controlled grasp to impaired patients.

Decoding fingertip trajectory from electrocorticographic signals in humans

Seeking to apply brain-machine interface technology in neuroprosthetics, a number of methods for predicting trajectory of the elbow and wrist have been proposed and have shown remarkable results. Recently, the prediction of hand trajectory and classification of hand gestures or grasping types have attracted considerable attention. However, trajectory prediction for precise finger motion has remained a challenge. We proposed a method for the prediction of fingertip motions from electrocorticographic signals in human cortex. A patient performed extension/flexion tasks with three fingers. Average Pearson's correlation coefficients and normalized root-mean-square errors between decoded and actual trajectories were 0.83-0.90 and 0.24-0.48, respectively. To confirm generalizability to other users, we applied our method to the BCI Competition IV open data sets. Our method showed that the prediction accuracy of fingertip trajectory could be equivalent to that of other results in the competition.

Decoding of the spike timing of primary afferents during voluntary arm movements in monkeys

Understanding the mechanisms of encoding forelimb kinematics in the activity of peripheral afferents is essential for developing a somatosensory neuroprosthesis. To investigate whether the spike timing of dorsal root ganglion (DRG) neurons could be estimated from the forelimb kinematics of behaving monkeys, we implanted two multi-electrode arrays chronically in the DRGs at the level of the cervical segments in two monkeys. Neuronal activity during voluntary reach-to-grasp movements were recorded simultaneously with the trajectories of hand/arm movements, which were tracked in three-dimensional space using a motion capture system. Sixteen and 13 neurons, including muscle spindles, skin receptors, and tendon organ afferents, were recorded in the two monkeys, respectively. We were able to reconstruct forelimb joint kinematics from the temporal firing pattern of a subset of DRG neurons using sparse linear regression (SLiR) analysis, suggesting that DRG neuronal ensembles encoded information about joint kinematics. Furthermore, we estimated the spike timing of the DRG neuronal ensembles from joint kinematics using an integrate-and-fire model (IF) incorporating the SLiR algorithm. The temporal change of firing frequency of a subpopulation of neurons was reconstructed precisely from forelimb kinematics using the SLiR. The estimated firing pattern of the DRG neuronal ensembles encoded forelimb joint angles and velocities as precisely as the originally recorded neuronal activity. These results suggest that a simple model can be used to generate an accurate estimate of the spike timing of DRG neuronal ensembles from forelimb joint kinematics, and is useful for designing a proprioceptive decoder in a brain machine interface.

Encoding of forelimb forces by corticospinal tract activity in the rat

In search of a solution to the long standing problems encountered in traditional brain computer interfaces (BCI), the lateral descending tracts of the spinal cord present an alternative site for taping into the volitional motor signals. Due to the convergence of the cortical outputs into a final common pathway in the descending tracts of the spinal cord, neural interfaces with the spinal cord can potentially acquire signals richer with volitional information in a smaller anatomical region. The main objective of this study was to evaluate the feasibility of extracting motor control signals from the corticospinal tract (CST) of the rat spinal cord. Flexible substrate, multi-electrode arrays (MEA) were implanted in the CST of rats trained for a lever pressing task. This novel use of flexible substrate MEAs allowed recording of CST activity in behaving animals for up to three weeks with the current implantation technique. Time-frequency and principal component analyses (PCA) were applied to the neural signals to reconstruct isometric forelimb forces. Computed regression coefficients were then used to predict isometric forces in additional trials. The correlation between measured and predicted forces in the vertical direction averaged across six animals was 0.67 and R² value was 0.44. Force regression in the horizontal directions was less successful, possibly due to the small amplitude of forces. Neural signals above and near the high gamma band made the largest contributions to prediction of forces. The results of this study support the feasibility of a spinal cord computer interface (SCCI) for generation of command signals in paralyzed individuals.

Decoding grasp force profile from electrocorticography signals in non-human primate sensorimotor cortex

The relatively low invasiveness of electrocorticography (ECoG) has made it a promising candidate for the development of practical, high-performance neural prosthetics. Recent ECoG-based studies have shown success in decoding hand and finger movements and muscle activity in reaching and grasping tasks. However, decoding of force profiles is still lacking. Here, we demonstrate that lateral grasp force profile can be decoded using a sparse linear regression from 15 and 16 channel ECoG signals recorded from sensorimotor cortex in two non-human primates. The best average correlation coefficients of prediction after 10-fold cross validation were 0.82±0.09 and 0.79±0.15 for our monkeys A and B, respectively. These results show that grasp force profile was successfully decoded from ECoG signals in reaching and grasping tasks and may potentially contribute to the development of more natural control methods for grasping in neural prosthetics.

Towards effective non-invasive brain-computer interfaces dedicated to gait rehabilitation systems

In the last few years, significant progress has been made in the field of walk rehabilitation. Motor cortex signals in bipedal monkeys have been interpreted to predict walk kinematics. Epidural electrical stimulation in rats and in one young paraplegic has been realized to partially restore motor control after spinal cord injury. However, these experimental trials are far from being applicable to all patients suffering from motor impairments. Therefore, it is thought that more simple rehabilitation systems are desirable in the meanwhile. The goal of this review is to describe and summarize the progress made in the development of non-invasive brain-computer interfaces dedicated to motor rehabilitation systems. In the first part, the main principles of human locomotion control are presented. The paper then focuses on the mechanisms of supra-spinal centers active during gait, including results from electroencephalography, functional brain imaging technologies [near-infrared spectroscopy (NIRS), functional magnetic resonance imaging (fMRI), positron-emission tomography (PET), single-photon emission-computed tomography (SPECT)] and invasive studies. The first brain-computer interface (BCI) applications to gait rehabilitation are then presented, with a discussion about the different strategies developed in the field. The challenges to raise for future systems are identified and discussed. Finally, we present some proposals to address these challenges, in order to contribute to the improvement of BCI for gait rehabilitation.

Prediction of hand trajectory from electrocorticography signals in primary motor cortex

Due to their potential as a control modality in brain-machine interfaces, electrocorticography (ECoG) has received much focus in recent years. Studies using ECoG have come out with success in such endeavors as classification of arm movements and natural grasp types, regression of arm trajectories in two and three dimensions, estimation of muscle activity time series and so on. However, there still remains considerable work to be done before a high performance ECoG-based neural prosthetic can be realized. In this study, we proposed an algorithm to decode hand trajectory from 15 and 32 channel ECoG signals recorded from primary motor cortex (M1) in two primates. To determine the most effective areas for prediction, we applied two electrode selection methods, one based on position relative to the central sulcus (CS) and another based on the electrodes' individual prediction performance. The best coefficients of determination for decoding hand trajectory in the two monkeys were 0.4815 ± 0.0167 and 0.7780 ± 0.0164. Performance results from individual ECoG electrodes showed that those with higher performance were concentrated at the lateral areas and areas close to the CS. The results of prediction according with different numbers of electrodes based on proposed methods were also shown and discussed. These results also suggest that superior decoding performance can be achieved from a group of effective ECoG signals rather than an entire ECoG array.

Prediction of three-dimensional arm trajectories based on ECoG signals recorded from human sensorimotor cortex

Brain-machine interface techniques have been applied in a number of studies to control neuromotor prostheses and for neurorehabilitation in the hopes of providing a means to restore lost motor function. Electrocorticography (ECoG) has seen recent use in this regard because it offers a higher spatiotemporal resolution than non-invasive EEG and is less invasive than intracortical microelectrodes. Although several studies have already succeeded in the inference of computer cursor trajectories and finger flexions using human ECoG signals, precise three-dimensional (3D) trajectory reconstruction for a human limb from ECoG has not yet been achieved. In this study, we predicted 3D arm trajectories in time series from ECoG signals in humans using a novel preprocessing method and a sparse linear regression. Average Pearson’s correlation coefficients and normalized root-mean-square errors between predicted and actual trajectories were 0.44∼0.73 and 0.18∼0.42, respectively, confirming the feasibility of predicting 3D arm trajectories from ECoG. We foresee this method contributing to future advancements in neuroprosthesis and neurorehabilitation technology.

Restoration of upper limb movement via artificial corticospinal and musculospinal connections in a monkey with spinal cord injury

Functional loss of limb control in individuals with spinal cord injury or stroke can be caused by interruption of corticospinal pathways, although the neural circuits located above and below the lesion remain functional. An artificial neural connection that bridges the lost pathway and connects cortical to spinal circuits has potential to ameliorate the functional loss. We investigated the effects of introducing novel artificial neural connections in a paretic monkey that had a unilateral spinal cord lesion at the C2 level. The first application bridged the impaired spinal lesion. This allowed the monkey to drive the spinal stimulation through volitionally controlled power of high-gamma activity in either the premotor or motor cortex, and thereby to acquire a force-matching target. The second application created an artificial recurrent connection from a paretic agonist muscle to a spinal site, allowing muscle-controlled spinal stimulation to boost on-going activity in the muscle. These results suggest that artificial neural connections can compensate for interrupted descending pathways and promote volitional control of upper limb movement after damage of descending pathways such as spinal cord injury or stroke.