Reprogramming movements: extraction of motor intentions from cortical ensemble activity when movement goals change

Motor cortex activation during visuomotor transformations: evoked potentials during overt and imagined movements

Despite the prevalence of visuomotor transformations in our motor skills, their mechanisms remain incompletely understood, especially when imagery actions are considered such as mentally picking up a cup or pressing a button. Here, we used a stimulus-response task to directly compare the visuomotor transformation underlying overt and imagined button presses. Electroencephalographic activity was recorded while participants responded to highlights of the target button while ignoring the second, non-target button. Movement-related potentials (MRPs) and event-related desynchronization occurred for both overt movements and motor imagery (MI), with responses present even for non-target stimuli. Consistent with the activity accumulation model where visual stimuli are evaluated and transformed into the eventual motor response, the timing of MRPs matched the response time on individual trials. Activity-accumulation patterns were observed for MI, as well. Yet, unlike overt movements, MI-related MRPs were not lateralized, which appears to be a neural marker for the distinction between generating a mental image and transforming it into an overt action. Top-down response strategies governing this hemispheric specificity should be accounted for in future research on MI, including basic studies and medical practice.

Parallel movement planning is achieved via an optimal preparatory state in motor cortex

How do patterns of neural activity in the motor cortex contribute to the planning of a movement? A recent theory developed for single movements proposes that the motor cortex acts as a dynamical system whose initial state is optimized during the preparatory phase of the movement. This theory makes important yet untested predictions about preparatory dynamics in more complex behavioral settings. Here, we analyze preparatory activity in non-human primates planning not one but two movements simultaneously. As predicted by the theory, we find that parallel planning is achieved by adjusting preparatory activity within an optimal subspace to an intermediate state reflecting a trade-off between the two movements. The theory quantitatively accounts for the relationship between this intermediate state and fluctuations in the animals' behavior down at the trial level. These results uncover a simple mechanism for planning multiple movements in parallel and further point to motor planning as a controlled dynamical process.

Open-Source, Low Cost, Free-Behavior Monitoring, and Reward System for Neuroscience Research in Non-human Primates

We describe a low-cost system designed to document bodily movement and neural activity and deliver rewards to monkeys behaving freely in their home cage. An important application is to studying brain-machine interface (BMI) systems during free behavior, since brain signals associated with natural movement can differ significantly from those associated with more commonly used constrained conditions. Our approach allows for short-latency (<500 ms) reward delivery and behavior monitoring using low-cost off-the-shelf components. This system interfaces existing untethered recording equipment with a custom hub that controls a cage-mounted feeder. The behavior monitoring system uses a depth camera to provide real-time, easy-to-analyze, gross movement data streams. In a proof-of-concept experiment we demonstrate robust learning of neural activity using the system over 14 behavioral sessions.

Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation

Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.

Interfacing to the brain's motor decisions

It has been long known that neural activity, recorded with electrophysiological methods, contains rich information about a subject's motor intentions, sensory experiences, allocation of attention, action planning, and even abstract thoughts. All these functions have been the subject of neurophysiological investigations, with the goal of understanding how neuronal activity represents behavioral parameters, sensory inputs, and cognitive functions. The field of brain-machine interfaces (BMIs) strives for a somewhat different goal: it endeavors to extract information from neural modulations to create a communication link between the brain and external devices. Although many remarkable successes have been already achieved in the BMI field, questions remain regarding the possibility of decoding high-order neural representations, such as decision making. Could BMIs be employed to decode the neural representations of decisions underlying goal-directed actions? In this review we lay out a framework that describes the computations underlying goal-directed actions as a multistep process performed by multiple cortical and subcortical areas. We then discuss how BMIs could connect to different decision-making steps and decode the neural processing ongoing before movements are initiated. Such decision-making BMIs could operate as a system with prediction that offers many advantages, such as shorter reaction time, better error processing, and improved unsupervised learning. To present the current state of the art, we review several recent BMIs incorporating decision-making components.

Wireless Cortical Brain-Machine Interface for Whole-Body Navigation in Primates

Several groups have developed brain-machine-interfaces (BMIs) that allow primates to use cortical activity to control artificial limbs. Yet, it remains unknown whether cortical ensembles could represent the kinematics of whole-body navigation and be used to operate a BMI that moves a wheelchair continuously in space. Here we show that rhesus monkeys can learn to navigate a robotic wheelchair, using their cortical activity as the main control signal. Two monkeys were chronically implanted with multichannel microelectrode arrays that allowed wireless recordings from ensembles of premotor and sensorimotor cortical neurons. Initially, while monkeys remained seated in the robotic wheelchair, passive navigation was employed to train a linear decoder to extract 2D wheelchair kinematics from cortical activity. Next, monkeys employed the wireless BMI to translate their cortical activity into the robotic wheelchair’s translational and rotational velocities. Over time, monkeys improved their ability to navigate the wheelchair toward the location of a grape reward. The navigation was enacted by populations of cortical neurons tuned to whole-body displacement. During practice with the apparatus, we also noticed the presence of a cortical representation of the distance to reward location. These results demonstrate that intracranial BMIs could restore whole-body mobility to severely paralyzed patients in the future.

Characterization of Artifacts Produced by Gel Displacement on Non-invasive Brain-Machine Interfaces during Ambulation

So far, Brain-Machine Interfaces (BMIs) have been mainly used to study brain potentials during movement-free conditions. Recently, due to the emerging concern of improving rehabilitation therapies, these systems are also being used during gait experiments. Under this new condition, the evaluation of motion artifacts has become a critical point to assure the validity of the results obtained. Due to the high signal to noise ratio provided, the use of wet electrodes is a widely accepted technic to acquire electroencephalographic (EEG signals). To perform these recordings it is necessary to apply a conductive gel between the scalp and the electrodes. This work is focused on the study of gel displacements produced during ambulation and how they affect the amplitude of EEG signals. Data recorded during three ambulation conditions (gait training) and one movement-free condition (BMI motor imagery task) are compared to perform this study. Two phenomenons, manifested as unusual increases of the signals' amplitude, have been identified and characterized during this work. Results suggest that they are caused by abrupt changes on the conductivity between the electrode and the scalp due to gel displacement produced during ambulation and head movements. These artifacts significantly increase the Power Spectral Density (PSD) of EEG recordings at all frequencies from 5 to 90 Hz, corresponding to the main bandwidth of electrocortical potentials. They should be taken into consideration before performing EEG recordings in order to asses the correct gel allocation and to avoid the use of electrodes on certain scalp areas depending on the experimental conditions.

A novel wireless recording and stimulating multichannel epicortical grid for supplementing or enhancing the sensory-motor functions in monkey (Macaca fascicularis)

Artificial brain-machine interfaces (BMIs) represent a prospective step forward supporting or replacing faulty brain functions. So far, several obstacles, such as the energy supply, the portability and the biocompatibility, have been limiting their effective translation in advanced experimental or clinical applications. In this work, a novel 16 channel chronically implantable epicortical grid has been proposed. It provides wireless transmission of cortical recordings and stimulations, with induction current recharge. The grid has been chronically implanted in a non-human primate (Macaca fascicularis) and placed over the somato-motor cortex such that 13 electrodes recorded or stimulated the primary motor cortex and three the primary somatosensory cortex, in the deeply anaesthetized animal. Cortical sensory and motor recordings and stimulations have been performed within 3 months from the implant. In detail, by delivering motor cortex epicortical single spot stimulations (1-8 V, 1-10 Hz, 500 ms, biphasic waves), we analyzed the motor topographic precision, evidenced by tunable finger or arm movements of the anesthetized animal. The responses to light mechanical peripheral sensory stimuli (blocks of 100 stimuli, each single stimulus being <1 ms and interblock intervals of 1.5-4 s) have been analyzed. We found 150-250 ms delayed cortical responses from fast finger touches, often spread to nearby motor stations. We also evaluated the grid electrical stimulus interference with somatotopic natural tactile sensory processing showing no suppressing interference with sensory stimulus detection. In conclusion, we propose a chronically implantable epicortical grid which can accommodate most of current technological restrictions, representing an acceptable candidate for BMI experimental and clinical uses.

Vacillation, indecision and hesitation in moment-by-moment decoding of monkey motor cortex

When choosing actions, we can act decisively, vacillate, or suffer momentary indecision. Studying how individual decisions unfold requires moment-by-moment readouts of brain state. Here we provide such a view from dorsal premotor and primary motor cortex. Two monkeys performed a novel decision task while we recorded from many neurons simultaneously. We found that a decoder trained using 'forced choices' (one target viable) was highly reliable when applied to 'free choices'. However, during free choices internal events formed three categories. Typically, neural activity was consistent with rapid, unwavering choices. Sometimes, though, we observed presumed 'changes of mind': the neural state initially reflected one choice before changing to reflect the final choice. Finally, we observed momentary 'indecision': delay forming any clear motor plan. Further, moments of neural indecision accompanied moments of behavioral indecision. Together, these results reveal the rich and diverse set of internal events long suspected to occur during free choice.

Should I stay or should I go? Conceptual underpinnings of goal-directed actions

All actions, even the simplest like moving an arm to grasp a pen, are associated with energy costs. Thus all mobile organisms possess the ability to evaluate resources and select those behaviors that are most likely to lead to the greatest accrual of valuable items (reward) in the near or, especially in the case of humans, distant future. The evaluation process is performed at all possible stages of the series of decisions that lead to the building of a goal-directed action or to its suppression. This is because all animals have a limited amount of energy and resources; to survive and be able to reproduce they have to minimize the costs and maximize the outcomes of their actions. These computations are at the root of behavioral flexibility. Two executive functions play a major role in generating flexible behaviors: (i) the ability to predict future outcomes of goal-directed actions; and (ii) the ability to cancel them when they are unlikely to accomplish valuable results. These two processes operate continuously during the entire course of a movement: during its genesis, its planning and even its execution, so that the motor output can be modulated or suppressed at any time before its execution. In this review, functional interactions of the extended neural network subserving generation and inhibition of goal-directed movements will be outlined, leading to the intriguing hypothesis that the performance of actions and their suppression are not specified by independent sets of brain regions. Rather, it will be proposed that acting and stopping are functions emerging from specific interactions between largely overlapping brain regions, whose activity is intimately linked (directly or indirectly) to the evaluations of pros and cons of an action. Such mechanism would allow the brain to perform as a highly efficient and flexible system, as different functions could be computed exploiting the same components operating in different configurations.

Spatiotemporal dynamics of online motor correction processing revealed by high-density electroencephalography

The ability to control online motor corrections is key to dealing with unexpected changes arising in the environment with which we interact. How the CNS controls online motor corrections is poorly understood, but evidence has accumulated in favor of a submovement-based model in which apparently continuous movement is segmented into distinct submovements. Although most studies have focused on submovements' kinematic features, direct links with the underlying neural dynamics have not been extensively explored. This study sought to identify an electroencephalographic signature of submovements. We elicited kinematic submovements using a double-step displacement paradigm. Participants moved their wrist toward a target whose direction could shift mid-movement with a 50% probability. Movement kinematics and cortical activity were concurrently recorded with a low-friction robotic device and high-density electroencephalography. Analysis of spatiotemporal dynamics of brain activation and its correlation with movement kinematics showed that the production of each kinematic submovement was accompanied by (1) stereotyped topographic scalp maps and (2) frontoparietal ERPs time-locked to submovements. Positive ERP peaks from frontocentral areas contralateral to the moving wrist preceded kinematic submovement peaks by 220-250 msec and were followed by positive ERP peaks from contralateral parietal areas (140-250 msec latency, 0-80 msec before submovement peaks). Moreover, individual subject variability in the latency of frontoparietal ERP components following the target shift significantly predicted variability in the latency of the corrective submovement. Our results are in concordance with evidence for the intermittent nature of continuous movement and elucidate the timing and role of frontoparietal activations in the generation and control of corrective submovements.

Movement-related cortical potentials in paraplegic patients: abnormal patterns and considerations for BCI-rehabilitation

Non-invasive EEG-based Brain-Computer Interfaces (BCI) can be promising for the motor neuro-rehabilitation of paraplegic patients. However, this shall require detailed knowledge of the abnormalities in the EEG signatures of paraplegic patients. The association of abnormalities in different subgroups of patients and their relation to the sensorimotor integration are relevant for the design, implementation and use of BCI systems in patient populations. This study explores the patterns of abnormalities of movement related cortical potentials (MRCP) during motor imagery tasks of feet and right hand in patients with paraplegia (including the subgroups with/without central neuropathic pain (CNP) and complete/incomplete injury patients) and the level of distinctiveness of abnormalities in these groups using pattern classification. The most notable observed abnormalities were the amplified execution negativity and its slower rebound in the patient group. The potential underlying mechanisms behind these changes and other minor dissimilarities in patients' subgroups, as well as the relevance to BCI applications, are discussed. The findings are of interest from a neurological perspective as well as for BCI-assisted neuro-rehabilitation and therapy.

Motor cortical correlates of arm resting in the context of a reaching task and implications for prosthetic control

Prosthetic devices are being developed to restore movement for motor-impaired individuals. A robotic arm can be controlled based on models that relate motor-cortical ensemble activity to kinematic parameters. The models are typically built and validated on data from structured trial periods during which a subject actively performs specific movements, but real-world prosthetic devices will need to operate correctly during rest periods as well. To develop a model of motor cortical modulation during rest, we trained monkeys (Macaca mulatta) to perform a reaching task with their own arm while recording motor-cortical single-unit activity. When a monkey spontaneously put its arm down to rest between trials, our traditional movement decoder produced a nonzero velocity prediction, which would cause undesired motion when applied to a prosthetic arm. During these rest periods, a marked shift was found in individual units' tuning functions. The activity pattern of the whole population during rest (Idle state) was highly distinct from that during reaching movements (Active state), allowing us to predict arm resting from instantaneous firing rates with 98% accuracy using a simple classifier. By cascading this state classifier and the movement decoder, we were able to predict zero velocity correctly, which would avoid undesired motion in a prosthetic application. Interestingly, firing rates during hold periods followed the Active pattern even though hold kinematics were similar to those during rest with near-zero velocity. These findings expand our concept of motor-cortical function by showing that population activity reflects behavioral context in addition to the direct parameters of the movement itself.

Identification of a self-paced hitting task in freely moving rats based on adaptive spike detection from multi-unit M1 cortical signals

Invasive brain–computer interfaces (BCIs) may prove to be a useful rehabilitation tool for severely disabled patients. Although some systems have shown to work well in restricted laboratory settings, their usefulness must be tested in less controlled environments. Our objective was to investigate if a specific motor task could reliably be detected from multi-unit intra-cortical signals from freely moving animals. Four rats were trained to hit a retractable paddle (defined as a “hit”). Intra-cortical signals were obtained from electrodes placed in the primary motor cortex. First, the signal-to-noise ratio was increased by wavelet denoising. Action potentials were then detected using an adaptive threshold, counted in three consecutive time intervals and were used as features to classify either a “hit” or a “no-hit” (defined as an interval between two “hits”). We found that a “hit” could be detected with an accuracy of 75 ± 6% when wavelet denoising was applied whereas the accuracy dropped to 62 ± 5% without prior denoising. We compared our approach with the common daily practice in BCI that consists of using a fixed, manually selected threshold for spike detection without denoising. The results showed the feasibility of detecting a motor task in a less restricted environment than commonly applied within invasive BCI research.

Toward high performance, weakly invasive brain computer interfaces using selective visual attention

Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.

Complex motor stereotypies: an evolving neurobiological concept

Complex motor stereotypies are repetitive arm and/or hand flapping, waving and wiggling movements that begin before the age of 3 years, occur repeatedly throughout the day and stop with distraction. These movements are commonly seen in children with autism, but also appear in otherwise normally developing individuals labelled as primary. Although proposed to have a psychological and neurobiological mechanism, evidence suggests that there is an abnormality within the corticostriatal–thalamocortical circuitry or its connecting structures. Animal models include both drug-induced (i.e., via stimulants or cocaine) and spontaneously appearing prototypes. Neurochemical investigations, primarily in rodents, have identified a variety of neurotransmitter alterations, with an emphasis on dopamine or glutamate; however, findings are inconsistent. We hypothesize that, based on its various roles in controlling and modulating movements, the frontal cortex will ultimately be shown to be the prime site of abnormality in this disorder. Future studies investigating both humans and animal models are essential for attaining a greater understanding of the pathobiology underlying motor stereotypies.