A flexible intracortical brain-computer interface for typing using finger movements

Keyboard typing with finger movements is a versatile digital interface for users with diverse skills, needs, and preferences. Currently, such an interface does not exist for people with paralysis. We developed an intracortical brain-computer interface (BCI) for typing with attempted flexion/extension movements of three finger groups on the right hand, or both hands, and demonstrated its flexibility in two dominant typing paradigms. The first paradigm is "point-and-click" typing, where a BCI user selects one key at a time using continuous real-time control, allowing selection of arbitrary sequences of symbols. During cued character selection with this paradigm, a human research participant with paralysis achieved 30-40 selections per minute with nearly 90% accuracy. The second paradigm is "keystroke" typing, where the BCI user selects each character by a discrete movement without real-time feedback, often giving a faster speed for natural language sentences. With 90 cued characters per minute, decoding attempted finger movements and correcting errors using a language model resulted in more than 90% accuracy. Notably, both paradigms matched the state-of-the-art for BCI performance and enabled further flexibility by the simultaneous selection of multiple characters as well as efficient decoder estimation across paradigms. Overall, the high-performance interface is a step towards the wider accessibility of BCI technology by addressing unmet user needs for flexibility.

BRAND: a platform for closed-loop experiments with deep network models

Objective.Artificial neural networks (ANNs) are state-of-the-art tools for modeling and decoding neural activity, but deploying them in closed-loop experiments with tight timing constraints is challenging due to their limited support in existing real-time frameworks. Researchers need a platform that fully supports high-level languages for running ANNs (e.g. Python and Julia) while maintaining support for languages that are critical for low-latency data acquisition and processing (e.g. C and C++).Approach.To address these needs, we introduce the Backend for Realtime Asynchronous Neural Decoding (BRAND). BRAND comprises Linux processes, termednodes, which communicate with each other in agraphvia streams of data. Its asynchronous design allows for acquisition, control, and analysis to be executed in parallel on streams of data that may operate at different timescales. BRAND uses Redis, an in-memory database, to send data between nodes, which enables fast inter-process communication and supports 54 different programming languages. Thus, developers can easily deploy existing ANN models in BRAND with minimal implementation changes.Main results.In our tests, BRAND achieved <600 microsecond latency between processes when sending large quantities of data (1024 channels of 30 kHz neural data in 1 ms chunks). BRAND runs a brain-computer interface with a recurrent neural network (RNN) decoder with less than 8 ms of latency from neural data input to decoder prediction. In a real-world demonstration of the system, participant T11 in the BrainGate2 clinical trial (ClinicalTrials.gov Identifier: NCT00912041) performed a standard cursor control task, in which 30 kHz signal processing, RNN decoding, task control, and graphics were all executed in BRAND. This system also supports real-time inference with complex latent variable models like Latent Factor Analysis via Dynamical Systems.Significance.By providing a framework that is fast, modular, and language-agnostic, BRAND lowers the barriers to integrating the latest tools in neuroscience and machine learning into closed-loop experiments.

An accurate and rapidly calibrating speech neuroprosthesis

Brain-computer interfaces can enable rapid, intuitive communication for people with paralysis by transforming the cortical activity associated with attempted speech into text on a computer screen. Despite recent advances, communication with brain-computer interfaces has been restricted by extensive training data requirements and inaccurate word output. A man in his 40's with ALS with tetraparesis and severe dysarthria (ALSFRS-R = 23) was enrolled into the BrainGate2 clinical trial. He underwent surgical implantation of four microelectrode arrays into his left precentral gyrus, which recorded neural activity from 256 intracortical electrodes. We report a speech neuroprosthesis that decoded his neural activity as he attempted to speak in both prompted and unstructured conversational settings. Decoded words were displayed on a screen, then vocalized using text-to-speech software designed to sound like his pre-ALS voice. On the first day of system use, following 30 minutes of attempted speech training data, the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. On the second day, the size of the possible output vocabulary increased to 125,000 words, and, after 1.4 additional hours of training data, the neuroprosthesis achieved 90.2% accuracy. With further training data, the neuroprosthesis sustained 97.5% accuracy beyond eight months after surgical implantation. The participant has used the neuroprosthesis to communicate in self-paced conversations for over 248 hours. In an individual with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore naturalistic communication after a brief training period.

Measuring instability in chronic human intracortical neural recordings towards stable, long-term brain-computer interfaces

Intracortical brain-computer interfaces (iBCIs) enable people with tetraplegia to gain intuitive cursor control from movement intentions. To translate to practical use, iBCIs should provide reliable performance for extended periods of time. However, performance begins to degrade as the relationship between kinematic intention and recorded neural activity shifts compared to when the decoder was initially trained. In addition to developing decoders to better handle long-term instability, identifying when to recalibrate will also optimize performance. We propose a method to measure instability in neural data without needing to label user intentions. Longitudinal data were analyzed from two BrainGate2 participants with tetraplegia as they used fixed decoders to control a computer cursor spanning 142 days and 28 days, respectively. We demonstrate a measure of instability that correlates with changes in closed-loop cursor performance solely based on the recorded neural activity (Pearson r = 0.93 and 0.72, respectively). This result suggests a strategy to infer online iBCI performance from neural data alone and to determine when recalibration should take place for practical long-term use.

A real-time, high-performance brain-computer interface for finger decoding and quadcopter control

People with paralysis express unmet needs for peer support, leisure activities, and sporting activities. Many within the general population rely on social media and massively multiplayer video games to address these needs. We developed a high-performance finger brain-computer-interface system allowing continuous control of 3 independent finger groups with 2D thumb movements. The system was tested in a human research participant over sequential trials requiring fingers to reach and hold on targets, with an average acquisition rate of 76 targets/minute and completion time of 1.58 ± 0.06 seconds. Performance compared favorably to previous animal studies, despite a 2-fold increase in the decoded degrees-of-freedom (DOF). Finger positions were then used for 4-DOF velocity control of a virtual quadcopter, demonstrating functionality over both fixed and random obstacle courses. This approach shows promise for controlling multiple-DOF end-effectors, such as robotic fingers or digital interfaces for work, entertainment, and socialization.

Brain-Computer Interfaces for Communication in Patients with Disorders of Consciousness: A Gap Analysis and Scientific Roadmap

BACKGROUND

We developed a gap analysis that examines the role of brain-computer interfaces (BCI) in patients with disorders of consciousness (DoC), focusing on their assessment, establishment of communication, and engagement with their environment.

METHODS

The Curing Coma Campaign convened a Coma Science work group that included 16 clinicians and neuroscientists with expertise in DoC. The work group met online biweekly and performed a gap analysis of the primary question.

RESULTS

We outline a roadmap for assessing BCI readiness in patients with DoC and for advancing the use of BCI devices in patients with DoC. Additionally, we discuss preliminary studies that inform development of BCI solutions for communication and assessment of readiness for use of BCIs in DoC study participants. Special emphasis is placed on the challenges posed by the complex pathophysiologies caused by heterogeneous brain injuries and their impact on neuronal signaling. The differences between one-way and two-way communication are specifically considered. Possible implanted and noninvasive BCI solutions for acute and chronic DoC in adult and pediatric populations are also addressed.

CONCLUSIONS

We identify clinical and technical gaps hindering the use of BCI in patients with DoC in each of these contexts and provide a roadmap for research aimed at improving communication for adults and children with DoC, spanning the clinical spectrum from intensive care unit to chronic care.

Brain control of bimanual movement enabled by recurrent neural networks

Brain-computer interfaces have so far focused largely on enabling the control of a single effector, for example a single computer cursor or robotic arm. Restoring multi-effector motion could unlock greater functionality for people with paralysis (e.g., bimanual movement). However, it may prove challenging to decode the simultaneous motion of multiple effectors, as we recently found that a compositional neural code links movements across all limbs and that neural tuning changes nonlinearly during dual-effector motion. Here, we demonstrate the feasibility of high-quality bimanual control of two cursors via neural network (NN) decoders. Through simulations, we show that NNs leverage a neural 'laterality' dimension to distinguish between left and right-hand movements as neural tuning to both hands become increasingly correlated. In training recurrent neural networks (RNNs) for two-cursor control, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously. Our results suggest that neural network decoders may be advantageous for multi-effector decoding, provided they are designed to transfer to the online setting.

Co-occurring ripple oscillations facilitate neuronal interactions between cortical locations in humans

How the human cortex integrates ("binds") information encoded by spatially distributed neurons remains largely unknown. One hypothesis suggests that synchronous bursts of high-frequency oscillations ("ripples") contribute to binding by facilitating integration of neuronal firing across different cortical locations. While studies have demonstrated that ripples modulate local activity in the cortex, it is not known whether their co-occurrence coordinates neural firing across larger distances. We tested this hypothesis using local field-potentials and single-unit firing from four 96-channel microelectrode arrays in the supragranular cortex of 3 patients. Neurons in co-rippling locations showed increased short-latency co-firing, prediction of each other's firing, and co-participation in neural assemblies. Effects were similar for putative pyramidal and interneurons, during non-rapid eye movement sleep and waking, in temporal and Rolandic cortices, and at distances up to 16 mm (the longest tested). Increased co-prediction during co-ripples was maintained when firing-rate changes were equated, indicating that it was not secondary to non-oscillatory activation. Co-rippling enhanced prediction was strongly modulated by ripple phase, supporting the most common posited mechanism for binding-by-synchrony. Co-ripple enhanced prediction is reciprocal, synergistic with local upstates, and further enhanced when multiple sites co-ripple, supporting re-entrant facilitation. Together, these results support the hypothesis that trans-cortical co-occurring ripples increase the integration of neuronal firing of neurons in different cortical locations and do so in part through phase-modulation rather than unstructured activation.

Modified Neuropixels probes for recording human neurophysiology in the operating room

Neuropixels are silicon-based electrophysiology-recording probes with high channel count and recording-site density. These probes offer a turnkey platform for measuring neural activity with single-cell resolution and at a scale that is beyond the capabilities of current clinically approved devices. Our team demonstrated the first-in-human use of these probes during resection surgery for epilepsy or tumors and deep brain stimulation electrode placement in patients with Parkinson's disease. Here, we provide a better understanding of the capabilities and challenges of using Neuropixels as a research tool to study human neurophysiology, with the hope that this information may inform future efforts toward regulatory approval of Neuropixels probes as research devices. In perioperative procedures, the major concerns are the initial sterility of the device, maintaining a sterile field during surgery, having multiple referencing and grounding schemes available to de-noise recordings (if necessary), protecting the silicon probe from accidental contact before insertion and obtaining high-quality action potential and local field potential recordings. The research team ensures that the device is fully operational while coordinating with the surgical team to remove sources of electrical noise that could otherwise substantially affect the signals recorded by the sensitive hardware. Prior preparation using the equipment and training in human clinical research and working in operating rooms maximize effective communication within and between the teams, ensuring high recording quality and minimizing the time added to the surgery. The perioperative procedure requires ~4 h, and the entire protocol requires multiple weeks.

BRAND: A platform for closed-loop experiments with deep network models

Artificial neural networks (ANNs) are state-of-the-art tools for modeling and decoding neural activity, but deploying them in closed-loop experiments with tight timing constraints is challenging due to their limited support in existing real-time frameworks. Researchers need a platform that fully supports high-level languages for running ANNs (e.g., Python and Julia) while maintaining support for languages that are critical for low-latency data acquisition and processing (e.g., C and C++). To address these needs, we introduce the Backend for Realtime Asynchronous Neural Decoding (BRAND). BRAND comprises Linux processes, termed nodes , which communicate with each other in a graph via streams of data. Its asynchronous design allows for acquisition, control, and analysis to be executed in parallel on streams of data that may operate at different timescales. BRAND uses Redis to send data between nodes, which enables fast inter-process communication and supports 54 different programming languages. Thus, developers can easily deploy existing ANN models in BRAND with minimal implementation changes. In our tests, BRAND achieved <600 microsecond latency between processes when sending large quantities of data (1024 channels of 30 kHz neural data in 1-millisecond chunks). BRAND runs a brain-computer interface with a recurrent neural network (RNN) decoder with less than 8 milliseconds of latency from neural data input to decoder prediction. In a real-world demonstration of the system, participant T11 in the BrainGate2 clinical trial performed a standard cursor control task, in which 30 kHz signal processing, RNN decoding, task control, and graphics were all executed in BRAND. This system also supports real-time inference with complex latent variable models like Latent Factor Analysis via Dynamical Systems. By providing a framework that is fast, modular, and language-agnostic, BRAND lowers the barriers to integrating the latest tools in neuroscience and machine learning into closed-loop experiments.

A high-performance speech neuroprosthesis

Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into text1,2 or sound3,4. Early demonstrations, although promising, have not yet achieved accuracies sufficiently high for communication of unconstrained sentences from a large vocabulary1-7. Here we demonstrate a speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant-who can no longer speak intelligibly owing to amyotrophic lateral sclerosis-achieved a 9.1% word error rate on a 50-word vocabulary (2.7 times fewer errors than the previous state-of-the-art speech BCI2) and a 23.8% word error rate on a 125,000-word vocabulary (the first successful demonstration, to our knowledge, of large-vocabulary decoding). Our participant's attempted speech was decoded  at 62 words per minute, which is 3.4 times as fast as the previous record8 and begins to approach the speed of natural conversation (160 words per minute9). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for restoring rapid communication to people with paralysis who can no longer speak.

Distinguishing Distinct Neural Systems for Proximal vs Distal Upper Extremity Motor Control After Acute Stroke

BACKGROUND AND OBJECTIVES

The classic and singular pattern of distal greater than proximal upper extremity motor deficits after acute stroke does not account for the distinct structural and functional organization of circuits for proximal and distal motor control in the healthy CNS. We hypothesized that separate proximal and distal upper extremity clinical syndromes after acute stroke could be distinguished and that patterns of neuroanatomical injury leading to these 2 syndromes would reflect their distinct organization in the intact CNS.

METHODS

Proximal and distal components of motor impairment (upper extremity Fugl-Meyer score) and strength (Shoulder Abduction Finger Extension score) were assessed in consecutively recruited patients within 7 days of acute stroke. Partial correlation analysis was used to assess the relationship between proximal and distal motor scores. Functional outcomes including the Box and Blocks Test (BBT), Barthel Index (BI), and modified Rankin scale (mRS) were examined in relation to proximal vs distal motor patterns of deficit. Voxel-based lesion-symptom mapping was used to identify regions of injury associated with proximal vs distal upper extremity motor deficits.

RESULTS

A total of 141 consecutive patients (49% female) were assessed 4.0 ± 1.6 (mean ± SD) days after stroke onset. Separate proximal and distal upper extremity motor components were distinguishable after acute stroke (p = 0.002). A pattern of proximal more than distal injury (i.e., relatively preserved distal motor control) was not rare, observed in 23% of acute stroke patients. Patients with relatively preserved distal motor control, even after controlling for total extent of deficit, had better outcomes in the first week and at 90 days poststroke (BBT, ρ = 0.51, p < 0.001; BI, ρ = 0.41, p < 0.001; mRS, ρ = 0.38, p < 0.001). Deficits in proximal motor control were associated with widespread injury to subcortical white and gray matter, while deficits in distal motor control were associated with injury restricted to the posterior aspect of the precentral gyrus, consistent with the organization of proximal vs distal neural circuits in the healthy CNS.

DISCUSSION

These results highlight that proximal and distal upper extremity motor systems can be selectively injured by acute stroke, with dissociable deficits and functional consequences. Our findings emphasize how disruption of distinct motor systems can contribute to separable components of poststroke upper extremity hemiparesis.

Co-occurring ripple oscillations facilitate neuronal interactions between cortical locations in humans

Synchronous bursts of high frequency oscillations ('ripples') are hypothesized to contribute to binding by facilitating integration of neuronal firing across cortical locations. We tested this hypothesis using local field-potentials and single-unit firing from four 96-channel microelectrode arrays in supragranular cortex of 3 patients. Neurons in co-rippling locations showed increased short-latency co-firing, prediction of each-other's firing, and co-participation in neural assemblies. Effects were similar for putative pyramidal and interneurons, during NREM sleep and waking, in temporal and Rolandic cortices, and at distances up to 16mm. Increased co-prediction during co-ripples was maintained when firing-rate changes were equated, and were strongly modulated by ripple phase. Co-ripple enhanced prediction is reciprocal, synergistic with local upstates, and further enhanced when multiple sites co-ripple. Together, these results support the hypothesis that trans-cortical co-ripples increase the integration of neuronal firing of neurons in different cortical locations, and do so in part through phase-modulation rather than unstructured activation.

Translating deep learning to neuroprosthetic control

Advances in deep learning have given rise to neural network models of the relationship between movement and brain activity that appear to far outperform prior approaches. Brain-computer interfaces (BCIs) that enable people with paralysis to control external devices, such as robotic arms or computer cursors, might stand to benefit greatly from these advances. We tested recurrent neural networks (RNNs) on a challenging nonlinear BCI problem: decoding continuous bimanual movement of two computer cursors. Surprisingly, we found that although RNNs appeared to perform well in offline settings, they did so by overfitting to the temporal structure of the training data and failed to generalize to real-time neuroprosthetic control. In response, we developed a method that alters the temporal structure of the training data by dilating/compressing it in time and re-ordering it, which we show helps RNNs successfully generalize to the online setting. With this method, we demonstrate that a person with paralysis can control two computer cursors simultaneously, far outperforming standard linear methods. Our results provide evidence that preventing models from overfitting to temporal structure in training data may, in principle, aid in translating deep learning advances to the BCI setting, unlocking improved performance for challenging applications.

A brain-computer typing interface using finger movements

Intracortical brain computer interfaces (iBCIs) decode neural activity from the cortex and enable motor and communication prostheses, such as cursor control, handwriting and speech, for people with paralysis. This paper introduces a new iBCI communication prosthesis using a 3D keyboard interface for typing using continuous, closed loop movement of multiple fingers. A participant-specific BCI keyboard prototype was developed for a BrainGate2 clinical trial participant (T5) using neural recordings from the hand-knob area of the left premotor cortex. We assessed the relative decoding accuracy of flexion/extension movements of individual single fingers (5 degrees of freedom (DOF)) vs. three groups of fingers (thumb, index-middle, and ring-small fingers, 3 DOF). Neural decoding using 3 independent DOF was more accurate (95%) than that using 5 DOF (76%). A virtual keyboard was then developed where each finger group moved along a flexion-extension arc to acquire targets that corresponded to English letters and symbols. The locations of these letter/symbols were optimized using natural language statistics, resulting in an approximately a 2× reduction in distance traveled by fingers on average compared to a random keyboard layout. This keyboard was tested using a simple real-time closed loop decoder enabling T5 to type with 31 symbols at 90% accuracy and approximately 2.3 sec/symbol (excluding a 2 second hold time) on average.

Interim Safety Profile From the Feasibility Study of the BrainGate Neural Interface System

BACKGROUND AND OBJECTIVES

Brain-computer interfaces (BCIs) are being developed to restore mobility, communication, and functional independence to people with paralysis. Though supported by decades of preclinical data, the safety of chronically implanted microelectrode array BCIs in humans is unknown. We report safety results from the prospective, open-label, nonrandomized BrainGate feasibility study (NCT00912041), the largest and longest-running clinical trial of an implanted BCI.

METHODS

Adults aged 18-75 years with quadriparesis from spinal cord injury, brainstem stroke, or motor neuron disease were enrolled through 7 clinical sites in the United States. Participants underwent surgical implantation of 1 or 2 microelectrode arrays in the motor cortex of the dominant cerebral hemisphere. The primary safety outcome was device-related serious adverse events (SAEs) requiring device explantation or resulting in death or permanently increased disability during the 1-year postimplant evaluation period. The secondary outcomes included the type and frequency of other adverse events and the feasibility of the BrainGate system for controlling a computer or other assistive technologies.

RESULTS

From 2004 to 2021, 14 adults enrolled in the BrainGate trial had devices surgically implanted. The average duration of device implantation was 872 days, yielding 12,203 days of safety experience. There were 68 device-related adverse events, including 6 device-related SAEs. The most common device-related adverse event was skin irritation around the percutaneous pedestal. There were no safety events that required device explantation, no unanticipated adverse device events, no intracranial infections, and no participant deaths or adverse events resulting in permanently increased disability related to the investigational device.

DISCUSSION

The BrainGate Neural Interface system has a safety record comparable with other chronically implanted medical devices. Given rapid recent advances in this technology and continued performance gains, these data suggest a favorable risk/benefit ratio in appropriately selected individuals to support ongoing research and development.

TRIAL REGISTRATION INFORMATION

ClinicalTrials.gov Identifier: NCT00912041.

CLASSIFICATION OF EVIDENCE

This study provides Class IV evidence that the neurosurgically placed BrainGate Neural Interface system is associated with a low rate of SAEs defined as those requiring device explantation, resulting in death, or resulting in permanently increased disability during the 1-year postimplant period.

Long-term unsupervised recalibration of cursor BCIs

Intracortical brain-computer interfaces (iBCIs) require frequent recalibration to maintain robust performance due to changes in neural activity that accumulate over time. Compensating for this nonstationarity would enable consistently high performance without the need for supervised recalibration periods, where users cannot engage in free use of their device. Here we introduce a hidden Markov model (HMM) to infer what targets users are moving toward during iBCI use. We then retrain the system using these inferred targets, enabling unsupervised adaptation to changing neural activity. Our approach outperforms the state of the art in large-scale, closed-loop simulations over two months and in closed-loop with a human iBCI user over one month. Leveraging an offline dataset spanning five years of iBCI recordings, we further show how recently proposed data distribution-matching approaches to recalibration fail over long time scales; only target-inference methods appear capable of enabling long-term unsupervised recalibration. Our results demonstrate how task structure can be used to bootstrap a noisy decoder into a highly-performant one, thereby overcoming one of the major barriers to clinically translating BCIs.

Learned Motor Patterns Are Replayed in Human Motor Cortex during Sleep

Consolidation of memory is believed to involve offline replay of neural activity. While amply demonstrated in rodents, evidence for replay in humans, particularly regarding motor memory, is less compelling. To determine whether replay occurs after motor learning, we sought to record from motor cortex during a novel motor task and subsequent overnight sleep. A 36-year-old man with tetraplegia secondary to cervical spinal cord injury enrolled in the ongoing BrainGate brain-computer interface pilot clinical trial had two 96-channel intracortical microelectrode arrays placed chronically into left precentral gyrus. Single- and multi-unit activity was recorded while he played a color/sound sequence matching memory game. Intended movements were decoded from motor cortical neuronal activity by a real-time steady-state Kalman filter that allowed the participant to control a neurally driven cursor on the screen. Intracortical neural activity from precentral gyrus and 2-lead scalp EEG were recorded overnight as he slept. When decoded using the same steady-state Kalman filter parameters, intracortical neural signals recorded overnight replayed the target sequence from the memory game at intervals throughout at a frequency significantly greater than expected by chance. Replay events occurred at speeds ranging from 1 to 4 times as fast as initial task execution and were most frequently observed during slow-wave sleep. These results demonstrate that recent visuomotor skill acquisition in humans may be accompanied by replay of the corresponding motor cortex neural activity during sleep.SIGNIFICANCE STATEMENT Within cortex, the acquisition of information is often followed by the offline recapitulation of specific sequences of neural firing. Replay of recent activity is enriched during sleep and may support the consolidation of learning and memory. Using an intracortical brain-computer interface, we recorded and decoded activity from motor cortex as a human research participant performed a novel motor task. By decoding neural activity throughout subsequent sleep, we find that neural sequences underlying the recently practiced motor task are repeated throughout the night, providing direct evidence of replay in human motor cortex during sleep. This approach, using an optimized brain-computer interface decoder to characterize neural activity during sleep, provides a framework for future studies exploring replay, learning, and memory.

Association of Modified Rankin Scale With Recovery Phenotypes in Patients With Upper Extremity Weakness After Stroke

BACKGROUND

Precise measurement of outcomes is essential for stroke trials and clinical care. Prior research has highlighted conceptual differences between global outcome measures such as the Modified Rankin Scale (mRS) and domain-specific measures (e.g. motor, sensory, language or cognitive function). This study related motor phenotypes to the mRS, specifically aiming to (1) determine whether mRS levels distinguish motor impairment and function phenotypes, and (2) compare mRS outcomes to meaningful changes in impairment and function from acute to subacute recovery after stroke.

METHODS

Patients with upper extremity weakness after ischemic stroke were assessed with a battery of impairment and functional measures within the first week and at 90-days post-stroke. Impairment and functional outcomes were examined in relation to 90-day mRS scores. Clinically meaningful changes in motor impairment, activities of daily living, and mobility were examined in relation to 90-day mRS.

RESULTS

In this cohort of n = 73 stroke patients, impairment and functional outcomes were associated with 90-day mRS scores but showed substantial variability within individual mRS levels: within mRS level 2, upper extremity impairment ranged from near hemiplegia (with an upper extremity Fugl-Meyer 8) to no deficits (upper extremity Fugl-Meyer 66). Overall, there were few differences in impairment and functional outcomes between adjacent mRS levels. While some outcome measures were significantly different between mRS levels 3 and 4 (Nine-Hole Peg, Leg Motor, Gait Velocity, Timed Up and Go, National Institutes of Health Stroke Scale, and Barthel Index), none of the outcome measures differed between mRS levels 1 and 2. Fugl-Meyer and Grip Strength were not different between any adjacent mRS levels. A substantial number of patients experienced clinically meaningful changes in impairment and function in the first 90 days post-stroke but did not achieve good mRS outcome (mRS ≤ 2).

CONCLUSIONS

The mRS broadly relates to domain-specific outcomes after stroke confirming its established value in stroke trials, but it does not precisely distinguish differences in impairment and function nor does it sufficiently capture meaningful clinical changes across impairment, ADL status, and mobility. These findings underscore the potential utility of incorporating detailed phenotypic measures alongside the mRS in future stroke trials.

Large-scale neural recordings with single neuron resolution using Neuropixels probes in human cortex

Recent advances in multi-electrode array technology have made it possible to monitor large neuronal ensembles at cellular resolution in animal models. In humans, however, current approaches restrict recordings to a few neurons per penetrating electrode or combine the signals of thousands of neurons in local field potential (LFP) recordings. Here we describe a new probe variant and set of techniques that enable simultaneous recording from over 200 well-isolated cortical single units in human participants during intraoperative neurosurgical procedures using silicon Neuropixels probes. We characterized a diversity of extracellular waveforms with eight separable single-unit classes, with differing firing rates, locations along the length of the electrode array, waveform spatial spread and modulation by LFP events such as inter-ictal discharges and burst suppression. Although some challenges remain in creating a turnkey recording system, high-density silicon arrays provide a path for studying human-specific cognitive processes and their dysfunction at unprecedented spatiotemporal resolution.

Development of a Manually Operated Communication System (MOCS) for patients in intensive care units

Nonvocal alert patients in the intensive care unit (ICU) setting often struggle to communicate due to inaccessible or unavailable tools for augmentative and alternative communication. Innovation of a hand-operated non-touchscreen communication system for nonvocal ICU patients was guided by design concepts including speech output, simplicity, and flexibility. A novel communication tool, the Manually Operated Communication System (MOCS), was developed for use in intensive care settings with patients unable to speak. MOCS is a speech-output technology designed for patients with manual dexterity impairments preventing legible writing. MOCS may have the potential to improve communication for nonvocal patients with limited manual dexterity.

Effects of Peripheral Haptic Feedback on Intracortical Brain-Computer Interface Control and Associated Sensory Responses in Motor Cortex

Intracortical brain-computer interfaces (iBCIs) provide people with paralysis a means to control devices with signals decoded from brain activity. Despite recent impressive advances, these devices still cannot approach able-bodied levels of control. To achieve naturalistic control and improved performance of neural prostheses, iBCIs will likely need to include proprioceptive feedback. With the goal of providing proprioceptive feedback via mechanical haptic stimulation, we aim to understand how haptic stimulation affects motor cortical neurons and ultimately, iBCI control. We provided skin shear haptic stimulation as a substitute for proprioception to the back of the neck of a person with tetraplegia. The neck location was determined via assessment of touch sensitivity using a monofilament test kit. The participant was able to correctly report skin shear at the back of the neck in 8 unique directions with 65% accuracy. We found motor cortical units that exhibited sensory responses to shear stimuli, some of which were strongly tuned to the stimuli and well modeled by cosine-shaped functions. In this article, we also demonstrated online iBCI cursor control with continuous skin-shear feedback driven by decoded command signals. Cursor control performance increased slightly but significantly when the participant was given haptic feedback, compared to the purely visual feedback condition.

The neuroethics of disorders of consciousness: a brief history of evolving ideas

Neuroethical questions raised by recent advances in the diagnosis and treatment of disorders of consciousness are rapidly expanding, increasingly relevant, and yet underexplored. The aim of this thematic review is to provide a clinically applicable framework for understanding the current taxonomy of disorders of consciousness and to propose an approach to identifying and critically evaluating actionable neuroethical issues that are frequently encountered in research and clinical care for this vulnerable population. Increased awareness of these issues and clarity about opportunities for optimizing ethically-responsible care in this domain are especially timely given recent surges in critically ill patients with unusually prolonged disorders of consciousness associated with coronavirus disease 2019 (COVID-19) around the world. We begin with an overview of the field of neuroethics: what it is, its history and evolution in the context of biomedical ethics at large. We then explore nomenclature used in disorders of consciousness, covering categories proposed by the American Academy of Neurology, the American Congress of Rehabilitation Medicine, and the National Institute on Disability, Independent Living, and Rehabilitation Research, including definitions of terms such as coma, the vegetative state, unresponsive wakefulness syndrome, minimally conscious state, covert consciousness, and the confusional state. We discuss why these definitions matter, and why there has been such evolution in this nosology over the years, from Jennett and Plum in 1972 to the Multi-Society Task Force in 1994, the Aspen Working Group in 2002 and up until the 2018 American and 2020 European Disorders of Consciousness guidelines. We then move to a discussion of clinical aspects of disorders of consciousness, the natural history of recovery, and ethical issues that arise within the context of caring for persons with disorders of consciousness. We conclude with a discussion of key challenges associated with assessing residual consciousness in disorders of consciousness, potential solutions and future directions, including integration of crucial disability rights perspectives.

Home Use of a Percutaneous Wireless Intracortical Brain-Computer Interface by Individuals With Tetraplegia

OBJECTIVE

Individuals with neurological disease or injury such as amyotrophic lateral sclerosis, spinal cord injury or stroke may become tetraplegic, unable to speak or even locked-in. For people with these conditions, current assistive technologies are often ineffective. Brain-computer interfaces are being developed to enhance independence and restore communication in the absence of physical movement. Over the past decade, individuals with tetraplegia have achieved rapid on-screen typing and point-and-click control of tablet apps using intracortical brain-computer interfaces (iBCIs) that decode intended arm and hand movements from neural signals recorded by implanted microelectrode arrays. However, cables used to convey neural signals from the brain tether participants to amplifiers and decoding computers and require expert oversight, severely limiting when and where iBCIs could be available for use. Here, we demonstrate the first human use of a wireless broadband iBCI.

METHODS

Based on a prototype system previously used in pre-clinical research, we replaced the external cables of a 192-electrode iBCI with wireless transmitters and achieved high-resolution recording and decoding of broadband field potentials and spiking activity from people with paralysis. Two participants in an ongoing pilot clinical trial completed on-screen item selection tasks to assess iBCI-enabled cursor control.

RESULTS

Communication bitrates were equivalent between cabled and wireless configurations. Participants also used the wireless iBCI to control a standard commercial tablet computer to browse the web and use several mobile applications. Within-day comparison of cabled and wireless interfaces evaluated bit error rate, packet loss, and the recovery of spike rates and spike waveforms from the recorded neural signals. In a representative use case, the wireless system recorded intracortical signals from two arrays in one participant continuously through a 24-hour period at home.

SIGNIFICANCE

Wireless multi-electrode recording of broadband neural signals over extended periods introduces a valuable tool for human neuroscience research and is an important step toward practical deployment of iBCI technology for independent use by individuals with paralysis. On-demand access to high-performance iBCI technology in the home promises to enhance independence and restore communication and mobility for individuals with severe motor impairment.

Responsive neurostimulation for focal motor status epilepticus

No clear evidence‐based treatment paradigm currently exists for refractory and super‐refractory status epilepticus, which can result in significant mortality and morbidity. While patients are typically treated with antiepileptic drugs and anesthetics, neurosurgical neuromodulation techniques can also be considered. We present a novel case in which responsive neurostimulation was used to effectively treat a patient who had developed super‐refractory status epilepticus, later consistent with epilepsia partialis continua, that was refractory to antiepileptic drugs, immunomodulatory therapies, and transcranial magnetic stimulation. This case demonstrates how regional therapy provided by responsive neurostimulation can be effective in treating super‐refractory status epilepticus through neuromodulation of seizure networks.

Vagus nerve stimulation paired with rehabilitation for upper limb motor function after ischaemic stroke (VNS-REHAB): a randomised, blinded, pivotal, device trial

BACKGROUND

Long-term loss of arm function after ischaemic stroke is common and might be improved by vagus nerve stimulation paired with rehabilitation. We aimed to determine whether this strategy is a safe and effective treatment for improving arm function after stroke.

METHODS

In this pivotal, randomised, triple-blind, sham-controlled trial, done in 19 stroke rehabilitation services in the UK and the USA, participants with moderate-to-severe arm weakness, at least 9 months after ischaemic stroke, were randomly assigned (1:1) to either rehabilitation paired with active vagus nerve stimulation (VNS group) or rehabilitation paired with sham stimulation (control group). Randomisation was done by ResearchPoint Global (Austin, TX, USA) using SAS PROC PLAN (SAS Institute Software, Cary, NC, USA), with stratification by region (USA vs UK), age (≤30 years vs >30 years), and baseline Fugl-Meyer Assessment-Upper Extremity (FMA-UE) score (20-35 vs 36-50). Participants, outcomes assessors, and treating therapists were masked to group assignment. All participants were implanted with a vagus nerve stimulation device. The VNS group received 0·8 mA, 100 μs, 30 Hz stimulation pulses, lasting 0·5 s. The control group received 0 mA pulses. Participants received 6 weeks of in-clinic therapy (three times per week; total of 18 sessions) followed by a home exercise programme. The primary outcome was the change in impairment measured by the FMA-UE score on the first day after completion of in-clinic therapy. FMA-UE response rates were also assessed at 90 days after in-clinic therapy (secondary endpoint). All analyses were by intention to treat. This trial is registered at ClinicalTrials.gov, NCT03131960.

FINDINGS

Between Oct 2, 2017, and Sept 12, 2019, 108 participants were randomly assigned to treatment (53 to the VNS group and 55 to the control group). 106 completed the study (one patient for each group did not complete the study). On the first day after completion of in-clinic therapy, the mean FMA-UE score increased by 5·0 points (SD 4·4) in the VNS group and by 2·4 points (3·8) in the control group (between group difference 2·6, 95% CI 1·0-4·2, p=0·0014). 90 days after in-clinic therapy, a clinically meaningful response on the FMA-UE score was achieved in 23 (47%) of 53 patients in the VNS group versus 13 (24%) of 55 patients in the control group (between group difference 24%, 6-41; p=0·0098). There was one serious adverse event related to surgery (vocal cord paresis) in the control group.

INTERPRETATION

Vagus nerve stimulation paired with rehabilitation is a novel potential treatment option for people with long-term moderate-to-severe arm impairment after ischaemic stroke.

FUNDING

MicroTransponder.

Cognitive Demands Influence Upper Extremity Motor Performance During Recovery From Acute Stroke

OBJECTIVE

To test the hypothesis that cognitive demands influence motor performance during recovery from acute stroke, we tested patients with acute stroke on 2 motor tasks with different cognitive demands and related task performance to cognitive impairment and neuroanatomic injury.

METHODS

We assessed the contralesional and ipsilesional upper extremities of a cohort of 50 patients with weakness after unilateral acute ischemic stroke at 3 time points with 2 tasks: the Box & Blocks Test, a task with greater cognitive demand, and Grip Strength, a simple and ballistic motor task. We compared performance on the 2 tasks, related motor performance to cognitive dysfunction, and used voxel-based lesion symptom mapping to determine neuroanatomic sites associated with motor performance.

RESULTS

Consistent across contralesional and ipsilesional upper extremities and most pronounced immediately after stroke, Box & Blocks scores were significantly more impaired than Grip Strength scores. The presence of cognitive dysfunction significantly explained up to 33% of variance in Box & Blocks performance but was not associated with Grip Strength performance. While Grip Strength performance was associated with injury largely restricted to sensorimotor regions, Box & Blocks performance was associated with broad injury outside sensorimotor structures, particularly the dorsal anterior insula, a region known to be important for complex cognitive function.

CONCLUSIONS

Together, these results suggest that cognitive demands influence upper extremity motor performance during recovery from acute stroke. Our findings emphasize the integrated nature of motor and cognitive systems and suggest that it is critical to consider cognitive demands during motor testing and neurorehabilitation after stroke.

Arm Motor Recovery After Ischemic Stroke: A Focus on Clinically Distinct Trajectory Groups

BACKGROUND AND PURPOSE

Recovery of arm function poststroke is highly variable with some people experiencing rapid recovery but many experiencing slower or limited functional improvement. Current stroke prediction models provide some guidance for clinicians regarding expected motor outcomes poststroke but do not address recovery rates, complicating discharge planning. This study developed a novel approach to defining recovery groups based on arm motor recovery trajectories poststroke. In addition, between-group differences in baseline characteristics and therapy hours were explored.

METHODS

A retrospective cohort analysis was conducted where 40 participants with arm weakness were assessed 1 week, 6 weeks, 3 months, and 6 months after an ischemic stroke. Arm recovery trajectory groups were defined on the basis of timing of changes in the Fugl-Meyer Assessment Upper Extremity (FMA-UE), at least the minimal clinically important difference (MCID), 1 week to 6 weeks or 6 weeks to 6 months. Three recovery trajectory groups were defined: Fast (n = 19), Extended (n = 12), and Limited (n = 9). Between-group differences in baseline characteristics and therapy hours were assessed. Associations between baseline characteristics and group membership were also determined.

RESULTS

Three baseline characteristics were associated with trajectory group membership: FMA-UE, NIH Stroke Scale, and Barthel Index. The Fast Recovery group received the least therapy hours 6 weeks to 6 months. No differences in therapy hours were observed between Extended and Limited Recovery groups at any time points.

DISCUSSION AND CONCLUSIONS

Three clinically relevant recovery trajectory groups were defined using the FMA-UE MCID. Baseline impairment, overall stroke severity, and dependence in activities of daily living were associated with group membership and therapy hours differed between groups. Stratifying individuals by recovery trajectory early poststroke could offer additional guidance to clinicians in discharge planning.

(See Supplemental Digital Content 1 for Video Abstract, available at: http://links.lww.com/JNPT/A337.).

Brain-Computer Interfaces in Neurorecovery and Neurorehabilitation

Recent advances in brain-computer interface technology to restore and rehabilitate neurologic function aim to enable persons with disabling neurologic conditions to communicate, interact with the environment, and achieve other key activities of daily living and personal goals. Here we evaluate the principles, benefits, challenges, and future directions of brain-computer interfaces in the context of neurorehabilitation. We then explore the clinical translation of these technologies and propose an approach to facilitate implementation of brain-computer interfaces for persons with neurologic disease.

Motor neuroprosthesis implanted with neurointerventional surgery improves capacity for activities of daily living tasks in severe paralysis: first in-human experience

BACKGROUND

Implantable brain-computer interfaces (BCIs), functioning as motor neuroprostheses, have the potential to restore voluntary motor impulses to control digital devices and improve functional independence in patients with severe paralysis due to brain, spinal cord, peripheral nerve or muscle dysfunction. However, reports to date have had limited clinical translation.

METHODS

Two participants with amyotrophic lateral sclerosis (ALS) underwent implant in a single-arm, open-label, prospective, early feasibility study. Using a minimally invasive neurointervention procedure, a novel endovascular Stentrode BCI was implanted in the superior sagittal sinus adjacent to primary motor cortex. The participants undertook machine-learning-assisted training to use wirelessly transmitted electrocorticography signal associated with attempted movements to control multiple mouse-click actions, including zoom and left-click. Used in combination with an eye-tracker for cursor navigation, participants achieved Windows 10 operating system control to conduct instrumental activities of daily living (IADL) tasks.

RESULTS

Unsupervised home use commenced from day 86 onwards for participant 1, and day 71 for participant 2. Participant 1 achieved a typing task average click selection accuracy of 92.63% (100.00%, 87.50%-100.00%) (trial mean (median, Q1-Q3)) at a rate of 13.81 (13.44, 10.96-16.09) correct characters per minute (CCPM) with predictive text disabled. Participant 2 achieved an average click selection accuracy of 93.18% (100.00%, 88.19%-100.00%) at 20.10 (17.73, 12.27-26.50) CCPM. Completion of IADL tasks including text messaging, online shopping and managing finances independently was demonstrated in both participants.

CONCLUSION

We describe the first-in-human experience of a minimally invasive, fully implanted, wireless, ambulatory motor neuroprosthesis using an endovascular stent-electrode array to transmit electrocorticography signals from the motor cortex for multiple command control of digital devices in two participants with flaccid upper limb paralysis.

Auditory cues reveal intended movement information in middle frontal gyrus neuronal ensemble activity of a person with tetraplegia

Intracortical brain-computer interfaces (iBCIs) allow people with paralysis to directly control assistive devices using neural activity associated with the intent to move. Realizing the full potential of iBCIs critically depends on continued progress in understanding how different cortical areas contribute to movement control. Here we present the first comparison between neuronal ensemble recordings from the left middle frontal gyrus (MFG) and precentral gyrus (PCG) of a person with tetraplegia using an iBCI. As expected, PCG was more engaged in selecting and generating intended movements than in earlier perceptual stages of action planning. By contrast, MFG displayed movement-related information during the sensorimotor processing steps preceding the appearance of the action plan in PCG, but only when the actions were instructed using auditory cues. These results describe a previously unreported function for neurons in the human left MFG in auditory processing contributing to motor control.

Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus

OBJECTIVE

To evaluate the potential of intracortical electrode array signals for brain-computer interfaces (BCIs) to restore lost speech, we measured the performance of decoders trained to discriminate a comprehensive basis set of 39 English phonemes and to synthesize speech sounds via a neural pattern matching method. We decoded neural correlates of spoken-out-loud words in the 'hand knob' area of precentral gyrus, a step toward the eventual goal of decoding attempted speech from ventral speech areas in patients who are unable to speak.

APPROACH

Neural and audio data were recorded while two BrainGate2 pilot clinical trial participants, each with two chronically-implanted 96-electrode arrays, spoke 420 different words that broadly sampled English phonemes. Phoneme onsets were identified from audio recordings, and their identities were then classified from neural features consisting of each electrode's binned action potential counts or high-frequency local field potential power. Speech synthesis was performed using the 'Brain-to-Speech' pattern matching method. We also examined two potential confounds specific to decoding overt speech: acoustic contamination of neural signals and systematic differences in labeling different phonemes' onset times.

MAIN RESULTS

A linear decoder achieved up to 29.3% classification accuracy (chance = 6%) across 39 phonemes, while an RNN classifier achieved 33.9% accuracy. Parameter sweeps indicated that performance did not saturate when adding more electrodes or more training data, and that accuracy improved when utilizing time-varying structure in the data. Microphonic contamination and phoneme onset differences modestly increased decoding accuracy, but could be mitigated by acoustic artifact subtraction and using a neural speech onset marker, respectively. Speech synthesis achieved r = 0.523 correlation between true and reconstructed audio.

SIGNIFICANCE

The ability to decode speech using intracortical electrode array signals from a nontraditional speech area suggests that placing electrode arrays in ventral speech areas is a promising direction for speech BCIs.

Power-saving design opportunities for wireless intracortical brain-computer interfaces

The efficacy of wireless intracortical brain-computer interfaces (iBCIs) is limited in part by the number of recording channels, which is constrained by the power budget of the implantable system. Designing wireless iBCIs that provide the high-quality recordings of today's wired neural interfaces may lead to inadvertent over-design at the expense of power consumption and scalability. Here, we report analyses of neural signals collected from experimental iBCI measurements in rhesus macaques and from a clinical-trial participant with implanted 96-channel Utah multielectrode arrays to understand the trade-offs between signal quality and decoder performance. Moreover, we propose an efficient hardware design for clinically viable iBCIs, and suggest that the circuit design parameters of current recording iBCIs can be relaxed considerably without loss of performance. The proposed design may allow for an order-of-magnitude power savings and lead to clinically viable iBCIs with a higher channel count.

Personalized Connectome Mapping to Guide Targeted Therapy and Promote Recovery of Consciousness in the Intensive Care Unit

There are currently no therapies proven to promote early recovery of consciousness in patients with severe brain injuries in the intensive care unit (ICU). For patients whose families face time-sensitive, life-or-death decisions, treatments that promote recovery of consciousness are needed to reduce the likelihood of premature withdrawal of life-sustaining therapy, facilitate autonomous self-expression, and increase access to rehabilitative care. Here, we present the Connectome-based Clinical Trial Platform (CCTP), a new paradigm for developing and testing targeted therapies that promote early recovery of consciousness in the ICU. We report the protocol for STIMPACT (Stimulant Therapy Targeted to Individualized Connectivity Maps to Promote ReACTivation of Consciousness), a CCTP-based trial in which intravenous methylphenidate will be used for targeted stimulation of dopaminergic circuits within the subcortical ascending arousal network (ClinicalTrials.gov NCT03814356). The scientific premise of the CCTP and the STIMPACT trial is that personalized brain network mapping in the ICU can identify patients whose connectomes are amenable to neuromodulation. Phase 1 of the STIMPACT trial is an open-label, safety and dose-finding study in 22 patients with disorders of consciousness caused by acute severe traumatic brain injury. Patients in Phase 1 will receive escalating daily doses (0.5-2.0 mg/kg) of intravenous methylphenidate over a 4-day period and will undergo resting-state functional magnetic resonance imaging and electroencephalography to evaluate the drug's pharmacodynamic properties. The primary outcome measure for Phase 1 relates to safety: the number of drug-related adverse events at each dose. Secondary outcome measures pertain to pharmacokinetics and pharmacodynamics: (1) time to maximal serum concentration; (2) serum half-life; (3) effect of the highest tolerated dose on resting-state functional MRI biomarkers of connectivity; and (4) effect of each dose on EEG biomarkers of cerebral cortical function. Predetermined safety and pharmacodynamic criteria must be fulfilled in Phase 1 to proceed to Phase 2A. Pharmacokinetic data from Phase 1 will also inform the study design of Phase 2A, where we will test the hypothesis that personalized connectome maps predict therapeutic responses to intravenous methylphenidate. Likewise, findings from Phase 2A will inform the design of Phase 2B, where we plan to enroll patients based on their personalized connectome maps. By selecting patients for clinical trials based on a principled, mechanistic assessment of their neuroanatomic potential for a therapeutic response, the CCTP paradigm and the STIMPACT trial have the potential to transform the therapeutic landscape in the ICU and improve outcomes for patients with severe brain injuries.

Intact Brain Network Function in an Unresponsive Patient with COVID-19

Many patients with severe coronavirus disease 2019 (COVID‐19) remain unresponsive after surviving critical illness. Although several structural brain abnormalities have been described, their impact on brain function and implications for prognosis are unknown. Functional neuroimaging, which has prognostic significance, has yet to be explored in this population. Here we describe a patient with severe COVID‐19 who, despite prolonged unresponsiveness and structural brain abnormalities, demonstrated intact functional network connectivity, and weeks later recovered the ability to follow commands. When prognosticating for survivors of severe COVID‐19, clinicians should consider that brain networks may remain functionally intact despite structural injury and prolonged unresponsiveness. ANN NEUROL 2020;88:851–854

The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models

The Kalman filter provides a simple and efficient algorithm to compute the posterior distribution for state-space models where both the latent state and measurement models are linear and gaussian. Extensions to the Kalman filter, including the extended and unscented Kalman filters, incorporate linearizations for models where the observation model p ( observation | state ) is nonlinear. We argue that in many cases, a model for p ( state | observation ) proves both easier to learn and more accurate for latent state estimation. Approximating p ( state | observation ) as gaussian leads to a new filtering algorithm, the discriminative Kalman filter (DKF), which can perform well even when p ( observation | state ) is highly nonlinear and/or nongaussian. The approximation, motivated by the Bernstein-von Mises theorem, improves as the dimensionality of the observations increases. The DKF has computational complexity similar to the Kalman filter, allowing it in some cases to perform much faster than particle filters with similar precision, while better accounting for nonlinear and nongaussian observation models than Kalman-based extensions. When the observation model must be learned from training data prior to filtering, off-the-shelf nonlinear and nonparametric regression techniques can provide a gaussian model for p ( observation | state ) that cleanly integrates with the DKF. As part of the BrainGate2 clinical trial, we successfully implemented gaussian process regression with the DKF framework in a brain-computer interface to provide real-time, closed-loop cursor control to a person with a complete spinal cord injury. In this letter, we explore the theory underlying the DKF, exhibit some illustrative examples, and outline potential extensions.

Speech-related dorsal motor cortex activity does not interfere with iBCI cursor control

OBJECTIVE

Speech-related neural modulation was recently reported in 'arm/hand' area of human dorsal motor cortex that is used as a signal source for intracortical brain-computer interfaces (iBCIs). This raises the concern that speech-related modulation might deleteriously affect the decoding of arm movement intentions, for instance by affecting velocity command outputs. This study sought to clarify whether or not speaking would interfere with ongoing iBCI use.

APPROACH

A participant in the BrainGate2 iBCI clinical trial used an iBCI to control a computer cursor; spoke short words in a stand-alone speech task; and spoke short words during ongoing iBCI use. We examined neural activity in all three behaviors and compared iBCI performance with and without concurrent speech.

MAIN RESULTS

Dorsal motor cortex firing rates modulated strongly during stand-alone speech, but this activity was largely attenuated when speaking occurred during iBCI cursor control using attempted arm movements. 'Decoder-potent' projections of the attenuated speech-related neural activity were small, explaining why cursor task performance was similar between iBCI use with and without concurrent speaking.

SIGNIFICANCE

These findings indicate that speaking does not directly interfere with iBCIs that decode attempted arm movements. This suggests that patients who are able to speak will be able to use motor cortical-driven computer interfaces or prostheses without needing to forgo speaking while using these devices.

Applications of brain-computer interfaces to the control of robotic and prosthetic arms

Brain-computer interfaces (BCIs) have the potential to improve the quality of life of individuals with severe motor disabilities. BCIs capture the user's brain activity and translate it into commands for the control of an effector, such as a computer cursor, robotic limb, or functional electrical stimulation device. Full dexterous manipulation of robotic and prosthetic arms via a BCI system has been a challenge because of the inherent need to decode high dimensional and preferably real-time control commands from the user's neural activity. Nevertheless, such functionality is fundamental if BCI-controlled robotic or prosthetic limbs are to be used for daily activities. In this chapter, we review how this challenge has been addressed by BCI researchers and how new solutions may improve the BCI user experience with robotic effectors.

Neural ensemble dynamics in dorsal motor cortex during speech in people with paralysis

Speaking is a sensorimotor behavior whose neural basis is difficult to study with single neuron resolution due to the scarcity of human intracortical measurements. We used electrode arrays to record from the motor cortex 'hand knob' in two people with tetraplegia, an area not previously implicated in speech. Neurons modulated during speaking and during non-speaking movements of the tongue, lips, and jaw. This challenges whether the conventional model of a 'motor homunculus' division by major body regions extends to the single-neuron scale. Spoken words and syllables could be decoded from single trials, demonstrating the potential of intracortical recordings for brain-computer interfaces to restore speech. Two neural population dynamics features previously reported for arm movements were also present during speaking: a component that was mostly invariant across initiating different words, followed by rotatory dynamics during speaking. This suggests that common neural dynamical motifs may underlie movement of arm and speech articulators.

Corticospinal Tract Injury Estimated From Acute Stroke Imaging Predicts Upper Extremity Motor Recovery After Stroke

Background and Purpose- Injury to the corticospinal tract (CST) has been shown to have a major effect on upper extremity motor recovery after stroke. This study aimed to examine how well CST injury, measured from neuroimaging acquired during the acute stroke workup, predicts upper extremity motor recovery. Methods- Patients with upper extremity weakness after ischemic stroke were assessed using the upper extremity Fugl-Meyer during the acute stroke hospitalization and again at 3-month follow-up. CST injury was quantified and compared, using 4 different methods, from images obtained as part of the stroke standard-of-care workup. Logistic and linear regression were performed using CST injury to predict ΔFugl-Meyer. Injury to primary motor and premotor cortices were included as potential modifiers of the effect of CST injury on recovery. Results- N=48 patients were enrolled 4.2±2.7 days poststroke and completed 3-month follow-up (median 90-day modified Rankin Scale score, 3; interquartile range, 1.5). CST injury distinguished patients who reached their recovery potential (as predicted from initial impairment) from those who did not, with area under the curve values ranging from 0.70 to 0.8. In addition, CST injury explained ≈20% of the variance in the magnitude of upper extremity recovery, even after controlling for the severity of initial impairment. Results were consistent when comparing 4 different methods of measuring CST injury. Extent of injury to primary motor and premotor cortices did not significantly influence the predictive value that CST injury had for recovery. Conclusions- Structural injury to the CST, as estimated from standard-of-care imaging available during the acute stroke hospitalization, is a robust way to distinguish patients who achieve their predicted recovery potential and explains a significant amount of the variance in poststroke upper extremity motor recovery.

Rapid calibration of an intracortical brain-computer interface for people with tetraplegia

OBJECTIVE

Brain-computer interfaces (BCIs) can enable individuals with tetraplegia to communicate and control external devices. Though much progress has been made in improving the speed and robustness of neural control provided by intracortical BCIs, little research has been devoted to minimizing the amount of time spent on decoder calibration.

APPROACH

We investigated the amount of time users needed to calibrate decoders and achieve performance saturation using two markedly different decoding algorithms: the steady-state Kalman filter, and a novel technique using Gaussian process regression (GP-DKF).

MAIN RESULTS

Three people with tetraplegia gained rapid closed-loop neural cursor control and peak, plateaued decoder performance within 3 min of initializing calibration. We also show that a BCI-naïve user (T5) was able to rapidly attain closed-loop neural cursor control with the GP-DKF using self-selected movement imagery on his first-ever day of closed-loop BCI use, acquiring a target 37 s after initiating calibration.

SIGNIFICANCE

These results demonstrate the potential for an intracortical BCI to be used immediately after deployment by people with paralysis, without the need for user learning or extensive system calibration.

Signal processing methods for reducing artifacts in microelectrode brain recordings caused by functional electrical stimulation

OBJECTIVE

Functional electrical stimulation (FES) is a promising technology for restoring movement to paralyzed limbs. Intracortical brain-computer interfaces (iBCIs) have enabled intuitive control over virtual and robotic movements, and more recently over upper extremity FES neuroprostheses. However, electrical stimulation of muscles creates artifacts in intracortical microelectrode recordings that could degrade iBCI performance. Here, we investigate methods for reducing the cortically recorded artifacts that result from peripheral electrical stimulation.

APPROACH

One participant in the BrainGate2 pilot clinical trial had two intracortical microelectrode arrays placed in the motor cortex, and thirty-six stimulating intramuscular electrodes placed in the muscles of the contralateral limb. We characterized intracortically recorded electrical artifacts during both intramuscular and surface stimulation. We compared the performance of three artifact reduction methods: blanking, common average reference (CAR) and linear regression reference (LRR), which creates channel-specific reference signals, composed of weighted sums of other channels.

MAIN RESULTS

Electrical artifacts resulting from surface stimulation were 175  ×  larger than baseline neural recordings (which were 110 µV peak-to-peak), while intramuscular stimulation artifacts were only 4  ×  larger. The artifact waveforms were highly consistent across electrodes within each array. Application of LRR reduced artifact magnitudes to less than 10 µV and largely preserved the original neural feature values used for decoding. Unmitigated stimulation artifacts decreased iBCI decoding performance, but performance was almost completely recovered using LRR, which outperformed CAR and blanking and extracted useful neural information during stimulation artifact periods.

SIGNIFICANCE

The LRR method was effective at reducing electrical artifacts resulting from both intramuscular and surface FES, and almost completely restored iBCI decoding performance (>90% recovery for surface stimulation and full recovery for intramuscular stimulation). The results demonstrate that FES-induced artifacts can be easily mitigated in FES  +  iBCI systems by using LRR for artifact reduction, and suggest that the LRR method may also be useful in other noise reduction applications.

Decoding Speech from Intracortical Multielectrode Arrays in Dorsal "Arm/Hand Areas" of Human Motor Cortex

Neural prostheses are being developed to restore speech to people with neurological injury or disease. A key design consideration is where and how to access neural correlates of intended speech. Most prior work has examined cortical field potentials at a coarse resolution using electroencephalography (EEG) or medium resolution using electrocorticography (ECoG). The few studies of speech with single-neuron resolution recorded from ventral areas known to be part of the speech network. Here, we recorded from two 96- electrode arrays chronically implanted into the 'hand knob' area of motor cortex while a person with tetraplegia spoke. Despite being located in an area previously demonstrated to modulate during attempted arm movements, many electrodes' neuronal firing rates responded to speech production. In offline analyses, we could classify which of 9 phonemes (plus silence) was spoken with 81% single-trial accuracy using a combination of spike rate and local field potential (LFP) power. This suggests that high-fidelity speech prostheses may be possible using large-scale intracortical recordings in motor cortical areas involved in controlling speech articulators.

Intracortical neural activity distal to seizure-onset-areas predicts human focal seizures

The apparent unpredictability of epileptic seizures has a major impact in the quality of life of people with pharmacologically resistant seizures. Here, we present initial results and a proof-of-concept of how focal seizures can be predicted early in advance based on intracortical signals recorded from small neocortical patches away from identified seizure onset areas. We show that machine learning algorithms can discriminate between interictal and preictal periods based on multiunit activity (i.e. thresholded action potential counts) and multi-frequency band local field potentials recorded via 4 X 4 mm² microelectrode arrays. Microelectrode arrays were implanted in 5 patients undergoing neuromonitoring for resective surgery. Post-implant analysis revealed arrays were outside the seizure onset areas. Preictal periods were defined as the 1-hour period leading to a seizure. A 5-minute gap between the preictal period and the putative seizure onset was enforced to account for potential errors in the determination of actual seizure onset times. We used extreme gradient boosting and long short-term memory networks for prediction. Prediction accuracy based on the area under the receiver operating characteristic curves reached 90% for at least one feature type in each patient. Importantly, successful prediction could be achieved based exclusively on multiunit activity. This result indicates that preictal activity in the recorded neocortical patches involved not only subthreshold postsynaptic potentials, perhaps driven by the distal seizure onset areas, but also neuronal spiking in distal recurrent neocortical networks. Beyond the commonly identified seizure onset areas, our findings point to the engagement of large-scale neuronal networks in the neural dynamics building up toward a seizure. Our initial results obtained on currently available human intracortical microelectrode array recordings warrant new studies on larger datasets, and open new perspectives for seizure prediction and control by emphasizing the contribution of multiscale neural signals in large-scale neuronal networks.

Principled BCI Decoder Design and Parameter Selection Using a Feedback Control Model

Decoders optimized offline to reconstruct intended movements from neural recordings sometimes fail to achieve optimal performance online when they are used in closed-loop as part of an intracortical brain-computer interface (iBCI). This is because typical decoder calibration routines do not model the emergent interactions between the decoder, the user, and the task parameters (e.g. target size). Here, we investigated the feasibility of simulating online performance to better guide decoder parameter selection and design. Three participants in the BrainGate2 pilot clinical trial controlled a computer cursor using a linear velocity decoder under different gain (speed scaling) and temporal smoothing parameters and acquired targets with different radii and distances. We show that a user-specific iBCI feedback control model can predict how performance changes under these different decoder and task parameters in held-out data. We also used the model to optimize a nonlinear speed scaling function for the decoder. When used online with two participants, it increased the dynamic range of decoded speeds and decreased the time taken to acquire targets (compared to an optimized standard decoder). These results suggest that it is feasible to simulate iBCI performance accurately enough to be useful for quantitative decoder optimization and design.

Early Detection of Human Epileptic Seizures Based on Intracortical Microelectrode Array Signals

OBJECTIVE

We examine, for the first time, the use of intracortical microelectrode array (MEA) signals for early detection of human epileptic seizures.

METHODS

4×4 mm² 96-channel-MEA recordings were obtained during neuro-monitoring preceding resective surgery in five participants. The participant-specific seizure-detection framework consisted of: first, feature extraction from local field potentials (LFPs) and multiunit activity (MUA); second, nonlinear cost-sensitive support vector machine (SVM) classification of ictal and interictal states based on LFP, MUA, and combined LFP-MUA (a SVM was trained for each participant separately); and third, Kalman filter postprocessing of SVM scoring functions. Performance was assessed on data including 17 seizures and 39.0 h interictal and preictal recordings.

RESULTS

The use of combined LFP-MUA features resulted in 100% sensitivity with short detection latency (average: 2.7 s; median: 2.5 s) and five false alarms (0.13/h). The average detection performance based on the area under the receiver operating characteristic corresponded to 0.97. Importantly, technically false alarms were related to epileptiform activity, subclinical seizures, and recording artifacts. Extreme gradient boosting classifiers ranked features based on LFP spectral coherence or MUA count among the top features for seizures characterized by spike-wave complexes, whereas features related to LFP power spectra were ranked higher for seizures characterized by sustained gamma LFP oscillations.

CONCLUSION

The combination of intracortical LFP and MUA signals may allow reliable detection of human epileptic seizures by improving latency and false alarm rate.

SIGNIFICANCE

Intracortical MEAs provide promising signals for closed-loop seizure-control systems based on seizure early-detection in people with pharmacologically resistant epilepsies.

Volitional control of single-electrode high gamma local field potentials by people with paralysis

Intracortical brain-computer interfaces (BCIs) can enable individuals to control effectors, such as a computer cursor, by directly decoding the user's movement intentions from action potentials and local field potentials (LFPs) recorded within the motor cortex. However, the accuracy and complexity of effector control achieved with such "biomimetic" BCIs will depend on the degree to which the intended movements used to elicit control modulate the neural activity. In particular, channels that do not record distinguishable action potentials and only record LFP modulations may be of limited use for BCI control. In contrast, a biofeedback approach may surpass these limitations by letting the participants generate new control signals and learn strategies that improve the volitional control of signals used for effector control. Here, we show that, by using a biofeedback paradigm, three individuals with tetraplegia achieved volitional control of gamma LFPs (40-400 Hz) recorded by a single microelectrode implanted in the precentral gyrus. Control was improved over a pair of consecutive sessions up to 3 days apart. In all but one session, the channel used to achieve control lacked distinguishable action potentials. Our results indicate that biofeedback LFP-based BCIs may potentially contribute to the neural modulation necessary to obtain reliable and useful control of effectors. NEW & NOTEWORTHY Our study demonstrates that people with tetraplegia can volitionally control individual high-gamma local-field potential (LFP) channels recorded from the motor cortex, and that this control can be improved using biofeedback. Motor cortical LFP signals are thought to be both informative and stable intracortical signals and, thus, of importance for future brain-computer interfaces.

Abstract TP363: Early Changes in Stroke Severity: Characterization and Impact on Patient-Centered Stroke Outcomes

Introduction: Early changes in NIH stroke scale (NIHSS) within the first days after ischemic stroke have been associated with clinical outcomes, however association with patient-centered outcomes is unknown. Predicting outcomes is important for decisions after the acute period. We sought to characterize the magnitude of early NIHSS change and identify its impact on 90-day Stroke Impact Scale-16 (SIS).

Methods: Data were collected as part of an ongoing single-center study of recovery for patients with upper extremity weakness. NIHSS at time of presentation (presentation NIHSS) was obtained by chart review and NIHSS at time of enrollment (enrollment NIHSS) was assessed prior to acute hospital discharge. We collected demographic, treatment, imaging, and 90-day outcomes. We used a linear regression to determine the relationship of early NIHSS improvement (presentation-enrollment NIHSS) with 90-day SIS and dichotomized the dataset (early NIHSS improvement ≥3 vs not) to compare predefined clinical variables hypothesized to be early improvement predictors.

Results: Study participants (n=72) had median presentation NIHSS of 6 (IQR4-13) and median enrollment NIHSS of 6 (IQR4-10) with a mean of 2.7+/-2.5 days between timepoints. Seventeen subjects improved by ≥3 and 16 worsened by ≥3. Acute treatments were endovascular therapy (ET, n=10) and thrombolysis (tPA, n=16). Early NIHSS improvement was associated with better 90-day SIS (p=0.012). This association remained when subjects who underwent ET or tPA were excluded (p=0.046). Subjects with early NIHSS improvement ≥3 were less likely to have hypertension (15 vs 85%, p=0.039) and more likely to have undergone ET (60 vs 40%, p=0.010), but there were no differences in tPA treatment, infarct volume, days between timepoints, age, or other medical history.

Conclusion: This analysis confirms that there are substantial changes in NIHSS in the first days after stroke. Early NIHSS improvement was associated with better 90-day SIS, even when excluding subjects who underwent treatment with ET or tPA suggesting this association also exists for subjects with spontaneous improvement. Early NIHSS improvement may be a useful prognostic tool for patient-centered outcomes after stroke.