Compartmentalized dynamics within a common multi-area mesoscale manifold represent a repertoire of human hand movements

Brain-wide spatial mapping of oscillatory activity during naturalistic motor behavior

Understanding oscillatory neural activity associated with motor behavior is greatly contributing to the development of neuroprosthetic systems, robotic interfaces, and advanced neurorehabilitation techniques. Most current knowledge about movement-specific patterns of cortical activity is derived from laboratory experiments using highly standardized, repetitive, and often meaningless movements that are very distinct from natural motor behavior. This is characterized by frequent task switching, diverse kinematics, and endogenous motivation. Whether observed patterns of movement-related neural activity during standard laboratory tasks can be generalized to natural motor behavior is largely unknown. Here, we investigated the spatial, spectral, and temporal features of oscillatory neural activity associated with human motor control in a parkour of everyday movements. We replicated strong and significant decreases in the alpha/beta frequency range before movement onset and further show that this power decrease began about 2 s before movement initiation and reached a nadir around movement onset. In addition to the sustained event-related decrease in the alpha/beta range, we identified brief (4-5 cycles) increases in low-frequency activity (3-5 Hz) that either preceded or peaked at movement onset. These low-frequency increases exhibited much greater focality and lateralization compared with the wide-spread alpha/beta decrease. Together, our results provide a comprehensive account of brain rhythmic electric activity across spatial, spectral, and temporal scales in naturalistic motor behavior. Movement-preceding low-frequency activity has previously been identified as a promising brain stimulation target in patients with stroke. Detectability of low-frequency activity in naturalistic movements may enhance its utility as a target for on-demand brain stimulation in neurorehabilitation.NEW & NOTEWORTHY We here provide a comprehensive account of brain rhythmic electric activity across spatial, spectral, and temporal scales, associated with ecologically valid, freely chosen, auditory cued, and visually guided movements of either hand. New and noteworthy, the brain-wide topography of movement preceding, short-lasting increases in low-frequency activity (3-5 Hz), recently identified as a promising target for on-demand neurostimulation in stroke rehabilitation, is described and compared with classically studied sensorimotor rhythms.

Sampling representational plasticity of simple imagined movements across days enables long-term neuroprosthetic control

The nervous system needs to balance the stability of neural representations with plasticity. It is unclear what the representational stability of simple well-rehearsed actions is, particularly in humans, and their adaptability to new contexts. Using an electrocorticography brain-computer interface (BCI) in tetraplegic participants, we found that the low-dimensional manifold and relative representational distances for a repertoire of simple imagined movements were remarkably stable. The manifold's absolute location, however, demonstrated constrained day-to-day drift. Strikingly, neural statistics, especially variance, could be flexibly regulated to increase representational distances during BCI control without somatotopic changes. Discernability strengthened with practice and was BCI-specific, demonstrating contextual specificity. Sampling representational plasticity and drift across days subsequently uncovered a meta-representational structure with generalizable decision boundaries for the repertoire; this allowed long-term neuroprosthetic control of a robotic arm and hand for reaching and grasping. Our study offers insights into mesoscale representational statistics that also enable long-term complex neuroprosthetic control.

Progressively shifting patterns of co-modulation among premotor cortex neurons carry dynamically similar signals during action execution and observation

Many neurons in the premotor cortex show firing rate modulation whether the subject performs an action or observes another individual performing a similar action. Although such "mirror neurons" have been thought to have highly congruent discharge during execution and observation, many if not most actually show non-congruent activity. Studies of neuronal populations active during both execution and observation have shown that the most prevalent patterns of co-modulation-captured as neural trajectories-pass through subspaces which are shared in part, but in part are visited exclusively during either execution or observation. These studies focused on reaching movements for which low-dimensional neural trajectories exhibit comparatively simple dynamical motifs. But the neural dynamics of hand movements are more complex. We developed a novel approach to examine prevalent patterns of co-modulation during execution and observation of a task that involved reaching, grasping, and manipulation. Rather than following neural trajectories in subspaces that contain their entire time course, we identified time series of instantaneous subspaces, calculated principal angles among them, sampled trajectory segments at the times of selected behavioral events, and projected those segments into the time series of instantaneous subspaces. We found that instantaneous neural subspaces most often remained distinct during execution versus observation. Nevertheless, latent dynamics during execution and observation could be partially aligned with canonical correlation, indicating some similarity of the relationships among neural representations of different movements relative to one another during execution and observation. We also found that during action execution, mirror neurons showed consistent patterns of co-modulation both within and between sessions, but other non-mirror neurons that were modulated only during action execution and not during observation showed considerable variability of co-modulation.

Accurate neural control of a hand prosthesis by posture-related activity in the primate grasping circuit

Brain-computer interfaces (BCIs) have the potential to restore hand movement for people with paralysis, but current devices still lack the fine control required to interact with objects of daily living. Following our understanding of cortical activity during arm reaches, hand BCI studies have focused primarily on velocity control. However, mounting evidence suggests that posture, and not velocity, dominates in hand-related areas. To explore whether this signal can causally control a prosthesis, we developed a BCI training paradigm centered on the reproduction of posture transitions. Monkeys trained with this protocol were able to control a multidimensional hand prosthesis with high accuracy, including execution of the very intricate precision grip. Analysis revealed that the posture signal in the target grasping areas was the main contributor to control. We present, for the first time, neural posture control of a multidimensional hand prosthesis, opening the door for future interfaces to leverage this additional information channel.

Global motor dynamics - Invariant neural representations of motor behavior in distributed brain-wide recordings

Objective.Motor-related neural activity is more widespread than previously thought, as pervasive brain-wide neural correlates of motor behavior have been reported in various animal species. Brain-wide movement-related neural activity have been observed in individual brain areas in humans as well, but it is unknown to what extent global patterns exist.Approach.Here, we use a decoding approach to capture and characterize brain-wide neural correlates of movement. We recorded invasive electrophysiological data from stereotactic electroencephalographic electrodes implanted in eight epilepsy patients who performed both an executed and imagined grasping task. Combined, these electrodes cover the whole brain, including deeper structures such as the hippocampus, insula and basal ganglia. We extract a low-dimensional representation and classify movement from rest trials using a Riemannian decoder.Main results.We reveal global neural dynamics that are predictive across tasks and participants. Using an ablation analysis, we demonstrate that these dynamics remain remarkably stable under loss of information. Similarly, the dynamics remain stable across participants, as we were able to predict movement across participants using transfer learning.Significance.Our results show that decodable global motor-related neural dynamics exist within a low-dimensional space. The dynamics are predictive of movement, nearly brain-wide and present in all our participants. The results broaden the scope to brain-wide investigations, and may allow combining datasets of multiple participants with varying electrode locations or calibrationless neural decoder.

Neural subspaces of imagined movements in parietal cortex remain stable over several years in humans

Objective.A crucial goal in brain-machine interfacing is the long-term stability of neural decoding performance, ideally without regular retraining. Long-term stability has only been previously demonstrated in non-human primate experiments and only in primary sensorimotor cortices. Here we extend previous methods to determine long-term stability in humans by identifying and aligning low-dimensional structures in neural data.Approach.Over a period of 1106 and 871 d respectively, two participants completed an imagined center-out reaching task. The longitudinal accuracy between all day pairs was assessed by latent subspace alignment using principal components analysis and canonical correlations analysis of multi-unit intracortical recordings in different brain regions (Brodmann Area 5, Anterior Intraparietal Area and the junction of the postcentral and intraparietal sulcus).Main results.We show the long-term stable representation of neural activity in subspaces of intracortical recordings from higher-order association areas in humans.Significance.These results can be practically applied to significantly expand the longevity and generalizability of brain-computer interfaces.Clinical TrialsNCT01849822, NCT01958086, NCT01964261.

Cross-Frequency Coupling as a Biomarker for Early Stroke Recovery

BACKGROUND

The application of neuroimaging-based biomarkers in stroke has enriched our understanding of post-stroke recovery mechanisms, including alterations in functional connectivity based on synchronous oscillatory activity across various cortical regions. Phase-amplitude coupling, a type of cross-frequency coupling, may provide additional mechanistic insight.

OBJECTIVE

To determine how the phase of prefrontal cortex delta (1-3 Hz) oscillatory activity mediates the amplitude of motor cortex beta (13-20 Hz) oscillations in individual's early post-stroke.

METHODS

Participants admitted to an inpatient rehabilitation facility completed resting and task-based EEG recordings and motor assessments around the time of admission and discharge along with structural neuroimaging. Unimpaired controls completed EEG procedures during a single visit. Mixed-effects linear models were performed to assess within- and between-group differences in delta-beta prefrontomotor coupling. Associations between coupling and motor status and injury were also determined.

RESULTS

Thirty individuals with stroke and 17 unimpaired controls participated. Coupling was greater during task versus rest conditions for all participants. Though coupling during affected extremity task performance decreased during hospitalization, coupling remained elevated at discharge compared to controls. Greater baseline coupling was associated with better motor status at admission and discharge and positively related to motor recovery. Coupling demonstrated both positive and negative associations with injury involving measures of lesion volume and overlap injury to anterior thalamic radiation, respectively.

CONCLUSIONS

This work highlights the utility of prefrontomotor cross-frequency coupling as a potential motor status and recovery biomarker in stroke. The frequency- and region-specific neurocircuitry featured in this work may also facilitate novel treatment strategies in stroke.

Algorithmic assessment of shoulder function using smartphone video capture and machine learning

Tears within the stabilizing muscles of the shoulder, known as the rotator cuff (RC), are the most common cause of shoulder pain-often presenting in older patients and requiring expensive advanced imaging for diagnosis. Despite the high prevalence of RC tears within the elderly population, there is no previously published work examining shoulder kinematics using markerless motion capture in the context of shoulder injury. Here we show that a simple string pulling behavior task, where subjects pull a string using hand-over-hand motions, provides a reliable readout of shoulder mobility across animals and humans. We find that both mice and humans with RC tears exhibit decreased movement amplitude, prolonged movement time, and quantitative changes in waveform shape during string pulling task performance. In rodents, we further note the degradation of low dimensional, temporally coordinated movements after injury. Furthermore, a logistic regression model built on our biomarker ensemble succeeds in classifying human patients as having a RC tear with > 90% accuracy. Our results demonstrate how a combined framework bridging animal models, motion capture, convolutional neural networks, and algorithmic assessment of movement quality enables future research into the development of smartphone-based, at-home diagnostic tests for shoulder injury.

Pseudo-linear Summation explains Neural Geometry of Multi-finger Movements in Human Premotor Cortex

How does the motor cortex combine simple movements (such as single finger flexion/extension) into complex movements (such hand gestures or playing piano)? Motor cortical activity was recorded using intracortical multi-electrode arrays in two people with tetraplegia as they attempted single, pairwise and higher order finger movements. Neural activity for simultaneous movements was largely aligned with linear summation of corresponding single finger movement activities, with two violations. First, the neural activity was normalized, preventing a large magnitude with an increasing number of moving fingers. Second, the neural tuning direction of weakly represented fingers (e.g. middle) changed significantly as a result of the movement of other fingers. These deviations from linearity resulted in non-linear methods outperforming linear methods for neural decoding. Overall, simultaneous finger movements are thus represented by the combination of individual finger movements by pseudo-linear summation.

Flexible regulation of representations on a drifting manifold enables long-term stable complex neuroprosthetic control

The nervous system needs to balance the stability of neural representations with plasticity. It is unclear what is the representational stability of simple actions, particularly those that are well-rehearsed in humans, and how it changes in new contexts. Using an electrocorticography brain-computer interface (BCI), we found that the mesoscale manifold and relative representational distances for a repertoire of simple imagined movements were remarkably stable. Interestingly, however, the manifold's absolute location demonstrated day-to-day drift. Strikingly, representational statistics, especially variance, could be flexibly regulated to increase discernability during BCI control without somatotopic changes. Discernability strengthened with practice and was specific to the BCI, demonstrating remarkable contextual specificity. Accounting for drift, and leveraging the flexibility of representations, allowed neuroprosthetic control of a robotic arm and hand for over 7 months without recalibration. Our study offers insight into how electrocorticography can both track representational statistics across long periods and allow long-term complex neuroprosthetic control.

Subspace partitioning in the human prefrontal cortex resolves cognitive interference

The human prefrontal cortex (PFC) constitutes the structural basis underlying flexible cognitive control, where mixed-selective neural populations encode multiple task features to guide subsequent behavior. The mechanisms by which the brain simultaneously encodes multiple task-relevant variables while minimizing interference from task-irrelevant features remain unknown. Leveraging intracranial recordings from the human PFC, we first demonstrate that competition between coexisting representations of past and present task variables incurs a behavioral switch cost. Our results reveal that this interference between past and present states in the PFC is resolved through coding partitioning into distinct low-dimensional neural states; thereby strongly attenuating behavioral switch costs. In sum, these findings uncover a fundamental coding mechanism that constitutes a central building block of flexible cognitive control.

Neural subspaces of imagined movements in parietal cortex remain stable over several years in humans

A crucial goal in brain-machine interfacing is long-term stability of neural decoding performance, ideally without regular retraining. Here we demonstrate stable neural decoding over several years in two human participants, achieved by latent subspace alignment of multi-unit intracortical recordings in posterior parietal cortex. These results can be practically applied to significantly expand the longevity and generalizability of future movement decoding devices.

Quantifying Hand Strength and Isometric Pinch Individuation Using a Flexible Pressure Sensor Grid

Modulating force between the thumb and another digit, or isometric pinch individuation, is critical for daily tasks and can be impaired due to central or peripheral nervous system injury. Because surgical and rehabilitative efforts often focus on regaining this dexterous ability, we need to be able to consistently quantify pinch individuation across time and facilities. Currently, a standardized metric for such an assessment does not exist. Therefore, we tested whether we could use a commercially available flexible pressure sensor grid (Tekscan F-Socket [Tekscan Inc., Norwood, MA, USA]) to repeatedly measure isometric pinch individuation and maximum voluntary contraction (MVC) in twenty right-handed healthy volunteers at two visits. We developed a novel equation informed by the prior literature to calculate isometric individuation scores that quantified percentage of force on the grid generated by the indicated digit. MVC intra-class correlation coefficients (ICCs) for the left and right hands were 0.86 (p < 0.0001) and 0.88 (p < 0.0001), respectively, suggesting MVC measurements were consistent over time. However, individuation score ICCs, were poorer (left index ICC 0.41, p = 0.28; right index ICC -0.02, p = 0.51), indicating that this protocol did not provide a sufficiently repeatable individuation assessment. These data support the need to develop novel platforms specifically for repeatable and objective isometric hand dexterity assessments.

Putative cell-type-specific multiregional mode in posterior parietal cortex during coordinated visual behavior

In the reach and saccade regions of the posterior parietal cortex (PPC), multiregional communication depends on the timing of neuronal activity with respect to beta-frequency (10-30 Hz) local field potential (LFP) activity, termed dual coherence. Neural coherence is believed to reflect neural excitability, whereby spiking tends to occur at a particular phase of LFP activity, but the mechanisms of multiregional dual coherence remain unknown. Here, we investigate dual coherence in the PPC of non-human primates performing eye-hand movements. We computationally model dual coherence in terms of multiregional neural excitability and show that one latent component, a multiregional mode, reflects shared excitability across distributed PPC populations. Analyzing the power in the multiregional mode with respect to different putative cell types reveals significant modulations with the spiking of putative pyramidal neurons and not inhibitory interneurons. These results suggest a specific role for pyramidal neurons in dual coherence supporting multiregional communication in PPC.

The spatio-temporal architecture of everyday manual behavior

In everyday activities, humans move alike to manipulate objects. Prior works suggest that hand movements are built by a limited set of basic building blocks consisting of a set of common postures. However, how the low dimensionality of hand movements supports the adaptability and flexibility of natural behavior is unknown. Through a sensorized glove, we collected kinematics data from thirty-six participants preparing and having breakfast in naturalistic conditions. By means of an unbiased analysis, we identified a repertoire of hand states. Then, we tracked their transitions over time. We found that manual behavior can be described in space through a complex organization of basic configurations. These, even in an unconstrained experiment, recurred across subjects. A specific temporal structure, highly consistent within the sample, seems to integrate such identified hand shapes to realize skilled movements. These findings suggest that the simplification of the motor commands unravels in the temporal dimension more than in the spatial one.

Quantitative assessments of finger individuation with an instrumented glove

BACKGROUND

In clinical and research settings, hand dexterity is often assessed as finger individuation, or the ability to move one finger at a time. Despite its clinical importance, there is currently no standardized, sufficiently sensitive, or fully objective platform for these evaluations.

METHODS

Here we developed two novel individuation scores and tested them against a previously developed score using a commercially available instrumented glove and data collected from 20 healthy adults. Participants performed individuation for each finger of each hand as well as whole hand open-close at two study visits separated by several weeks. Using the three individuation scores, intra-class correlation coefficients (ICC) and minimal detectable changes (MDC) were calculated. Individuation scores were further correlated with subjective assessments to assess validity.

RESULTS

We found that each score emphasized different aspects of individuation performance while generating scores on the same scale (0 [poor] to 1 [ideal]). These scores were repeatable, but the quality of the metrics varied by both equation and finger of interest. For example, index finger intra-class correlation coefficients (ICC's) were 0.90 (< 0.0001), 0.77 (< 0.001), and 0.83 (p < 0.0001), while pinky finger ICC's were 0.96 (p < 0.0001), 0.88 (p < 0.0001), and 0.81 (p < 0.001) for each score. Similarly, MDCs also varied by both finger and equation. In particular, thumb MDCs were 0.068, 0.14, and 0.045, while index MDCs were 0.041, 0.066, and 0.078. Furthermore, objective measurements correlated with subjective assessments of finger individuation quality for all three equations (ρ = - 0.45, p < 0.0001; ρ = - 0.53, p < 0.0001; ρ = - 0.40, p < 0.0001).

CONCLUSIONS

Here we provide a set of normative values for three separate finger individuation scores in healthy adults with a commercially available instrumented glove. Each score emphasizes a different aspect of finger individuation performance and may be more uniquely applicable to certain clinical scenarios. We hope for this platform to be used within and across centers wishing to share objective data in the physiological study of hand dexterity. In sum, this work represents the first healthy participant data set for this platform and may inform future translational applications into motor physiology and rehabilitation labs, orthopedic hand and neurosurgery clinics, and even operating rooms.

A Tool for Low-Cost, Quantitative Assessment of Shoulder Function Using Machine Learning

Tears within the stabilizing muscles of the shoulder, known as the rotator cuff (RC), are the most common cause of shoulder pain-often presenting in older patients and requiring expensive, advanced imaging for diagnosis1-4. Despite the high prevalence of RC tears within the elderly population, there are no accessible and low-cost methods to assess shoulder function which can eschew the barrier of an in-person physical exam or imaging study. Here we show that a simple string pulling behavior task, where subjects pull a string using hand-over-hand motions, provides a reliable readout of shoulder health across animals and humans. We find that both mice and humans with RC tears exhibit decreased movement amplitude, prolonged movement time, and quantitative changes in waveform shape during string pulling task performance. In rodents, we further note the degradation of low dimensional, temporally coordinated movements after injury. Furthermore, a predictive model built on our biomarker ensemble succeeds in classifying human patients as having a RC tear with >90% accuracy. Our results demonstrate how a combined framework bridging task kinematics, machine learning, and algorithmic assessment of movement quality enables future development of smartphone-based, at-home diagnostic tests for shoulder injury.

Modulation of neural co-firing to enhance network transmission and improve motor function after stroke

Stroke is a leading cause of disability. While neurotechnology has shown promise for improving upper limb recovery after stroke, efficacy in clinical trials has been variable. Our central thesis is that to improve clinical translation, we need to develop a common neurophysiological framework for understanding how neurotechnology alters network activity. Our perspective discusses principles for how motor networks, both healthy and those recovering from stroke, subserve reach-to-grasp movements. We focus on neural processing at the resolution of single movements, the timescale at which neurotechnologies are applied, and discuss how this activity might drive long-term plasticity. We propose that future studies should focus on cross-area communication and bridging our understanding of timescales ranging from single trials within a session to across multiple sessions. We hope that this perspective establishes a combined path forward for preclinical and clinical research with the goal of more robust clinical translation of neurotechnology.

Transition from predictable to variable motor cortex and striatal ensemble patterning during behavioral exploration

Animals can capitalize on invariance in the environment by learning and automating highly consistent actions; however, they must also remain flexible and adapt to environmental changes. It remains unclear how primary motor cortex (M1) can drive precise movements, yet also support behavioral exploration when faced with consistent errors. Using a reach-to-grasp task in rats, along with simultaneous electrophysiological monitoring in M1 and dorsolateral striatum (DLS), we find that behavioral exploration to overcome consistent task errors is closely associated with tandem increases in M1 and DLS neural variability; subsequently, consistent ensemble patterning returns with convergence to a new successful strategy. We also show that compared to reliably patterned intracranial microstimulation in M1, variable stimulation patterns result in significantly greater movement variability. Our results thus indicate that motor and striatal areas can flexibly transition between two modes, reliable neural pattern generation for automatic and precise movements versus variable neural patterning for behavioral exploration.

It is not fully understood how behavioral flexibility is established in the context of automatic performance of a complex motor skill. Here the authors show that corticostriatal activity can flexibly transition between two modes during a reach to-grasp task in rats: reliable neural pattern generation for precise, automatic movements versus variable neural patterning for behavioral exploration.

Distributed yet compartmentalized neural dynamics of hand actions

In this issue of Neuron,Natraj et al. (2021) demonstrate that finger and hand grasping movements are represented in the human fronto-parietal grasp network in a compartmentalized fashion. The movements are encoded in a distributed network that is preserved across various hand actions. The neural dynamics are specific to particular hand movements, leading to movement-specific submanifolds in the network.