Observed, Executed, and Imagined Action Representations can be Decoded From Ventral and Dorsal Areas

AngoraPy: A Python toolkit for modeling anthropomorphic goal-driven sensorimotor systems

Goal-driven deep learning increasingly supplements classical modeling approaches in computational neuroscience. The strength of deep neural networks as models of the brain lies in their ability to autonomously learn the connectivity required to solve complex and ecologically valid tasks, obviating the need for hand-engineered or hypothesis-driven connectivity patterns. Consequently, goal-driven models can generate hypotheses about the neurocomputations underlying cortical processing that are grounded in macro- and mesoscopic anatomical properties of the network's biological counterpart. Whereas, goal-driven modeling is already becoming prevalent in the neuroscience of perception, its application to the sensorimotor domain is currently hampered by the complexity of the methods required to train models comprising the closed sensation-action loop. This paper describes AngoraPy, a Python library that mitigates this obstacle by providing researchers with the tools necessary to train complex recurrent convolutional neural networks that model the human sensorimotor system. To make the technical details of this toolkit more approachable, an illustrative example that trains a recurrent toy model on in-hand object manipulation accompanies the theoretical remarks. An extensive benchmark on various classical, 3D robotic, and anthropomorphic control tasks demonstrates AngoraPy's general applicability to a wide range of tasks. Together with its ability to adaptively handle custom architectures, the flexibility of this toolkit demonstrates its power for goal-driven sensorimotor modeling.

Short-Term Effects of Specific Sensorimotor Training on Postural Assessment in Healthy Individuals: A Pilot Study with a Randomized Placebo-Controlled Trial

It is well-known that sensorimotor training aims to increase the performance of the sensorimotor system to maintain an upright position. Through the use of a randomized placebo-controlled trial, the specific aim of this study was to investigate the short-term effects of a specific session of sensorimotor training on postural balance, stability and coordination in healthy, recreationally active participants. Ninety subjects were randomly allocated into three groups: experimental (n = 30), placebo (n = 32) and control (n = 28). The experimental group performed a 5 min warm-up, with the sensorimotor training consisting of 60-min specific sensorimotor exercises; the control group was not allowed to perform any sensorimotor training; the placebo group observed a video clip of an individual belonging to the experimental group performing the sensorimotor training accurately. All participants were seen three times per week for 4 weeks. Before and after the entire training, all groups of participants undertook stabilometric parameter assessment. The intervention-mediated sensorimotor training confirmed significant enhancement in the proprioceptive system. Significant improvement in the motor and/or sensory function was observed in the experimental and placebo groups. In conclusion, our findings suggest that specific sensorimotor training performed 3 days per week for 4 weeks could improve postural balance, stability and coordination in healthy individuals.

Electroencephalographic Effective Connectivity Analysis of the Neural Networks during Gesture and Speech Production Planning in Young Adults

Gestures and speech, as linked communicative expressions, form an integrated system. Previous functional magnetic resonance imaging studies have suggested that neural networks for gesture and spoken word production share similar brain regions consisting of fronto-temporo-parietal brain regions. However, information flow within the neural network may dynamically change during the planning of two communicative expressions and also differ between them. To investigate dynamic information flow in the neural network during the planning of gesture and spoken word generation in this study, participants were presented with spatial images and were required to plan the generation of gestures or spoken words to represent the same spatial situations. The evoked potentials in response to spatial images were recorded to analyze the effective connectivity within the neural network. An independent component analysis of the evoked potentials indicated 12 clusters of independent components, the dipoles of which were located in the bilateral fronto-temporo-parietal brain regions and on the medial wall of the frontal and parietal lobes. Comparison of effective connectivity indicated that information flow from the right middle cingulate gyrus (MCG) to the left supplementary motor area (SMA) and from the left SMA to the left precentral area increased during gesture planning compared with that of word planning. Furthermore, information flow from the right MCG to the left superior frontal gyrus also increased during gesture planning compared with that of word planning. These results suggest that information flow to the brain regions for hand praxis is more strongly activated during gesture planning than during word planning.

The multisensory nature of human action imagery

Imagination can appeal to all our senses and may, therefore, manifest in very different qualities (e.g., visual, tactile, proprioceptive, or kinesthetic). One line of research addresses action imagery that refers to a process by which people imagine the execution of an action without actual body movements. In action imagery, visual and kinesthetic aspects of the imagined action are particularly important. However, other sensory modalities may also play a role. The purpose of the paper will be to address issues that include: (i) the creation of an action image, (ii) how the brain generates images of movements and actions, (iii) the richness and vividness of action images. We will further address possible causes that determine the sensory impression of an action image, like task specificity, instruction and experience. In the end, we will outline open questions and future directions.

A neural signature for combined action observation and motor imagery? An fNIRS study into prefrontal activation, automatic imitation, and self-other perceptions

INTRODUCTION

Research indicates that both observed and imagined actions can be represented in the brain as two parallel sensorimotor representations. One proposal is that higher order cognitive processes would align these two hypothetical action simulations.

METHODS

We investigated this hypothesis using an automatic imitation paradigm, with functional near-infrared spectroscopy recordings over the prefrontal cortex during different motor simulation states. On each trial, participants (n = 14) observed a picture of a rhythmical action (instructed action) followed by a distractor movie showing the same or different action. Participants then executed the instructed action. Distractor actions were manipulated to be fast or slow, and instructions were manipulated during distractor presentation: action observation (AO), combined action observation and motor imagery (AO+MI) and observe to imitate (intentional imitation). A pure motor imagery (MI) condition was also included.

RESULTS

Kinematic analyses showed that although distractor speed effects were significant under all instructions (shorter mean cycle times in execution for fast compared to slow trials), this imitation bias was significantly stronger for combined AO+MI than both AO and MI, and stronger for intentional imitation than the other three automatic imitation conditions. In the left prefrontal cortex, cerebral oxygenation was significantly greater for combined AO+MI than all other instructions. Participants reported that their representation of the self overlapped with the observed model significantly more during AO+MI than AO.

CONCLUSION

Left prefrontal activation may therefore be a neural signature of AO+MI, supporting attentional switching between concurrent representations of self (MI, top-down) and other (AO, bottom-up) to increase imitation and perceived closeness.

The Empowering Effect of Embodied Awareness Practice on Body Structural Map and Sensorimotor Activity: The Case of Feldenkrais Method

While outcomes of embodied awareness practices in terms of improved posture and flexibility, movement efficiency, and well-being are often reported, systematic investigations of such training effects and of the actual nature, extent, and neurofunctional correlates of learning mechanisms thought to lie at the core of such practices are very limited. The present study focused on the Feldenkrais method (FM), one of the most established embodied awareness practices, and aimed at investigating the neurofunctional outcomes of the somatic learning process at the core of the method by testing the modulations induced by a standardized FM protocol on the complexity of practicers’ body structural map and on the activity of their sensorimotor network during different movement-related tasks (i.e., gestures observation, execution, and imagery). Twenty-five participants were randomly divided into an experimental group—which completed a 28-session FM protocol based on guided group practice—and a control group, and underwent pre-/post-training psychometric and electrophysiological assessment. Data analysis highlighted, at the end of the FM protocol, a significant increase of EEG markers of cortical activation (task-related mu desynchronization) in precentral regions during action observation and in central regions during action execution and imagery. Also, posterior regions of the sensorimotor network showed systematic activation during all the action-related tasks.

Human mirror neuron system responsivity to unimodal and multimodal presentations of action

This study aims to clarify unresolved questions from two earlier studies by McGarry et al. Exp Brain Res 218(4): 527-538, 2012 and Kaplan and Iacoboni Cogn Process 8: 103-113, 2007 on human mirror neuron system (hMNS) responsivity to multimodal presentations of actions. These questions are: (1) whether the two frontal areas originally identified by Kaplan and Iacoboni (ventral premotor cortex [vPMC] and inferior frontal gyrus [IFG]) are both part of the hMNS (i.e., do they respond to execution as well as observation), (2) whether both areas yield effects of biologicalness (biological, control) and modality (audio, visual, audiovisual), and (3) whether the vPMC is preferentially responsive to multimodal input. To resolve these questions about the hMNS, we replicated and extended McGarry et al.'s electroencephalography (EEG) study, while incorporating advanced source localization methods. Participants were asked to execute movements (ripping paper) as well as observe those movements across the same three modalities (audio, visual, and audiovisual), all while 64-channel EEG data was recorded. Two frontal sources consistent with those identified in prior studies showed mu event-related desynchronization (mu-ERD) under execution and observation conditions. These sources also showed a greater response to biological movement than to control stimuli as well as a distinct visual advantage, with greater responsivity to visual and audiovisual compared to audio conditions. Exploratory analyses of mu-ERD in the vPMC under visual and audiovisual observation conditions suggests that the hMNS tracks the magnitude of visual movement over time.

Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

In addition to the well-established somatotopy in the pre- and post-central gyrus, there is now strong evidence that somatotopic organization is evident across other regions in the sensorimotor network. This raises several experimental questions: To what extent is activity in the sensorimotor network effector-dependent and effector-independent? How important is the sensorimotor cortex when predicting the motor effector? Is there redundancy in the distributed somatotopically organized network such that removing one region has little impact on classification accuracy? To answer these questions, we developed a novel experimental approach. fMRI data were collected while human subjects performed a precisely controlled force generation task separately with their hand, foot, and mouth. We used a simple linear iterative clustering (SLIC) algorithm to segment whole-brain beta coefficient maps to build an adaptive brain parcellation and then classified effectors using extreme gradient boosting (XGBoost) based on parcellations at various spatial resolutions. This allowed us to understand how data-driven adaptive brain parcellation granularity altered classification accuracy. Results revealed effector-dependent activity in regions of the post-central gyrus, precentral gyrus, and paracentral lobule. SMA, regions of the inferior and superior parietal lobule, and cerebellum each contained effector-dependent and effector-independent representations. Machine learning analyses showed that increasing the spatial resolution of the data-driven model increased classification accuracy, which reached 94% with 1755 supervoxels. Our SLIC-based supervoxel parcellation outperformed classification analyses using established brain templates and random simulations. Occlusion experiments further demonstrated redundancy across the sensorimotor network when classifying effectors. Our observations extend our understanding of effector-dependent and effector-independent organization within the human brain and provide new insight into the functional neuroanatomy required to predict the motor effector used in a motor control task.

Decoding grip type and action goal during the observation of reaching-grasping actions: A multivariate fMRI study

During execution and observation of reaching-grasping actions, the brain must encode, at the same time, the final action goal and the type of grip necessary to achieve it. Recently, it has been proposed that the Mirror Neuron System (MNS) is involved not only in coding the final goal of the observed action, but also the type of grip used to grasp the object. However, the specific contribution of the different areas of the MNS, at both cortical and subcortical level, in disentangling action goal and grip type is still unclear. Here, twenty human volunteers participated in an fMRI study in which they performed two tasks: (a) observation of four different types of actions, consisting in reaching-to-grasp a box handle with two possible grips (precision, hook) and two possible goals (open, close); (b) action execution, in which participants performed grasping actions similar to those presented during the observation task. A conjunction analysis revealed the presence of shared activated voxels for both action observation and execution within several cortical areas including dorsal and ventral premotor cortex, inferior and superior parietal cortex, intraparietal sulcus, primary somatosensory cortex, and cerebellar lobules VI and VIII. ROI analyses showed a main effect for grip type in several premotor and parietal areas and cerebellar lobule VI, with higher BOLD activation during observation of precision vs hook actions. A grip x goal interaction was also present in the left inferior parietal cortex, with higher BOLD activity during precision-to-close actions. A multivariate pattern analysis (MVPA) revealed a significant accuracy for the grip model in all ROIs, while for the action goal model, significant accuracy was observed only for left inferior parietal cortex ROI. These findings indicate that a large network involving cortical and cerebellar areas is involved in the processing of type of grip, while final action goal appears to be mainly processed within the inferior parietal region, suggesting a differential contribution of the areas activated in this study.

Using motor imagery practice for improving motor performance - A review

Motor imagery practice is a current trend, but there is a need for a systematic integration of neuroscientific advances in the field. In this review, we describe the technique of motor imagery practice and its neural representation, considering different fields of application. The current practice of individualized motor imagery practice schemes often lacks systematization and is mostly based on experience. We review literature related to motor imagery practice in order to identify relevant modulators of practice effects like previous experience in motor training and motor imagery practice, the type of motor task to be trained, and strategies to increase sensory feedback during physical practice. Relevant discrepancies are identified between neuroscientific findings and practical consideration of these findings. To bridge these gaps, more effort should be directed at analyzing the brain network activities related to practically relevant motor imagery practice interventions.

A novel fully immersive virtual reality environment for upper extremity rehabilitation in patients with stroke

Given the rising incidence of stroke, several technology-driven methods for rehabilitation have recently been developed. Virtual reality (VR) is a promising therapeutic technology among them. We recently developed a neuroscientifically grounded VR system to aid recovery of motor function poststroke. The developed system provides unilateral and bilateral upper extremity (UE) training in a fully immersive virtual environment that may stimulate and activate mirror neurons (MNs) in the brain necessary for UE rehabilitation. Twenty-three participants were randomized to a VR group (n = 12) to receive VR intervention (8 h within 2 weeks) plus 8-h occupational therapy (OT) or a control group (n = 11) to receive time-matched OT alone. Treatment effects on motor recovery and cortical reorganization were investigated using the Barthel Index (BI), Fugl-Meyer Upper Extremity (FM-UE), and resting-state fMRI. Both groups significantly improved BI (P < 0.05), reflecting the recovery of UE motor function. The VR group revealed significant improvements on FM-UE scores (P < 0.05) than the control group. Neural activity increased after the intervention, particularly in the brain areas implicating MNs, such as in the primary motor cortex. Overall, results suggested that using a neuroscientifically grounded VR system might offer additional benefits for UE rehabilitation in patients receiving OT.

Practice modality of motor sequences impacts the neural signature of motor imagery

Motor imagery is conceptualized as an internal simulation that uses motor-related parts of the brain as its substrate. Many studies have investigated this sharing of common neural resources between the two modalities of motor imagery and motor execution. They have shown overlapping but not identical activation patterns that thereby result in a modality-specific neural signature. However, it is not clear how far this neural signature depends on whether the imagined action has previously been practiced physically or only imagined. The present study aims to disentangle whether the neural imprint of an imagined manual pointing sequence within cortical and subcortical motor areas is determined by the nature of this prior practice modality. Each participant practiced two sequences physically, practiced two other sequences mentally, and did a behavioural pre-test without any further practice on a third pair of sequences. After a two-week practice intervention, participants underwent fMRI scans while imagining all six sequences. Behavioural data demonstrated practice-related effects as well as very good compliance with instructions. Functional MRI data confirmed the previously known motor imagery network. Crucially, we found that mental and physical practice left a modality-specific footprint during mental motor imagery. In particular, activation within the right posterior cerebellum was stronger when the imagined sequence had previously been practiced physically. We conclude that cerebellar activity is shaped specifically by the nature of the prior practice modality.

Proactive Motor Functional Recovery Following Immersive Virtual Reality-Based Limb Mirroring Therapy in Patients with Subacute Stroke

Virtual reality (VR) is considered to be a promising therapeutic technology for the rehabilitation of upper extremities (UEs) post-stroke. Recently, we designed and then implemented a neuroscientifically grounded VR protocol for the rehabilitation of patients with stroke. The system provides unilateral and bilateral limb mirroring exercises in a fully immersive virtual environment that may stimulate and activate the mirror neuron system in the brain to help patients for their rehabilitation. Twelve patients with subacute stroke underwent the newly implemented VR treatment in addition to conventional rehabilitation for 8 consecutive weekdays. The treatment effect on brain reorganization and motor function was investigated using resting-state fMRI (rs-fMRI) and the Fugl-Meyer assessment for Upper Extremity (FM-UE), respectively. Fifteen healthy controls (HCs) also underwent rs-fMRI scanning one time. The study finally obtained usable data from 8 patients and 13 HCs. After the intervention, patients demonstrated significant improvement in their FM-UE scores (p values < 0.042). Voxel-wise functional connectivity (FC) analysis based on the rs-fMRI data found that HCs showed widespread bilateral FC patterns associated with the dominant hemispheric primary motor cortex (M1). However, the FC patterns in patients revealed intra-hemispheric association with the ipsilesional M1 seed and this association became visible in the contra-hemisphere after the intervention. Moreover, the change of FC values between the bilateral M1 was significantly correlated with the changes in FM-UE scores (p values < 0.037). We conclude that unilateral and bilateral limb mirroring exercise in an immersive virtual environment may enhance cortical reorganization and lead to improved motor function.

Affective, Social, and Informative Gestures Reproduction in Human Interaction: Hyperscanning and Brain Connectivity

Gestural communication characterizes daily individuals' interactions in order to share information and to modify others' behavior. Social neuroscience has investigated the neural bases which support recognizing of different gestures. The present research, through the use of the hyperscanning approach, that allows the simultaneously recording of the activity of two or more individuals involved in a joint action, aims to investigate the neural bases of gestural communication. Moreover, by using hyperscanning paradigm we explore the inter-brain connectivity between two inter-agents, the one who performed the gesture (encoder) and the one who received it (decoder), with functional Near-infrared Spectroscopy (fNIRS) during the reproduction of affective, social and informative gestures with positive and negative valence. Result showed an increase in oxygenated hemoglobin concentration (O2Hb) and inter-brain connectivity in the dorsolateral prefrontal cortex (DLPFC) for affective gestures, in the superior frontal gyrus (SFG) for social gestures and the frontal eye fields (FEF) for informative gestures, for both encoder and decoder. Furthermore, it emerged that positive gestures activate more the left DLPFC, with an increase in inter-brain connectivity in DLPFC and SFG. The present study revealed the relevant function of the type and valence of gestures in affecting intra- and inter-brain connectivity.

Hyperalignment of motor cortical areas based on motor imagery during action observation

Multivariate Pattern Analysis (MVPA) has grown in importance due to its capacity to use both coarse and fine scale patterns of brain activity. However, a major limitation of multivariate analysis is the difficulty of aligning features across brains, which makes MVPA a subject specific analysis. Recent work by Haxby et al. (2011) introduced a method called Hyperalignment that explored neural activity in ventral temporal cortex during object recognition and demonstrated the ability to align individual patterns of brain activity into a common high dimensional space to facilitate Between Subject Classification (BSC). Here we examined BSC based on Hyperalignment of motor cortex during a task of motor imagery of three natural actions (lift, knock and throw). To achieve this we collected brain activity during the combined tasks of action observation and motor imagery to a parametric action space containing 25 stick-figure blends of the three natural actions. From these responses we derived Hyperalignment transformation parameters that were used to map subjects’ representational spaces of the motor imagery task in the motor cortex into a common model representational space. Results showed that BSC of the neural response patterns based on Hyperalignment exceeded both BSC based on anatomical alignment as well as a standard Within Subject Classification (WSC) approach. We also found that results were sensitive to the order in which participants entered the Hyperalignment algorithm. These results demonstrate the effectiveness of Hyperalignment to align neural responses across subject in motor cortex to enable BSC of motor imagery.

Using Action-congruent Language Facilitates the Motor Response during Action Observation: A Combined Transcranial Magnetic Stimulation and Eye-tracking Study

There is evidence that action observation (AO) and the processing of action-related words are associated with increased activity in cortical motor regions. Research has examined the effects of AO and action verb processing on activity in the motor system independently. The aim of this experiment was to investigate, for the first time, the modulation of corticospinal excitability and visual attention during the concurrent processing of action verbs and AO stimuli. Twenty participants took part in an integrated transcranial magnetic stimulation and eye-tracking protocol. Single-pulse transcranial magnetic stimulation was delivered to the hand representation of the left motor cortex during (i) observation of a static hand, (ii) AO of a hand squeezing a sponge, (iii) AO of the same action with an audio recording of the word "squeeze," and (iv) AO of the same action with an audio recording of the word "green". Motor evoked potentials were recorded from the abductor pollicis brevis and abductor digiti minimi muscles of the right hand. Eye gaze was recorded throughout the four conditions as a proxy for visual attention. Interviews were conducted to discuss participants' preferences and imagery use for each condition. The AO and action verb condition resulted in significantly increased motor evoked potential amplitudes in the abductor pollicis brevis muscle; participants also made significantly more fixations on the sponge and reported wanting to move their hand more in the action verb condition. The inclusion of auditory action verbs, alongside AO stimuli, in movement simulation interventions could have implications for the delivery of AO interventions for motor (re)learning.

Neural bases of self- and object-motion in a naturalistic vision

To plan movements toward objects our brain must recognize whether retinal displacement is due to self-motion and/or to object-motion. Here, we aimed to test whether motion areas are able to segregate these types of motion. We combined an event-related functional magnetic resonance imaging experiment, brain mapping techniques, and wide-field stimulation to study the responsivity of motion-sensitive areas to pure and combined self- and object-motion conditions during virtual movies of a train running within a realistic landscape. We observed a selective response in MT to the pure object-motion condition, and in medial (PEc, pCi, CSv, and CMA) and lateral (PIC and LOR) areas to the pure self-motion condition. Some other regions (like V6) responded more to complex visual stimulation where both object- and self-motion were present. Among all, we found that some motion regions (V3A, LOR, MT, V6, and IPSmot) could extract object-motion information from the overall motion, recognizing the real movement of the train even when the images remain still (on the screen), or moved, because of self-movements. We propose that these motion areas might be good candidates for the "flow parsing mechanism," that is the capability to extract object-motion information from retinal motion signals by subtracting out the optic flow components.

Neuromuscular electrical stimulation-promoted plasticity of the human brain

The application of neuromuscular electrical stimulation (NMES) to paretic limbs has demonstrated utility for motor rehabilitation following brain injury. When NMES is delivered to a mixed peripheral nerve, typically both efferent and afferent fibres are recruited. Muscle contractions brought about by the excitation of motor neurons are often used to compensate for disability by assisting actions such as the formation of hand aperture, or by preventing others including foot drop. In this context, exogenous stimulation provides a direct substitute for endogenous neural drive. The goal of the present narrative review is to describe the means through which NMES may also promote sustained adaptations within central motor pathways, leading ultimately to increases in (intrinsic) functional capacity. There is an obvious practical motivation, in that detailed knowledge concerning the mechanisms of adaptation has the potential to inform neurorehabilitation practice. In addition, responses to NMES provide a means of studying CNS plasticity at a systems level in humans. We summarize the fundamental aspects of NMES, focusing on the forms that are employed most commonly in clinical and experimental practice. Specific attention is devoted to adjuvant techniques that further promote adaptive responses to NMES thereby offering the prospect of increased therapeutic potential. The emergent theme is that an association with centrally initiated neural activity, whether this is generated in the context of NMES triggered by efferent drive or via indirect methods such as mental imagery, may in some circumstances promote the physiological changes that can be induced through peripheral electrical stimulation.

Target-oriented motor imagery for grasping action: different characteristics of brain activation between kinesthetic and visual imagery

Motor imagery (MI) for target-oriented movements, which is a basis for functional activities of daily living, can be more appropriate than non-target-oriented MI as tasks to promote motor recovery or brain-computer interface (BCI) applications. This study aimed to explore different characteristics of brain activation among target-oriented kinesthetic imagery (KI) and visual imagery (VI) in the first-person (VI-1) and third-person (VI-3) perspectives. Eighteen healthy volunteers were evaluated for MI ability, trained for the three types of target-oriented MIs, and scanned using 3 T functional magnetic resonance imaging (fMRI) under MI and perceptual control conditions, presented in a block design. Post-experimental questionnaires were administered after fMRI. Common brain regions activated during the three types of MI were the left premotor area and inferior parietal lobule, irrespective of the MI modalities or perspectives. Contrast analyses showed significantly increased brain activation only in the contrast of KI versus VI-1 and KI versus VI-3 for considerably extensive brain regions, including the supplementary motor area and insula. Neural activity in the orbitofrontal cortex and cerebellum during VI-1 and KI was significantly correlated with MI ability measured by mental chronometry and a self-reported questionnaire, respectively. These results can provide a basis in developing MI-based protocols for neurorehabilitation to improve motor recovery and BCI training in severely paralyzed individuals.

Cognitive Control Structures in the Imitation Learning of Spatial Sequences and Rhythms-An fMRI Study

Imitation learning involves the acquisition of novel motor patterns based on action observation (AO). We used event-related functional magnetic resonance imaging to study the imitation learning of spatial sequences and rhythms during AO, motor imagery (MI), and imitative execution in nonmusicians and musicians. While both tasks engaged the fronto-parietal mirror circuit, the spatial sequence task recruited posterior parietal and dorsal premotor regions more strongly. The rhythm task involved an additional network for auditory working memory. This partial dissociation supports the concept of task-specific mirror mechanisms. Two regions of cognitive control were identified: 1) dorsolateral prefrontal cortex (DLPFC) was found to be more strongly activated during MI of novel spatial sequences, which allowed us to extend the 2-level model of imitation learning by Buccino et al. (2004) to spatial sequences. 2) During imitative execution of both tasks, the posterior medial frontal cortex was robustly activated, along with the DLPFC, which suggests that both regions are involved in the cognitive control of imitation learning. The musicians' selective behavioral advantage for rhythm imitation was reflected cortically in enhanced sensory-motor processing during AO and by the absence of practice-related activation differences in DLPFC during rhythm execution.

Subjective vividness of motor imagery has a neural signature in human premotor and parietal cortex

Motor imagery (MI) is the process in which subjects imagine executing a body movement with a strong kinesthetic component from a first-person perspective. The individual capacity to elicit such mental images is not universal but varies within and between subjects. Neuroimaging studies have shown that these inter-as well as intra-individual differences in imagery quality mediate the amplitude of neural activity during MI on a group level. However, these analyses were not sensitive to forms of representation that may not map onto a simple modulation of overall amplitude. Therefore, the present study asked how far the subjective impression of motor imagery vividness is reflected by a spatial neural code, and how patterns of neural activation in different motor regions relate to specific imagery impressions. During fMRI scanning, 20 volunteers imagined three different types of right-hand actions. After each imagery trial, subjects were asked to evaluate the perceived vividness of their imagery. A correlation analysis compared the rating differences and neural dissimilarity values of the rating groups separately for each region of interest. Results showed a significant positive correlation in the left vPMC and right IPL, indicating that these regions particularly reflect perceived imagery vividness in that similar rated trials evoke more similar neural patterns. A decoding analysis revealed that the vividness of the motor image related systematically to the action specificity of neural activation patterns in left vPMC and right SPL. Imagined actions accompanied by higher vividness ratings were significantly more distinguishable within these areas. Altogether, results showed that spatial patterns of neural activity within the human motor cortices reflect the individual vividness of imagined actions. Hence, the findings reveal a link between the subjective impression of motor imagery vividness and objective physiological markers.

Motor and extra-motor gray matter integrity may underlie neurophysiologic parameters of motor function in amyotrophic lateral sclerosis: a combined voxel-based morphometry and transcranial stimulation study

The association between gray matter (GM) density and neurophysiologic changes is still unclear in amyotrophic lateral sclerosis (ALS). We evaluated the relationship between GM density and motor system integrity combining voxel-based morphometry (VBM) and transcranial magnetic stimulation (TMS) in ALS. We included 17 ALS patients and 22 healthy controls (HC) who underwent 3D-T1-weighted imaging. Among the ALS group, we applied left motor cortex single-pulse TMS. We used whole-brain VBM comparing ALS and HC in GM density. We also conducted regression analysis to examine correlations between GM density and the following TMS parameters: motor evoked potential (MEP)/M ratio and central motor conduction time (CMCT). We found significantly decreased GM density in ALS patients in several frontal, temporal, parietal/occipital and cerebellar regions (p < 0.001 uncorrected; cluster-extent threshold k = 100 voxels per cluster). With regards to TMS parameters, ALS patients showed mostly increased MEP/M ratio and modest prolongation of CMCT. MEP/M ratio was associated with GM density in (a) rolandic operculum/inferior frontal gyrus/precentral gyrus; anterior cingulate gyrus; inferior temporal gyrus; superior parietal lobule; cuneus; superior occipital gyrus and cerebellum (positive association) and (b) paracentral lobule/supplementary motor area (negative association). CMCT was associated with GM density in (a) inferior frontal gyrus and middle cingulated gyrus (positive association) and (b) superior parietal lobule; cuneus and cerebellum (negative association). Our findings support a significant interaction between motor and extra-motor structural and functional changes and highlight that motor and extra-motor GM integrity may underlie TMS parameters of motor function in ALS patients.

Action perception and motor imagery: Mental practice of action

Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative ¹⁴C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.

Watch, Imagine, Attempt: Motor Cortex Single-Unit Activity Reveals Context-Dependent Movement Encoding in Humans With Tetraplegia

Planning and performing volitional movement engages widespread networks in the human brain, with motor cortex considered critical to the performance of skilled limb actions. Motor cortex is also engaged when actions are observed or imagined, but the manner in which ensembles of neurons represent these volitional states (VoSs) is unknown. Here we provide direct demonstration that observing, imagining or attempting action activates shared neural ensembles in human motor cortex. Two individuals with tetraplegia (due to brainstem stroke or amyotrophic lateral sclerosis, ALS) were verbally instructed to watch, imagine, or attempt reaching actions displayed on a computer screen. Neural activity in the precentral gyrus incorporated information about both cognitive state and movement kinematics; the three conditions presented overlapping but unique, statistically distinct activity patterns. These findings demonstrate that individual neurons in human motor cortex reflect information related to sensory inputs and VoS in addition to movement features, and are a key part of a broader network linking perception and cognition to action.

Task-Specificity of Muscular Responses During Motor Imagery: Peripheral Physiological Effects and the Legacy of Edmund Jacobson

Motor imagery has become a key issue in cognitive neuroscience and particularly in fMRI research. However, peripheral physiological effects of motor imagery were already being studied a century ago with some research hypotheses even tracing back to Washburn (1916). This review focuses on research by Edmund Jacobson in the early 1930s. Jacobsen demonstrated that peripheral physiological effects rely on task-specific instructions: Bending the right arm elicits muscular responses in the right biceps, but not in the muscles of other limbs. This review discusses how Jacobsen examined this issue in a series of studies. This scientific spadework is worth recalling here because of its methodological innovations and its forward-looking discussion that even today, continues to be relevant for prospective research on this topic.

Transitive Versus Intransitive Complex Gesture Representation: A Comparison Between Execution, Observation and Imagination by fNIRS

The aim of the present study was to examine cortical correlates of motor execution, motor observation and motor imagery of hand complex gestures, in particular by comparing meaningful gestures implying the use of an object (transitive action) or not (intransitive action). Functional near-infrared spectroscopy (fNIRS) was used to verify the presence of partial overlapping between some cortical areas involved in those different tasks. Participants were instructed to observe videos of transitive vs. intransitive gestures and then to execute or imagine them. Gesture execution was associated to greater brain activity (increased oxygenated hemoglobin levels) with respect to observation and imagination in motor areas (premotor cortex, PMC; primary sensorimotor cortex, SM1). In contrast, the posterior parietal cortex (PPC) was more relevantly involved in both execution and observation tasks compared to gesture imagination. Moreover, execution and observation of transitive gestures seemed primarily supported by similar parietal posterior areas when compared with intransitive gestures, which do not imply the presence on a object.

Mu Suppression Is Sensitive to Observational Practice but Results in Different Patterns of Activation in Comparison with Physical Practice

Research has shown the effectiveness of observational practice for motor learning, but there continues to be debate about the mechanisms underlying effectiveness. Although cortical processes can be moderated during observation, after both physical and observational practice, how these processes change with respect to behavioural measures of learning has not been studied. Here we compared short-term physical and observational practice during the acquisition and retention of a novel motor task to evaluate how each type of practice modulates EEG mu rhythm (8-13 Hz). Thirty healthy individuals were randomly assigned to one of three groups: (1) physical practice (PP), (2) observational practice (OP), and (3) no practice (NP) control. There were four testing stages: baseline EEG, practice, postpractice observation, and delayed retention. There was significant bilateral suppression of mu rhythm during PP but only left lateralized mu suppression during OP. In the postpractice observation phase, mu suppression was bilateral and larger after PP compared to that after OP. NP control showed no evidence of suppression and was significantly different to both the OP and PP groups. When comparing the three groups in retention, the groups did not differ with respect to tracing times, but the PP group showed fewer errors, especially in comparison to the NP group. Therefore, although the neurophysiological measures index changes in the OP group, which are similar but moderated in comparison to PP, changes in these processes are not manifest in observational practice outcomes when assessed in a delayed retention test.

Imagined and Executed Actions in the Human Motor System: Testing Neural Similarity Between Execution and Imagery of Actions with a Multivariate Approach

Simulation theory proposes motor imagery (MI) to be a simulation based on representations also used for motor execution (ME). Nonetheless, it is unclear how far they use the same neural code. We use multivariate pattern analysis (MVPA) and representational similarity analysis (RSA) to describe the neural representations associated with MI and ME within the frontoparietal motor network. During functional magnetic resonance imaging scanning, 20 volunteers imagined or executed 3 different types of right-hand actions. Results of MVPA showed that these actions as well as their modality (MI or ME) could be decoded significantly above chance from the spatial patterns of BOLD signals in premotor and posterior parietal cortices. This was also true for cross-modal decoding. Furthermore, representational dissimilarity matrices of frontal and parietal areas showed that MI and ME representations formed separate clusters, but that the representational organization of action types within these clusters was identical. For most ROIs, this pattern of results best fits with a model that assumes a low-to-moderate degree of similarity between the neural patterns associated with MI and ME. Thus, neural representations of MI and ME are neither the same nor totally distinct but exhibit a similar structural geometry with respect to different types of action.

Just above Chance: Is It Harder to Decode Information from Prefrontal Cortex Hemodynamic Activity Patterns?

The prefrontal cortex (PFC) is central to flexible, goal-directed cognition, and understanding its representational code is an important problem in cognitive neuroscience. In humans, multivariate pattern analysis (MVPA) of fMRI blood oxygenation level-dependent (BOLD) measurements has emerged as an important approach for studying neural representations. Many previous studies have implicitly assumed that MVPA of fMRI BOLD is just as effective in decoding information encoded in PFC neural activity as it is in visual cortex. However, MVPA studies of PFC have had mixed success. Here we estimate the base rate of decoding information from PFC BOLD activity patterns from a meta-analysis of published MVPA studies. We show that PFC has a significantly lower base rate (55.4%) than visual areas in occipital (66.6%) and temporal (71.0%) cortices and one that is close to chance levels. Our results have implications for the design and interpretation of MVPA studies of PFC and raise important questions about its functional organization.

What Are You Doing With That Object? Comparing the Neural Responses of Action Understanding in Adolescents With and Without Autism

Understanding another's actions, including what they are doing and why they are doing it, can be difficult for individuals with autism spectrum disorder (ASD). This understanding is supported by the action observation (AON) and mentalizing (MZN) networks, as well as the superior temporal sulcus. We examined these areas in children with ASD and typically developing controls by having participants view eating and placing actions performed in conventional and unconventional ways while functional magnetic resonance images were collected. We found an effect of action-type, but not conventionality, in both groups, and a between groups difference only when viewing conventional eating actions. Findings suggest there are not global AON/MZN deficits in ASD, and observing unconventional actions may not spontaneously activate the MZN.

Object words modulate the activity of the mirror neuron system during action imitation

BACKGROUND

Although research has demonstrated that the mirror neuron system (MNS) plays a crucial role in both action imitation and action-related semantic processing, whether action-related words can inversely modulate the MNS activity remains unclear.

METHODS

Here, three types of task-irrelevant words (body parts, verbs, and manufactured objects) were presented to examine the modulation effect of these words on the MNS activity during action observation and imitation. Twenty-two participants were recruited for the fMRI scanning and remaining data from 19 subjects were reported here.

RESULTS

Brain activity results showed that word types elicited different modulation effects over nodes of the MNS (i.e., the right inferior frontal gyrus, premotor cortex, inferior parietal lobule, and STS), especially during the imitation stage. Compared with other word conditions, action imitation following manufactured objects words induced stronger activation in these brain regions during the imitation stage. These results were consistent in both task-dependent and -independent ROI analysis.

CONCLUSION

Our findings thus provide evidence for the unique effect of object words on the MNS during imitation of action, which may also confirm the key role of goal inference in action imitation.

Action-skilled observation: Issues for the study of sport expertise and the brain

With a growing body of research devoted to uncovering regions of the brain implicated in action observation following various action-related experiences, including sport, we ask what we know from this research, and what we still need to know, as it pertains to sport and the brain. To do this, we review and integrate knowledge garnered from developmental work, short-term motor learning studies, and most significantly sport athletes across varying skill levels. We consider various neurophysiological methods, including TMS, fMRI, and EEG, which have been used to help uncover brain regions involved in action-skilled observation. We are particularly interested in how these processes are related to action prediction and the detection of deceptive actions among athlete groups. This research is considered within broad theoretical frameworks related to action-simulation and prediction, although our main focus is on the brain regions that have been implicated in skilled action observation and the implications of this research for knowledge and further study of sport expertise.

Feature-coding transitions to conjunction-coding with progression through human visual cortex

Identifying an object and distinguishing it from similar items depends upon the ability to perceive its component parts as conjoined into a cohesive whole, but the brain mechanisms underlying this ability remain elusive. The ventral visual processing pathway in primates is organized hierarchically: Neuronal responses in early stages are sensitive to the manipulation of simple visual features, whereas neuronal responses in subsequent stages are tuned to increasingly complex stimulus attributes. It is widely assumed that feature-coding dominates in early visual cortex whereas later visual regions employ conjunction-coding in which object representations are different from the sum of their simple feature parts. However, no study in humans has demonstrated that putative object-level codes in higher visual cortex cannot be accounted for by feature-coding and that putative feature codes in regions prior to ventral temporal cortex are not equally well characterized as object-level codes. Thus the existence of a transition from feature- to conjunction-coding in human visual cortex remains unconfirmed, and if a transition does occur its location remains unknown. By employing multivariate analysis of functional imaging data, we measure both feature-coding and conjunction-coding directly, using the same set of visual stimuli, and pit them against each other to reveal the relative dominance of one vs. the other throughout cortex. Our results reveal a transition from feature-coding in early visual cortex to conjunction-coding in both inferior temporal and posterior parietal cortices. This novel method enables the use of experimentally controlled stimulus features to investigate population-level feature and conjunction codes throughout human cortex.NEW & NOTEWORTHY We use a novel analysis of neuroimaging data to assess representations throughout visual cortex, revealing a transition from feature-coding to conjunction-coding along both ventral and dorsal pathways. Occipital cortex contains more information about spatial frequency and contour than about conjunctions of those features, whereas inferotemporal and parietal cortices contain conjunction coding sites in which there is more information about the whole stimulus than its component parts.

Neural Representation. A Survey-Based Analysis of the Notion

The word representation (as in “neural representation”), and many of its related terms, such as to represent, representational and the like, play a central explanatory role in neuroscience literature. For instance, in “place cell” literature, place cells are extensively associated with their role in “the representation of space.” In spite of its extended use, we still lack a clear, universal and widely accepted view on what it means for a nervous system to represent something, on what makes a neural activity a representation, and on what is re-presented. The lack of a theoretical foundation and definition of the notion has not hindered actual research. My aim here is to identify how active scientists use the notion of neural representation, and eventually to list a set of criteria, based on actual use, that can help in distinguishing between genuine or non-genuine neural-representation candidates. In order to attain this objective, I present first the results of a survey of authors within two domains, place-cell and multivariate pattern analysis (MVPA) research. Based on the authors’ replies, and on a review of neuroscientific research, I outline a set of common properties that an account of neural representation seems to require. I then apply these properties to assess the use of the notion in two domains of the survey, place-cell and MVPA studies. I conclude by exploring a shift in the notion of representation suggested by recent literature.

Altered modulation of sensorimotor rhythms with chronic paralysis

After paralysis, the disconnection between the cortex and its peripheral targets leads to neuroplasticity throughout the nervous system. However, it is unclear how chronic paralysis specifically impacts cortical oscillations associated with attempted movement of impaired limbs. We hypothesized that μ- (8-13 Hz) and β- (15-30 Hz) event-related desynchronization (ERD) would be less modulated for individuals with hand paralysis due to cervical spinal cord injury (SCI). To test this, we compared the modulation of ERD from magnetoencephalography (MEG) during attempted and imagined grasping performed by participants with cervical SCI (n = 12) and able-bodied controls (n = 13). Seven participants with tetraplegia were able to generate some electromyography (EMG) activity during attempted grasping, whereas the other five were not. The peak and area of ERD were significantly decreased for individuals without volitional muscle activity when they attempted to grasp compared with able-bodied subjects and participants with SCI,with some residual EMG activity. However, no significant differences were found between subject groups during mentally simulated tasks (i.e., motor imagery) where no muscle activity or somatosensory consequences were expected. These findings suggest that individuals who are unable to produce muscle activity are capable of generating ERD when attempting to move, but the characteristics of this ERD are altered. However, for people who maintain volitional muscle activity after SCI, there are no significant differences in ERD characteristics compared with able-bodied controls. These results provide evidence that ERD is dependent on the level of intact muscle activity after SCI.NEW & NOTEWORTHY Source space MEG was used to investigate sensorimotor cortical oscillations in individuals with SCI. This study provides evidence that individuals with cervical SCI exhibit decreased ERD when they attempt to grasp if they are incapable of generating muscle activity. However, there were no significant differences in ERD between paralyzed and able-bodied participants during motor imagery. These results have important implications for the design and evaluation of new therapies, such as motor imagery and neurofeedback interventions.

The role of virtual reality in improving motor performance as revealed by EEG: a randomized clinical trial

BACKGROUND

Many studies have demonstrated the usefulness of repetitive task practice by using robotic-assisted gait training (RAGT) devices, including Lokomat, for the treatment of lower limb paresis. Virtual reality (VR) has proved to be a valuable tool to improve neurorehabilitation training. The aim of our pilot randomized clinical trial was to understand the neurophysiological basis of motor function recovery induced by the association between RAGT (by using Lokomat device) and VR (an animated avatar in a 2D VR) by studying electroencephalographic (EEG) oscillations.

METHODS

Twenty-four patients suffering from a first unilateral ischemic stroke in the chronic phase were randomized into two groups. One group performed 40 sessions of Lokomat with VR (RAGT + VR), whereas the other group underwent Lokomat without VR (RAGT-VR). The outcomes (clinical, kinematic, and EEG) were measured before and after the robotic intervention.

RESULTS

As compared to the RAGT-VR group, all the patients of the RAGT + VR group improved in the Rivermead Mobility Index and Tinetti Performance Oriented Mobility Assessment. Moreover, they showed stronger event-related spectral perturbations in the high-γ and β bands and larger fronto-central cortical activations in the affected hemisphere.

CONCLUSIONS

The robotic-based rehabilitation combined with VR in patients with chronic hemiparesis induced an improvement in gait and balance. EEG data suggest that the use of VR may entrain several brain areas (probably encompassing the mirror neuron system) involved in motor planning and learning, thus leading to an enhanced motor performance.

TRIAL REGISTRATION

Retrospectively registered in Clinical Trials on 21-11-2016, n. NCT02971371 .

The Contribution of Different Cortical Regions to the Control of Spatially Decoupled Eye-Hand Coordination

Our brain's ability to flexibly control the communication between the eyes and the hand allows for our successful interaction with the objects located within our environment. This flexibility has been observed in the pattern of neural responses within key regions of the frontoparietal reach network. More specifically, our group has shown how single-unit and oscillatory activity within the dorsal premotor cortex (PMd) and the superior parietal lobule (SPL) change contingent on the level of visuomotor compatibility between the eyes and hand. Reaches that involve a coupling between the eyes and hand toward a common spatial target display a pattern of neural responses that differ from reaches that require eye-hand decoupling. Although previous work examined the altered spiking and oscillatory activity that occurs during different types of eye-hand compatibilities, they did not address how each of these measures of neurological activity interacts with one another. Thus, in an effort to fully characterize the relationship between oscillatory and single-unit activity during different types of eye-hand coordination, we measured the spike-field coherence (SFC) within regions of macaque SPL and PMd. We observed stronger SFC within PMdr and superficial regions of SPL (areas 5/PEc) during decoupled reaches, whereas PMdc and regions within SPL surrounding medial intrapareital sulcus had stronger SFC during coupled reaches. These results were supported by meta-analysis on human fMRI data. Our results support the proposal of altered cortical control during complex eye-hand coordination and highlight the necessity to account for the different eye-hand compatibilities in motor control research.

Decoding Movement Goals from the Fronto-Parietal Reach Network

During reach planning, fronto-parietal brain areas need to transform sensory information into a motor code. It is debated whether these areas maintain a sensory representation of the visual cue or a motor representation of the upcoming movement goal. Here, we present results from a delayed pro-/anti-reach task which allowed for dissociating the position of the visual cue from the reach goal. In this task, the visual cue was combined with a context rule (pro vs. anti) to infer the movement goal. Different levels of movement goal specification during the delay were obtained by presenting the context rule either before the delay together with the visual cue (specified movement goal) or after the delay (underspecified movement goal). By applying functional magnetic resonance imaging (fMRI) multivoxel pattern analysis (MVPA), we demonstrate movement goal encoding in the left dorsal premotor cortex (PMd) and bilateral superior parietal lobule (SPL) when the reach goal is specified. This suggests that fronto-parietal reach regions (PRRs) maintain a prospective motor code during reach planning. When the reach goal is underspecified, only area PMd but not SPL represents the visual cue position indicating an incomplete state of sensorimotor integration. Moreover, this result suggests a potential role of PMd in movement goal selection.

Sex-specific effects of posture on the attribution of handedness to an imagined agent

In a series of previous studies, we found that when participants were required to imagine another person performing a manual action, they imagined a significantly higher proportion of actions performed with their dominant rather than non-dominant hand, which indicates that shared motor representations between the self and the other are involved also during the imagination of others' actions. Interestingly, the activation of lateralized body-specific motor representations (as indexed by the congruence between the participant's handedness and the imagined person's handedness) appeared to be affected by the visual perspective adopted and participants' handedness. Given that past literature indicates that incongruent or unnatural postures interfere with motor imagery, we tested 480 right-handed participants to investigate whether subjects holding their right hand behind their back would have imagined right-handed actions less frequently than those holding their left hand behind their back. Moreover, we examined the effects of participant's sex, action category (simple or complex) and hand shape (open or fist). Contrary to our prediction, female participants holding their right hand behind their back imagined right-handed actions more frequently than those holding their left hand behind their back, whereas no significant effect was observed in male participants. We propose that the muscle contraction needed to keep a hand behind the back could activate the motor representations of that hand so as to increase the likelihood of imagining an action performed with the corresponding hand. Moreover, the sex difference observed is consistent with the greater use of embodied strategies by females than by males.

Neural Correlates of Sexual Orientation in Heterosexual, Bisexual, and Homosexual Men

Studies of subjective and genital sexual arousal in monosexual (i.e. heterosexual and homosexual) men have repeatedly found that erotic stimuli depicting men’s preferred sex produce strong responses, whereas erotic stimuli depicting the other sex produce much weaker responses. Inconsistent results have previously been obtained in bisexual men, who have sometimes demonstrated distinctly bisexual responses, but other times demonstrated patterns more similar to those observed in monosexual men. We used fMRI to investigate neural correlates of responses to erotic pictures and videos in heterosexual, bisexual, and homosexual men, ages 25–50. Sixty participants were included in video analyses, and 62 were included in picture analyses. We focused on the ventral striatum (VS), due to its association with incentive motivation. Patterns were consistent with sexual orientation, with heterosexual and homosexual men showing female-favoring and male-favoring responses, respectively. Bisexual men tended to show less differentiation between male and female stimuli. Consistent patterns were observed in the whole brain, including the VS, and also in additional regions such as occipitotemporal, anterior cingulate, and orbitofrontal cortices. This study extends previous findings of gender-specific neural responses in monosexual men, and provides initial evidence for distinct brain activity patterns in bisexual men.