The multiform motor cortical output: Kinematic, predictive and response coding

When Corticospinal Inhibition Favors an Efficient Motor Response

Many daily activities involve responding to the actions of other people. However, the functional relationship between the motor preparation and execution phases still needs to be clarified. With the combination of different and complementary experimental techniques (i.e., motor excitability measures, reaction times, electromyography, and dyadic 3-D kinematics), we investigated the behavioral and neurophysiological signatures characterizing different stages of a motor response in contexts calling for an interactive action. Participants were requested to perform an action (i.e., stirring coffee or lifting a coffee cup) following a co-experimenter's request gesture. Another condition, in which a non-interactive gesture was used, was also included. Greater corticospinal inhibition was found when participants prepared their motor response after observing an interactive request, compared to a non-interactive gesture. This, in turn, was associated with faster and more efficient action execution in kinematic terms (i.e., a social motor priming effect). Our results provide new insights on the inhibitory and facilitatory drives guiding social motor response generation. Altogether, the integration of behavioral and neurophysiological indexes allowed us to demonstrate that a more efficient action execution followed a greater corticospinal inhibition. These indexes provide a full picture of motor activity at both planning and execution stages.

Evidence of motor resonance in stroke patients with severe upper limb function impairments

For the past fifteen years, observation of actions has proved to be effective in the motor rehabilitation of stroke. Despite this, no evidence has ever been provided that this practice is able to activate the efferent motor system of a limb unable to perform the observed action due to stroke. In fact, transcranial magnetic stimulation cannot easily be used in these patients, and the fMRI evidence is inconclusive. This creates a logical problem, as the effectiveness of action observation in functional recovery is attributed to its ability to evoke action simulation, up to sub-threshold muscle activation (i.e., motor resonance), in healthy individuals. To provide the necessary proof-of-concept, patients with severe upper limb function impairments and matched control participants were submitted to a verified action prediction paradigm. They were asked to watch videos showing gripping movements towards a graspable or an ungraspable object, and to press a button the instant the agent touched the object. The presence of more accurate responses for the graspable object trials is considered an indirect evidence of motor resonance. Participants were required to perform the task in two sessions which differed in the hand used to respond. Despite the serious difficulty of movement, 8 out of 18 patients were able to perform the task with their impaired hand. We found that the responses given by the paretic hand showed a modulation of the action prediction time no different from that showed by the non-paretic hand, which, in turn, did not differ from that showed by the matched control participants. The present proof-of-concept study shows that action observation involves the efferent motor system even when the hand used to respond is unable to perform the observed action due to a cortical lesion, providing the missing evidence to support the already established use of Action Observation Training (AOT) in motor rehabilitation of stroke.

Action Intentions, Predictive Processing, and Mind Reading: Turning Goalkeepers Into Penalty Killers

The key to action control is one’s ability to adequately predict the consequences of one’s actions. Predictive processing theories assume that forward models enable rapid “preplay” to assess the match between predicted and intended action effects. Here we propose the novel hypothesis that “reading” another’s action intentions requires a rich forward model of that agent’s action. Such a forward model can be obtained and enriched through learning by either practice or simulation. Based on this notion, we ran a series of studies on soccer goalkeepers and novices, who predicted the intended direction of penalties being kicked at them in a computerized penalty-reading task. In line with hypotheses, extensive practice in penalty kicking improved performance in penalty reading among goalkeepers who had extensive prior experience in penalty blocking but not in penalty kicking. A robust benefit in penalty reading did not result from practice in kinesthetic motor imagery of penalty kicking in novice participants. To test whether goalkeepers actually use such penalty-kicking imagery in penalty reading, we trained a machine-learning classifier on multivariate fMRI activity patterns to distinguish motor-imagery-related from attention-related strategies during a penalty-imagery training task. We then applied that classifier to fMRI data related to a separate penalty-reading task and showed that 2/3 of all correctly read penalty kicks were classified as engaging the motor-imagery circuit rather than merely the attention circuit. This study provides initial evidence that, in order to read our opponent’s action intention, it helps to observe their action kinematics, and use our own forward model to predict the sensory consequences of “our” penalty kick if we were to produce these action kinematics ourselves. In sum, it takes practice as a penalty kicker to become a penalty killer.

Contextual Priors Guide Perception and Motor Responses to Observed Actions

In everyday-life scenarios, prior expectations provided by the context in which actions are embedded support action prediction. However, it is still unclear how newly learned action-context associations can drive our perception and motor responses. To fill this gap, we measured behavioral (Experiment 1) and motor responses (Experiment 2) during two tasks requiring the prediction of occluded actions or geometrical shapes. Each task consisted of an implicit probabilistic learning and a test phase. During learning, we exposed participants to videos showing specific associations between a contextual cue and a particular action or shape. During the test phase, videos were earlier occluded to reduce the amount of sensorial information and induce participants to use the implicitly learned action/shape-context associations for disambiguation. Results showed that reliable contextual cues made participants more accurate in identifying the unfolding action or shape. Importantly, motor responses were modulated by contextual probability during action, but not shape prediction. Particularly, in conditions of perceptual uncertainty the motor system coded for the most probable action based on contextual informativeness, regardless of action kinematics. These findings suggest that contextual priors can shape motor responses to action observation beyond mere kinematics mapping.

Motor Recruitment during Action Observation: Effect of Interindividual Differences in Action Strategy

Visual processing of other’s actions is supported by sensorimotor brain activations. Access to sensorimotor representations may, in principle, provide the top-down signal required to bias search and selection of critical visual features. For this to happen, it is necessary that a stable one-to-one mapping exists between observed kinematics and underlying motor commands. However, due to the inherent redundancy of the human musculoskeletal system, this is hardly the case for multijoint actions where everyone has his own moving style (individual motor signature—IMS). Here, we investigated the influence of subject’s IMS on subjects’ motor excitability during the observation of an actor achieving the same goal by adopting two different IMSs. Despite a clear dissociation in kinematic and electromyographic patterns between the two actions, we found no group-level modulation of corticospinal excitability (CSE) in observers. Rather, we found a negative relationship between CSE and actor-observer IMS distance, already at the single-subject level. Thus, sensorimotor activity during action observation does not slavishly replicate the motor plan implemented by the actor, but rather reflects the distance between what is canonical according to one’s own motor template and the observed movements performed by other individuals.

Social Motor Priming: when offline interference facilitates motor execution

Many daily activities involve synchronizing with other people's actions. Previous literature has revealed that a slowdown of performance occurs whenever the action to be carried out is different to the one observed (i.e., visuomotor interference). However, action execution can be facilitated by observing a different action if it calls for an interactive gesture (i.e., social motor priming). The aim of this study is to investigate the costs and benefits of spontaneously processing a social response and then executing the same or a different action. Participants performed two different types of grips, which could be either congruent or not with the socially appropriate response and with the observed action. In particular, participants performed a precision grip (PG; thumb-index fingers opposition) or a whole-hand grasp (WHG; fingers-palm opposition) after observing videos showing an actor performing a PG and addressing them (interactive condition) or not (non-interactive condition). Crucially, in the interactive condition, the most appropriate response was a WHG, but in 50 percent of trials participants were asked to perform a PG. This procedure allowed us to measure both the facilitator effect of performing an action appropriate to the social context (WHG)-but different with respect to the observed one (PG)-and the cost of inhibiting it. These effects were measured by means of 3-D kinematical analysis of movement. Results show that, in terms of reaction time and movement time, the interactive request facilitated (i.e., speeded) the socially appropriate action (WHG), whereas interfered with (i.e., delayed) a different action (PG), although observed actions were always PGs. This interference also manifested with an increase of maximum grip aperture, which seemingly reflects the concurrent representation of the socially appropriate response. Overall, these findings extend previous research by revealing that physically incongruent action representations can be integrated into a single action plan even during an offline task and without any training.

Uncertainty in contextual and kinematic cues jointly modulates motor resonance in primary motor cortex

Contextual information accompanying others' actions modulates "motor resonance", i.e., neural activity within motor areas that is elicited by movement observation. One possibility is that we weigh and combine such information in a Bayesian manner according to their relative uncertainty. Therefore, contextual information becomes particularly useful when others' actions are difficult to discriminate. It is unclear, however, whether this uncertainty modulates the neural activity in primary motor cortex (M1) during movement observation. Here, we applied single-pulse transcranial magnetic stimulation (TMS) while subjects watched different grasping actions. We operationalized motor resonance as grip-specific modulation of corticomotor excitability measured in the index (FDI) versus the little finger abductor (ADM). We experimentally modulated either the availability of kinematic information ( experiment 1) or the reliability of contextual cues ( experiment 2). Our results indicate that even in the absence of movement kinematics, reliable contextual information is enough to trigger significant muscle-specific corticomotor excitability changes in M1, which are strongest when both kinematics and contextual information are available. These findings suggest that bottom-up mechanisms that activate motor representations as a function of the observed kinematics and top-down mechanisms that activate motor representations associated with arbitrary cues converge in M1. NEW & NOTEWORTHY Our study reveals new neurophysiological insights in support of the Bayesian account of action observation by showing that "motor resonance", i.e., neural activity evoked by observing others' actions, incorporates the uncertainty related to both contextual (prior beliefs) and kinematic (sensory evidence) cues. Notably, we show that muscle-specific modulation of M1 is strongest when context and movement kinematics are available, and it can be elicited even in the absence of movement kinematics.

Early modulation of intra-cortical inhibition during the observation of action mistakes

Errors while performing an action are fundamental for learning. During interaction others' errors must be monitored and taken into account to allow joint action coordination and imitation learning. This monitoring relies on an action observation network (AON) mainly based on parietofrontal recurrent circuits. Although different studies suggest that inappropriate actions may rapidly be inhibited during execution, little is known about the modulation of the AON when an action misstep is shown. Here we used single and paired pulse transcranial magnetic stimulation to assess corticospinal excitability, intracortical facilitation and intracortical inhibition at different time intervals (120, 180, 240 ms) after the visual presentation of a motor execution error. Results show a specific and early (120 ms) decrease of intracortical inhibition likely because of a significant mismatch between the observed erroneous action and observer's expectations. Indeed, as proposed by the top-down predictive framework, the motor system may be involved in the generation of these error signals and our data show that this mechanism could rely on the early decrease of intracortical inhibition within the corticomotor system.

Facial expressions as a model to test the role of the sensorimotor system in the visual perception of the actions

A long-term debate concerns whether the sensorimotor coding carried out during transitive actions observation reflects the low-level movement implementation details or the movement goals. On the contrary, phonemes and emotional facial expressions are intransitive actions that do not fall into this debate. The investigation of phonemes discrimination has proven to be a good model to demonstrate that the sensorimotor system plays a role in understanding actions acoustically presented. In the present study, we adapted the experimental paradigms already used in phonemes discrimination during face posture manipulation, to the discrimination of emotional facial expressions. We submitted participants to a lower or to an upper face posture manipulation during the execution of a four alternative labelling task of pictures randomly taken from four morphed continua between two emotional facial expressions. The results showed that the implementation of low-level movement details influence the discrimination of ambiguous facial expressions differing for a specific involvement of those movement details. These findings indicate that facial expressions discrimination is a good model to test the role of the sensorimotor system in the perception of actions visually presented.

Action observation effects reflect the modular organization of the human motor system

Action observation, similarly to action execution, facilitates the observer's motor system and Transcranial Magnetic Stimulation (TMS) has been instrumental in exploring the nature of these motor activities. However, contradictory findings question some of the fundamental assumptions regarding the neural computations run by the Action Observation Network (AON). To better understand this issue, we delivered TMS over the observers' motor cortex at two timings of two reaching-grasping actions (precision vs power grip) and we recorded Motor-Evoked Potentials (4 hand/arm muscles; MEPs). At the same time, we also recorded whole-hand TMS Evoked Kinematics (8 hand elevation angles; MEKs) that capture the global functional motor output, as opposed to the limited view offered by recording few muscles. By repeating the same protocol twice, and a third time after continuous theta burst stimulation (cTBS) over the motor cortex, we observe significant time-dependent grip-specific MEPs and MEKs modulations, that disappeared after cTBS. MEKs, differently from MEPs, exhibit a consistent significant modulation across pre-cTBS sessions. Beside clear methodological implications, the multidimensionality of MEKs opens a window on muscle synergies needed to overcome system redundancy. By providing better access to the AON computations, our results strengthen the idea that action observation shares key organizational similarities with action execution.

The role of attention in human motor resonance

Observation of others' actions evokes in primary motor cortex and spinal circuits of observers a subliminal motor resonance response, which reflects the motor program encoding observed actions. We investigated the role of attention in human motor resonance with four experimental conditions, explored in different subject groups: in the first explicit condition, subjects were asked to observe a rhythmic hand flexion-extension movement performed live in front of them. In two other conditions subjects had to monitor the activity of a LED light mounted on the oscillating hand. The hand was clearly visible but it was not the focus of subjects' attention: in the semi-implicit condition hand movement was relevant to task completion, while in the implicit condition it was irrelevant. In a fourth, baseline, condition subjects observed the rhythmic oscillation of a metal platform. Motor resonance was measured with the H-reflex technique as the excitability modulation of cortico-spinal motorneurons driving a hand flexor muscle. As expected, a normal resonant response developed in the explicit condition, and no resonant response in the baseline condition. Resonant responses also developed in both semi-implicit and implicit conditions and, surprisingly, were not different from each other, indicating that viewing an action is, per se, a powerful stimulus for the action observation network, even when it is not the primary focus of subjects' attention and even when irrelevant to the task. However, the amplitude of these responses was much reduced compared to the explicit condition, and the phase-lock between the time courses of observed movement and resonant motor program was lost. In conclusion, different parameters of the response were differently affected by subtraction of attentional resources with respect to the explicit condition: time course and muscle selection were preserved while the activation of motor circuits resulted in much reduced amplitude and lost its kinematic specificity.

Complementary Hand Responses Occur in Both Peri- and Extrapersonal Space

Human beings have a strong tendency to imitate. Evidence from motor priming paradigms suggests that people automatically tend to imitate observed actions such as hand gestures by performing mirror-congruent movements (e.g., lifting one’s right finger upon observing a left finger movement; from a mirror perspective). Many observed actions however, do not require mirror-congruent responses but afford complementary (fitting) responses instead (e.g., handing over a cup; shaking hands). Crucially, whereas mirror-congruent responses don't require physical interaction with another person, complementary actions often do. Given that most experiments studying motor priming have used stimuli devoid of contextual information, this space or interaction-dependency of complementary responses has not yet been assessed. To address this issue, we let participants perform a task in which they had to mirror or complement a hand gesture (fist or open hand) performed by an actor depicted either within or outside of reach. In three studies, we observed faster reaction times and less response errors for complementary relative to mirrored hand movements in response to open hand gestures (i.e., ‘hand-shaking’) irrespective of the perceived interpersonal distance of the actor. This complementary effect could not be accounted for by a low-level spatial cueing effect. These results demonstrate that humans have a strong and automatic tendency to respond by performing complementary actions. In addition, our findings underline the limitations of manipulations of space in modulating effects of motor priming and the perception of affordances.

Kick with the finger: symbolic actions shape motor cortex excitability

A large body of research indicates that observing actions made by others is associated with corresponding motor facilitation of the observer's corticospinal system. However, it is still controversial whether this matching mechanism strictly reflects the kinematics of the observed action or its meaning. To test this issue, motor evoked potentials induced by single-pulse transcranial magnetic stimulation were recorded from hand and leg muscles while participants observed a symbolic action carried out with the index finger, but classically performed with the leg (i.e., a soccer penalty kick). A control condition in which participants observed a similar (but not symbolic) hand movement was also included. Results showed that motor facilitation occurs both in the observer's hand (first dorsal interosseous) and leg (quadriceps femoris) muscles. The present study provides evidence that both the kinematics and the symbolic value of an observed action are able to modulate motor cortex excitability. The human motor system is thus not only involved in mirroring observed actions but is also finely tuned to their symbolic value.

Congruent and Incongruent Corticospinal Activations at the Level of Multiple Effectors

Motor resonance is defined as the subliminal activation of the motor system while observing actions performed by others. However, resonating with another person's actions is not always an appropriate response: In real life, people do not just imitate but rather respond in a suitable fashion. A growing body of neurophysiologic studies has demonstrated that motor resonance can be overridden by complementary motor responses (such as preparing a precision grip on a small object when seeing an open hand in sign of request). In this study, we investigated the relationship between congruent and incongruent corticospinal activations at the level of multiple effectors. The modulation of motor evoked potentials evoked by single-pulse TMS over the motor cortex was assessed in upper and lower limb muscles of participants observing a soccer player performing a penalty kick straight in their direction. Study results revealed a double dissociation: Seeing the soccer player kicking the ball triggered a motor resonance in the observer's lower limb, whereas the upper limb response afforded by the object was overridden. On the other hand, seeing the ball approaching the observers elicited a complementary motor activation in upper limbs while motor resonance in lower limbs disappeared. Control conditions showing lateral kicks, mimicked kicks, and a ball in penalty area were also included to test the motor coding of object affordances. Results point to a modulation of motor responses in different limbs over the course of action and in function of their relevance in different contexts. We contend that ecologically valid paradigms are now needed to shed light on the motor system functioning in complex forms of interaction.

Complementary actions

Complementary colors are color pairs which, when combined in the right proportions, produce white or black. Complementary actions refer here to forms of social interaction wherein individuals adapt their joint actions according to a common aim. Notably, complementary actions are incongruent actions. But being incongruent is not sufficient to be complementary (i.e., to complete the action of another person). Successful complementary interactions are founded on the abilities: (i) to simulate another person's movements, (ii) to predict another person's future action/s, (iii) to produce an appropriate incongruent response which differ, while interacting, with observed ones, and (iv) to complete the social interaction by integrating the predicted effects of one's own action with those of another person. This definition clearly alludes to the functional importance of complementary actions in the perception-action cycle and prompts us to scrutinize what is taking place behind the scenes. Preliminary data on this topic have been provided by recent cutting-edge studies utilizing different research methods. This mini-review aims to provide an up-to-date overview of the processes and the specific activations underlying complementary actions.