No need to integrate action information during coarse semantic processing of man-made tools

Action representation of man-made tools consists of two subtypes: structural action representation concerning how to grasp an object, and functional action representation concerning the skilled use of an object. Compared to structural action representation, functional action representation plays the dominant role in fine-grained (i.e., basic level) object recognition. However, it remains unclear whether the two types of action representation are involved differently in the coarse semantic processing in which the object is recognized at a superordinate level (i.e., living/non-living). Here we conducted three experiments using the priming paradigm, in which video clips displaying structural and functional action hand gestures were used as prime stimuli and grayscale photos of man-made tools were used as target stimuli. Participants recognized the target objects at the basic level in Experiment 1 (i.e., naming task) and at the superordinate level in Experiments 2 and 3 (i.e., categorization task). We observed a significant priming effect for functional action prime-target pairs only in the naming task. In contrast, no priming effect was found in either the naming or the categorization task for the structural action prime-target pairs (Experiment 2), even when the categorization task was preceded by a preliminary action imitation of the prime gestures (Experiment 3). Our results suggest that only functional action information is retrieved during fine-grained object processing. In contrast, coarse semantic processing does not require the integration of either structural or functional action information.

An active inference model of hierarchical action understanding, learning and imitation

We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.

Action representations in prevention behavior: Evidence from motor execution

Human actions sometimes aim at preventing an event from occurring. How these to-be-prevented events are represented, however, is poorly understood. Recent proposals in the literature point to a possible divide between effect-producing, operant actions, and effect-precluding, prevention actions, suggesting that the control of operant actions relies on codes of environment-related effects whereas prevention actions do not. Here we report two experiments on this issue, showing that spatial features (Experiment 1) as well as temporal features (Experiment 2) of to-be-prevented events influence actions in the same way as corresponding features of to-be-produced effects. This implies that selecting and executing prevention actions relies on anticipated environmental changes, comparable to operant actions.

Dissociation between dreams and wakefulness: Insights from body and action representations of rare individuals with massive somatosensory deafferentation

The realism of body and actions in dreams is thought to be induced by simulations based on internal representations used during wakefulness. As somatosensory signals contribute to the updating of body and action representations, these are impaired when somatosensory signals are lacking. Here, we tested the hypothesis that individuals with somatosensory deafferentation have impaired body and actions in their dreams, as in wakefulness. We questioned three individuals with a severe, acquired sensory neuropathy on their dreams. While deafferented participants were impaired in daily life, they could dream of themselves as able-bodied, with some sensations (touch, proprioception) and actions (such as running or jumping) which had not been experienced in physical life since deafferentation. We speculate that simulation in dreams could be based on former, "healthy" body and action representations. Our findings are consistent with the idea that distinct body and action representations may be used during dreams and wakefulness.

Representational Processes of Actions Toward and Away from the Body

The aim of the present study was to investigate the role of mental representation processes during the planning, reaching, and use phases of actions with tools commonly used toward the body (TB, e.g., toothbrush) or away from the body (AB, e.g., pencil). In the first session, healthy participants were asked to perform TB (i.e., making circular movements with the toothbrush near the mouth) and AB (i.e., making circular movements with the pencil near the desk) actions both with (i.e., actual use) and without the tool in hand (i.e., the pantomime of tool use). In the second session, the same participants performed a series of mental rotation tasks involving body- (i.e., face and hands) and object-related (i.e., abstract lines) stimuli. The temporal and kinematic analysis of the motor actions showed that the time required to start the pantomimes (i.e., the planning phase) was shorter for the AB action than for the TB action. In contrast, the reaching phase lasted longer for the AB action than for the TB action. Furthermore, the TB pantomime was associated with the performance in the mental rotation of body-related stimuli, especially during the planning and reaching phases, whereas the AB pantomime was more related to the performance in the mental rotation of object-related stimuli, especially during the tool use phase. Thus, the results revealed that the direction of a goal-directed motor action influences the dynamics of the different phases of the motor action and can determine the type of mental images involved in the planning and execution of the action.

How vertical elevation affects self-other integration as measured by the joint Simon effect

Earlier findings suggest that positions of power decrease self-other integration and increase psychological distance to others. Until now, however, evidence for this relation rests exclusively on subjective measures. The current research instead employed a vertical joint Simon task to measure self-other integration. This task assesses the extent to which people represent their own actions in reference to their co-actor's, also referred to as the joint Simon effect. Building on cultural associations between power and vertical elevation, we manipulated whether participants were in an elevated (high-power) or lower (low-power) seating position. Experiments 1a and 1b reanalyzed existing datasets and found that elevated (vs. lower) seating position decreased the joint Simon effect, consistent with predictions. Experiment 2 provides a high-powered replication of this finding. Yet, further analyses revealed that feelings of power - measured as a manipulation check and indeed demonstrating that the manipulation was successful - did not mediate or moderate the effect of seating position on the joint Simon effect. Therefore, it is possible that the effect of seating elevation was driven through other aspects of that manipulation than feelings of power. We discuss these and suggest ways to test these alternative explanations.

Inferior parietal lobule involved in representation of "what" in a delayed-action Libet task

Intentional motor action is typically characterized by the decision about the timing, and the selection of the action variant, known as the "what" component. We compared free action selection with instructed action, where the movement type was externally cued, in order to investigate the action selection and action representation in a Libet's task. Temporal and spatial locus of these processes was examined using the combination of high-density electroencephalography, topographic analysis of variance, and source reconstruction. Instructed action, engaging representation of the response movement, was associated with distinct negativity at the parietal and centro-parietal channels starting around 750 ms before the movement, which has a source particularly in the bilateral inferior parietal lobule. This suggests that in delayed-action tasks, the process of action representation in the inferior parietal lobule may play an important part in the larger parieto-frontal activity responsible for movement selection.

Structuralist mental representation of dual-action demands: Evidence for compositional coding from dual tasks with low cross-task dimensional overlap

The present study asks how behavioral (dual-action) demands in dual tasks are mentally represented and whether changes in representation might govern practice-related dual-task performance improvements. Three different representation accounts were empirically tested based on the idea that dual-action demands required in a dual-task trial might be represented in different ways. According to a compositional (Structuralist) account, component tasks remain structurally intact when combined with another task. In contrast, a holistic (Gestalt) account posits that dual-action requirements in dual tasks are represented holistically and entirely distinct from its component action requirements. Finally, a contextual change account assumes that a change in context (e.g., from single- to dual-action requirement) generally impedes response retrieval, similar to repeating a response while the task context switches. To address this issue, we analyzed trial-by-trial effects in a single/dual switch paradigm (SDS paradigm, involving a randomized mix of single- and dual-task trials within blocks). Specifically, we analyzed performance in an extensive dual-task training setting (involving training sessions across several days) combining an auditory-vocal task and a visual-manual task. The results indicated that, throughout practice, nearly all relevant comparisons of performance between complete switch trials (e.g., between the two single tasks) and partial repetition trials (e.g., from dual to single task) revealed partial repetition benefits, that is, for both the auditory-vocal and the visual-manual task, and for both single- and dual-task performance analyses. Therefore, dual-action requirements in the present dual-task setting are mentally represented in a compositional, Structuralist fashion, probably due to low between-task dimensional overlap.

To prevent means to know: Explicit but no implicit agency for prevention behavior

Human agents draw on a variety of explicit and implicit cues to construct a sense of agency for their actions and the effects of these actions on the outside world. Associative mechanisms binding actions to their immediate effects support the evolution of agency for operant actions. However, human agents often also act to prevent a certain event from occurring. Such prevention behavior poses a critical challenge for the sense of agency, as successful prevention inherently revolves around the absence of a perceivable effect. By assessing the psychological microstructure of singular operant and prevention actions we show that this comes with profound consequences: agency for prevention actions is only evident in explicit measures but not in corresponding implicit proxies. These findings attest to an altered action representation in prevention behavior and they support recent proposals to model related processes such as avoidance learning in terms of propositional rather than associative terms.

Dance and Parkinson's: A review and exploration of the role of cognitive representations of action

Parkinson's disease (PD) is a neurodegenerative condition that causes both sensorimotor and non-motor impairments, and there is a clear need for non-medical approaches to improve quality of life. Dance is an increasingly popular activity among people with PD, which demonstrates potential therapeutic benefits. However, findings to date have been inconsistent, and little is known about the mechanisms underlying benefits of dance in PD. In this review, we provide an overview of research into dance for people with PD. The majority of quantitative evidence is in the sensorimotor domain, but cognitive, psychological and social effects have also been reported. We consider the role of cognitive representations of action within dance through observation, imitation and imagery, which may contribute to both sensorimotor and non-motor outcomes for people with PD. Moreover, we discuss how these processes may be enhanced through dance to provide further benefits in everyday life. Finally, we propose avenues for future research to increase understanding of action representation in dance for PD, which has the potential to inform practice and maximize benefits.

Chimpanzees use observed temporal directionality to learn novel causal relations

We investigated whether chimpanzees use the temporal sequence of external events to determine causation. Seventeen chimpanzees (Pan troglodytes) witnessed a human experimenter press a button in two different conditions. When she pressed the "causal button" the delivery of juice and a sound immediately followed (cause-then-effect). In contrast, she pressed the "non-causal button" only after the delivery of juice and sound (effect-then-cause). When given the opportunity to produce the desired juice delivery themselves, the chimpanzees preferentially pressed the causal button, i.e., the one that preceded the effect. Importantly, they did so in their first test trial and even though both buttons were equally associated with juice delivery. This outcome suggests that chimpanzees, like human children, do not rely solely on their own actions to make use of novel causal relations, but they can learn causal sequences based on observation alone. We discuss these findings in relation to the literature on causal inferences as well as associative learning.

Fleeing or not: Responsivity of a chased target influences the cognitive representation of the chasing action

The chasing action, in which an actor chases a target, is a fundamental activity for the evolutionary shaping of social abilities. Where previous research has emphasized the chaser's role, the current study explored whether the fleeing responsivity of a chased target influences the cognitive representation of the chasing action. We investigated this with a change-detection task, in which a set of chasing actions, either exhibiting or not exhibiting fleeing behavior, were memorized in sequence, and it was tested whether a memorized action reappeared after altering an object's appearance. The results suggest that the target's fleeing responsivity influenced the detection of representation-related changes in the appearance of the involved agents, especially when the appearance of one target was replaced with another (i.e., a new pair, but with the same functional role), showing impaired sensitivity to change for the chasing action (Experiment 1). This effect disappeared, however, when the perceived chasing from presented movements was impaired, while displaying largely the same low-level differences as those present in earlier trials through the use of mirrored chasing (Experiment 2) and setting the faced direction opposite of the moving direction (Experiment 3). These findings suggest that the fleeing responsivity of the chased target can influence the stored representation of the action. This differentiation may be attributed to the stronger construction of social interaction structure for chasing action with fleeing than without, since the fleeing behavior can be deemed a contingency cue for social interaction interpretation.

Sex-specific effects of posture on the attribution of handedness to an imagined agent

In a series of previous studies, we found that when participants were required to imagine another person performing a manual action, they imagined a significantly higher proportion of actions performed with their dominant rather than non-dominant hand, which indicates that shared motor representations between the self and the other are involved also during the imagination of others' actions. Interestingly, the activation of lateralized body-specific motor representations (as indexed by the congruence between the participant's handedness and the imagined person's handedness) appeared to be affected by the visual perspective adopted and participants' handedness. Given that past literature indicates that incongruent or unnatural postures interfere with motor imagery, we tested 480 right-handed participants to investigate whether subjects holding their right hand behind their back would have imagined right-handed actions less frequently than those holding their left hand behind their back. Moreover, we examined the effects of participant's sex, action category (simple or complex) and hand shape (open or fist). Contrary to our prediction, female participants holding their right hand behind their back imagined right-handed actions more frequently than those holding their left hand behind their back, whereas no significant effect was observed in male participants. We propose that the muscle contraction needed to keep a hand behind the back could activate the motor representations of that hand so as to increase the likelihood of imagining an action performed with the corresponding hand. Moreover, the sex difference observed is consistent with the greater use of embodied strategies by females than by males.

Intact action segmentation in Parkinson's disease: Hypothesis testing using a novel computational approach

Action observation is known to trigger predictions of the ongoing course of action and thus considered a hallmark example for predictive perception. A related task, which explicitly taps into the ability to predict actions based on their internal representations, is action segmentation; the task requires participants to demarcate where one action step is completed and another one begins. It thus benefits from a temporally precise prediction of the current action. Formation and exploitation of these temporal predictions of external events is now closely associated with a network including the basal ganglia and prefrontal cortex. Because decline of dopaminergic innervation leads to impaired function of the basal ganglia and prefrontal cortex in Parkinson's disease (PD), we hypothesised that PD patients would show increased temporal variability in the action segmentation task, especially under medication withdrawal (hypothesis 1). Another crucial aspect of action segmentation is its reliance on a semantic representation of actions. There is no evidence to suggest that action representations are substantially altered, or cannot be accessed, in non-demented PD patients. We therefore expected action segmentation judgments to follow the same overall patterns in PD patients and healthy controls (hypothesis 2), resulting in comparable segmentation profiles. Both hypotheses were tested with a novel classification approach. We present evidence for both hypotheses in the present study: classifier performance was slightly decreased when it was tested for its ability to predict the identity of movies segmented by PD patients, and a measure of normativity of response behaviour was decreased when patients segmented movies under medication-withdrawal without access to an episodic memory of the sequence. This pattern of results is consistent with hypothesis 1. However, the classifier analysis also revealed that responses given by patients and controls create very similar action-specific patterns, thus delivering evidence in favour hypothesis 2. In terms of methodology, the use of classifiers in the present study allowed us to establish similarity of behaviour across groups (hypothesis 2). The approach opens up a new avenue that standard statistical methods often fail to provide and is discussed in terms of its merits to measure hypothesised similarities across study populations.

Reduced motor imagery efficiency is associated with online control difficulties in children with probable developmental coordination disorder

Recent evidence indicates that the ability to correct reaching movements in response to unexpected target changes (i.e., online control) is reduced in children with developmental coordination disorder (DCD). Recent computational modeling of human reaching suggests that these inefficiencies may result from difficulties generating and/or monitoring internal representations of movement. This study was the first to test this putative relationship empirically. We did so by investigating the degree to which the capacity to correct reaching mid-flight could be predicted by motor imagery (MI) proficiency in a sample of children with probable DCD (pDCD). Thirty-four children aged 8 to 12 years (17 children with pDCD and 17 age-matched controls) completed the hand rotation task, a well-validated measure of MI, and a double-step reaching task (DSRT), a protocol commonly adopted to infer one's capacity for correcting reaching online. As per previous research, children with pDCD demonstrated inefficiencies in their ability to generate internal action representations and correct their reaching online, demonstrated by inefficient hand rotation performance and slower correction to the reach trajectory following unexpected target perturbation during the DSRT compared to age-matched controls. Critically, hierarchical moderating regression demonstrated that even after general reaching ability was controlled for, MI efficiency was a significant predictor of reaching correction efficiency, a relationship that was constant across groups. Ours is the first study to provide direct pilot evidence in support of the view that a decreased capacity for online control of reaching typical of DCD may be associated with inefficiencies generating and/or using internal representations of action.

Developmental improvements in reaching correction efficiency are associated with an increased ability to represent action mentally

We investigated the purported association between developmental changes in the efficiency of online reaching corrections and improved action representation. Younger children (6-7 years), older children (8-12 years), adolescents (13-17 years), and young adults (18-24 years) completed a double-step reaching paradigm and a motor imagery task. Results showed similar nonlinear performance improvements across both tasks, typified by substantial changes in efficiency after 6 or 7 years followed by incremental improvements. Regression showed that imagery ability significantly predicted reaching efficiency and that this association stayed constant across age. Findings provide the first empirical evidence that more efficient online control through development is predicted, partly, by improved action representation.

Motor imagery is less efficient in adults with probable developmental coordination disorder: evidence from the hand rotation task

The present study aimed to provide preliminary insight into the integrity of motor imagery (MI) in adults with probable developmental coordination disorder (pDCD). Based on a strong body of evidence indicating that paediatric samples of DCD often experience difficulties engaging MI, we hypothesised that young adults with pDCD would demonstrate similar difficulties. The performance of 12 young adults (19-35 years) with pDCD was compared to 47 age-matched controls on a traditional mental hand rotation task. Mean inverse efficiency scores were generated for each participant by dividing each participant's mean RT by their proportion of correct responses at each of the stimuli presentation conditions. Preliminary analysis revealed that the performance profiles of individuals with pDCD and age-matched controls showed evidence of being constrained by the biomechanical and postural constraints of real movement, suggesting that both groups engaged in an embodied (MI) strategy to complete the task. Despite engaging in a MI strategy, however, young adults with pDCD were nonetheless significantly less efficient when doing so, shown by significant main effects for group on all group efficiency comparisons. Based on the assumption that MI provides insight into the internal 'neural' action representation that precedes action, we argue that the less efficient MI performance demonstrated by young adults with pDCD may indicate inefficiencies engaging or implementing internal action representations. Implications and directions for future research are discussed.

Action representation: crosstalk between semantics and pragmatics

Marc Jeannerod pioneered a representational approach to movement and action. In his approach, motor representations provide both, declarative knowledge about action and procedural knowledge for action (action semantics and action pragmatics, respectively). Recent evidence from language comprehension and action simulation supports the claim that action pragmatics and action semantics draw on common representational resources, thus challenging the traditional divide between declarative and procedural action knowledge. To account for these observations, three kinds of theoretical frameworks are discussed: (i) semantics is grounded in pragmatics, (ii) pragmatics is anchored in semantics, and (iii) pragmatics is part and parcel of semantics.