Evidence for an effector-independent action system from people born without hands

Modal and amodal cognition: an overarching principle in various domains of psychology

Accounting for how the human mind represents the internal and external world is a crucial feature of many theories of human cognition. Central to this question is the distinction between modal as opposed to amodal representational formats. It has often been assumed that one but not both of these two types of representations underlie processing in specific domains of cognition (e.g., perception, mental imagery, and language). However, in this paper, we suggest that both formats play a major role in most cognitive domains. We believe that a comprehensive theory of cognition requires a solid understanding of these representational formats and their functional roles within and across different domains of cognition, the developmental trajectory of these representational formats, and their role in dysfunctional behavior. Here we sketch such an overarching perspective that brings together research from diverse subdisciplines of psychology on modal and amodal representational formats so as to unravel their functional principles and their interactions.

Effector-independent Representations Guide Sequential Target Selection Biases in Action

Previous work shows that automatic attention biases toward recently selected target features transfer across action and perception and even across different effectors such as the eyes and hands on a trial-by-trial basis. Although these findings suggest a common neural representation of selection history across effectors, the extent to which information about recently selected target features is encoded in overlapping versus distinct brain regions is unknown. Using fMRI and a priming of pop-out task where participants selected unpredictable, uniquely colored targets among homogeneous distractors via reach or saccade, we show that color priming is driven by shared, effector-independent underlying representations of recent selection history. Consistent with previous work, we found that the intraparietal sulcus (IPS) was commonly activated on trials where target colors were switched relative to those where the colors were repeated; however, the dorsal anterior insula exhibited effector-specific activation related to color priming. Via multivoxel cross-classification analyses, we further demonstrate that fine-grained patterns of activity in both IPS and the medial temporal lobe encode information about selection history in an effector-independent manner, such that ROI-specific models trained on activity patterns during reach selection could predict whether a color was repeated or switched on the current trial during saccade selection and vice versa. Remarkably, model generalization performance in IPS and medial temporal lobe also tracked individual differences in behavioral priming sensitivity across both types of action. These results represent a first step to clarify the neural substrates of experience-driven selection biases in contexts that require the coordination of multiple actions.

Dissociable Codes in Motor Working Memory

Working memory has been comprehensively studied in sensory domains, like vision, but little attention has been paid to how motor information (e.g., kinematics of recent movements) is maintained and manipulated in working memory. "Motor working memory" (MWM) is important for short-term behavioral control and skill learning. Here, we employed tasks that required participants to encode and recall reaching movements over short timescales. We conducted three experiments (N = 65 undergraduates) to examine MWM under varying cognitive loads, delays, and degrees of interference. The results support a model of MWM that includes an abstract code that flexibly transfers across effectors, and an effector-specific code vulnerable to interfering movements, even when interfering movements are irrelevant to the task. Neither code was disrupted by increasing visuospatial working memory load. These results echo distinctions between representational formats in other domains, suggesting that MWM shares a basic computational structure with other working memory subsystems.

Effector-selective modulation of the effective connectivity within frontoparietal circuits during visuomotor tasks

Despite extensive research, the functional architecture of the subregions of the dorsal posterior parietal cortex (PPC) involved in sensorimotor processing is far from clear. Here, we draw a thorough picture of the large-scale functional organization of the PPC to disentangle the fronto-parietal networks mediating visuomotor functions. To this aim, we reanalyzed available human functional magnetic resonance imaging data collected during the execution of saccades, hand, and foot pointing, and we combined individual surface-based activation, resting-state functional connectivity, and effective connectivity analyses. We described a functional distinction between a more lateral region in the posterior intraparietal sulcus (lpIPS), preferring saccades over pointing and coupled with the frontal eye fields (FEF) at rest, and a more medial portion (mpIPS) intrinsically correlated to the dorsal premotor cortex (PMd). Dynamic causal modeling revealed feedforward-feedback loops linking lpIPS with FEF during saccades and mpIPS with PMd during pointing, with substantial differences between hand and foot. Despite an intrinsic specialization of the action-specific fronto-parietal networks, our study reveals that their functioning is finely regulated according to the effector to be used, being the dynamic interactions within those networks differently modulated when carrying out a similar movement (i.e. pointing) but with distinct effectors (i.e. hand and foot).

Language and developmental plasticity after perinatal stroke

The mature human brain is lateralized for language, with the left hemisphere (LH) primarily responsible for sentence processing and the right hemisphere (RH) primarily responsible for processing suprasegmental aspects of language such as vocal emotion. However, it has long been hypothesized that in early life there is plasticity for language, allowing young children to acquire language in other cortical regions when LH areas are damaged. If true, what are the constraints on functional reorganization? Which areas of the brain can acquire language, and what happens to the functions these regions ordinarily perform? We address these questions by examining long-term outcomes in adolescents and young adults who, as infants, had a perinatal arterial ischemic stroke to the LH areas ordinarily subserving sentence processing. We compared them with their healthy age-matched siblings. All participants were tested on a battery of behavioral and functional imaging tasks. While stroke participants were impaired in some nonlinguistic cognitive abilities, their processing of sentences and of vocal emotion was normal and equal to that of their healthy siblings. In almost all, these abilities have both developed in the healthy RH. Our results provide insights into the remarkable ability of the young brain to reorganize language. Reorganization is highly constrained, with sentence processing almost always in the RH frontotemporal regions homotopic to their location in the healthy brain. This activation is somewhat segregated from RH emotion processing, suggesting that the two functions perform best when each has its own neural territory.

Are reaching and grasping effector-independent? Similarities and differences in reaching and grasping kinematics between the hand and foot

While reaching and grasping are highly prevalent manual actions, neuroimaging studies provide evidence that their neural representations may be shared between different body parts, i.e., effectors. If these actions are guided by effector-independent mechanisms, similar kinematics should be observed when the action is performed by the hand or by a cortically remote and less experienced effector, such as the foot. We tested this hypothesis with two characteristic components of action: the initial ballistic stage of reaching, and the preshaping of the digits during grasping based on object size. We examined if these kinematic features reflect effector-independent mechanisms by asking participants to reach toward and to grasp objects of different widths with their hand and foot. First, during both reaching and grasping, the velocity profile up to peak velocity matched between the hand and the foot, indicating a shared ballistic acceleration phase. Second, maximum grip aperture and time of maximum grip aperture of grasping increased with object size for both effectors, indicating encoding of object size during transport. Differences between the hand and foot were found in the deceleration phase and time of maximum grip aperture, likely due to biomechanical differences and the participants’ inexperience with foot actions. These findings provide evidence for effector-independent visuomotor mechanisms of reaching and grasping that generalize across body parts.

Anterograde interference emerges along a gradient as a function of task similarity: A behavioural study

Anterograde interference emerges when two opposite (B → A) or identical tasks (A → A) are learned in close temporal succession, suggesting that interference cannot be fully accounted for by competing memories. Informed by neurobiological evidence, this work tested the hypothesis that interference depends upon the degree of overlap between the neural networks involved in the learning of two tasks. In a fully within‐subject and counterbalanced design, participants (n = 24) took part in two learning sessions where the putative overlap between learning‐specific neural networks was behaviourally manipulated across four conditions by modifying reach direction and the effector used during gradual visuomotor adaptation. The results showed that anterograde interference emerged regardless of memory competition—that is, to a similar extent in the B → A and A → A conditions—and along a gradient as a function of the tasks' similarity. Specifically, learning under similar reaching conditions generated more anterograde interference than learning under dissimilar reaching conditions, suggesting that putatively overlapping neural networks are required to generate interference. Overall, these results indicate that competing memories are not the sole contributor to anterograde interference and suggest that overlapping neural networks between two learning sessions are required to trigger interference. One discussed possibility is that initial learning modifies the properties of its neural networks to constrain further plasticity induction and learning capabilities, therefore causing anterograde interference in a network‐dependent manner. One implication is that learning‐specific neural networks must be maximally dissociated to minimize the interfering influences of previous learning on subsequent learning.

Unraveling somatotopic organization in the human brain using machine learning and adaptive supervoxel-based parcellations

In addition to the well-established somatotopy in the pre- and post-central gyrus, there is now strong evidence that somatotopic organization is evident across other regions in the sensorimotor network. This raises several experimental questions: To what extent is activity in the sensorimotor network effector-dependent and effector-independent? How important is the sensorimotor cortex when predicting the motor effector? Is there redundancy in the distributed somatotopically organized network such that removing one region has little impact on classification accuracy? To answer these questions, we developed a novel experimental approach. fMRI data were collected while human subjects performed a precisely controlled force generation task separately with their hand, foot, and mouth. We used a simple linear iterative clustering (SLIC) algorithm to segment whole-brain beta coefficient maps to build an adaptive brain parcellation and then classified effectors using extreme gradient boosting (XGBoost) based on parcellations at various spatial resolutions. This allowed us to understand how data-driven adaptive brain parcellation granularity altered classification accuracy. Results revealed effector-dependent activity in regions of the post-central gyrus, precentral gyrus, and paracentral lobule. SMA, regions of the inferior and superior parietal lobule, and cerebellum each contained effector-dependent and effector-independent representations. Machine learning analyses showed that increasing the spatial resolution of the data-driven model increased classification accuracy, which reached 94% with 1755 supervoxels. Our SLIC-based supervoxel parcellation outperformed classification analyses using established brain templates and random simulations. Occlusion experiments further demonstrated redundancy across the sensorimotor network when classifying effectors. Our observations extend our understanding of effector-dependent and effector-independent organization within the human brain and provide new insight into the functional neuroanatomy required to predict the motor effector used in a motor control task.

From Observed Action Identity to Social Affordances

Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.