Space coding by premotor cortex

Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition

Peripersonal space (PPS) is a construct referring to the portion of space immediately surrounding our bodies, where most of the interactions between the subject and the environment, including other individuals, take place. Decades of animal and human neuroscience research have revealed that the brain holds a separate representation of this region of space: this distinct spatial representation has evolved to ensure proper relevance to stimuli that are close to the body and prompt an appropriate behavioral response. The neural underpinnings of such construct have been thoroughly investigated by different generations of studies involving anatomical and electrophysiological investigations in animal models, and, recently, neuroimaging experiments in human subjects. Here, we provide a comprehensive anatomical overview of the anatomical circuitry underlying PPS representation in the human brain. Gathering evidence from multiple areas of research, we identified cortical and subcortical regions that are involved in specific aspects of PPS encoding.We show how these regions are part of segregated, yet integrated functional networks within the brain, which are in turn involved in higher-order integration of information. This wide-scale circuitry accounts for the relevance of PPS encoding in multiple brain functions, including not only motor planning and visuospatial attention but also emotional and social cognitive aspects. A complete characterization of these circuits may clarify the derangements of PPS representation observed in different neurological and neuropsychiatric diseases.

Hand-blink reflex modulation: The role of primary emotions and attachment dimensions

The hand-blink reflex (HBR) is a subcortical response elicited by the electrical stimulation of the median nerve. HBR magnitude is enhanced when the stimulated hand is close to the face and is modulated by high-level structures according to the perceived threat magnitude. Psychological factors may contribute to threat evaluation and possibly to HBR amplitude modulation. In this study, we assessed distinctively emotional and relational aspects of personality and evaluated their associations with the HBR response, or lack thereof, in healthy subjects. Seventy-one volunteers filled the Experiences in Close Relationships Scale, the Affective Neuroscience Personality Scales, and the State-Trait Anxiety Inventory Form Y questionnaires and underwent HBR recording. We found that the HBR could be evoked only in 50.7% of all subjects (responders). Non-responders subjects showed higher scores in the avoidance dimension (p = .005), and lower scores in the care dimension (p = .008), compared with responders. In responders, regression analysis showed a negative association of HBR amplitude (difference in near vs. far responses) with anger dimension and a positive association with state anxiety (R2  = 0.239). A positive association also emerged with HBR latency and fear dimension (R2  = 0.419). We conclude that primary emotional and relational factors may play an important role in the modulation of brainstem circuits mediating the HBR response. Our results may also contribute to the question about the absence of the HBR in about half of the subjects since high-level cognitive processes seem to play an important role in the differentiation between responder and non-responder.

Architectural experience influences the processing of others' body expressions

The interplay between space and cognition is a crucial issue in Neuroscience leading to the development of multiple research fields. However, the relationship between architectural space and the movement of the inhabitants and their interactions has been too often neglected, failing to provide a unifying view of architecture's capacity to modulate social cognition broadly. We bridge this gap by requesting participants to judge avatars' emotional expression (high vs. low arousal) at the end of their promenade inside high- or low-arousing architectures. Stimuli were presented in virtual reality to ensure a dynamic, naturalistic experience. High-density electroencephalography (EEG) was recorded to assess the neural responses to the avatar's presentation. Observing highly aroused avatars increased Late Positive Potentials (LPP), in line with previous evidence. Strikingly, 250 ms before the occurrence of the LPP, P200 amplitude increased due to the experience of low-arousing architectures, reflecting an early greater attention during the processing of body expressions. In addition, participants stared longer at the avatar's head and judged the observed posture as more arousing. Source localization highlighted a contribution of the dorsal premotor cortex to both P200 and LPP. In conclusion, the immersive and dynamic architectural experience modulates human social cognition. In addition, the motor system plays a role in processing architecture and body expressions suggesting that the space and social cognition interplay is rooted in overlapping neural substrates. This study demonstrates that the manipulation of mere architectural space is sufficient to influence human social cognition.

Does hand position affect orienting when no action is required? An electrophysiological study

Previous research has shown that attention can be biased to targets appearing near the hand that require action responses, arguing that attention to the hand facilitates upcoming action. It is unclear whether attention orients to non-targets near the hand not requiring responses. Using electroencephalography/event-related potentials (EEG/ERP), this study investigated whether hand position affected visual orienting to non-targets under conditions that manipulated the distribution of attention. We modified an attention paradigm in which stimuli were presented briefly and rapidly on either side of fixation; participants responded to infrequent targets (15%) but not standard non-targets and either a hand or a block was placed next to one stimulus location. In Experiment 1, attention was distributed across left and right stimulus locations to determine whether P1 or N1 ERP amplitudes to non-target standards were differentially influenced by hand location. In Experiment 2, attention was narrowed to only one stimulus location to determine whether attentional focus affected orienting to non-target locations near the hand. When attention was distributed across both stimulus locations, the hand increased overall N1 amplitudes relative to the block but not selectively to stimuli appearing near the hand. However, when attention was focused on one location, amplitudes were affected by the location of attentional focus and the stimulus, but not by hand or block location. Thus, hand position appears to contribute only a non-location-specific input to standards during visual orienting, but only in cases when attention is distributed across stimulus locations.

The Remapping of Peripersonal Space in a Real but Not in a Virtual Environment

One of the most surprising features of our brain is the fact that it is extremely plastic. Among the various plastic processes supported by our brain, there is the neural representation of the space surrounding our body, the peripersonal space (PPS). The effects of real-world tool use on the PPS are well known in cognitive neuroscience, but little is still known whether similar mechanisms also govern virtual tool use. To this purpose, the present study investigated the plasticity of the PPS before and after a real (Experiment 1) or virtual motor training with a tool (Experiment 2). The results show the expansion of the PPS only following real-world tool use but not virtual use, highlighting how the two types of training potentially rely on different processes. This study enriches the current state of the art on the plasticity of PPS in real and virtual environments. We discuss our data with respect to the relevance for the development of effective immersive environment for trainings, learning and rehabilitation.

Close facial emotions enhance physiological responses and facilitate perceptual discrimination

Accumulating evidence indicates that the peripersonal space (PPS) constitutes a privileged area for efficient processing of proximal stimuli, allowing to flexibly adapt our behavior both to the physical and social environment. Whether and how behavioral and physiological signatures of PPS relate to each other in emotional contexts remains, though, elusive. Here, we addressed this question by having participants to discriminate male from female faces depicting different emotions (happiness, anger or neutral) and presented at different distances (50 cm-300 cm) while we measured the reaction time and accuracy of their responses, as well as pupillary diameter, heart rate and heart rate variability. Results showed facilitation of participants' performances (i.e., faster response time) when faces were presented close compared to far from the participants, even when controlling for retinal size across distances. These behavioral effects were accompanied by significant modulation of participants' physiological indexes when faces were presented in PPS. Interestingly, both PPS representation and physiological signals were affected by features of the seen faces such as the emotional valence, its sex and the participants' sex, revealing the profound impact of social context onto the autonomic state and behavior within PPS. Together, these findings suggest that both external and internal signals contribute in shaping PPS representation.

Investigating the Interaction Between Form and Motion Processing: A Review of Basic Research and Clinical Evidence

A widely held view of the visual system supported the perspective that the primate brain is organized in two main specialized streams, called the ventral and dorsal streams. The ventral stream is known to be involved in object recognition (e.g., form and orientation). In contrast, the dorsal stream is thought to be more involved in spatial recognition (e.g., the spatial relationship between objects and motion direction). Recent evidence suggests that these two streams are not segregated but interact with each other. A class of visual stimuli known as Glass patterns has been developed to shed light on this process. Glass patterns are visual stimuli made of pairs of dots, called dipoles, that give the percept of a specific form or apparent motion, depending on the spatial and temporal arrangement of the dipoles. In this review, we show an update of the neurophysiological, brain imaging, psychophysical, clinical, and brain stimulation studies which have assessed form and motion integration mechanisms, and the level at which this occurs in the human and non-human primate brain. We also discuss several studies based on non-invasive brain stimulation techniques that used different types of visual stimuli to assess the cortico-cortical interactions in the visual cortex for the processing of form and motion information. Additionally, we discuss the timing of specific visual processing in the ventral and dorsal streams. Finally, we report some parallels between healthy participants and neurologically impaired patients in the conscious processing of form and motion.

Seeing or not Seeing Where Your Hands Are. The Influence of Visual Feedback About Hand Position on the Interaction Between Nociceptive and Visual Stimuli

Examining the mechanisms underlying crossmodal interaction between nociceptive and visual stimuli is crucial to understand how humans handle potential bodily threats in their environment. It has recently been shown that nociceptive stimuli can affect the perception of visual stimuli, provided that they occur close together in external space. The present study addresses the question whether these crossmodal interactions between nociceptive and visual stimuli are mediated by the visually perceived proximity between the visual stimuli and the limb on which nociceptive stimuli are applied, by manipulating the presence vs. absence of visual feedback about the position of the stimulated limb. Participants performed temporal order judgments on pairs of visual stimuli, shortly preceded by nociceptive stimuli, either applied on one hand or both hands simultaneously. The hands were placed near the visual stimuli and could either be seen directly, seen through a glass barrier, or hidden from sight with a wooden board. Unilateral nociceptive stimuli induced spatial biases to the advantage of visual stimuli presented near the stimulated hand, which were greater in the conditions in which the hands were seen than in the condition in which vision was prevented. Spatial biases were not modulated by the presence of the glass barrier, minimizing the possibility that the differential effect between the vision and no-vision conditions is solely due to the presence of the barrier between the hands and the visual stimuli. These findings highlight the importance of visual feedback for determining spatial mapping between nociceptive and visual stimuli for crossmodal interaction.

Genetically Defined Functional Modules for Spatial Orienting in the Mouse Superior Colliculus

In order to explore and interact with their surroundings, animals need to orient toward specific positions in space. Throughout the animal kingdom, head movements represent a primary form of orienting behavior. The superior colliculus (SC) is a fundamental structure for the generation of orienting responses, but how genetically distinct groups of collicular neurons contribute to these spatially tuned behaviors remains largely to be defined. Here, through the genetic dissection of the murine SC, we identify a functionally and genetically homogeneous subclass of glutamatergic neurons defined by the expression of the paired-like homeodomain transcription factor Pitx2. We show that the optogenetic stimulation of Pitx2^ON neurons drives three-dimensional head displacements characterized by stepwise, saccade-like kinematics. Furthermore, during naturalistic foraging behavior, the activity of Pitx2^ON neurons precedes and predicts the onset of spatially tuned head movements. Intriguingly, we reveal that Pitx2^ON neurons are clustered in an orderly array of anatomical modules that tile the entire intermediate layer of the SC. Such a modular organization gives origin to a discrete and discontinuous representation of the motor space, with each Pitx2^ON module subtending a defined portion of the animal’s egocentric space. The modularity of Pitx2^ON neurons provides an anatomical substrate for the convergence of spatially coherent sensory and motor signals of cortical and subcortical origins, thereby promoting the recruitment of appropriate movement vectors. Overall, these data support the view of the superior colliculus as a selectively addressable and modularly organized spatial-motor register.

•

Pitx2 expression labels a functionally homogeneous class of projecting SC neurons

•

Pitx2^ON neurons drive three-dimensional head movements during foraging behavior

•

Pitx2^ON neurons are organized in an orderly array of anatomical modules

•

Modularity of Pitx2^ON neurons defines a discrete motor map for spatial orienting

Aim and Plausibility of Action Chains Remap Peripersonal Space

Successful interaction with objects in the peripersonal space requires that the information relative to current and upcoming positions of our body is continuously monitored and updated with respect to the location of target objects. Voluntary actions, for example, are known to induce an anticipatory remapping of the peri-hand space (PHS, i.e., the space near the acting hand) during the very early stages of the action chain: planning and initiating an object grasp increase the interference exerted by visual stimuli coming from the object on touches delivered to the grasping hand, thus allowing for hand-object position monitoring and guidance. Voluntarily grasping an object, though, is rarely performed in isolation. Grasping a candy, for example, is most typically followed by concatenated secondary action steps (bringing the candy to the mouth and swallowing it) that represent the agent’s ultimate intention (to eat the candy). However, whether and when complex action chains remap the PHS remains unknown, just as whether remapping is conditional to goal achievability (e.g., candy-mouth fit). Here we asked these questions by assessing changes in visuo-tactile interference on the acting hand while participants had to grasp an object serving as a support for an elongated candy, and bring it toward their mouth. Depending on its orientation, the candy could potentially enter the participants’ mouth (plausible goal), or not (implausible goal). We observed increased visuo-tactile interference at relatively late stages of the action chain, after the object had been grasped, and only when the action goal was plausible. These findings suggest that multisensory interactions during action execution depend upon the final aim and plausibility of complex goal-directed actions, and extend our knowledge about the role of peripersonal space in guiding goal-directed voluntary actions.

Toward understanding the neurophysiological basis of peripersonal space: An EEG study on healthy individuals

The subcortical mechanisms subtending the sensorimotor processes related to the peripersonal space (PPS) have been well characterized, whereas less evidence is available concerning the cortical mechanisms. We investigated the theta, alpha and beta event-related spectral perturbations (ERSP) while holding the forearm in different positions into the PPS of the face. Fifty healthy individuals were subjected to EEG recording while being provided with median nerve electric stimulation at the wrist of the right hand held at different hand-to-face distances. Theta and beta rhythms were significantly perturbed depending on the hand-to-face distance, whereas alpha oscillations reflected a more general, non-specific oscillatory response to the motor task. The perturbation of theta and beta frequency bands may reflect the processes of top-down modulation overseeing the conscious spatiotemporal encoding of sensory-motor information within the PPS. In other words, such perturbation reflects the continuous update of the conscious internal representations of the PPS to build up a purposeful and reflexive motor response.

From multisensory integration in peripersonal space to bodily self-consciousness: from statistical regularities to statistical inference

Integrating information across sensory systems is a critical step toward building a cohesive representation of the environment and one's body, and as illustrated by numerous illusions, scaffolds subjective experience of the world and self. In the last years, classic principles of multisensory integration elucidated in the subcortex have been translated into the language of statistical inference understood by the neocortical mantle. Most importantly, a mechanistic systems-level description of multisensory computations via probabilistic population coding and divisive normalization is actively being put forward. In parallel, by describing and understanding bodily illusions, researchers have suggested multisensory integration of bodily inputs within the peripersonal space as a key mechanism in bodily self-consciousness. Importantly, certain aspects of bodily self-consciousness, although still very much a minority, have been recently casted under the light of modern computational understandings of multisensory integration. In doing so, we argue, the field of bodily self-consciousness may borrow mechanistic descriptions regarding the neural implementation of inference computations outlined by the multisensory field. This computational approach, leveraged on the understanding of multisensory processes generally, promises to advance scientific comprehension regarding one of the most mysterious questions puzzling humankind, that is, how our brain creates the experience of a self in interaction with the environment.

Three-Dimensional Representation of Motor Space in the Mouse Superior Colliculus

From the act of exploring an environment to that of grasping a cup of tea, animals must put in register their motor acts with their surrounding space. In the motor domain, this is likely to be defined by a register of three-dimensional (3D) displacement vectors, whose recruitment allows motion in the direction of a target. One such spatially targeted action is seen in the head reorientation behavior of mice, yet the neural mechanisms underlying these 3D behaviors remain unknown. Here, by developing a head-mounted inertial sensor for studying 3D head rotations and combining it with electrophysiological recordings, we show that neurons in the mouse superior colliculus are either individually or conjunctively tuned to the three Eulerian components of head rotation. The average displacement vectors associated with motor-tuned colliculus neurons remain stable over time and are unaffected by changes in firing rate or the duration of spike trains. Finally, we show that the motor tuning of collicular neurons is largely independent from visual or landmark cues. By describing the 3D nature of motor tuning in the superior colliculus, we contribute to long-standing debate on the dimensionality of collicular motor decoding; furthermore, by providing an experimental paradigm for the study of the metric of motor tuning in mice, this study also paves the way to the genetic dissection of the circuits underlying spatially targeted motion.

•

Development of inertial sensor system for monitoring 3D head movements in real time

•

Neurons in the superior colliculus code for the full dimensionality of head rotations

•

Firing rate correlates with velocity, but not head displacement angle

•

The spatial tuning of collicular units is largely independent of visual or landmark cues

Action affordances and visuo-spatial complexity in motor imagery: An fMRI study

Imagining a complex action requires not only motor-related processing but also visuo-spatial imagery. In the current study, we examined visuo-spatial complexity and action affordances in motor imagery (MI). Using functional magnetic resonance imaging, we investigated the neural activity in MI of reach-to-grasp movements of the right hand in five conditions. Thirty participants were scanned while imagining grasping an everyday object, grasping a geometrical shape, grasping next to an everyday object, grasping next to a geometrical shape, and grasping at nothing (no object involved). We found that MI of grasping next to an object recruited the visuo-spatial cognition network including posterior parietal and premotor regions more strongly than MI of grasping an object. This indicates that grasping next to an object requires additional processing resources rendering MI more complex. MI of a grasping movement involving a familiar everyday object compared to a geometrical shape yielded stronger activation in motor-related regions, including the bilateral supplementary motor area. This activation might be due to inhibitory processes preventing motor execution of motor scripts evoked by everyday objects (action affordances). Our results indicate that visuo-spatial cognition plays a significant role in MI.

Hierarchical Organization Within the Ventral Premotor Cortex of the Macaque Monkey

Recent studies have revealed that the ventral premotor cortex (PMv) of nonhuman primates plays a pivotal role in various behaviors that require the transformation of sensory cues to appropriate actions. Examples include decision-making based on various sensory cues, preparation for upcoming motor behavior, adaptive sensorimotor transformation, and the generation of motor commands using rapid sensory feedback. Although the PMv has frequently been regarded as a single entity, it can be divided into at least five functionally distinct regions: F4, a dorsal convexity region immediately rostral to the primary motor cortex (M1); F5p, a cortical region immediately rostral to F4, lying within the arcuate sulcus; F5c, a ventral convexity region rostral to F4; and F5a, located in the caudal bank of the arcuate sulcus inferior limb lateral to F5p. Among these, F4 can be further divided into dorsal and ventral subregions (F4d and F4v), which are involved in forelimb and orofacial movements, respectively. F5p contains "mirror neurons" to understand others' actions based on visual and other types of information, and F4d and F5p work together as a functional complex involved in controlling forelimb and eye movements, most efficiently in the execution and completion of coordinated eye-hand movements for reaching and grasping under visual guidance. In contrast, F5c and F5a are hierarchically higher than the F4d, F5p, and F5v complexes, and play a role in decision-making based on various sensory discriminations. Hence, the PMv subregions form a hierarchically organized integral system from decision-making to eye-hand coordination under various behavioral circumstances.

Vision for Prehension in the Medial Parietal Cortex

In the last 2 decades, the medial posterior parietal area V6A has been extensively studied in awake macaque monkeys for visual and somatosensory properties and for its involvement in encoding of spatial parameters for reaching, including arm movement direction and amplitude. This area also contains populations of neurons sensitive to grasping movements, such as wrist orientation and grip formation. Recent work has shown that V6A neurons also encode the shape of graspable objects and their affordance. In other words, V6A seems to encode object visual properties specifically for the purpose of action, in a dynamic sequence of visuomotor transformations that evolve in the course of reach-to-grasp action.We propose a model of cortical circuitry controlling reach-to-grasp actions, in which V6A acts as a comparator that monitors differences between current and desired hand positions and configurations. This error signal could be used to continuously update the motor output, and to correct reach direction, hand orientation, and/or grip aperture as required during the act of prehension.In contrast to the generally accepted view that the dorsomedial component of the dorsal visual stream encodes reaching, but not grasping, the functional properties of V6A neurons strongly suggest the view that this area is involved in encoding all phases of prehension, including grasping.

Slower attentional disengagement but faster perceptual processing near the hand

Many recent studies have reported altered visual processing near the hands. However, there is no definitive agreement about the mechanisms responsible for this effect. One viewpoint is that the effect is predominantly attentional while others argue for the role of pre-attentive perceptual differences in the manifestation of the hand-proximity effect. However, in most of the studies pre-attentional and attentional effects have been conflated. We argue that it is important to dissociate the effect of hand proximity on perception and attention to better theorize and understand how visual processing is altered near the hands. We report two experiments using a visual search task where participants completed a visual search task with their hands either on the monitor or on their lap. When on the monitor, the target could appear near the hand or farther away. In experiment 1, a letter search task showed steeper search slope near the hand suggesting slower attentional disengagement. However, the intercept was smaller in the near hand condition suggesting faster perceptual processing. These results were also replicated in experiment 2 with a conjunction search task with target present and absent conditions and 4 set sizes. The results suggest that there are dissociable effects of hand proximity on perception and attention. Importantly, the pre-attentive advantage of hand proximity does not translate to attentional benefit, but a processing cost. The results of experiment 2 additionally indicate that the steeper slope does not arise from any spatial biases in how search proceeds, but an indicator of slower attentional processing near the hands. The results also suggest that the effect of hand proximity on attention is not spatially graded whereas its effect on perceptuo-motor processes seems to be.

The dorsal visual stream revisited: Stable circuits or dynamic pathways?

In both macaque and human brain, information regarding visual motion flows from the extrastriate area V6 along two different paths: a dorsolateral one towards areas MT/V5, MST, V3A, and a dorsomedial one towards the visuomotor areas of the superior parietal lobule (V6A, MIP, VIP). The dorsolateral visual stream is involved in many aspects of visual motion analysis, including the recognition of object motion and self motion. The dorsomedial stream uses visual motion information to continuously monitor the spatial location of objects while we are looking and/or moving around, to allow skilled reaching for and grasping of the objects in structured, dynamically changing environments. Grasping activity is present in two areas of the dorsal stream, AIP and V6A. Area AIP is more involved than V6A in object recognition, V6A in encoding vision for action. We suggest that V6A is involved in the fast control of prehension and plays a critical role in biomechanically selecting appropriate postures during reach to grasp behaviors. In everyday life, numerous functional networks, often involving the same cortical areas, are continuously in action in the dorsal visual stream, with each network dynamically activated or inhibited according to the context. The dorsolateral and dorsomedial streams represent only two examples of these networks. Many others streams have been described in the literature, but it is worthwhile noting that the same cortical area, and even the same neurons within an area, are not specific for just one functional property, being part of networks that encode multiple functional aspects. Our proposal is to conceive the cortical streams not as fixed series of interconnected cortical areas in which each area belongs univocally to one stream and is strictly involved in only one function, but as interconnected neuronal networks, often involving the same neurons, that are involved in a number of functional processes and whose activation changes dynamically according to the context.

Corollary Discharge and Oculomotor Proprioception: Cortical Mechanisms for Spatially Accurate Vision

A classic problem in psychology is understanding how the brain creates a stable and accurate representation of space for perception and action despite a constantly moving eye. Two mechanisms have been proposed to solve this problem: Herman von Helmholtz's idea that the brain uses a corollary discharge of the motor command that moves the eye to adjust the visual representation, and Sir Charles Sherrington's idea that the brain measures eye position to calculate a spatial representation. Here, we discuss the cognitive, neuropsychological, and physiological mechanisms that support each of these ideas. We propose that both are correct: A rapid corollary discharge signal remaps the visual representation before an impending saccade, computing accurate movement vectors; and an oculomotor proprioceptive signal enables the brain to construct a more accurate craniotopic representation of space that develops slowly after the saccade.

Grasping remaps the distribution of visuospatial attention and enhances competing action activation

We examined how action goals influence the distribution of visuospatial attention near the body (Experiment 1) and how the temporal relationship between distractors and targets modifies shifts in visuospatial attention (Experiment 2). Targets were light emitting diodes (LEDs) in the left and right hemispace of a visual display. Following left or right target illumination, participants reached to point-to or grasp target object in blocked trials. Coincident with target onset, a distractor LED illuminated in the same or opposite hemispace between the initiation point and target, or no distractor appeared. In Experiment 1, during grasping there was a larger temporal interference effect (slower reach initiation) than with pointing. When grasping versus pointing, participants deviated more towards same-side distractors and away from opposite-side distractors. In Experiment 2, distractors onset 200ms prior to (-200-ms), coincident with (0 ms), or 200ms following (+200 ms) the target. For both reach types, -200-ms distractors had greater onset temporal interference than 0 ms and +200-ms distractors. For grasping, +200 ms distractors had larger temporal interference than 0 ms distractors. For -200-ms, reach trajectories deviated more towards opposite-side distractors and away from same-side distractors, the reverse of the pattern for 0 ms and +200-ms distractors.

REVIEW ■ : Multiple Representations of Space in the Brain

Lesions of the posterior parietal cortex have long been known to produce visuospatial deficits in both humans and monkeys. Yet there is no known "map" of space in the parietal cortex. The posterior parietal cortex projects to a number of other areas that are involved in specialized spatial functions. In these areas, space is represented at the level of single neurons and, in many of them, there is a topographically organized map of space. These extraparietal areas include the premotor cortex and the putamen, involved in visuomotor space, the frontal eye fields and the superior colliculus, involved in oculomotor space, the hippocampus, involved in environmental space, and the dorsolateral prefrontal cortex, involved in mnemonic space. In many of these areas, space is represented by means of a coordinate system that is fixed to a particular body part. Thus, the processing of space is not unitary but is divided among several brain areas and several coordinate systems, in addition to those in the posterior parietal cortex. The Neuroscientist 1:43-50, 1995

Tuning Curves for Arm Posture Control in Motor Cortex Are Consistent with Random Connectivity

Neuronal responses characterized by regular tuning curves are typically assumed to arise from structured synaptic connectivity. However, many responses exhibit both regular and irregular components. To address the relationship between tuning curve properties and underlying circuitry, we analyzed neuronal activity recorded from primary motor cortex (M1) of monkeys performing a 3D arm posture control task and compared the results with a neural network model. Posture control is well suited for examining M1 neuronal tuning because it avoids the dynamic complexity of time-varying movements. As a function of hand position, the neuronal responses have a linear component, as has previously been described, as well as heterogeneous and highly irregular nonlinearities. These nonlinear components involve high spatial frequencies and therefore do not support explicit encoding of movement parameters. Yet both the linear and nonlinear components contribute to the decoding of EMG of major muscles used in the task. Remarkably, despite the presence of a strong linear component, a feedforward neural network model with entirely random connectivity can replicate the data, including both the mean and distributions of the linear and nonlinear components as well as several other features of the neuronal responses. This result shows that smoothness provided by the regularity in the inputs to M1 can impose apparent structure on neural responses, in this case a strong linear (also known as cosine) tuning component, even in the absence of ordered synaptic connectivity.

Grounding grammatical categories: attention bias in hand space influences grammatical congruency judgment of Chinese nominal classifiers

Embodied cognitive theories predict that linguistic conceptual representations are grounded and continually represented in real world, sensorimotor experiences. However, there is an on-going debate on whether this also holds for abstract concepts. Grammar is the archetype of abstract knowledge, and therefore constitutes a test case against embodied theories of language representation. Former studies have largely focussed on lexical-level embodied representations. In the present study we take the grounding-by-modality idea a step further by using reaction time (RT) data from the linguistic processing of nominal classifiers in Chinese. We take advantage of an independent body of research, which shows that attention in hand space is biased. Specifically, objects near the hand consistently yield shorter RTs as a function of readiness for action on graspable objects within reaching space, and the same biased attention inhibits attentional disengagement. We predicted that this attention bias would equally apply to the graspable object classifier but not to the big object classifier. Chinese speakers (N = 22) judged grammatical congruency of classifier-noun combinations in two conditions: graspable object classifier and big object classifier. We found that RTs for the graspable object classifier were significantly faster in congruent combinations, and significantly slower in incongruent combinations, than the big object classifier. There was no main effect on grammatical violations, but rather an interaction effect of classifier type. Thus, we demonstrate here grammatical category-specific effects pertaining to the semantic content and by extension the visual and tactile modality of acquisition underlying the acquisition of these categories. We conclude that abstract grammatical categories are subjected to the same mechanisms as general cognitive and neurophysiological processes and may therefore be grounded.

Neuroplasticity subserving the operation of brain-machine interfaces

Neuroplasticity is key to the operation of brain machine interfaces (BMIs)-a direct communication pathway between the brain and a man-made computing device. Whereas exogenous BMIs that associate volitional control of brain activity with neurofeedback have been shown to induce long lasting plasticity, endogenous BMIs that use prolonged activity-dependent stimulation--and thus may curtail the time scale that governs natural sensorimotor integration loops--have been shown to induce short lasting plasticity. Here we summarize recent findings from studies using both categories of BMIs, and discuss the fundamental principles that may underlie their operation and the longevity of the plasticity they induce. We draw comparison to plasticity mechanisms known to mediate natural sensorimotor skill learning and discuss principles of homeostatic regulation that may constrain endogenous BMI effects in the adult mammalian brain. We propose that BMIs could be designed to facilitate structural and functional plasticity for the purpose of re-organization of target brain regions and directed augmentation of sensorimotor maps, and suggest possible avenues for future work to maximize their efficacy and viability in clinical applications.

Development of space perception in relation to the maturation of the motor system in infant rhesus macaques (Macaca mulatta)

To act on the environment, organisms must perceive object locations in relation to their body. Several neuroscientific studies provide evidence of neural circuits that selectively represent space within reach (i.e., peripersonal) and space outside of reach (i.e., extrapersonal). However, the developmental emergence of these space representations remains largely unexplored. We investigated the development of space coding in infant macaques and found that they exhibit different motor strategies and hand configurations depending on the objects' size and location. Reaching-grasping improved from 2 to 4 weeks of age, suggesting a broadly defined perceptual body schema at birth, modified by the acquisition and refinement of motor skills through early sensorimotor experience, enabling the development of a mature capacity for coding space.

Motor resources in peripersonal space are intrinsic to spatial encoding: evidence from motor interference

The aim of this study was to explore the role of motor resources in peripersonal space encoding: are they intrinsic to spatial processes or due to action potentiality of objects? To answer this question, we disentangled the effects of motor resources on object manipulability and spatial processing in peripersonal and extrapersonal spaces. Participants had to localize manipulable and non-manipulable 3-D stimuli presented within peripersonal or extrapersonal spaces of an immersive virtual reality scenario. To assess the contribution of motor resources to the spatial task a motor interference paradigm was used. In Experiment 1, localization judgments were provided with the left hand while the right dominant arm could be free or blocked. Results showed that participants were faster and more accurate in localizing both manipulable and non-manipulable stimuli in peripersonal space with their arms free. On the other hand, in extrapersonal space there was no significant effect of motor interference. Experiment 2 replicated these results by using alternatively both hands to give the response and controlling the possible effect of the orientation of object handles. Overall, the pattern of results suggests that the encoding of peripersonal space involves motor processes per se, and not because of the presence of manipulable stimuli. It is argued that this motor grounding reflects the adaptive need of anticipating what may happen near the body and preparing to react in time.

Bodily selves in relation: embodied simulation as second-person perspective on intersubjectivity

This article addresses basic aspects of social cognition focusing on the pivotal role played by the lived body in the constitution of our experience of others. It is suggested that before studying intersubjectivity we should better qualify the notion of the self. A minimal notion of the self, the bodily self, defined in terms of its motor potentialities, is proposed. The discovery of mirror mechanisms for action, emotions and sensations led to the proposal of an embodied approach to intersubjectivity-embodied simulation (ES) theory. ES and the related notion of neural reuse provide a new empirically based perspective on intersubjectivity, viewed first and foremost as intercorporeality. ES challenges the notion that folk psychology is the sole account of interpersonal understanding. ES is discussed within a second-person perspective on mindreading.

Multisensory Representation of the Space Near the Hand

When interacting with objects and other people, the brain needs to locate our limbs and the relevant visual information surrounding them. Studies on monkeys showed that information from different sensory modalities converge at the single cell level within a set of interconnected multisensory frontoparietal areas. It is largely accepted that this network allows for multisensory processing of the space surrounding the body (peripersonal space), whose function has been linked to the sensory guidance of appetitive and defensive movements, and localization of the limbs in space. In the current review, we consider multidisciplinary findings about the processing of the space near the hands in humans and offer a convergent view of its functions and underlying neural mechanisms. We will suggest that evolution has provided the brain with a clever tool for representing visual information around the hand, which takes the hand itself as a reference for the coding of surrounding visual space. We will contend that the hand-centered representation of space, known as perihand space, is a multisensory-motor interface that allows interaction with the objects and other persons around us.

Transfer of information by BMI

Brain machine interfaces (BMI) have become important in systems neuroscience with the goal to restore motor function in paralyzed patients. We assess the current ability of BMI devices to move objects. The topics discussed include: (1) the bits of information generated by a BMI signal, (2) the limitations of including more neurons for generating a BMI signal, (3) the superiority of a BMI signal using single cells versus electroencephalography, (4) plasticity and BMI, (5) the selection of a neural code for generating BMI, (6) the suppression of body movements during BMI, and (7) the role of vision in BMI. We conclude that further research on understanding how the brain generates movement is necessary before BMI can become a reasonable option for paralyzed patients.

Reach and gaze representations in macaque parietal and premotor grasp areas

Voluntary movements are frequently composed of several actions that are combined to achieve a specific behavior. For example, prehension involves reaching and grasping actions to transport the hand to a target to grasp or manipulate it. For controlling these actions, separate parietofrontal networks have been described for generating reaching and grasping actions. However, this separation has been challenged recently for the dorsomedial part of this network (area V6A). Here we report that the anterior intraparietal (AIP) and the rostral ventral premotor area (F5) in the macaque, which are both part of the dorsolateral parietofrontal network and causally linked to hand grasping movements, also represent spatial information during the execution of a reach-to-grasp task. In addition to grip type information, gaze and target positions were represented in AIP and F5 and could be readily decoded from single unit activity in these areas. Whereas the fraction of grip type tuned units increased toward movement execution, the number of cells with spatial representations stayed relatively constant throughout the task, although more prominently in AIP than in F5. Furthermore, the recorded target position signals were substantially encoded in retinotopic coordinates. In conclusion, the simultaneous presence of grasp-related and spatial information in AIP and F5 suggests at least a supportive role of these spatial signals for the planning of grasp actions. Whether these spatial signals in AIP and F5 also play a causal role for the planning of reach actions would need to be the subject of further investigations.

Differential effects of motor efference copies and proprioceptive information on response evaluation processes

It is well-kown that sensory information influences the way we execute motor responses. However, less is known about if and how sensory and motor information are integrated in the subsequent process of response evaluation. We used a modified Simon Task to investigate how these streams of information are integrated in response evaluation processes, applying an in-depth neurophysiological analysis of event-related potentials (ERPs), time-frequency decomposition and sLORETA. The results show that response evaluation processes are differentially modulated by afferent proprioceptive information and efference copies. While the influence of proprioceptive information is mediated via oscillations in different frequency bands, efference copy based information about the motor execution is specifically mediated via oscillations in the theta frequency band. Stages of visual perception and attention were not modulated by the interaction of proprioception and motor efference copies. Brain areas modulated by the interactive effects of proprioceptive and efference copy based information included the middle frontal gyrus and the supplementary motor area (SMA), suggesting that these areas integrate sensory information for the purpose of response evaluation. The results show how motor response evaluation processes are modulated by information about both the execution and the location of a response.

Effects of body to head rotation on the labyrinthine responses of rat vestibular neurons

Vestibulospinal reflexes elicited by head displacement in space depend on the direction of body displacement, because the neuronal responses to labyrinthine stimulation are tuned by neck displacement: a directional tuning takes place in the medial cerebellum and in spinal motoneurons, while a gain and a basal activity tuning can be observed in the reticular formation, a target structure of the medial cerebellum. In the present study, we investigated whether also the response of vestibular nuclear neurons (another target of the medial cerebellum) to labyrinthine stimulation is tuned by neck displacement and which parameters of the response are modulated by it. In urethane-anaesthetized Wistar rats, single-unit activity was recorded from the vestibular nuclei at rest and during wobble of the whole animal at 0.156 Hz. This stimulus tilted the animal's head by a constant amplitude (5°), in a direction rotating at a constant velocity over the horizontal plane, either in clockwise or counter clockwise direction. The gain and the direction of neuronal responses to wobble were evaluated through Fourier analysis, in the control position (with coincident head and body axes) and following a body-to-head rotation of 5-30° over the horizontal plane, in both directions. Most of the vestibular neurons modified their response gain and/or their basal activity following body-to-head rotation, as it occurs in the reticular formation. Only few neurons modified their response direction, as occurs in the cerebellum and in spinal motoneurons. The different behaviour of cerebellar neurons and of their vestibular and reticular target cells, suggests that the role played by the cerebellum in the neck tuning of vestibulospinal reflexes has to be reconsidered.

The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge

Concepts are the elementary units of reason and linguistic meaning. They are conventional and relatively stable. As such, they must somehow be the result of neural activity in the brain. The questions are: Where? and How? A common philosophical position is that all concepts-even concepts about action and perception-are symbolic and abstract, and therefore must be implemented outside the brain's sensory-motor system. We will argue against this position using (1) neuroscientific evidence; (2) results from neural computation; and (3) results about the nature of concepts from cognitive linguistics. We will propose that the sensory-motor system has the right kind of structure to characterise both sensory-motor and more abstract concepts. Central to this picture are the neural theory of language and the theory of cogs, according to which, brain structures in the sensory-motor regions are exploited to characterise the so-called "abstract" concepts that constitute the meanings of grammatical constructions and general inference patterns.

Strategy-dependent encoding of planned arm movements in the dorsal premotor cortex

The kinematic strategy encoded in motor cortical areas for classic straight-line reaching is remarkably simple and consistent across subjects, despite the complicated musculoskeletal dynamics that are involved. As tasks become more challenging, however, different conscious strategies may be used to improve perceived behavioral performance. We identified additional spatial information that appeared both in single neurons and in the population code of monkey dorsal premotor cortex when obstacles impeded direct reach paths. The neural correlate of movement planning varied between subjects in a manner consistent with the use of different strategies to optimize task completion. These distinct planning strategies were manifested in the timing and strength of the information contained in the neural population code.

Haptic interaction of touch and proprioception: implications for neuroprosthetics

Somatosensation is divided into multiple discrete modalities that we think of separably: e.g., tactile, proprioceptive, and temperature sensation. However, in processes such as haptics,those modalities all interact. If one intended to artificially generate a sensation that could be used for stereognosis, for example, it would be crucial to understand these interactions. We are presently examining the relationship between tactile and proprioceptive modalities in this context. In this overview of some of our recent work, we show that signals that would normally be attributed to two of these systems separately, tactile contact and self-movement, interact both perceptually and physiologically in ways that complicate the understanding of haptic processing. In the first study described here, we show that a tactile illusion on the fingertips, the cutaneous rabbit effect, can be abolished by changing the posture of the fingers. We then discuss activity in primary somatosensory cortical neurons illustrating the interrelationship of tactile and postural signals. In this study, we used a robot-enhanced virtual environment to show that many neurons in primary somatosensory cortex with cutaneous receptive fields encode elements both of tactile contact and self-motion. We then show the results of studies examining the structure of the process which extracts the spatial location of the hand from proprioceptive signals. The structure of the spatial errors in these maps indicates that the proprioceptive-spatial map is stable but individually constructed.These seemingly disparate studies lead us to suggest that tactile sensation is encoded in a 2-D map, but one which undergoes continual dynamic modification by an underlying proprioceptive map. Understanding how the disparate signals that comprise the somatosensory system are processed to produce sensation is an important step in realizing the kind of seamless integration aspired to in neuroprosthetics.

The proprioceptive map of the arm is systematic and stable, but idiosyncratic

Visual and somatosensory signals participate together in providing an estimate of the hand's spatial location. While the ability of subjects to identify the spatial location of their hand based on visual and proprioceptive signals has previously been characterized, relatively few studies have examined in detail the spatial structure of the proprioceptive map of the arm. Here, we reconstructed and analyzed the spatial structure of the estimation errors that resulted when subjects reported the location of their unseen hand across a 2D horizontal workspace. Hand position estimation was mapped under four conditions: with and without tactile feedback, and with the right and left hands. In the task, we moved each subject's hand to one of 100 targets in the workspace while their eyes were closed. Then, we either a) applied tactile stimulation to the fingertip by allowing the index finger to touch the target or b) as a control, hovered the fingertip 2 cm above the target. After returning the hand to a neutral position, subjects opened their eyes to verbally report where their fingertip had been. We measured and analyzed both the direction and magnitude of the resulting estimation errors. Tactile feedback reduced the magnitude of these estimation errors, but did not change their overall structure. In addition, the spatial structure of these errors was idiosyncratic: each subject had a unique pattern of errors that was stable between hands and over time. Finally, we found that at the population level the magnitude of the estimation errors had a characteristic distribution over the workspace: errors were smallest closer to the body. The stability of estimation errors across conditions and time suggests the brain constructs a proprioceptive map that is reliable, even if it is not necessarily accurate. The idiosyncrasy across subjects emphasizes that each individual constructs a map that is unique to their own experiences.

Computational models of spatial updating in peri-saccadic perception

Perceptual phenomena that occur around the time of a saccade, such as peri-saccadic mislocalization or saccadic suppression of displacement, have often been linked to mechanisms of spatial stability. These phenomena are usually regarded as errors in processes of trans-saccadic spatial transformations and they provide important tools to study these processes. However, a true understanding of the underlying brain processes that participate in the preparation for a saccade and in the transfer of information across it requires a closer, more quantitative approach that links different perceptual phenomena with each other and with the functional requirements of ensuring spatial stability. We review a number of computational models of peri-saccadic spatial perception that provide steps in that direction. Although most models are concerned with only specific phenomena, some generalization and interconnection between them can be obtained from a comparison. Our analysis shows how different perceptual effects can coherently be brought together and linked back to neuronal mechanisms on the way to explaining vision across saccades.

The perspective matters! Multisensory integration in ego-centric reference frames determines full-body ownership

Recent advances in experimental science have made it possible to investigate the perceptual processes involved in generating a sense of owning an entire body. This is achieved by full-body ownership illusions which make use of specific patterns of visual and somatic stimuli integration. Here we investigate the fundamental question of the reference frames used in the process of attributing an entire body to the self. We quantified the strength of the body-swap illusion in conditions where the participants were observing this artificial body from the perspective of the first or third person. Consistent results from subjective reports and physiological recordings show that the first person visual perspective is critical for the induction of this full-body ownership illusion. This demonstrates that the multisensory integration processes producing the sense of corporeal self operates in an ego-centric reference frame.

Priming of reach trajectory when observing actions: hand-centred effects

When another person's actions are observed it appears that these actions are simulated, such that similar motor processes are triggered in the observer. Much evidence suggests that such simulation concerns the achievement of behavioural goals, such as grasping a particular object, and is less concerned with the specific nature of the action, such as the path the hand takes to reach the goal object. We demonstrate that when observing another person reach around an obstacle, an observer's subsequent reach has an increased curved trajectory, reflecting motor priming of reach path. This priming of reach trajectory via action observation can take place under a variety of circumstances: with or without a shared goal, and when the action is seen from a variety of perspectives. However, of most importance, the reach path priming effect is only evoked if the obstacle avoided by another person is within the action (peripersonal) space of the observer.