The orienting of attention during eye and hand movements: ERP evidence for similar frame of reference but different spatially specific modulations of tactile processing

The anticipatory effect of goal-directed action planning with a lower limb on peri-personal space

Recent studies have demonstrated that the representation of peri-personal space (PPS) can be strongly modulated by the intention to execute a spatially-directed hand-movement. However, the question of whether analogous motor-induced PPS modulations can be observed during the planning and execution of goal-directed lower limbs movements has been scarcely investigated. Here we asked whether changes in the visuo-tactile PPS maps occur during the planning of a goal directed foot-movement. We asked participants to respond to the location of a tactile stimulus delivered to the index finger (top) or the thumb (bottom) of the right hand while ignoring a visual distractor presented at congruent or incongruent elevations, either close to the foot or close to the goal of the foot movement. This version of the cross-modal congruency task was performed under two different experimental conditions, as a baseline (static task, no movement involved) and embedded into a dual-task in which participants also had to plan and execute a goal-directed foot movement (dynamic task). In the static task, comparable cross-modal congruency effects (CCE) were present near the foot and near the movement goal. In the dynamic task, the CCE near the foot shrank considerably, whereas a sizable CCE was present near the movement goal. This anticipatory reweighting of the multisensory representation of near-space demonstrates that PPS is modulated by the intention to perform a goal-directed foot movement, with a weakened representation of the space around the currently occupied foot location when a movement is imminent.

Modulation of anticipatory brain activity as a function of action complexity

Stimulus-driven actions are preceded by preparatory brain activity that can be expressed by event-related potentials (ERP). Literature on this topic has focused on simple actions, such as the finger keypress, finding activity in frontal, parietal, and occipital areas detectable up to two seconds before the stimulus onset. Little is known about the preparatory brain activity when the action complexity increases, and specific brain areas designated to achieve movement integration intervene. This paper aims to identify the time course of preparatory brain activity associated with actions of increasing complexity using ERP analysis and a visuomotor discrimination task. Motor complexity was manipulated by asking nineteen volunteers to provide their response by simply pressing a key or by adding to the keypress arm extensions alone, or in combination with a standing step (involving the whole body). Results showed that these actions of increasing levels of complexity appear to be associated with different patterns of preparatory brain activity in which the found components were differently modulated. The simple keypress was characterized by the prominent motor excitatory preparation in premotor areas paralleled by the largest prefrontal inhibitory/attentional control. Reaching presented a dominant parietal preparation confirming the role of these integration areas in reaching actions toward a goal. Stepping was characterized by localized activity in the bilateral dorsomedial parieto-occipital areas attributable to sensory readiness, for the approaching stimulus. In conclusion, the brain can optimally anticipate any stimulus-driven action modulating the activity in the brain areas specialized in the preparation of that action type.

ERP evidence of attentional somatosensory processing and stimulus-response coupling under different hand and arm postures

We investigated (1) the effects of divided and focused attention on event-related brain potentials (ERPs) elicited by somatosensory stimulation under different response modes, (2) the effects of hand position (closely-placed vs. separated hands) and arm posture (crossed vs. uncrossed forearms) on the attentional modulation of somatosensory ERPs, and (3) changes in the coupling of stimulus- and response-related processes by somatosensory attention using a single-trial analysis of P300 latency and reaction times. Electrocutaneous stimulation was presented randomly to the thumb or middle finger of the left or right hand at random interstimulus intervals (700-900 ms). Subjects attended unilaterally or bilaterally to stimuli in order to detect target stimuli by a motor response or counting. The effects of unilaterally-focused attention were also tested under different hand and arm positions. The amplitude of N140 in the divided attention condition was intermediate between unilaterally attended and unattended stimuli in the unilaterally-focused attention condition in both the mental counting and motor response tasks. Attended infrequent (target) stimuli elicited greater P300 in the unilaterally attention condition than in the divided attention condition. P300 latency was longer in the divided attention condition than in the unilaterally-focused attention condition in the motor response task, but remained unchanged in the counting task. Closely locating the hands had no impact, whereas crossing the forearms decreased the attentional enhancement in N140 amplitude. In contrast, these two manipulations uniformly decreased P300 amplitude and increased P300 latency. The correlation between single-trial P300 latency and RT was decreased by crossed forearms, but not by divided attention or closely-placed hands. Therefore, the present results indicate that focused and divided attention differently affected middle latency and late processing, and that hand position and arm posture also differently affected attentional processes and stimulus-response coupling.

On the spread of spatial attention in touch: Evidence from Event-Related Brain potentials

To investigate the distribution of tactile spatial attention near the current attentional focus, participants were cued to attend to one of four body locations (hand or shoulder on the left or right side) to respond to infrequent tactile targets. In this Narrow attention task, effects of spatial attention on the ERPs elicited by tactile stimuli delivered to the hands were compared as a function of the distance from the attentional focus (Focus on the hand vs. Focus on the shoulder). When participants focused on the hand, attentional modulations of the sensory-specific P100 and N140 components were followed by the longer latency Nd component. Notably, when participants focused on the shoulder, they were unable to restrict their attentional resources to the cued location, as revealed by the presence of reliable attentional modulations at the hands. This effect of attention outside the attentional focus was delayed and reduced compared to that observed within the attentional focus, revealing the presence of an attentional gradient. In addition, to investigate whether the size of the attentional focus modulated the effects of tactile spatial attention on somatosensory processing, participants also completed the Broad attention task, in which they were cued to attend to two locations (both the hand and the shoulder) on the left or right side. Attentional modulations at the hands emerged later and were reduced in the Broad compared to the Narrow attention task, suggesting reduced attentional resources for a wider attentional focus.

Limits of Perceived Audio-Visual Spatial Coherence as Defined by Reaction Time Measurements

The ventriloquism effect describes the phenomenon of audio and visual signals with common features, such as a voice and a talking face merging perceptually into one percept even if they are spatially misaligned. The boundaries of the fusion of spatially misaligned stimuli are of interest for the design of multimedia products to ensure a perceptually satisfactory product. They have mainly been studied using continuous judgment scales and forced-choice measurement methods. These results vary greatly between different studies. The current experiment aims to evaluate audio-visual fusion using reaction time (RT) measurements as an indirect method of measurement to overcome these great variances. A two-alternative forced-choice (2AFC) word recognition test was designed and tested with noise and multi-talker speech background distractors. Visual signals were presented centrally and audio signals were presented between 0° and 31° audio-visual offset in azimuth. RT data were analyzed separately for the underlying Simon effect and attentional effects. In the case of the attentional effects, three models were identified but no single model could explain the observed RTs for all participants so data were grouped and analyzed accordingly. The results show that significant differences in RTs are measured from 5° to 10° onwards for the Simon effect. The attentional effect varied at the same audio-visual offset for two out of the three defined participant groups. In contrast with the prior research, these results suggest that, even for speech signals, small audio-visual offsets influence spatial integration subconsciously.

Tool use modulates early stages of visuo-tactile integration in far space: Evidence from event-related potentials

The neural representation of multisensory space near the body is modulated by the active use of long tools in non-human primates. Here, we investigated whether the electrophysiological correlates of visuo-tactile integration in near and far space were modulated by active tool use in healthy humans. Participants responded to a tactile target delivered to one hand while an irrelevant visual stimulus was presented ipsilaterally in near or far space. This crossmodal task was performed after the use of either short or long tools. Crucially, the P100 components elicited by visuo-tactile stimuli was enhanced on far as compared to near space trials after the use of long tools, while no such difference was present after short tool use. Thus, we found increased neural responses in brain areas encoding tactile stimuli to the body when visual stimuli were presented close to the tip of the tool after long tool use. This increased visuo-tactile integration on far space trials following the use of long tools might indicate a transient remapping of multisensory space. We speculate that performing voluntary actions with long tools strengthens the representation of sensory information arising within portions of space (i.e. the hand and the tip of the tool) that are most functionally relevant to one's behavioural goals.

Task demands affect spatial reference frame weighting during tactile localization in sighted and congenitally blind adults

Task demands modulate tactile localization in sighted humans, presumably through weight adjustments in the spatial integration of anatomical, skin-based, and external, posture-based information. In contrast, previous studies have suggested that congenitally blind humans, by default, refrain from automatic spatial integration and localize touch using only skin-based information. Here, sighted and congenitally blind participants localized tactile targets on the palm or back of one hand, while ignoring simultaneous tactile distractors at congruent or incongruent locations on the other hand. We probed the interplay of anatomical and external location codes for spatial congruency effects by varying hand posture: the palms either both faced down, or one faced down and one up. In the latter posture, externally congruent target and distractor locations were anatomically incongruent and vice versa. Target locations had to be reported either anatomically (“palm” or “back” of the hand), or externally (“up” or “down” in space). Under anatomical instructions, performance was more accurate for anatomically congruent than incongruent target-distractor pairs. In contrast, under external instructions, performance was more accurate for externally congruent than incongruent pairs. These modulations were evident in sighted and blind individuals. Notably, distractor effects were overall far smaller in blind than in sighted participants, despite comparable target-distractor identification performance. Thus, the absence of developmental vision seems to be associated with an increased ability to focus tactile attention towards a non-spatially defined target. Nevertheless, that blind individuals exhibited effects of hand posture and task instructions in their congruency effects suggests that, like the sighted, they automatically integrate anatomical and external information during tactile localization. Moreover, spatial integration in tactile processing is, thus, flexibly adapted by top-down information—here, task instruction—even in the absence of developmental vision.

Neural mechanisms of selective attention in the somatosensory system

Selective attention allows organisms to extract behaviorally relevant information while ignoring distracting stimuli that compete for the limited resources of their central nervous systems. Attention is highly flexible, and it can be harnessed to select information based on sensory modality, within-modality feature(s), spatial location, object identity, and/or temporal properties. In this review, we discuss the body of work devoted to understanding mechanisms of selective attention in the somatosensory system. In particular, we describe the effects of attention on tactile behavior and corresponding neural activity in somatosensory cortex. Our focus is on neural mechanisms that select tactile stimuli based on their location on the body (somatotopic-based attention) or their sensory feature (feature-based attention). We highlight parallels between selection mechanisms in touch and other sensory systems and discuss several putative neural coding schemes employed by cortical populations to signal the behavioral relevance of sensory inputs. Specifically, we contrast the advantages and disadvantages of using a gain vs. spike-spike correlation code for representing attended sensory stimuli. We favor a neural network model of tactile attention that is composed of frontal, parietal, and subcortical areas that controls somatosensory cells encoding the relevant stimulus features to enable preferential processing throughout the somatosensory hierarchy. Our review is based on data from noninvasive electrophysiological and imaging data in humans as well as single-unit recordings in nonhuman primates.

Independent effects of eye gaze and spatial attention on the processing of tactile events: Evidence from event-related potentials

Directing one's gaze at a body part reduces detection speed and enhances the processing of tactile stimuli presented at the gazed location. Given the close links between spatial attention and the oculomotor system it is possible that these gaze- dependent modulations of touch are mediated by attentional mechanisms. To investigate this possibility, gaze direction and sustained tactile attention were orthogonally manipulated in the present study. Participants covertly attended to one hand to perform a tactile target-nontarget discrimination while they gazed at the same or opposite hand. Spatial attention resulted in enhancements of the somatosensory P100 and Nd components. In contrast, gaze resulted in modulations of the N140 component with more positive ERPs for gazed than non gazed stimuli. This dissociation in the pattern and timing of the effects of gaze and attention on somatosensory processing reveals that gaze and attention have independent effects on touch.

How our body influences our perception of the world

Incorporating the fact that the senses are embodied is necessary for an organism to interpret sensory information. Before a unified perception of the world can be formed, sensory signals must be processed with reference to body representation. The various attributes of the body such as shape, proportion, posture, and movement can be both derived from the various sensory systems and can affect perception of the world (including the body itself). In this review we examine the relationships between sensory and motor information, body representations, and perceptions of the world and the body. We provide several examples of how the body affects perception (including but not limited to body perception). First we show that body orientation effects visual distance perception and object orientation. Also, visual-auditory crossmodal-correspondences depend on the orientation of the body: audio "high" frequencies correspond to a visual "up" defined by both gravity and body coordinates. Next, we show that perceived locations of touch is affected by the orientation of the head and eyes on the body, suggesting a visual component to coding body locations. Additionally, the reference-frame used for coding touch locations seems to depend on whether gaze is static or moved relative to the body during the tactile task. The perceived attributes of the body such as body size, affect tactile perception even at the level of detection thresholds and two-point discrimination. Next, long-range tactile masking provides clues to the posture of the body in a canonical body schema. Finally, ownership of seen body parts depends on the orientation and perspective of the body part in view. Together, all of these findings demonstrate how sensory and motor information, body representations, and perceptions (of the body and the world) are interdependent.

Early event-related potentials indicate context-specific target processing for eye and hand motor systems

Concurrent eye and hand movements toward a common visual target require different motor programs based on identical visual input. We used event-related brain potentials (ERP) to determine if and when the processing of the visual target differs for the two motor systems. The N2, an index for target evaluation, was more negative for the target of a hand than of an eye movement in two experiments. A possible interpretation for this finding is different visual target processing. Targets for hand movements require a different weighting of visual information, for example concerning features such as surface structure which are important for hand but not for eye movements. In experiment 2, the early C1-component, which had an average maximum at 67 ms following target onset, was significantly more negative when subjects pointed at the stimuli. Traditionally, the C1 has been regarded as a sensory component, but recent studies have linked it to higher order processing, such as attention and expectations. Thus, the present data indicate that target processing for eye or hand movements is already context-specific during early visual information processing. We suggest that differences in a target's relevance for upcoming movements modify target processing as well as sensory expectations.