Parietal and superior frontal visuospatial maps activated by pointing and saccades

Functional rather than effector-specific organization of human posterior parietal cortex

Neurophysiological and neuroimaging studies have shown that the posterior parietal cortex (PPC) distinguishes between the planning of eye and hand movements. This distinction has usually been interpreted as evidence for a modular, effector-specific organization of this cerebral region. However, the eyes differ markedly from other body parts both in terms of their functional purpose and with regard to the spatial transformations required to plan goal-directed movements. PPC may therefore provide specialized subregions for eye movements, but distinguish less for other effectors. Using functional magnetic resonance imaging, we compared activity during memory-guided eye, hand, and foot movements in human participants. The results did not reveal any significant activation differences during the planning of hand and foot movements, except in the most anterior part of PPC [Brodmann's area (BA) 5], marginally extending into anterior BA 7/40. This region showed a lateral-to-medial gradient for hand versus foot movement planning. The limb-unspecific PPC regions were functionally connected with hand and foot motor regions. In contrast, a gradient-like organization was found for all of PPC for the planning of eye versus hand and foot movements. Although planning-related activity across the three effectors considerably overlapped, saccade planning activated occipitoparietal regions more than limb movements, whereas limb movements activated anterior regions of the superior parietal lobule more than saccades. We infer that PPC does not follow a strict effector-specific organization. Rather, the large-scale organization of this region might reflect the different computational constraints that need to be satisfied when planning eye and limb movements.

Sensitivity of human visual cortical area V6 to stereoscopic depth gradients associated with self-motion

The principal visual cue to self-motion (egomotion) is optic flow, which is specified in terms of local 2D velocities in the retinal image without reference to depth cues. However, in general, points near the center of expansion of natural flow fields are distant, whereas those in the periphery are closer, creating gradients of horizontal binocular disparity. To assess whether the brain combines disparity gradients with optic flow when encoding egomotion, stereoscopic gradients were applied to expanding dot patterns presented to observers during functional MRI scanning. The gradients were radially symmetrical, disparity changing as a function of eccentricity. The depth cues were either consistent with egomotion (peripheral dots perceived as near and central dots perceived as far) or inconsistent (the reverse gradient, central dots near, peripheral dots far). The BOLD activity generated by these stimuli was compared in a range of predefined visual regions in 13 participants with good stereoacuity. Visual area V6, in the parieto-occipital sulcus, showed a unique pattern of results, responding well to all optic flow patterns but much more strongly when they were paired with consistent rather than inconsistent or zero-disparity gradients. Of the other areas examined, a region of the precuneus and parietoinsular vestibular cortex also differentiate between consistent and inconsistent gradients, but with weak or suppressive responses. V3A, V7, MT, and ventral intraparietal area responded more strongly in the presence of a depth gradient but were indifferent to its depth-flow congruence. The results suggest that depth and flow cues are integrated in V6 to improve estimation of egomotion.

The organization of the human cerebral cortex estimated by intrinsic functional connectivity

Information processing in the cerebral cortex involves interactions among distributed areas. Anatomical connectivity suggests that certain areas form local hierarchical relations such as within the visual system. Other connectivity patterns, particularly among association areas, suggest the presence of large-scale circuits without clear hierarchical relations. In this study the organization of networks in the human cerebrum was explored using resting-state functional connectivity MRI. Data from 1,000 subjects were registered using surface-based alignment. A clustering approach was employed to identify and replicate networks of functionally coupled regions across the cerebral cortex. The results revealed local networks confined to sensory and motor cortices as well as distributed networks of association regions. Within the sensory and motor cortices, functional connectivity followed topographic representations across adjacent areas. In association cortex, the connectivity patterns often showed abrupt transitions between network boundaries. Focused analyses were performed to better understand properties of network connectivity. A canonical sensory-motor pathway involving primary visual area, putative middle temporal area complex (MT+), lateral intraparietal area, and frontal eye field was analyzed to explore how interactions might arise within and between networks. Results showed that adjacent regions of the MT+ complex demonstrate differential connectivity consistent with a hierarchical pathway that spans networks. The functional connectivity of parietal and prefrontal association cortices was next explored. Distinct connectivity profiles of neighboring regions suggest they participate in distributed networks that, while showing evidence for interactions, are embedded within largely parallel, interdigitated circuits. We conclude by discussing the organization of these large-scale cerebral networks in relation to monkey anatomy and their potential evolutionary expansion in humans to support cognition.

Current perspectives and methods in studying neural mechanisms of multisensory interactions

In the past decade neuroscience has witnessed major advances in the field of multisensory interactions. A large body of research has revealed several new types of cross-sensory interactions. In addition, multisensory interactions have been reported at temporal and spatial system levels previously thought of as strictly unimodal. We review the findings that have led to the current broad consensus that most, if not all, higher, as well as lower level neural processes are in some form multisensory. We continue by outlining the progress that has been made in identifying the functional significance of different types of interactions, for example, in subserving stimulus binding and enhancement of perceptual certainty. Finally, we provide a critical introduction to cutting edge methods from bayes optimal integration to multivoxel pattern analysis as applied to multisensory research at different system levels.

Imaging retinotopic maps in the human brain

A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.

Mapping reflexive shifts of attention in eye-centered and hand-centered coordinate systems

Behavioral studies indicate that directional gaze and hand pointing are fundamental social signals that may capture spatial attention more powerfully than directional arrows. By using fMRI, we explored whether reflexive shifts of attention triggered by different distracters were influenced by the motor effector used for performing an overt response. In separate blocks, healthy participants performed a directional saccadic or a hand pointing movement. Color changes of a central black fixation point constituted the imperative instruction signal to make a leftward (red color) or a rightward (blue color) movement while ignoring distracting leftward or rightward oriented gaze, hand pointing, or arrow. Distracters that were directionally incongruent with the instruction cue impaired the saccadic and pointing-release RTs. The comparison of incongruent vs. congruent conditions showed an increase of BOLD signal in the frontal eye field (FEF), the intraparietal sulcus (IPS), and the posterior parietal cortex (PPC) bilaterally. Importantly, a specific relationship between distracter and effector used for the response was found in these frontal and parietal regions. In particular, higher activity in the FEF, for distracting gaze was found mainly during the saccadic response task. In the same vein, higher activity in the left and right IPS regions was found for the distracting hand mainly in the hand pointing task. The results suggest that reflexive shifts of attention triggered by social signals are coded in the fronto-parietal cortex according to effector-specific mapping rules.

Specificity of human parietal saccade and reach regions during transcranial magnetic stimulation

Single-unit recordings in macaque monkeys have identified effector-specific regions in posterior parietal cortex (PPC), but functional neuroimaging in the human has yielded controversial results. Here we used on-line repetitive transcranial magnetic stimulation (rTMS) to determine saccade and reach specificity in human PPC. A short train of three TMS pulses (separated by an interval of 100 ms) was delivered to superior parieto-occipital cortex (SPOC), a region over the midposterior intraparietal sulcus (mIPS), and a site close to caudal IPS situated over the angular gyrus (AG) during a brief memory interval while subjects planned either a saccade or reach with the left or right hand. Behavioral measures then were compared to controls without rTMS. Stimulation of mIPS and AG produced similar patterns: increased end-point variability for reaches and decreased saccade accuracy for contralateral targets. In contrast, stimulation of SPOC deviated reach end points toward visual fixation and had no effect on saccades. Contralateral-limb specificity was highest for AG and lowest for SPOC. Visual feedback of the hand negated rTMS-induced disruptions of the reach plan for mIPS and AG, but not SPOC. These results suggest that human SPOC is specialized for encoding retinally peripheral reach goals, whereas more anterior-lateral regions (mIPS and AG) along the IPS possess overlapping maps for saccade and reach planning and are more closely involved in motor details (i.e., planning the reach vector for a specific hand). This work provides the first causal evidence for functional specificity of these parietal regions in healthy humans.

Human Cortical Control of Hand Movements: Parietofrontal Networks for Reaching, Grasping, and Pointing

In primates, control of the limb depends on many cortical areas. Whereas specialized parietofrontal circuits have been proposed for different movements in macaques, functional neuroimaging in humans has revealed widespread, overlapping activations for hand and eye movements and for movements such as reaching and grasping. This review examines the involvement of frontal and parietal areas in hand and arm movements in humans as revealed with functional neuroimaging. The degree of functional specialization, possible homologies with macaque cortical regions, and differences between frontal and posterior parietal areas are discussed, as well as a possible organization of hand movements with respect to different spatial reference frames. The available evidence supports a cortical organization along gradients of sensory (visual to somatosensory) and effector (eye to hand) preferences.

Neuronal synchronization in human posterior parietal cortex during reach planning

Although single-unit studies in monkeys have identified effector-related regions in the posterior parietal cortex (PPC) during saccade and reach planning, the degree of effector specificity of corresponding human regions, as established by recordings of the blood oxygen level-dependent signal, is still under debate. Here, we addressed this issue from a different perspective, by studying the neuronal synchronization of the human PPC during both reach and saccade planning. Using magnetoencephalography (MEG), we recorded ongoing brain activity while subjects performed randomly alternating trials of memory-guided reaches or saccades. Additionally, subjects performed a dissociation task requiring them to plan both a memory-guided saccade and reach to locations in opposing visual hemifields. We examined changes in spectral power of the MEG signal during a 1.5 s memory period in relation to target location (left/right) and effector type (eye/hand). The results show direction-selective synchronization in the 70-90 Hz gamma frequency band, originating from the medial aspect of the PPC, when planning a reaching movement. In contrast, activity in a more central portion of the PPC was synchronized in a lower gamma band (50-60 Hz) when planning the direction of a saccade. Both observations were corroborated in the dissociation task. In the lower frequency bands, we observed sustained alpha-band (8-12 Hz) desynchronization in occipitoparietal regions, but in an effector-unspecific manner. These results suggest that distinct modules in the posterior parietal cortex encode movement goals of different effectors by selective gamma-band activity, compatible with the functional organization of monkey PPC.

Spatial attention improves reliability of fMRI retinotopic mapping signals in occipital and parietal cortex

Spatial attention improves visual perception and increases the amplitude of neural responses in visual cortex. In addition, spatial attention tasks and fMRI have been used to discover topographic visual field representations in regions outside visual cortex. We therefore hypothesized that requiring subjects to attend to a retinotopic mapping stimulus would facilitate the characterization of visual field representations in a number of cortical areas. In our study, subjects attended either a central fixation point or a wedge-shaped stimulus that rotated about the fixation point. Response reliability was assessed by computing coherence between the fMRI time series and a sinusoid with the same frequency as the rotating wedge stimulus. When subjects attended to the rotating wedge instead of ignoring it, the reliability of retinotopic mapping signals increased by approximately 50% in early visual cortical areas (V1, V2, V3, V3A/B, V4) and ventral occipital cortex (VO1) and by approximately 75% in lateral occipital (LO1, LO2) and posterior parietal (IPS0, IPS1, IPS2) cortical areas. Additionally, one 5-min run of retinotopic mapping in the attention-to-wedge condition produced responses as reliable as the average of three to five (early visual cortex) or more than five (lateral occipital, ventral occipital, and posterior parietal cortex) attention-to-fixation runs. These results demonstrate that allocating attention to the retinotopic mapping stimulus substantially reduces the amount of scanning time needed to determine the visual field representations in occipital and parietal topographic cortical areas. Attention significantly increased response reliability in every cortical area we examined and may therefore be a general mechanism for improving the fidelity of neural representations of sensory stimuli at multiple levels of the cortical processing hierarchy.

Space representation for eye movements is more contralateral in monkeys than in humans

Contralateral hemispheric representation of sensory inputs (the right visual hemifield in the left hemisphere and vice versa) is a fundamental feature of primate sensorimotor organization, in particular the visuomotor system. However, many higher-order cognitive functions in humans show an asymmetric hemispheric lateralization--e.g., right brain specialization for spatial processing--necessitating a convergence of information from both hemifields. Electrophysiological studies in monkeys and functional imaging in humans have investigated space and action representations at different stages of visuospatial processing, but the transition from contralateral to unified global spatial encoding and the relationship between these encoding schemes and functional lateralization are not fully understood. Moreover, the integration of data across monkeys and humans and elucidation of interspecies homologies is hindered, because divergent findings may reflect actual species differences or arise from discrepancies in techniques and measured signals (electrophysiology vs. imaging). Here, we directly compared spatial cue and memory representations for action planning in monkeys and humans using event-related functional MRI during a working-memory oculomotor task. In monkeys, cue and memory-delay period activity in the frontal, parietal, and temporal regions was strongly contralateral. In putative human functional homologs, the contralaterality was significantly weaker, and the asymmetry between the hemispheres was stronger. These results suggest an inverse relationship between contralaterality and lateralization and elucidate similarities and differences in human and macaque cortical circuits subserving spatial awareness and oculomotor goal-directed actions.

Right hemisphere dominance during spatial selective attention and target detection occurs outside the dorsal frontoparietal network

Spatial selective attention is widely considered to be right hemisphere dominant. Previous functional magnetic resonance imaging studies, however, have reported bilateral blood-oxygenation-level-dependent responses in dorsal frontoparietal regions during anticipatory shifts of attention to a location (Kastner et al., 1999; Corbetta et al., 2000; Hopfinger et al., 2000). Right-lateralized activity has mainly been reported in ventral frontoparietal regions for shifts of attention to an unattended target stimulus (Arrington et al., 2000; Corbetta et al., 2000). However, clear conclusions cannot be drawn from these studies because hemispheric asymmetries were not assessed using direct voxelwise comparisons of activity in left and right hemispheres. Here, we used this technique to measure hemispheric asymmetries during shifts of spatial attention evoked by a peripheral cue stimulus and during target detection at the cued location. Stimulus-driven shifts of spatial attention in both visual fields evoked right-hemisphere dominant activity in temporoparietal junction (TPJ). Target detection at the attended location produced a more widespread right hemisphere dominance in frontal, parietal, and temporal cortex, including the TPJ region asymmetrically activated during shifts of spatial attention. However, hemispheric asymmetries were not observed during either shifts of attention or target detection in the dorsal frontoparietal regions (anterior precuneus, medial intraparietal sulcus, frontal eye fields) that showed the most robust activations for shifts of attention. Therefore, right hemisphere dominance during stimulus-driven shifts of spatial attention and target detection reflects asymmetries in cortical regions that are largely distinct from the dorsal frontoparietal network involved in the control of selective attention.

Synchronous retinotopic frontal-temporal activity during long-term memory for spatial location

Early visual areas in occipital cortex are known to be retinotopic. Recently, retinotopic maps have been reported in frontal and parietal cortex during spatial attention and working memory. The present event-related potential (ERP) and functional magnetic resonance imaging (fMRI) study determined whether spatial long-term memory was associated with retinotopic activity in frontal and parietal regions, and assessed whether retinotopic activity in these higher level control regions was synchronous with retinotopic activity in lower level visual sensory regions. During encoding, abstract shapes were presented to the left or right of fixation. During retrieval, old and new shapes were presented at fixation and participants classified each shape as old and previously on the "left", old and previously on the "right", or "new". Retinotopic effects were manifested by accurate memory for items previously presented on the left producing activity in the right hemisphere and accurate memory for items previously presented on the right producing activity in the left hemisphere. Retinotopic ERP activity was observed in frontal regions and visual sensory (occipital and temporal) regions. In frontal cortex, retinotopic fMRI activity was localized to the frontal eye fields. There were no significant ERP or fMRI retinotopic memory effects in parietal regions. The present long-term memory retinotopic effects complement previous spatial attention and working memory findings (and suggest retinotopic activity in parietal cortex may require an external peripheral stimulus). Furthermore, ERP cross-correlogram analysis revealed that retinotopic activations in frontal and temporal regions were synchronous, indicating that these regions interact during retrieval of spatial information.

Memory-guided saccade processing in visual form agnosia (patient DF)

According to Milner and Goodale's model (The visual brain in action, Oxford University Press, Oxford, 2006) areas in the ventral visual stream mediate visual perception and oV-line actions, whilst regions in the dorsal visual stream mediate the on-line visual control of action. Strong evidence for this model comes from a patient (DF), who suffers from visual form agnosia after bilateral damage to the ventro-lateral occipital region, sparing V1. It has been reported that she is normal in immediate reaching and grasping, yet severely impaired when asked to perform delayed actions. Here we investigated whether this dissociation would extend to saccade execution. Neurophysiological studies and TMS work in humans have shown that the posterior parietal cortex (PPC), on the right in particular (supposedly spared in DF), is involved in the control of memory-guided saccades. Surprisingly though, we found that, just as reported for reaching and grasping, DF's saccadic accuracy was much reduced in the memory compared to the stimulus-guided condition. These data support the idea of a tight coupling of eye and hand movements and further suggest that dorsal stream structures may not be sufficient to drive memory-guided saccadic performance.

Topographic organization of macaque area LIP

Despite several attempts to define retinotopic maps in the macaque lateral intraparietal area (LIP) using histological, electrophysiological, and neuroimaging methods, the degree to which this area is topographically organized remains controversial. We recorded blood oxygenation level-dependent signals with functional MRI from two macaques performing a difficult visual search task on stimuli presented at the fovea or in the periphery of the visual field. The results revealed the presence of a single topographic representation of the contralateral hemifield in the ventral subdivision of the LIP (LIPv) in both hemispheres of both monkeys. Also, a foveal representation was localized in rostral LIPv rather than in dorsal LIP (LIPd) as previous experiments had suggested. Finally, both LIPd and LIPv responded only to contralateral stimuli. In contrast, human studies have reported multiple topographic maps in intraparietal cortex and robust responses to ipsilateral stimuli. These blood oxygenation level-dependent functional MRI results provide clear evidence for the topographic organization of macaque LIP that complements the results of previous electrophysiology studies, and also reveal some unexpected characteristics of this organization that have eluded these previous studies. The results also delineate organizational differences between LIPv and LIPd, providing support for these two histologically defined areas may subserve different visuospatial functions. Finally, these findings point to potential evolutionary differences in functional organization with human posterior parietal cortex.

Functional Asymmetries Revealed in Visually Guided Saccades: An fMRI Study

Because eye movements are a fundamental tool for spatial exploration, we hypothesized that the neural bases of these movements in humans should be under right cerebral dominance, as already described for spatial attention. We used functional magnetic resonance imaging in 27 right-handed participants who alternated central fixation with either large or small visually guided saccades (VGS), equally performed in both directions. Hemispheric functional asymmetry was analyzed to identify whether brain regions showing VGS activation elicited hemispheric asymmetries. Hemispheric anatomical asymmetry was also estimated to assess its influence on the VGS functional lateralization. Right asymmetrical activations of a saccadic/attentional system were observed in the lateral frontal eye fields (FEF), the anterior part of the intraparietal sulcus (aIPS), the posterior third of the superior temporal sulcus (STS), the occipitotemporal junction (MT/V5 area), the middle occipital gyrus, and medially along the calcarine fissure (V1). The present rightward functional asymmetries were not related to differences in gray matter (GM) density/sulci positions between right and left hemispheres in the precentral, intraparietal, superior temporal, and extrastriate regions. Only V1 asymmetries were explained for almost 20% of the variance by a difference in the position of the right and left calcarine fissures. Left asymmetrical activations of a saccadic motor system were observed in the medial FEF and in the motor strip eye field along the Rolando sulcus. They were not explained by GM asymmetries. We suggest that the leftward saccadic motor asymmetry is part of a general dominance of the left motor cortex in right-handers, which must include an effect of sighting dominance. Our results demonstrate that, although bilateral by nature, the brain network involved in the execution of VGSs, irrespective of their direction, presented specific right and left asymmetries that were not related to anatomical differences in sulci positions.

Intention, action planning, and decision making in parietal-frontal circuits

The posterior parietal cortex and frontal cortical areas to which it connects are responsible for sensorimotor transformations. This review covers new research on four components of this transformation process: planning, decision making, forward state estimation, and relative-coordinate representations. These sensorimotor functions can be harnessed for neural prosthetic operations by decoding intended goals (planning) and trajectories (forward state estimation) of movements as well as higher cortical functions related to decision making and potentially the coordination of multiple body parts (relative-coordinate representations).

Visual-manual exploration and posterior parietal cortex in humans

Areas of human posterior parietal cortex (PPC) specialized for processing sensorimotor information associated with visually locating an object, reaching to grasp, and manually exploring that object were examined using functional MRI. Cortical activation was observed in response to three tasks: 1) saccadic eye movements, 2) visually guided reaching to grasp, and 3) manual shape discrimination. During saccadic eye movements, cortical fields within the lateral and rostral superior parietal lobe (SPL) and the caudal SPL and parieto-occipital boundary were active. During visually guided reaching to grasp, regions of cortex within the postcentral sulcus (PoCS) and rostral intraparietal sulcus (IPS) were active, as well as the caudal SPL of the left hemisphere and the medial and caudal IPS of the right hemisphere. Cortical regions at the junction of the IPS and PoCS and an area in the medial SPL were active bilaterally during shape manipulation. Only a few regions were most active during a single motor behavior, whereas several areas were highly active during two or more tasks. Hemispheric asymmetries in activation patterns were observed during visually guided reaching to grasp. The gross areal organization of human PPC is likely similar to the pattern previously described in nonhuman primates, including multifunctional regions and asymmetric processing of some manual abilities.

Topographic maps in human frontal and parietal cortex

Retinotopic mapping of functional magnetic resonance (fMRI) responses evoked by visual stimuli has resulted in the identification of many areas in human visual cortex and a description of the organization of the visual field representation in each of these areas. These methods have recently been employed in conjunction with tasks that involve higher-order cognitive processes such as spatial attention, working memory, and planning and execution of saccadic eye movements. This approach has led to the discovery of multiple areas in human parietal and frontal areas, each containing a topographic map of visual space. In this review, we summarize the anatomical locations, visual field organization, and functional specialization of these new parietal and frontal topographic cortical areas. The study of higher-order topographic cortex promises to yield unprecedented insights into the neural mechanisms of cognitive processes and, in conjunction with parallel studies in non-human primates, into the evolution of cognition.

Reflexive social attention is mapped according to effector-specific reference systems

Studies exploring reflexive joint attention report that attention is more powerfully captured by interfering social signals (such as others' gaze or hand orientation) than by non-biological directional cues (such as an arrow). However, what remains unknown is whether these effects are mapped in purely spatial or in body-part specific reference frames. Changes of a central, black fixation point into blue or orange were the imperative instruction signal for the experimental subjects to make a leftward or a rightward movement (saccades in Study 1 and hand pointing in Study 2) while ignoring distracting stimuli (leftward or rightward oriented gaze, hand pointing or arrow). Gaze and pointing hand distracters that were directionally incongruent with the instruction cue impaired the goal-driven saccadic and pointing performance, respectively. This pattern of results indicates that reflexive social attention is mapped not only in spatial but also in body-part specific reference frames.

Source estimates for MEG/EEG visual evoked responses constrained by multiple, retinotopically-mapped stimulus locations

Studying the human visual system with high temporal resolution is a significant challenge due to the limitations of the available, noninvasive measurement tools. MEG and EEG provide the millisecond temporal resolution necessary for answering questions about intracortical communication involved in visual processing, but source estimation is ill-posed and unreliable when multiple; simultaneously active areas are located close together. To address this problem, we have developed a retinotopy-constrained source estimation method to calculate the time courses of activation in multiple visual areas. Source estimation was disambiguated by: (1) fixing MEG/EEG generator locations and orientations based on fMRI retinotopy and surface tessellations constructed from high-resolution MRI images; and (2) solving for many visual field locations simultaneously in MEG/EEG responses, assuming source current amplitudes to be constant or varying smoothly across the visual field. Because of these constraints on the solutions, estimated source waveforms become less sensitive to sensor noise or random errors in the specification of the retinotopic dipole models. We demonstrate the feasibility of this method and discuss future applications such as studying the timing of attentional modulation in individual visual areas.

Posterior parietal cortex and episodic retrieval: convergent and divergent effects of attention and memory

Functional neuroimaging studies of humans engaged in retrieval from episodic memory have revealed a surprisingly consistent pattern of retrieval-related activity in lateral posterior parietal cortex (PPC). Given the well-established role of lateral PPC in subserving goal-directed and reflexive attention, it has been hypothesized that PPC activation during retrieval reflects the recruitment of parietal attention mechanisms during remembering. Here, we evaluate this hypothesis by considering the anatomical overlap of retrieval and attention effects in lateral PPC. We begin by briefly reviewing the literature implicating dorsal PPC in goal-directed attention and ventral PPC in reflexive attention. We then discuss the pattern of dorsal and ventral PPC activation during episodic retrieval, and conclude with consideration of the degree of anatomical convergence across the two domains. This assessment revealed that predominantly divergent subregions of lateral PPC are engaged during acts of episodic retrieval and during goal-directed and reflexive attention, suggesting that PPC retrieval effects reflect functionally distinct mechanisms from these forms of attention. Although attention must play a role in aspects of retrieval, the data reviewed here suggest that further investigation into the relationship between processes of attention and memory, as well as alternative accounts of PPC contributions to retrieval, is warranted.

Interaction of stimulus-driven reorienting and expectation in ventral and dorsal frontoparietal and basal ganglia-cortical networks

Shifts of attention to unattended stimuli (stimulus-driven reorienting) are often studied by measuring responses to unexpected stimuli, confounding reorienting and expectation. We separately measured the blood-oxygenation-level-dependent signal for both factors by manipulating the probability of salient visual cues that either shifted attention away from or maintained attention on a stream of visual stimuli. The results distinguished three networks recruited by reorienting. Right temporoparietal junction (TPJ), the posterior core of a ventral frontoparietal network, was activated more by cues for shifting than maintaining attention independently of cue location and probability, acting as a switch. TPJ was separately modulated by low probability cues, which signaled a breach of spatial expectation, independently of whether they shifted attention. Under resting conditions, TPJ activity was correlated [resting-state functional connectivity magnetic resonance imaging, (rs-fcMRI)] with right inferior frontal gyrus (IFG), an anterior component of the ventral network. Nevertheless, IFG was activated only by unexpected shifts of attention, dissociating its function from TPJ. Basal ganglia and frontal/insula regions also were activated only when reorienting was unexpected but showed strong rs-fcMRI among themselves, not with TPJ/IFG, defining a distinct network that may retrieve/activate commands for shifting attention. Within dorsal frontoparietal regions, shifting attention produced sustained spatially selective modulations in intraparietal sulcus (IPS) and frontal-eye field (FEF), and transient less selective modulations in precuneus and FEF. Modulations were observed even when reorienting was likely, but increased when reorienting was unexpected. The latter result may partly reflect interactions with lateral prefrontal components of the basal-ganglia/frontal/insula network that showed significant rs-fcMRI with the dorsal network.

Multiple parietal reach regions in humans: cortical representations for visual and proprioceptive feedback during on-line reaching

Reaching toward a visual target involves at least two sources of information. One is the visual feedback from the hand as it approaches the target. Another is proprioception from the moving limb, which informs the brain of the location of the hand relative to the target even when the hand is not visible. Where these two sources of information are represented in the human brain is unknown. In the present study, we investigated the cortical representations for reaching with or without visual feedback from the moving hand, using functional magnetic resonance imaging. To identify reach-dominant areas, we compared reaching with saccades. Our results show that a reach-dominant region in the anterior precuneus (aPCu), extending into medial intraparietal sulcus, is equally active in visual and nonvisual reaching. A second region, at the superior end of the parieto-occipital sulcus (sPOS), is more active for visual than for nonvisual reaching. These results suggest that aPCu is a sensorimotor area whose sensory input is primarily proprioceptive, while sPOS is a visuomotor area that receives visual feedback during reaching. In addition to the precuneus, medial, anterior intraparietal, and superior parietal cortex were also activated during both visual and nonvisual reaching, with more anterior areas responding to hand movements only and more posterior areas responding to both hand and eye movements. Our results suggest that cortical networks for reaching are differentially activated depending on the sensory conditions during reaching. This indicates the involvement of multiple parietal reach regions in humans, rather than a single homogenous parietal reach region.

Asymmetry and dyslexia

Developmental language disorders are characterized by a maturational trajectory that deviates or lags that of normal children. Given the wide variation in the rate of normal language development, diagnosis and classification of these disorders poses severe problems for the clinician. Our laboratory has been searching for anatomical signatures that could aid the development of a neurobiologically based classification. Quantitative analysis of the magnetic resonance imaging (MRI) brain scans of a series of samples of children and adults with reading and language disorders has identified two clusters with contrasting anatomical and reading profiles. Individuals with small symmetrical brain structures tend to have deficits in multiple domains of written and oral language whereas those with larger asymmetrical structures are more likely to have the isolated phonological deficits seen in adults with compensated dyslexia. Surprisingly, the anatomical risk factors that define these clusters do not form a continuum of increasing severity but deviate in opposite directions from normal. Individuals with moderate brain size and asymmetry typically demonstrate the best overall performance. Further research should determine if phonological impairments in the two clusters are associated with differing genetic and environmental risk factors requiring different types of intervention.

Spatial and effector processing in the human parietofrontal network for reaches and saccades

It is generally accepted that interactions between parietal and frontal cortices subserve the visuomotor processing for eye and hand movements. Here, we used a sequential-instruction paradigm in 3-T functional MRI to test the processing of effector and spatial signals, as well as their interaction, as a movement is composed and executed in different stages. Subjects prepared either a saccade or a reach following two successive visual instruction cues, presented in either order. One cue instructed which effector to use (eyes, right hand); the other signaled the spatial goal (leftward vs. rightward target location) of the movement. During the first phase of the prepared movement, after cueing of either goal or effector information, we found significant spatial goal selectivity but no effector specificity along the parietofrontal network. During the second phase of the prepared movement, when both goal and effector information were available, we found a large overlap in the neural circuitry involved in the planning of eye and hand movements. Gradually distributed along this network, we observed clear spatial goal selectivity and limited, but significant, effector specificity. Regions in the intraparietal sulcus and the dorsal premotor cortex were selective to both goal location and motor effector. Taken together, our results suggest that the relative weight of spatial goal and effector selectivity changes along the parietofrontal network, depending on the status of the movement plan.

Parietal regions processing visual 3D shape extracted from disparity

Three-dimensional (3D) shape is important for the visual control of grasping and manipulation. We used fMRI to study the processing of 3D shape extracted from disparity in human parietal cortex. Subjects stereoscopically viewed random-line stimuli portraying a 3D structure, a 2D structure in multiple depth planes or a 2D structure in the fixation plane. Subtracting the second from the first condition yields depth-structure sensitive regions and subtracting the third from the second position-in-depth sensitive regions. Two anterior intraparietal sulcus (IPS) regions, the dorsal IPS medial (DIPSM) and the dorsal IPS anterior (DIPSA) regions, were sensitive to depth structure and not to position in depth, while a posterior IPS region, the ventral IPS (VIPS) region, had a mixed sensitivity. All three IPS regions were also sensitive to 2D shape, indicating that they carry full 3D shape information. Finally DIPSM, but not DIPSA was sensitive to a saccade-related task. These results underscore the importance of anterior IPS regions in the processing of 3D shape, in agreement with their proximity to grasping-related regions. Moreover, comparison with the results of Durand, J.B., Nelissen, K., Joly, O., Wardak, C., Todd, J.T., Norman, J.F., Janssen, P., Vanduffel, W., Orban, G.A., 2007. Anterior Regions of Monkey Parietal Cortex Process Visual 3D Shape. Neuron 55, 493-505 obtained in the monkey indicates that DIPSA and DIPSM may represent human homologues for the posterior part of AIP and the adjoining part of LIP respectively.

In defense of qualitative changes in development

The balance between the preservation of early cognitive functions and serious transformations on these functions shifts across time. Piaget's writings, which favored transformations, are being replaced by writings that emphasize continuities between select cognitive functions of infants and older children. The claim that young infants possess elements present in the older child's concepts of number, physical impossibility, and object permanence is vulnerable to criticism because the inferences are based primarily on the single measure of change in looking time. It is suggested that investigators use unique constructs to describe phenomena observed in young infants that appear, on the surface, to resemble the psychological competences observed during later developmental stages.

Posterior parietal cortex and episodic encoding: insights from fMRI subsequent memory effects and dual-attention theory

The formation of episodic memories--memories for life events--is affected by attention during event processing. A leading neurobiological model of attention posits two separate yet interacting systems that depend on distinct regions in lateral posterior parietal cortex (PPC). From this dual-attention perspective, dorsal PPC is thought to support the goal-directed allocation of attention, whereas ventral PPC is thought to support reflexive orienting to information that automatically captures attention. To advance understanding of how parietal mechanisms may impact event encoding, we review functional MRI studies that document the relationship between lateral PPC activation during encoding and subsequent memory performance (e.g., later remembering or forgetting). This review reveals that (a) encoding-related activity is frequently observed in human lateral PPC, (b) increased activation in dorsal PPC is associated with later memory success, and (c) increased activation in ventral PPC predominantly correlates with later memory failure. From a dual-attention perspective, these findings suggest that allocating goal-directed attention during event processing increases the probability that the event will be remembered later, whereas the capture of reflexive attention during event processing may have negative consequences for event encoding. The prevalence of encoding-related activation in parietal cortex suggests that neurobiological models of episodic memory should consider how parietal-mediated attentional mechanisms regulate encoding.

Visuo-motor integration in humans: cortical patterns of response lateralisation and functional connectivity

PURPOSE

We assessed response and functional connectivity patterns of different parts of the visual and motor cortices during visuo-motor integration with particular focus on the intraparietal sulcus (IPS).

METHODS

Brain activity was measured during a visuo-motor task in 14 subjects using event-related fMRI. During central fixation, a blue or red target embedded in an array of grey distractors was presented for 250 ms in either the left or right visual hemifield. After a delay, the subjects were prompted to press the upper or lower response button for targets in the upper and lower hemifield with the left or right thumb for blue and red targets, respectively. The fMRI responses were evaluated for different regions of interests (ROIs), and the functional connectivity of the IPS subregions with these ROIs was quantified.

RESULTS

In an anterior IPS region and a region in the anterior premotor cortex, presumably the frontal eye fields (FEF), visually driven responses were dominant contralateral to both visual stimulus and effector. Thus, the anterior IPS combines, in contrast to the posterior IPS and the occipital cortex, response properties of cortex activated by visual input and by motor output. Further, functional connectivity with the motor areas was stronger for the anterior than for the posterior IPS regions.

DISCUSSION

Anterior IPS and FEF appear to be of major relevance for relating visual and effector information during visuo-motor integration. Patient studies with the devised paradigm are expected to uncover the impact of pathophysiologies and plasticity on the observed cortical lateralisation patterns.

Dynamic spatial coding within the dorsal frontoparietal network during a visual search task

To what extent are the left and right visual hemifields spatially coded in the dorsal frontoparietal attention network? In many experiments with neglect patients, the left hemisphere shows a contralateral hemifield preference, whereas the right hemisphere represents both hemifields. This pattern of spatial coding is often used to explain the right-hemispheric dominance of lesions causing hemispatial neglect. However, pathophysiological mechanisms of hemispatial neglect are controversial because recent experiments on healthy subjects produced conflicting results regarding the spatial coding of visual hemifields. We used an fMRI paradigm that allowed us to distinguish two attentional subprocesses during a visual search task. Either within the left or right hemifield subjects first attended to stationary locations (spatial orienting) and then shifted their attentional focus to search for a target line. Dynamic changes in spatial coding of the left and right hemifields were observed within subregions of the dorsal front-parietal network: During stationary spatial orienting, we found the well-known spatial pattern described above, with a bilateral hemifield representation in the right hemisphere and a contralateral preference in the left hemisphere. However, during search, the right hemisphere had a contralateral preference and the left hemisphere equally represented both hemifields. This finding leads to novel perspectives regarding models of visuospatial attention and hemispatial neglect.

Representation of eye movements and stimulus motion in topographically organized areas of human posterior parietal cortex

Recent imaging studies have shown that the human posterior parietal cortex (PPC) contains four topographically organized areas along the intraparietal sulcus (IPS1-IPS4). Using a memory-guided saccade paradigm, we confirmed the locations and retinotopic organization of IPS1-IPS4 and identified two additional areas, IPS5 and superior parietal lobule 1 (SPL1). IPS5 is located at the intersection of the intraparietal and postcentral sulcus; SPL1 branches off the IPS and extends into the superior parietal lobule. Both areas, as well as IPS1-IPS4, each contain a representation of the contralateral visual hemifield. We then probed core functions of the dorsal pathway in these areas, that is, the representation of eye movements and visual motion, to compare the functional characteristics of human PPC to physiologically and anatomically defined areas in monkey PPC. First, as in monkey PPC, a gradient representation of eye movements was found along the IPS with decreasing responses for saccades and increasing responses for smooth pursuit eye movements from posterior/medial to anterior/lateral. The greatest preference for saccades was found in SPL1 and for smooth pursuit in IPS5. Second, and again similar to monkey PPC, all topographically organized PPC areas responded to different types of motion including planar, circular, and radial optic flow, as assessed using adaptation paradigms. Areas in posterior IPS preferred radial optic flow over planar motion, whereas areas in anterior PPC did not show preference for a particular motion type. Together, our results indicate strikingly similar characteristics in the general functional organization of human and monkey PPC, but also reveal some notable differences.

Spatial updating: how the brain keeps track of changing object locations during observer motion

As you move through an environment, the positions of surrounding objects relative to your body constantly change. Updating these locations is a central feature of situational awareness and readiness to act. Here, we used functional magnetic resonance imaging and a virtual environment to test how the human brain uses optic flow to monitor changing object coordinates. Only activation profiles in the precuneus and the dorsal premotor cortex (PMd) were indicative of an updating process operating on a memorized egocentric map of space. A subsequent eye movement study argued against the alternative explanation that activation in PMd could be driven by oculomotor signals. Finally, introducing a verbal response mode revealed a dissociation between the two regions, with the PMd only showing updating-related responses when participants responded by pointing. We conclude that visual spatial updating relies on the construction of updated representations in the precuneus and the context-dependent planning of motor actions in PMd.

Probabilistic maps, morphometry, and variability of cytoarchitectonic areas in the human superior parietal cortex

Recently, 8 areas (5Ci, 5M, 5L, 7PC, 7A, 7P, 7M, hIP3) in the human superior parietal cortex (SPC) were delineated in 10 postmortem brains using observer-independent cytoarchitectonic analysis. Here we present 3D probabilistic maps of these areas, quantifying the interindividual overlap for each voxel in stereotaxic reference space, and a maximum probability map, providing a contiguous parcellation. For all areas, we determined probabilities of mutual borders, calculated stereotaxic centers of gravity, and estimated volumes. A basic pattern of areas and borders was observed, which showed, however, intersubject variations and a significant interhemispheric asymmetry (7P, 7M) that may be functionally relevant. There was a trend toward higher intersubject anatomical variability in lateral compared with medial areas. For several areas (5M, 7PC, 7A, 7P), variability was significantly higher in the left hemisphere and/or in men, whereas for areas 5Ci and 5M there was a hemisphere-by-gender interaction. Differences in anatomical variability could bias group analyses in functional imaging studies by reducing sensitivity for activations of entities with high variability. The probabilistic maps provide an objective anatomical reference and account for the structural variability of the human brain. Integrated into functional imaging experiments, they can improve structure-function investigations of the human SPC.

Retinotopy and attention in human occipital, temporal, parietal, and frontal cortex

Novel mapping stimuli composed of biological motion figures were used to study the extent and layout of multiple retinotopic regions in the entire human brain and to examine the independent manipulation of retinotopic responses by visual stimuli and by attention. A number of areas exhibited retinotopic activations, including full or partial visual field representations in occipital cortex, the precuneus, motion-sensitive temporal cortex (extending into the superior temporal sulcus), the intraparietal sulcus, and the vicinity of the frontal eye fields in frontal cortex. Early visual areas showed mainly stimulus-driven retinotopy; parietal and frontal areas were driven primarily by attention; and lateral temporal regions could be driven by both. We found clear spatial specificity of attentional modulation not just in early visual areas but also in classical attentional control areas in parietal and frontal cortex. Indeed, strong spatiotopic activity in these areas could be evoked by directed attention alone. Conversely, motion-sensitive temporal regions, while exhibiting attentional modulation, also responded significantly when attention was directed away from the retinotopic stimuli.

Visual field maps in human cortex

Much of the visual cortex is organized into visual field maps: nearby neurons have receptive fields at nearby locations in the image. Mammalian species generally have multiple visual field maps with each species having similar, but not identical, maps. The introduction of functional magnetic resonance imaging made it possible to identify visual field maps in human cortex, including several near (1) medial occipital (V1,V2,V3), (2) lateral occipital (LO-1,LO-2, hMT+), (3) ventral occipital (hV4, VO-1, VO-2), (4) dorsal occipital (V3A, V3B), and (5) posterior parietal cortex (IPS-0 to IPS-4). Evidence is accumulating for additional maps, including some in the frontal lobe. Cortical maps are arranged into clusters in which several maps have parallel eccentricity representations, while the angular representations within a cluster alternate in visual field sign. Visual field maps have been linked to functional and perceptual properties of the visual system at various spatial scales, ranging from the level of individual maps to map clusters to dorsal-ventral streams. We survey recent measurements of human visual field maps, describe hypotheses about the function and relationships between maps, and consider methods to improve map measurements and characterize the response properties of neurons comprising these maps.

Human intraparietal sulcus (IPS) and competition between exogenous and endogenous saccade plans

How are stimulus-driven reflexes generated, and what controls their competition with voluntary action? The saccadic reflex to look towards an abrupt visual onset (prosaccade) has been associated with the retinotectal and magnocellular pathways, which rapidly convey signals to the superior colliculus and cortical eye fields. Such stimulus-driven reflexes need to be suppressed when making an eye movement in the opposite direction (antisaccade), resulting in a cost in saccade latency. We compared the latencies of pro- and anti-saccades elicited by conventional luminance stimuli with those evoked by stimuli visible only to short-wave-sensitive cones (S cones) embedded in dynamic luminance noise. Critically, the retinotectal and magnocellular pathways are functionally blind to such stimuli. Compared to luminance stimuli, antisaccade latency costs were significantly reduced for 'S-cone' stimuli. This behavioural interaction is consistent with reduced competition between reflexive and endogenous saccade plans when S-cone stimuli are employed, while other processes involved in making an antisaccade, such as changing preparatory set or generating an endogenous saccade, are predicted to be equivalent for each kind of stimulus. Using fMRI, we found that activity in the right intraparietal sulcus (IPS) mirrored the behavioural interaction in saccade latencies. Thus, the right IPS appears to index the degree of competition between exogenous and endogenous saccade plans, showing the activity pattern predicted for an area involved in suppressing the saccade reflex. Furthermore, signals recorded from the superior colliculus showed the reverse pattern of responses, consistent with a direct inhibitory influence of IPS on SC.

Cortical activity time locked to the shift and maintenance of spatial attention

Attention increases the gain of visual neurons, which improves visual performance. How attention is controlled, however, remains unknown. Clear correlations between attention and saccade planning indicate that the control of attention is mediated through mechanisms housed in the oculomotor network. Here, we used event-related functional magnetic resonance imaging to compare overt and covert attention shifts. Subjects covertly or overtly shifted attention based on an endogenous cue and maintained attention throughout a long and variable delay. To insure continued attention, subjects counted when the attended target dimmed at near-threshold contrast levels. Overt and covert tasks used identical stimuli and required identical motor responses. Additionally, a staircase procedure that adjusted the target-dimming contrast separately for covert and overt trials equated the difficulty between conditions and across subjects. We found that the same regions along the precentral and intraparietal sulci were active during shifts of covert and overt attention. We also found sustained activation in the hemisphere contralateral to the attended visual field. We conclude that maps of prioritized locations are represented in areas classically associated with oculomotor control. The readout of these spatial maps by posterior visual areas directs spatial attention just as the readout by downstream saccade generators directs saccades.

Human cortical representations for reaching: mirror neurons for execution, observation, and imagery

We used functional magnetic resonance imaging (fMRI) to map the cortical representations of executed reaching, observed reaching, and imagined reaching in humans. Whereas previous studies have mostly examined hand actions related to grasping, hand-object interactions, or local finger movements, here we were interested in reaching only (i.e. the transport phase of the hand to a particular location in space), without grasping. We hypothesized that mirror neuron areas specific to reaching-related representations would be active in all three conditions. An overlap between executed, observed, and imagined reaching activations was found in dorsal premotor cortex as well as in the superior parietal lobe and the intraparietal sulcus, in accord with our hypothesis. Activations for observed reaching were more dorsal than activations typically reported in the literature for observation of hand-object interactions (grasping). Our results suggest that the mirror neuron system is specific to the type of hand action performed, and that these fronto-parietal activations are a putative human homologue of the neural circuits underlying reaching in macaques. The parietal activations reported here for executed, imagined, and observed reaching are also consistent with previous functional imaging studies on planned reaching and delayed pointing movements, and extend the proposed localization of human reach-related brain areas to observation as well as imagery of reaching.

Persistent neural activity during the maintenance of spatial position in working memory

The mechanism for the short-term maintenance of information involves persistent neural activity during the retention interval, which forms a bridge between the cued memoranda and its later contingent response. Here, we used event-related functional magnetic resonance imaging to identify cortical areas with activity that persists throughout working memory delays with the goal of testing if such activity represents visuospatial attention or prospective saccade goals. We did so by comparing two spatial working memory tasks. During a memory-guided saccade (MGS) task, a location was maintained during a delay after which a saccade was generated to the remembered location. During a spatial item recognition (SIR) task identical to MGS until after the delay, a button press indicated whether a newly cued location matched the remembered location. Activity in frontal and parietal areas persisted above baseline and was greater in the hemisphere contralateral to the cued visual field. However, delay-period activity did not differ between the tasks. Notably, in the putative frontal eye field (FEF), delay period activity did not differ despite that the precise metrics of the memory-guided saccade were known during the MGS delay and saccades were never made in SIR. Persistent FEF activity may therefore represent a prioritized attentional map of space, rather than the metrics for saccades.