Quadrantic deficit reveals anatomical constraints on selection

Visual selective attention and the control of tracking eye movements: a critical review

People’s eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

Cortical Distance but Not Physical Distance Modulates Attentional Rhythms

It has been well documented that the spotlight of attention is intrinsically rhythmic and oscillates by discretely sampling either single or multiple objects. However, the neural site of attentional rhythms remains poorly understood. Considering the topography of visual cortical areas, we modulated the cortical distances of two gratings while fixing the corresponding retinal distance by setting the gratings on different sides (cortically far, Experiment 1) or on the same side (cortically near, Experiment 2) of the vertical median, to investigate the interhemispheric divide effect in attentional rhythms. The cue-target stimulus onset asynchrony (SOA) varied from 0.1 s to 1.08 s in 20-ms increments, allowing fluctuations below 50 Hz to be examined. The results showed that when the two stimuli were on opposite sides of the vertical meridian, attentional rhythms were observed at theta and alpha frequencies, consistent with the results reported in previous studies. However, when the two stimuli were located on the same side of the vertical meridian, attentional rhythms were not observed. This study indicates that attentional rhythms are modulated by cortical distance but not by physical distance.

Understanding diaschisis models of attention dysfunction with rTMS

Visual attentive tracking requires a balance of excitation and inhibition across large-scale frontoparietal cortical networks. Using methods borrowed from network science, we characterize the induced changes in network dynamics following low frequency (1 Hz) repetitive transcranial magnetic stimulation (rTMS) as an inhibitory noninvasive brain stimulation protocol delivered over the intraparietal sulcus. When participants engaged in visual tracking, we observed a highly stable network configuration of six distinct communities, each with characteristic properties in node dynamics. Stimulation to parietal cortex had no significant impact on the dynamics of the parietal community, which already exhibited increased flexibility and promiscuity relative to the other communities. The impact of rTMS, however, was apparent distal from the stimulation site in lateral prefrontal cortex. rTMS temporarily induced stronger allegiance within and between nodal motifs (increased recruitment and integration) in dorsolateral and ventrolateral prefrontal cortex, which returned to baseline levels within 15 min. These findings illustrate the distributed nature by which inhibitory rTMS perturbs network communities and is preliminary evidence for downstream cortical interactions when using noninvasive brain stimulation for behavioral augmentations.

Selection enables enhancement: An integrated model of object tracking

The diversity of research on visual attention and multiple-object tracking presents challenges for anyone hoping to develop a unified account. One key challenge is identifying the attentional limitations that give rise to competition among targets during tracking. To address this challenge, we present a computational model of object tracking that relies on two attentional mechanisms: serial selection and parallel enhancement. Selection picks out an object for further processing, whereas enhancement increases sensitivity to stimuli in regions where objects have been selected previously. In this model, multiple target locations can be tracked in parallel via enhancement, whereas a single target can be selected so that additional information beyond its location can be processed. In simulations of two psychological experiments, we demonstrate that spatial competition during enhancement and temporal competition for selection can explain a range of findings on multiple-object tracking, and we argue that the interaction between selection and enhancement captured in the model is critical to understanding attention more broadly.

Vertical and horizontal meridian modulations suggest areas with quadrantic representations as neural locus of the attentional repulsion effect

The attentional repulsion effect (ARE) is a perceptual bias attributed to a covert shift of attention toward a peripheral cue, which, in turn, repulses the perceived position of a subsequently presented probe (Suzuki & Cavanagh, 1997). So far, probes were mainly presented around the vertical meridian. Other studies of perceptual biases reported disruptions when stimuli were presented across the vertical meridian. These disruptions were explained by separate representations of the left and right visual hemifields, projecting to opposite anatomical hemispheres. As the ARE is typically examined through two-alternative, forced-choice tasks in which the estimation of the probe's position is based on the cue's effectiveness to repulse the probe across the vertical meridian, no such asymmetry has been reported. To test for similar meridian disruptions in the ARE, we collected absolute estimations (computer mouse responses) of the perceived probe positions (Experiment 1a). As absolute estimations of memorized positions are associated with overestimated distances in reproduction, results had to be compared to a no-cue baseline condition (Experiment 1b). Through this new methodological approach, we found the ARE to be strongest when the attentional capturing cue and the subsequently presented probe were displayed in the same hemifield (Experiment 2a). In a further experiment (Experiment 2b), we observed that the ARE is not only disrupted at the vertical, but also at the horizontal meridian. These disruptions at both meridians suggest the involvement of visual neural areas with quadrantic representations, such as V2 and/or V3 in the generation of the ARE.

A Normalization Circuit Underlying Coding of Spatial Attention in Primate Lateral Prefrontal Cortex

Lateral prefrontal cortex (LPFC) neurons signal the allocation of voluntary attention; however, the neural computations underlying this function remain unknown. To investigate this, we recorded from neuronal ensembles in the LPFC of two Macaca fascicularis performing a visuospatial attention task. LPFC neural responses to a single stimulus were normalized when additional stimuli/distracters appeared across the visual field and were well-characterized by an averaging computation. Deploying attention toward an individual stimulus surrounded by distracters shifted neural activity from an averaging regime toward a regime similar to that when the attended stimulus was presented in isolation (winner-take-all; WTA). However, attentional modulation is both qualitatively and quantitatively dependent on a neuron’s visuospatial tuning. Our results show that during attentive vision, LPFC neuronal ensemble activity can be robustly read out by downstream areas to generate motor commands, and/or fed back into sensory areas to filter out distracter signals in favor of target signals.

Meridian interference reveals neural locus of motion-induced position shifts

When a Gabor patch moves along a path in one direction while its internal texture drifts orthogonally to this path, it can appear to deviate from its physical path by 45° or more. This double-drift illusion is different from other motion-induced position shift effects in several ways: it has an integration period of over a second; the illusory displacement that accumulates over a second or more is orthogonal to rather than along the motion path; the perceptual deviations are much larger; and they have little or no effect on eye movements to the target. In this study we investigated the underlying neural mechanisms of the motion integration and position processing for this double-drift stimulus by testing possible anatomical constraints on its magnitude. We found that the illusion was reduced at the vertical and horizontal meridians when the perceptual path would cross or be driven toward the meridian, but not at other locations or other motion directions. The disruption of the accumulation of the position error at both the horizontal and vertical meridians suggests a central role of quadrantic areas in the generation of this type of motion-induced position shift. NEW & NOTEWORTHY The remarkably strong double-drift illusion is disrupted at both the vertical and horizontal meridians. We propose that this finding is the behavioral consequence of the anatomical gaps at both meridians, suggesting that neural areas with quadrantic representations (e.g., V2, V3) are the initial locus of this motion-induced position shift. This result rules out V1 as the source of the illusion because it has an anatomical break only at the vertical meridian.

Lateralization of Executive Function: Working Memory Advantage for Same Hemifield Stimuli in the Monkey

Working memory capacity, the amount of information that may be maintained in mind over a period of seconds, is extremely limited, to a handful of items. Some evidence exists that the number of visual items that may be maintained in working memory is independent for the two hemifields. To test this idea, we trained monkeys to perform visual working memory tasks that required maintenance in memory of the locations and/or shapes of 3–5 visual stimuli. We then tested whether systematic performance differences were present for stimuli concentrated in the same hemifield, vs. distributed across hemifields. We found little evidence to support the expectation that working memory capacity is independent in the two hemifields. Instead, when an advantage of stimulus arrangement was present, it involved multiple stimuli presented in the same hemifield. This conclusion was consistent across variations of the task, performance levels, and apparent strategies adopted by individual subjects. This result suggests that factors such as grouping that favor processing of stimuli in relative proximity may counteract the benefits of independent processing in the two hemispheres. Our results reveal an important property of working memory and place constraints on models of working memory capacity.

Nonuniform Changes in the Distribution of Visual Attention from Visual Complexity and Action: A Driving Simulation Study

Researchers acknowledge the interplay between action and attention, but typically consider action as a response to successful attentional selection or the correlation of performance on separate action and attention tasks. We investigated how concurrent action with spatial monitoring affects the distribution of attention across the visual field. We embedded a functional field of view (FFOV) paradigm with concurrent central object recognition and peripheral target localization tasks in a simulated driving environment. Peripheral targets varied across 20-60 deg eccentricity at 11 radial spokes. Three conditions assessed the effects of visual complexity and concurrent action on the size and shape of the FFOV: (1) with no background, (2) with driving background, and (3) with driving background and vehicle steering. The addition of visual complexity slowed task performance and reduced the FFOV size but did not change the baseline shape. In contrast, the addition of steering produced not only shrinkage of the FFOV, but also changes in the FFOV shape. Nonuniform performance decrements occurred in proximal regions used for the central task and for steering, independent of interference from context elements. Multifocal attention models should consider the role of action and account for nonhomogeneities in the distribution of attention.

Local Immediate versus Long-Range Delayed Changes in Functional Connectivity Following rTMS on the Visual Attention Network

BACKGROUND

The interhemispheric competition hypothesis attributes the distribution of selective attention to a balance of mutual inhibition between homotopic, interhemispheric connections in parietal cortex (Kinsbourne 1977; Battelli et al., 2009). In support of this hypothesis, repetitive inhibitory TMS over right parietal cortex in healthy individuals rapidly induces interhemispheric imbalance in cortical activity that spreads beyond the site of stimulation (Plow et al., 2014). Behaviorally, the impacts of inhibitory rTMS may be long delayed from the onset of stimulation, as much as 30 minutes (Agosta et al., 2014; Hubl et al., 2008).

OBJECTIVE

In this study, we examine the temporal dynamics of inhibitory rTMS on cortical network integrity that supports sustained visual attention.

METHODS

Healthy individuals received 15 min of 1 Hz offline, inhibitory rTMS (or sham) over left parietal cortex, and then immediately engaged in a bilateral visual tracking task while we recorded brain activity with fMRI. We computed functional connectivity (FC) between three nodes of the attention network engaged by visual tracking: the intraparietal sulcus (IPS), frontal eye fields (FEF) and human MT+ (hMT+).

RESULTS

FC immediately and significantly decreased between the stimulation site (left IPS) and all other regions, then recovered to normal levels within 30 minutes. rTMS increased FC between left and right FEF at approximately 36 min following stimulation, and between sites in the unstimulated hemisphere approximately 48 min after stimulation.

CONCLUSIONS

These findings demonstrate large-scale changes in cortical organization following inhibitory rTMS. The immediate impact of rTMS on connectivity to the stimulation site dovetails with the putative role of interhemispheric balance for bilateral visual sustained attention. The delayed, compensatory increases in functional connectivity have implications for models of dynamic reorganization in networks supporting spatial and nonspatial selective attention, and compensatory mechanisms within these networks that may be stabilized in chronic stroke.

The whole is faster than its parts: evidence for temporally independent attention to distinct spatial locations

Behavioral and electrophysiological evidence suggests that visual attention operates in parallel at distinct spatial locations and samples the environment in periodic episodes. This combination of spatial and temporal characteristics raises the question of whether attention samples locations in a phase-locked or temporally independent manner. If attentional sampling rates were phase locked, attention would be limited by a global sampling rate. However, if attentional sampling rates were temporally independent, they could operate additively to sample higher rates of information. We tested these predictions by requiring participants to identify targets in 2 or 4 rapid serial visual presentation (RSVP) streams, synchronized or asynchronized to manipulate the rate of new information globally (across streams). Identification accuracy exhibited little or no change when the global rate of new information doubled from 7.5 to 15 Hz (Experiment 1) or quadrupled to 30 Hz (Experiment 2). This relatively stable identification accuracy occurred even though participants reliably discriminated 7.5 Hz synchronous displays from displays globally asynchronized at 15 and 30 Hz (Metamer Control Experiment). Identification accuracy in the left visual field also significantly exceeded that in the right visual field. Overall, our results are consistent with temporally independent attention across distinct spatial locations and support previous reports of a right parietal "when" pathway specialized for temporal attention.

The compensatory dynamic of inter-hemispheric interactions in visuospatial attention revealed using rTMS and fMRI

A balance of mutual tonic inhibition between bi-hemispheric posterior parietal cortices is believed to play an important role in bilateral visual attention. However, experimental support for this notion has been mainly drawn from clinical models of unilateral damage. We have previously shown that low-frequency repetitive TMS (rTMS) over the intraparietal sulcus (IPS) generates a contralateral attentional deficit in bilateral visual tracking. Here, we used functional magnetic resonance imaging (fMRI) to study whether rTMS temporarily disrupts the inter-hemispheric balance between bilateral IPS in visual attention. Following application of 1 Hz rTMS over the left IPS, subjects performed a bilateral visual tracking task while their brain activity was recorded using fMRI. Behaviorally, tracking accuracy was reduced immediately following rTMS. Areas ventro-lateral to left IPS, including inferior parietal lobule (IPL), lateral IPS (LIPS), and middle occipital gyrus (MoG), showed decreased activity following rTMS, while dorsomedial areas, such as Superior Parietal Lobule (SPL), Superior occipital gyrus (SoG), and lingual gyrus, as well as middle temporal areas (MT+), showed higher activity. The brain activity of the homologues of these regions in the un-stimulated, right hemisphere was reversed. Interestingly, the evolution of network-wide activation related to attentional behavior following rTMS showed that activation of most occipital synergists adaptively compensated for contralateral and ipsilateral decrement after rTMS, while activation of parietal synergists, and SoG remained competing. This pattern of ipsilateral and contralateral activations empirically supports the hypothesized loss of inter-hemispheric balance that underlies clinical manifestation of visual attentional extinction.

Transfer of learning between hemifields in multiple object tracking: memory reduces constraints of attention

Many tasks involve tracking multiple moving objects, or stimuli. Some require that individuals adapt to changing or unfamiliar conditions to be able to track well. This study explores processes involved in such adaptation through an investigation of the interaction of attention and memory during tracking. Previous research has shown that during tracking, attention operates independently to some degree in the left and right visual hemifields, due to putative anatomical constraints. It has been suggested that the degree of independence is related to the relative dominance of processes of attention versus processes of memory. Here we show that when individuals are trained to track a unique pattern of movement in one hemifield, that learning can be transferred to the opposite hemifield, without any evidence of hemifield independence. However, learning is not influenced by an explicit strategy of memorisation of brief periods of recognisable movement. The findings lend support to a role for implicit memory in overcoming putative anatomical constraints on the dynamic, distributed spatial allocation of attention involved in tracking multiple objects.

Competition explains limited attention and perceptual resources: implications for perceptual load and dilution theories

Both perceptual load theory and dilution theory purport to explain when and why task-irrelevant information, or so-called distractors are processed. Central to both explanations is the notion of limited resources, although the theories differ in the precise way in which those limitations affect distractor processing. We have recently proposed a neurally plausible explanation of limited resources in which neural competition among stimuli hinders their representation in the brain. This view of limited capacity can also explain distractor processing, whereby the competitive interactions and bias imposed to resolve the competition determine the extent to which a distractor is processed. This idea is compatible with aspects of both perceptual load and dilution models of distractor processing, but also serves to highlight their differences. Here we review the evidence in favor of a biased competition view of limited resources and relate these ideas to both classic perceptual load theory and dilution theory.

Flexible cognitive resources: competitive content maps for attention and memory

The brain has finite processing resources so that, as tasks become harder, performance degrades. Where do the limits on these resources come from? We focus on a variety of capacity-limited buffers related to attention, recognition, and memory that we claim have a two-dimensional 'map' architecture, where individual items compete for cortical real estate. This competitive format leads to capacity limits that are flexible, set by the nature of the content and their locations within an anatomically delimited space. We contrast this format with the standard 'slot' architecture and its fixed capacity. Using visual spatial attention and visual short-term memory as case studies, we suggest that competitive maps are a concrete and plausible architecture that limits cognitive capacity across many domains.

Anatomical constraints on attention: hemifield independence is a signature of multifocal spatial selection

Previous studies have shown independent attentional selection of targets in the left and right visual hemifields during attentional tracking (Alvarez & Cavanagh, 2005) but not during a visual search (Luck, Hillyard, Mangun, & Gazzaniga, 1989). Here we tested whether multifocal spatial attention is the critical process that operates independently in the two hemifields. It is explicitly required in tracking (attend to a subset of object locations, suppress the others) but not in the standard visual search task (where all items are potential targets). We used a modified visual search task in which observers searched for a target within a subset of display items, where the subset was selected based on location (Experiments 1 and 3A) or based on a salient feature difference (Experiments 2 and 3B). The results show hemifield independence in this subset visual search task with location-based selection but not with feature-based selection; this effect cannot be explained by general difficulty (Experiment 4). Combined, these findings suggest that hemifield independence is a signature of multifocal spatial attention and highlight the need for cognitive and neural theories of attention to account for anatomical constraints on selection mechanisms.

Attentional signatures of perception: multiple object tracking reveals the automaticity of contour interpolation

Multiple object tracking (MOT) is an attentional task wherein observers attempt to track multiple targets among moving distractors. Contour interpolation is a perceptual process that fills-in nonvisible edges on the basis of how surrounding edges (inducers) are spatiotemporally related. In five experiments, we explored the automaticity of interpolation through its influences on tracking. We found that (1) when the edges of targets and distractors jointly formed dynamic illusory or occluded contours, tracking accuracy worsened; (2) when interpolation bound all four targets together, performance improved; (3) when interpolation strength was weakened (by altering the size or relative orientation of inducing edges), tracking effects disappeared; and (4) real and interpolated contours influenced tracking comparably, except that real contours could more effectively shift attention toward distractors. These results suggest that interpolation's characteristics-and, in particular, its automaticity-can be revealed through its attentional influences or "signatures" within tracking. Our results also imply that relatively detailed object representations are formed in parallel, and that such representations can affect tracking when they become relevant to scene segmentation.

Visual cognition

Visual cognition, high-level vision, mid-level vision and top-down processing all refer to decision-based scene analyses that combine prior knowledge with retinal input to generate representations. The label "visual cognition" is little used at present, but research and experiments on mid- and high-level, inference-based vision have flourished, becoming in the 21st century a significant, if often understated part, of current vision research. How does visual cognition work? What are its moving parts? This paper reviews the origins and architecture of visual cognition and briefly describes some work in the areas of routines, attention, surfaces, objects, and events (motion, causality, and agency). Most vision scientists avoid being too explicit when presenting concepts about visual cognition, having learned that explicit models invite easy criticism. What we see in the literature is ample evidence for visual cognition, but few or only cautious attempts to detail how it might work. This is the great unfinished business of vision research: at some point we will be done with characterizing how the visual system measures the world and we will have to return to the question of how vision constructs models of objects, surfaces, scenes, and events.

Interhemispheric integration in visual search

The search task of Luck, Hillyard, Mangun and Gazzaniga (1989) was optimised to test for the presence of a bilateral field advantage in the visual search capabilities of normal subjects. The modified design used geometrically regular arrays of 2, 4 or 8 items restricted to hemifields delineated by the vertical or horizontal meridian; the target, if present, appeared at one of two fixed positions per quadrant at an eccentricity of 11 deg. Group and individual performance data were analysed in terms of the slope of response time against display-size functions (‘RT slope’). Averaging performance across all conditions save display mode (bilateral vs. unilateral) revealed a significant bilateral advantage in the form of a 21% increase in apparent item scanning speed for target detection; in the absence of a target, bilateral displays gave a 5% increase in speed that was not significant. Factor analysis by ANOVA confirmed this main effect of display mode, and also revealed several higher order interactions with display geometry, indicating that the bilateral advantage was masked at certain target positions by a crowding-like effect.

In a numerical model of search efficiency (i.e. RT slope), bilateral advantage was parameterised by an interhemispheric ‘transfer factor’ (T) that governs the strength of the ipsilateral representation of distractors, and modifies the level of intrahemispheric competition with the target. The factor T was found to be higher in superior field than inferior field; this result held for the modelled data of each individual subject, as well as the group, representing a uniform tendency for the bilateral advantage to be more prominent in inferior field. In fact statistical analysis and modelling of search efficiency showed that the geometrical display factors (target polar and quadrantic location, and associated crowding effects) were all remarkably consistent across subjects. Greater variability was inferred within a fixed, decisional component of response time, with individual subjects capable of opposite hemifield biases.

The results are interpretable by a guided search model of spatial attention – a first, parallel stage guiding selection by a second, serial stage – with the proviso that the first stage is relatively insular within each hemisphere. The bilateral advantage in search efficiency can then be attributed to a relative gain in target weight within the initial parallel stage, owing to a reduction in distractor competition mediated specifically by intrahemispheric circuitry. In the absence of a target there is no effective guidance, and hence no basis for a bilateral advantage to enhance search efficiency; the equivalence of scanning speed for the two display modes (bilateral and unilateral) implies a unitary second-stage process mediated via efficient interhemispheric integration.

A bilateral advantage for storage in visual working memory

Various studies have demonstrated enhanced visual processing when information is presented across both visual hemifields rather than in a single hemifield (the bilateral advantage). For example, Alvarez and Cavanagh (2005) reported that observers were able to track twice as many moving visual stimuli when the tracked items were presented bilaterally rather than unilaterally, suggesting that independent resources enable tracking in the two visual fields. Motivated by similarities in the apparent capacity and neural substrates that mediate tracking and visual working memory (WM), the present work examined whether or not a bilateral advantage also arises during storage in visual WM. Using a recall procedure to assess working memory for orientation information, we found a reliable bilateral advantage; recall error was smaller with bilateral sample displays than with unilateral displays. To demonstrate that the bilateral advantage influenced storage per se rather than just encoding efficiency, we replicated the observed bilateral advantage using sequentially presented stimuli. Finally, to further characterize how bilateral presentations enhanced storage in working memory, we measured both the number and the resolution of the stored items and found that bilateral presentations lead to an increased probability of storage, rather than enhanced mnemonic resolution. Thus, the bilateral advantage extends beyond the initial selection and encoding of visual information to influence online maintenance in visual working memory.

Distinguishing between parallel and serial accounts of multiple object tracking

Humans can track multiple moving objects. Is this accomplished by attending to all the objects at the same time or do we attend to each object in turn? We addressed this question using a novel application of the classic simultaneous-sequential paradigm. We considered a display in which objects moved for only part of the time. In one condition, the objects moved sequentially, whereas in the other condition they all moved and paused simultaneously. A parallel model would predict that the targets are tracked independently, so the tracking of one target should not be influenced by the movement of another target. Thus, one would expect equal performance in the two conditions. Conversely, a simple serial account of object tracking would predict that an observer's accuracy should be greater in the sequential condition because in that condition, at any one time, fewer targets are moving and thus need to be attended. In fact, in our experiments we observed performance in the simultaneous condition to be equal to or greater than the performance in the sequential condition. This occurred regardless of the number of targets or how the targets were positioned in the visual field. These results are more directly in line with a parallel account of multiple object tracking.

Tracking multiple objects is limited only by object spacing, not by speed, time, or capacity

In dealing with a dynamic world, people have the ability to maintain selective attention on a subset of moving objects in the environment. Performance in such multiple-object tracking is limited by three primary factors-the number of objects that one can track, the speed at which one can track them, and how close together they can be. We argue that this last limit, of object spacing, is the root cause of all performance constraints in multiple-object tracking. In two experiments, we found that as long as the distribution of object spacing is held constant, tracking performance is unaffected by large changes in object speed and tracking time. These results suggest that barring object-spacing constraints, people could reliably track an unlimited number of objects as fast as they could track a single object.

The number of attentional foci and their precision are dissociated in the posterior parietal cortex

Many everyday tasks require us to track moving objects with attention. The demand for attention increases both when more targets are tracked and when the targets move faster. These 2 aspects of attention-assigning multiple attentional foci (or indices) to targets and monitoring each focus with precision-may tap into different cognitive and brain mechanisms. In this study, we used functional magnetic resonance imaging to quantify the response profile of dorsal attentional areas to variations in the number of attentional foci and their spatiotemporal precision. Subjects were asked to track a specific spoke of either 1 or 2 pinwheels that rotated at various speeds. Their tracking performance declined both when more pinwheels were tracked and when the tracked pinwheels rotated faster. However, posterior parietal activity increased only when subjects tracked more pinwheels but remained flat when they tracked faster moving pinwheels. The frontal eye fields and early visual areas increased activity when there were more targets and when the targets rotated faster. These results suggest that the posterior parietal cortex is specifically involved in indexing independently moving targets with attention but not in monitoring each focus with precision.

Reduction of the crowding effect in spatially adjacent but cortically remote visual stimuli

When embedded in adjacent distractors, a target becomes more difficult to perceive. The neural mechanism for this ubiquitous visual crowding effect remains unresolved. Stimuli presented on opposite sides of the vertical meridian initially project to different hemispheres, whereas stimuli with the same spatial distance but presented to one side of the vertical meridian project to the same hemisphere. Dissociation between visual spatial distance and cortical distance can also be found in V2 and V3 (quadrant representations of the visual hemifield) along the horizontal meridian. In the current study, we observed a strong crowding effect from spatially adjacent distractors with either Gabor or letter targets presented near the vertical or horizontal meridian. Interestingly, for a target presented near the vertical meridian, a distractor from the same side of the meridian (cortically near) had a significantly stronger crowding effect compared with an equidistant distractor presented on the opposite side (cortically remote). No such meridian modulation was observed across the horizontal meridian. These results constrain the cortical locus of the crowding effect to a stage in which left and right visual spaces are represented discontinuously but the upper and lower visual fields are represented continuously, likely beyond the early retinotopic areas.

Evidence against a speed limit in multiple-object tracking

Everyday tasks often require us to keep track of multiple objects in dynamic scenes. Past studies show that tracking becomes more difficult as objects move faster. In the present study, we show that this trade-off may not be due to increased speed itself but may, instead, be due to the increased crowding that usually accompanies increases in speed. Here, we isolate changes in speed from variations in crowding, by projecting a tracking display either onto a small area at the center of a hemispheric projection dome or onto the entire dome. Use of the larger display increased retinal image size and object speed by a factor of 4 but did not increase interobject crowding. Results showed that tracking accuracy was equally good in the large-display condition, even when the objects traveled far into the visual periphery. Accuracy was also not reduced when we tested object speeds that limited performance in the small-display condition. These results, along with a reinterpretation of past studies, suggest that we might be able to track multiple moving objects as fast as we can a single moving object, once the effect of object crowding is eliminated.

Spatial separation between targets constrains maintenance of attention on multiple objects

Humans are limited in their ability to maintain multiple attentional foci. In attentive tracking of moving objects, performance declines as the number of tracked targets increases. Previous studies have interpreted such reduction in terms of a limit in the number of attentional foci. However, increasing the number of targets usually reduces spatial separation among different targets. In this study, we examine the role of target spatial separation in maintaining multiple attentional foci. Results from a multiple-object tracking task show that tracking accuracy deteriorates as the spatial separation between targets decreases. We propose that local interaction between nearby attentional foci modulates the resolution of attention, and that capacity limitation from attentive tracking originates in part from limitations in maintaining critical spacing among multiple attentional foci. These findings are consistent with the hypothesis that tracking performance is limited not primarily by a number of locations, but by factors such as the spacing and speed of the targets and distractors.

The "diagonal effect": a systematic error in oblique antisaccades

Antisaccades are known to show greater variable error and also a systematic hypometria in their amplitude compared with visually guided prosaccades. In this study, we examined whether their accuracy in direction (as opposed to amplitude) also showed a systematic error. We had human subjects perform prosaccades and antisaccades to goals located at a variety of polar angles. In the first experiment, subjects made prosaccades or antisaccades to one of eight equidistant locations in each block, whereas in the second, they made saccades to one of two equidistant locations per block. In the third, they made antisaccades to one of two locations at different distances but with the same polar angle in each block. Regardless of block design, the results consistently showed a saccadic systematic error, in that oblique antisaccades (but not prosaccades) requiring unequal vertical and horizontal vector components were deviated toward the 45 degrees diagonal meridians. This finding could not be attributed to range effects in either Cartesian or polar coordinates. A perceptual origin of the diagonal effect is suggested by similar systematic errors in other studies of memory-guided manual reaching or perceptual estimation of direction, and may indicate a common spatial bias when there is uncertain information about spatial location.