The number of attentional foci and their precision are dissociated in the posterior parietal cortex

Selection enables enhancement: An integrated model of object tracking

The diversity of research on visual attention and multiple-object tracking presents challenges for anyone hoping to develop a unified account. One key challenge is identifying the attentional limitations that give rise to competition among targets during tracking. To address this challenge, we present a computational model of object tracking that relies on two attentional mechanisms: serial selection and parallel enhancement. Selection picks out an object for further processing, whereas enhancement increases sensitivity to stimuli in regions where objects have been selected previously. In this model, multiple target locations can be tracked in parallel via enhancement, whereas a single target can be selected so that additional information beyond its location can be processed. In simulations of two psychological experiments, we demonstrate that spatial competition during enhancement and temporal competition for selection can explain a range of findings on multiple-object tracking, and we argue that the interaction between selection and enhancement captured in the model is critical to understanding attention more broadly.

Distinct Neural Mechanisms Meet Challenges in Dynamic Visual Attention due to Either Load or Object Spacing

When engaged in dynamic visuospatial tasks, the brain copes with perceptual and cognitive processing challenges. During multiple-object tracking (MOT), the number of objects to be tracked (i.e., load) imposes attentional demands, but so does spatial interference from irrelevant objects (i.e., close encounters). Presently, it is not clear whether the effect of load on accuracy solely depends on the number of close encounters. If so, the same cognitive and physiological mechanisms deal with increasing load by preparing for and dealing with spatial interference. However, this has never been directly tested. Such knowledge is important to understand the neurophysiology of dynamic visual attention and resolve conflicting views within visual cognition concerning sources of capacity limitations. We varied the processing challenge in MOT task in two ways: the number of targets and the minimum spatial proximity between targets and distractors. In a first experiment, we measured task-induced pupil dilations and saccades during MOT. In a separate cohort, we measured fMRI activity. In both cohorts, increased load and close encounters (i.e., close spatial proximity) led to reduced accuracy in an additive manner. Load was associated with pupil dilations, whereas close encounters were not. Activity in dorsal attentional areas and frequency of saccades were proportionally larger both with higher levels of load and close encounters. Close encounters recruited additionally ventral attentional areas that may reflect orienting mechanisms. The activity in two brainstem nuclei, ventral tegmental area/substantia nigra and locus coeruleus, showed clearly dissociated patterns. Our results constitute convergent evidence indicating that different mechanisms underlie processing challenges due to load and object spacing.

Influence of sports expertise level on attention in multiple object tracking

Background

This study aimed to investigate whether performance in a multiple object tracking (MOT) task could be improved incrementally with sports expertise, and whether differences between experienced and less experienced athletes, or non-athletes, were modulated by load.

Methods

We asked 22 elite and 20 intermediate basketball players, and 23 non-athletes, to perform an MOT task under three attentional load conditions (two, three, and four targets). Accuracies were analyzed to examine whether different levels of sports expertise influence MOT task performance.

Results

The elite athletes displayed better tracking performance compared with the intermediate or non-athletes when tracking three or four targets. However, no significant difference was found between the intermediate athletes and the non-athletes. Further, no differences were observed among the three groups when tracking two targets.

Discussion

The results suggest that the effects of expertise in team ball sports could transfer to a non-sports-specific attention task. These transfer effects to general cognitive functions occur only in elite athletes with extensive training under higher attentional load.

A common source of attention for auditory and visual tracking

Tasks that require tracking visual information reveal the severe limitations of our capacity to attend to multiple objects that vary in time and space. Although these limitations have been extensively characterized in the visual domain, very little is known about tracking information in other sensory domains. Does tracking auditory information exhibit characteristics similar to those of tracking visual information, and to what extent do these two tracking tasks draw on the same attention resources? We addressed these questions by asking participants to perform either single or dual tracking tasks from the same (visual-visual) or different (visual-auditory) perceptual modalities, with the difficulty of the tracking tasks being manipulated across trials. The results revealed that performing two concurrent tracking tasks, whether they were in the same or different modalities, affected tracking performance as compared to performing each task alone (concurrence costs). Moreover, increasing task difficulty also led to increased costs in both the single-task and dual-task conditions (load-dependent costs). The comparison of concurrence costs between visual-visual and visual-auditory dual-task performance revealed slightly greater interference when two visual tracking tasks were paired. Interestingly, however, increasing task difficulty led to equivalent costs for visual-visual and visual-auditory pairings. We concluded that visual and auditory tracking draw largely, though not exclusively, on common central attentional resources.

Neurocognitive Development of the Resolution of Selective Visuo-Spatial Attention: Functional MRI Evidence From Object Tracking

Our ability to select relevant information from the environment is limited by the resolution of attention – i.e., the minimum size of the region that can be selected. Neural mechanisms that underlie this limit and its development are not yet understood. Functional magnetic resonance imaging (fMRI) was performed during an object tracking task in 7- and 11-year-old children, and in young adults. Object tracking activated canonical fronto-parietal attention systems and motion-sensitive area MT in children as young as 7 years. Object tracking performance improved with age, together with stronger recruitment of parietal attention areas and a shift from low-level to higher-level visual areas. Increasing the required resolution of spatial attention – which was implemented by varying the distance between target and distractors in the object tracking task – led to activation increases in fronto-insular cortex, medial frontal cortex including anterior cingulate cortex (ACC) and supplementary motor area, superior colliculi, and thalamus. This core circuitry for attentional precision was recruited by all age groups, but ACC showed an age-related activation reduction. Our results suggest that age-related improvements in selective visual attention and in the resolution of attention are characterized by an increased use of more functionally specialized brain regions during the course of development.

Local Immediate versus Long-Range Delayed Changes in Functional Connectivity Following rTMS on the Visual Attention Network

BACKGROUND

The interhemispheric competition hypothesis attributes the distribution of selective attention to a balance of mutual inhibition between homotopic, interhemispheric connections in parietal cortex (Kinsbourne 1977; Battelli et al., 2009). In support of this hypothesis, repetitive inhibitory TMS over right parietal cortex in healthy individuals rapidly induces interhemispheric imbalance in cortical activity that spreads beyond the site of stimulation (Plow et al., 2014). Behaviorally, the impacts of inhibitory rTMS may be long delayed from the onset of stimulation, as much as 30 minutes (Agosta et al., 2014; Hubl et al., 2008).

OBJECTIVE

In this study, we examine the temporal dynamics of inhibitory rTMS on cortical network integrity that supports sustained visual attention.

METHODS

Healthy individuals received 15 min of 1 Hz offline, inhibitory rTMS (or sham) over left parietal cortex, and then immediately engaged in a bilateral visual tracking task while we recorded brain activity with fMRI. We computed functional connectivity (FC) between three nodes of the attention network engaged by visual tracking: the intraparietal sulcus (IPS), frontal eye fields (FEF) and human MT+ (hMT+).

RESULTS

FC immediately and significantly decreased between the stimulation site (left IPS) and all other regions, then recovered to normal levels within 30 minutes. rTMS increased FC between left and right FEF at approximately 36 min following stimulation, and between sites in the unstimulated hemisphere approximately 48 min after stimulation.

CONCLUSIONS

These findings demonstrate large-scale changes in cortical organization following inhibitory rTMS. The immediate impact of rTMS on connectivity to the stimulation site dovetails with the putative role of interhemispheric balance for bilateral visual sustained attention. The delayed, compensatory increases in functional connectivity have implications for models of dynamic reorganization in networks supporting spatial and nonspatial selective attention, and compensatory mechanisms within these networks that may be stabilized in chronic stroke.

Visuospatial Attention to Single and Multiple Objects Is Independently Impaired in Parkinson's Disease

Parkinson’s disease (PD) is associated with deficits in visuospatial attention. It is as yet unknown whether these attentional deficits begin at a perceptual level or instead reflect disruptions in oculomotor or higher-order processes. In the present study, non-demented individuals with PD and matched normal control adults (NC) participated in two tasks requiring sustained visuospatial attention, both based on a multiple object tracking paradigm. Eye tracking was used to ensure central fixation. In Experiment 1 (26 PD, 21 NC), a pair of identical red dots (one target, one distractor) rotated randomly for three seconds at varied speeds. The task was to maintain the identity of the sole target, which was labeled prior to each trial. PD were less accurate than NC overall (p = .049). When considering only trials where fixation was maintained, however, there was no significant group difference, suggesting that the deficit’s origin is closely related to oculomotor processing. To determine whether PD had additional impairment in multifocal attention, in Experiment 2 (25 PD, 15 NC), two targets were presented along with distractors at a moderate speed, along with a control condition in which dots remained stationary. PD were less accurate than NC for moving (p = 0.02) but not stationary targets. This group difference remained significant when considering only trials where fixation was maintained, suggesting the source of the PD deficit was independent from oculomotor processing. Taken together, the results implicate separate mechanisms for single vs. multiple object tracking deficits in PD.

Reconstructing representations of dynamic visual objects in early visual cortex

As raw sensory data are partial, our visual system extensively fills in missing details, creating enriched percepts based on incomplete bottom-up information. Despite evidence for internally generated representations at early stages of cortical processing, it is not known whether these representations include missing information of dynamically transforming objects. Long-range apparent motion (AM) provides a unique test case because objects in AM can undergo changes both in position and in features. Using fMRI and encoding methods, we found that the "intermediate" orientation of an apparently rotating grating, never presented in the retinal input but interpolated during AM, is reconstructed in population-level, feature-selective tuning responses in the region of early visual cortex (V1) that corresponds to the retinotopic location of the AM path. This neural representation is absent when AM inducers are presented simultaneously and when AM is visually imagined. Our results demonstrate dynamic filling-in in V1 for object features that are interpolated during kinetic transformations.

Blinded by the load: attention, awareness and the role of perceptual load

What is the relationship between attention and conscious awareness? Awareness sometimes appears to be restricted to the contents of focused attention, yet at other times irrelevant distractors will dominate awareness. This contradictory relationship has also been reflected in an abundance of discrepant research findings leading to an enduring controversy in cognitive psychology. Lavie's load theory of attention suggests that the puzzle can be solved by considering the role of perceptual load. Although distractors will intrude upon awareness in conditions of low load, awareness will be restricted to the content of focused attention when the attended information involves high perceptual load. Here, we review recent evidence for this proposal with an emphasis on the various subjective blindness phenomena, and their neural correlates, induced by conditions of high perceptual load. We also present novel findings that clarify the role of attention in the response to stimulus contrast. Overall, this article demonstrates a critical role for perceptual load across the spectrum of perceptual processes leading to awareness, from the very early sensory responses related to contrast detection to explicit recognition of semantic content.

Multiple object tracking in autism spectrum disorders

Difficulties in visual attention are often implicated in autism spectrum disorders (ASD) but it remains unclear which aspects of attention are affected. Here, we used a multiple object tracking (MOT) task to quantitatively characterize dynamic attentional function in children with ASD aged 5-12. While the ASD group performed significantly worse overall, the group difference did not increase with increased object speed. This finding suggests that decreased MOT performance is not due to deficits in dynamic attention but instead to a diminished capacity to select and maintain attention on multiple targets. Further, MOT performance improved from 5 to 10 years in both typical and ASD groups with similar developmental trajectories. These results argue against a specific deficit in dynamic attention in ASD.

Redundancy gains in retinotopic cortex

It is widely claimed that interactions among simultaneously presented visual stimuli are suppressive and that these interactions primarily occur when stimuli fall within the same receptive field (Desimone and Duncan 1995). Here, we show evidence for a novel form of interaction between simultaneously presented but distant stimuli that does not fit either pattern. To examine interactions between simultaneously presented stimuli, we measure the response to a single stimulus as a function of whether or not other stimuli are also presented simultaneously, and we further ask how the response to a given stimulus is affected by whether the simultaneously present stimuli are identical or different from each other. Our method reveals a new phenomenon of "redundancy gain:" the visual response to a stimulus is higher when accompanied by identical stimuli than when that stimulus is presented alone, even though the stimuli are displayed in separate visual quadrants. This pattern is observed throughout the visual hierarchy, including V1 and V2, and we show that it is distinct from the well-known simultaneous suppression effect (Kastner et al. 1998). We propose that the redundancy gain in early retinotopic cortex results from feedback from higher visual areas and may underlie perceptual averaging and other ensemble coding phenomena observed behaviorally.

Competition explains limited attention and perceptual resources: implications for perceptual load and dilution theories

Both perceptual load theory and dilution theory purport to explain when and why task-irrelevant information, or so-called distractors are processed. Central to both explanations is the notion of limited resources, although the theories differ in the precise way in which those limitations affect distractor processing. We have recently proposed a neurally plausible explanation of limited resources in which neural competition among stimuli hinders their representation in the brain. This view of limited capacity can also explain distractor processing, whereby the competitive interactions and bias imposed to resolve the competition determine the extent to which a distractor is processed. This idea is compatible with aspects of both perceptual load and dilution models of distractor processing, but also serves to highlight their differences. Here we review the evidence in favor of a biased competition view of limited resources and relate these ideas to both classic perceptual load theory and dilution theory.

Swapping or dropping? Electrophysiological measures of difficulty during multiple object tracking

In the multiple object tracking task, participants are asked to keep targets separate from identical distractors as all items move randomly. It is well known that simple manipulations such as object speed and number of distractors dramatically alter the number of targets that are successfully tracked, but very little is known about what causes this variation in performance. One possibility is that participants tend to lose track of objects (dropping) more frequently under these conditions. Another is that the tendency to confuse a target with a distractor increases (swapping). These two mechanisms have very different implications for the attentional architecture underlying tracking. However, behavioral data alone cannot differentiate between these possibilities. In the current study, we used an electrophysiological marker of the number of items being actively tracked to assess which type of errors tended to occur during speed and distractor load manipulations. Our neural measures suggest that increased distractor load led to an increased likelihood of confusing targets with distractors while increased speed led to an increased chance of a target item being dropped. Behavioral experiments designed to test this novel prediction support this assertion.

A mixture distribution of spatial attention

Although it may seem paradoxical, the unified-focus and multiple-foci theories of spatial selective attention are both well supported by experimental evidence. However, the apparent contradiction is illusory and the two competing views may be reconciled by a closer examination of the spatial mechanisms involved. We propose that the deployment of attention may be modeled as a mixture of individual distributions of attention and we tested this hypothesis in two experiments. Participants had to identify targets among distractors, with the targets presented at various distances from the cued locations. Experiment 1 confirmed that the distribution of attention may be described by a mixture of individual distributions, each centered at a cued location. Experiment 2 showed that cue separation is an important determinant of whether spatial attention is divided or not.

APOE e4 polymorphism in young adults is associated with improved attention and indexed by distinct neural signatures

The APOE e4 allele, which confers an increased risk of developing dementia in older adulthood, has been associated with enhanced cognitive performance in younger adults. An objective of the current study was to compare task-related behavioural and neural signatures for e4 carriers (e4+) and non-e4 carriers (e4-) to help elucidate potential mechanisms behind such cognitive differences. On two measures of attention, we recorded clear behavioural advantages in young adult e4+ relative to e4-, suggesting that e4+ performed these tasks with a wider field of attention. Behavioural advantages were associated with increased task-related brain activations detected by fMRI (BOLD). In addition, behavioural measures correlated with structural measures derived from a former DTI analysis of white matter integrity in our cohort. These data provide clear support for an antagonistic pleiotropy hypothesis--that the e4 allele confers some cognitive advantage in early life despite adverse consequences in old age. The data implicate differences in both structural and functional signatures as complementary mediators of the behavioural advantage.

Exhausting attentional tracking resources with a single fast-moving object

Driving on a busy road, eluding a group of predators, or playing a team sport involves keeping track of multiple moving objects. In typical laboratory tasks, the number of visual targets that humans can track is about four. Three types of theories have been advanced to explain this limit. The fixed-limit theory posits a set number of attentional pointers available to follow objects. Spatial interference theory proposes that when targets are near each other, their attentional spotlights mutually interfere. Resource theory asserts that a limited resource is divided among targets, and performance reflects the amount available per target. Utilising widely separated objects to avoid spatial interference, the present experiments validated the predictions of resource theory. The fastest target speed at which two targets could be tracked was much slower than the fastest speed at which one target could be tracked. This speed limit for tracking two targets was approximately that predicted if at high speeds, only a single target could be tracked. This result cannot be accommodated by the fixed-limit or interference theories. Evidently a fast target, if it moves fast enough, can exhaust attentional resources.