Shared filtering processes link attentional and visual short-term memory capacity limits

Defining attention from an auditory perspective

Attention prioritizes certain information at the expense of other information in ways that are similar across vision, audition, and other sensory modalities. It influences how-and even what-information is represented and processed, affecting brain activity at every level. Much of the core research into cognitive and neural mechanisms of attention has used visual tasks. However, the same top-down, object-based, and bottom-up attentional processes shape auditory perception, largely through the same underlying, cognitive networks. This article is categorized under: Psychology > Attention.

How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests

We investigated whether standardized neuropsychological tests and experimental cognitive paradigms measure the same cognitive faculties. Specifically, do neuropsychological tests commonly used to assess attention measure the same construct as attention paradigms used in cognitive psychology and neuroscience? We built on the “general attention factor”, comprising several widely used experimental paradigms (Huang et al., 2012). Participants (n = 636) completed an on-line battery (TestMyBrain.org) of six experimental tests [Multiple Object Tracking, Flanker Interference, Visual Working Memory, Approximate Number Sense, Spatial Configuration Visual Search, and Gradual Onset Continuous Performance Task (Grad CPT)] and eight neuropsychological tests [Trail Making Test versions A & B (TMT-A, TMT-B), Digit Symbol Coding, Forward and Backward Digit Span, Letter Cancellation, Spatial Span, and Arithmetic]. Exploratory factor analysis in a subset of 357 participants identified a five-factor structure: (1) attentional capacity (Multiple Object Tracking, Visual Working Memory, Digit Symbol Coding, Spatial Span), (2) search (Visual Search, TMT-A, TMT-B, Letter Cancellation); (3) Digit Span; (4) Arithmetic; and (5) Sustained Attention (GradCPT). Confirmatory analysis in 279 held-out participants showed that this model fit better than competing models. A hierarchical model where a general cognitive factor was imposed above the five specific factors fit as well as the model without the general factor. We conclude that Digit Span and Arithmetic tests should not be classified as attention tests. Digit Symbol Coding and Spatial Span tap attentional capacity, while TMT-A, TMT-B, and Letter Cancellation tap search (or attention-shifting) ability. These five tests can be classified as attention tests.

Selection enables enhancement: An integrated model of object tracking

The diversity of research on visual attention and multiple-object tracking presents challenges for anyone hoping to develop a unified account. One key challenge is identifying the attentional limitations that give rise to competition among targets during tracking. To address this challenge, we present a computational model of object tracking that relies on two attentional mechanisms: serial selection and parallel enhancement. Selection picks out an object for further processing, whereas enhancement increases sensitivity to stimuli in regions where objects have been selected previously. In this model, multiple target locations can be tracked in parallel via enhancement, whereas a single target can be selected so that additional information beyond its location can be processed. In simulations of two psychological experiments, we demonstrate that spatial competition during enhancement and temporal competition for selection can explain a range of findings on multiple-object tracking, and we argue that the interaction between selection and enhancement captured in the model is critical to understanding attention more broadly.

Gradients of functional organization in posterior parietal cortex revealed by visual attention, visual short-term memory, and intrinsic functional connectivity

Visual attention and visual working memory tasks recruit a common network of lateral frontal cortical (LFC) and posterior parietal cortical (PPC) regions. Here, we examine finer-scale organization of this frontoparietal network. Three LFC regions recruited by visual cognition tasks, superior precentral sulcus (sPCS), inferior precentral sulcus (iPCS), and mid inferior frontal sulcus (midIFS) exhibit differential patterns of resting-state functional connectivity to PPC. A broad dorsomedial to ventrolateral gradient is observed, with sPCS connectivity dominating in the dorsomedial PPC band, iPCS dominating in the middle band, and midIFS dominating in the ventrolateral band. These connectivity-defined subregions of PPC capture differential task activation between a pair of visual attention and working memory tasks. The relative functional connectivity of sPCS and iPCS also varies along the rostral-caudal axis of the retinotopic regions of PPC. iPCS connectivity is relatively stronger near the IPS0/IPS1 and IPS2/IPS3 borders, especially on the lateral portions of these borders, which each preferentially encode central visual field representations. In contrast, sPCS connectivity is relatively stronger elsewhere in retinotopic IPS regions which preferentially encode peripheral visual field representations. These findings reveal fine-scale gradients in functional connectivity within the frontoparietal visual network that capture a high-degree of specificity in PPC functional organization.

Spectral and Anatomical Patterns of Large-Scale Synchronization Predict Human Attentional Capacity

The capacity of visual attention determines how many visual objects may be perceived at any moment. This capacity can be investigated with multiple object tracking (MOT) tasks, which have shown that it varies greatly between individuals. The neuronal mechanisms underlying capacity limits have remained poorly understood. Phase synchronization of cortical oscillations coordinates neuronal communication within the fronto-parietal attention network and between the visual regions during endogenous visual attention. We tested a hypothesis that attentional capacity is predicted by the strength of pretarget synchronization within attention-related cortical regions. We recorded cortical activity with magneto- and electroencephalography (M/EEG) while measuring attentional capacity with MOT tasks and identified large-scale synchronized networks from source-reconstructed M/EEG data. Individual attentional capacity was correlated with load-dependent strengthening of theta (3–8 Hz), alpha (8–10 Hz), and gamma-band (30–120 Hz) synchronization that connected the visual cortex with posterior parietal and prefrontal cortices. Individual memory capacity was also preceded by crossfrequency phase–phase and phase–amplitude coupling of alpha oscillation phase with beta and gamma oscillations. Our results show that good attentional capacity is preceded by efficient dynamic functional coupling and decoupling within brain regions and across frequencies, which may enable efficient communication and routing of information between sensory and attentional systems.

Visual spatial attention and spatial working memory do not draw on shared capacity-limited core processes

The extent to which similar capacity limits in visual attention and visual working memory indicate a common shared underlying mechanism is currently still debated. In the spatial domain, the multiple object tracking (MOT) task has been used to assess the relationship between spatial attention and spatial working memory though existing results have been inconclusive. In three dual task experiments, we examined the extent of interference between attention to spatial positions and memory for spatial positions. When the position monitoring task required keeping track of target identities through colour-location binding, we found a moderate detrimental effect of position monitoring on spatial working memory and an ambiguous interaction effect. However, when this task requirement was removed, load increases in neither task were detrimental to the other. The only very moderate interference effect that remained resided in an interaction between load types but was not consistent with shared capacity between tasks-rather it was consistent with content-related crosstalk between spatial representations. Contrary to propositions that spatial attention and spatial working memory may draw on a common shared set of core processes, these findings indicate that for a purely spatial task, perceptual attention and working memory appear to recruit separate core capacity-limited processes.

Visual Short-Term Memory Activity in Parietal Lobe Reflects Cognitive Processes beyond Attentional Selection

Visual short-term memory (VSTM) and attention are distinct yet interrelated processes. While both require selection of information across the visual field, memory additionally requires the maintenance of information across time and distraction. VSTM recruits areas within human (male and female) dorsal and ventral parietal cortex that are also implicated in spatial selection; therefore, it is important to determine whether overlapping activation might reflect shared attentional demands. Here, identical stimuli and controlled sustained attention across both tasks were used to ask whether fMRI signal amplitude, functional connectivity, and contralateral visual field bias reflect memory-specific task demands. While attention and VSTM activated similar cortical areas, BOLD amplitude and functional connectivity in parietal cortex differentiated the two tasks. Relative to attention, VSTM increased BOLD amplitude in dorsal parietal cortex and decreased BOLD amplitude in the angular gyrus. Additionally, the tasks differentially modulated parietal functional connectivity. Contrasting VSTM and attention, intraparietal sulcus (IPS) 1-2 were more strongly connected with anterior frontoparietal areas and more weakly connected with posterior regions. This divergence between tasks demonstrates that parietal activation reflects memory-specific functions and consequently modulates functional connectivity across the cortex. In contrast, both tasks demonstrated hemispheric asymmetries for spatial processing, exhibiting a stronger contralateral visual field bias in the left versus the right hemisphere across tasks, suggesting that asymmetries are characteristic of a shared selection process in IPS. These results demonstrate that parietal activity and patterns of functional connectivity distinguish VSTM from more general attention processes, establishing a central role of the parietal cortex in maintaining visual information.SIGNIFICANCE STATEMENT Visual short-term memory (VSTM) and attention are distinct yet interrelated processes. Cognitive mechanisms and neural activity underlying these tasks show a large degree of overlap. To examine whether activity within the posterior parietal cortex (PPC) reflects object maintenance across distraction or sustained attention per se, it is necessary to control for attentional demands inherent in VSTM tasks. We demonstrate that activity in PPC reflects VSTM demands even after controlling for attention; remembering items across distraction modulates relationships between parietal and other areas differently than during periods of sustained attention. Our study fills a gap in the literature by directly comparing and controlling for overlap between visual attention and VSTM tasks.

Hue distinctiveness overrides category in determining performance in multiple object tracking

The visual distinctiveness between targets and distractors can significantly facilitate performance in multiple object tracking (MOT), in which color is a feature that has been commonly used. However, the processing of color can be more than "visual." Color is continuous in chromaticity, while it is commonly grouped into discrete categories (e.g., red, green). Evidence from color perception suggested that color categories may have a unique role in visual tasks independent of its chromatic appearance. Previous MOT studies have not examined the effect of chromatic and categorical distinctiveness on tracking separately. The current study aimed to reveal how chromatic (hue) and categorical distinctiveness of color between the targets and distractors affects tracking performance. With four experiments, we showed that tracking performance was largely facilitated by the increasing hue distance between the target set and the distractor set, suggesting that perceptual grouping was formed based on hue distinctiveness to aid tracking. However, we found no color categorical effect, because tracking performance was not significantly different when the targets and distractors were from the same or different categories. It was concluded that the chromatic distinctiveness of color overrides category in determining tracking performance, suggesting a dominant role of perceptual feature in MOT.

Functional Evidence for a Cerebellar Node of the Dorsal Attention Network

The "dorsal attention network" or "frontoparietal network" refers to a network of cortical regions that support sustained attention and working memory. Recent work has demonstrated that cortical nodes of the dorsal attention network possess intrinsic functional connections with a region in ventral cerebellum, in the vicinity of lobules VII/VIII. Here, we performed a series of task-based and resting-state fMRI experiments to investigate cerebellar participation in the dorsal attention network in humans. We observed that visual working memory and visual attention tasks robustly recruit cerebellar lobules VIIb and VIIIa, in addition to canonical cortical dorsal attention network regions. Across the cerebellum, resting-state functional connectivity with the cortical dorsal attention network strongly predicted the level of activation produced by attention and working memory tasks. Critically, cerebellar voxels that were most strongly connected with the dorsal attention network selectively exhibited load-dependent activity, a hallmark of the neural structures that support visual working memory. Finally, we examined intrinsic functional connectivity between task-responsive portions of cerebellar lobules VIIb/VIIIa and cortex. Cerebellum-to-cortex functional connectivity strongly predicted the pattern of cortical activation during task performance. Moreover, resting-state connectivity patterns revealed that cerebellar lobules VIIb/VIIIa group with cortical nodes of the dorsal attention network. This evidence leads us to conclude that the conceptualization of the dorsal attention network should be expanded to include cerebellar lobules VIIb/VIIIa.

SIGNIFICANCE STATEMENT

The functional participation of cerebellar structures in nonmotor cortical networks remains poorly understood and is highly understudied, despite the fact that the cerebellum possesses many more neurons than the cerebral cortex. Although visual attention paradigms have been reported to activate cerebellum, many researchers have largely dismissed the possibility of a cerebellar contribution to attention in favor of a motor explanation, namely, eye movements. The present study demonstrates that a cerebellar subdivision (mainly lobules VIIb/VIIIa), which exhibits strong intrinsic functional connectivity with the cortical dorsal attention network, also closely mirrors a myriad of cortical dorsal attention network responses to visual attention and working memory tasks. This evidence strongly supports a reconceptualization of the dorsal attention network to include cerebellar lobules VIIb/VIIIa.

The impact of top-down spatial attention on laterality and hemispheric asymmetry in the human parietal cortex

The human parietal cortex exhibits a preference to contralaterally presented visual stimuli (i.e., laterality) as well as an asymmetry between the two hemispheres with the left parietal cortex showing greater laterality than the right. Using visual short-term memory and perceptual tasks and varying target location predictability, this study examined whether hemispheric laterality and asymmetry are fixed characteristics of the human parietal cortex or whether they are dynamic and modulated by the deployment of top-down attention to the target present hemifield. Two parietal regions were examined here that have previously been shown to be involved in visual object individuation and identification and are located in the inferior and superior intraparietal sulcus (IPS), respectively. Across three experiments, significant laterality was found in both parietal regions regardless of attentional modulation with laterality being greater in the inferior than superior IPS, consistent with their roles in object individuation and identification, respectively. Although the deployment of top-down attention had no effect on the superior IPS, it significantly increased laterality in the inferior IPS. The deployment of top-down spatial attention can thus amplify the strength of laterality in the inferior IPS. Hemispheric asymmetry, on the other hand, was absent in both brain regions and only emerged in the inferior but not the superior IPS with the deployment of top-down attention. Interestingly, the strength of hemispheric asymmetry significantly correlated with the strength of laterality in the inferior IPS. Hemispheric asymmetry thus seems to only emerge when there is a sufficient amount of laterality present in a brain region.

Shared processing in multiple object tracking and visual working memory in the absence of response order and task order confounds

To understand how the visual system represents multiple moving objects and how those representations contribute to tracking, it is essential that we understand how the processes of attention and working memory interact. In the work described here we present an investigation of that interaction via a series of tracking and working memory dual-task experiments. Previously, it has been argued that tracking is resistant to disruption by a concurrent working memory task and that any apparent disruption is in fact due to observers making a response to the working memory task, rather than due to competition for shared resources. Contrary to this, in our experiments we find that when task order and response order confounds are avoided, all participants show a similar decrease in both tracking and working memory performance. However, if task and response order confounds are not adequately controlled for we find substantial individual differences, which could explain the previous conflicting reports on this topic. Our results provide clear evidence that tracking and working memory tasks share processing resources.

Multiple driver distractions: a systemic transport problem

Strategies to contend with driver distraction may no longer be sufficient for the emerging variety of contemporary driver distractions. A more systematic and systemic approach holds promise for improved road safety but is not currently being developed. This systematic review of multiple driver distractions aims to address this gap and presents two key findings. Systematic classification of distracting tasks with respect to driving is challenging, and engagement with Multiple-Additional-to-Driving (MAD) tasks is almost universally detrimental to driving performance. A model is presented to assist in systematically characterising multiple driver demands. Identified literature is placed into context using the model and shortfalls are identified.

Load dependence of β and γ oscillations predicts individual capacity of visual attention

Human capability to concurrently attend and perceive multiple visual objects has a limited and individual capacity of 2-4 objects. Neuronal mechanisms that support the perception of multiple objects and underlie these attentional capacity limits have remained unclear. We investigated the role of neuronal oscillations in multiobject visual perception and in limiting the attentional capacity. To this end, we used parametric multiobject tracking tasks, MEG and EEG recordings, and data-driven source-space analyses to localize the neuronal substrates of task performance. Three lines of evidence suggested a mechanistic role for neuronal oscillations in multiobject attention. First, oscillation amplitudes preceding target events were distinct for subsequently detected and undetected targets and also predicted reaction times to the target events. Second, suppression of θ to low-β (<20 Hz) and strengthening of high-β to γ (20-90 Hz) oscillations in frontoparietal and visual regions were correlated with attentional load. Third, the load-dependent strengthening of γ (30-90 Hz) band oscillations in lateral prefrontal, posterior parietal, and visual cortices predicted interindividual variability in attentional capacity. A progressive recruitment of γ oscillations in sensory, attentional, and executive networks is thus directly correlated with multiobject attentional demands and, in particular, with the individual capability to consciously attend and perceive multiple visual objects concurrently. These data support the hypothesis that γ oscillations contribute both to neuronal object representations and to attentional and executive processing.

Automatic feature-based grouping during multiple object tracking

Contour interpolation automatically binds targets with distractors to impair multiple object tracking (Keane, Mettler, Tsoi, & Kellman, 2011). Is interpolation special in this regard or can other features produce the same effect? To address this question, we examined the influence of eight features on tracking: color, contrast polarity, orientation, size, shape, depth, interpolation, and a combination (shape, color, size). In each case, subjects tracked 4 of 8 objects that began as undifferentiated shapes, changed features as motion began (to enable grouping), and returned to their undifferentiated states before halting. We found that intertarget grouping improved performance for all feature types except orientation and interpolation (Experiment 1 and Experiment 2). Most importantly, target-distractor grouping impaired performance for color, size, shape, combination, and interpolation. The impairments were, at times, large (>15% decrement in accuracy) and occurred relative to a homogeneous condition in which all objects had the same features at each moment of a trial (Experiment 2), and relative to a "diversity" condition in which targets and distractors had different features at each moment (Experiment 3). We conclude that feature-based grouping occurs for a variety of features besides interpolation, even when irrelevant to task instructions and contrary to the task demands, suggesting that interpolation is not unique in promoting automatic grouping in tracking tasks. Our results also imply that various kinds of features are encoded automatically and in parallel during tracking.

Differential roles for parietal and occipital cortices in visual working memory

Visual working memory (VWM) is known as a highly capacity-limited cognitive system that can hold 3–4 items. Recent studies have demonstrated that activity in the intraparietal sulcus (IPS) and occipital cortices correlates with the number of representations held in VWM. However, differences among those regions are poorly understood, particularly when task-irrelevant items are to be ignored. The present fMRI-based study investigated whether memory load-sensitive regions such as the IPS and occipital cortices respond differently to task-relevant information. Using a change detection task in which participants are required to remember pre-specified targets, here we show that while the IPS exhibited comparable responses to both targets and distractors, the dorsal occipital cortex manifested significantly weaker responses to an array containing distractors than to an array containing only targets, despite that the number of objects presented was the same for the two arrays. These results suggest that parietal and occipital cortices engage differently in distractor processing and that the dorsal occipital, rather than parietal, activity appears to reflect output of stimulus filtering and selection based on behavioral relevance.