Feature-based and spatial attentional selection in visual working memory

Predictable object motion is extrapolated to support visual working memory for surface features

Space and time support visual working memory (VWM) by providing incidental reference frames for task-relevant information. While this has been studied with stationary items, natural scenes also contain moving objects, whose positions change over time, often in a predictable manner. We investigated if predictable item motion is leveraged to facilitate VWM for surface features. In a dynamic change-detection task, participants memorised the colours of three disks moving at constant speed in different directions before disappearing. After a retention interval, the disks reappeared (a) at the movement endpoint locations where they had disappeared (b) at positions spatiotemporally congruent with their previous motion (where they would have been had they continued their movement), (c) at positions with a temporal offset (consistent with a change in speed while out of view) or (d) at positions with a spatial offset (consistent with a change in movement direction). Performance decreased with increasing temporal or spatial offsets relative to congruent positions, indicating that the memorised items' positions were remapped to their anticipated future locations. This updating of positions in spatiotemporal reference frames, however, only occurs if motion extrapolation allows for reliable predictions of where occluded items will reappear. In a task context with unreliable motion patterns, the congruency effect diminished over time and performance instead increased at the movement endpoints. A second experiment confirmed this influence of motion reliability. Thus, predictable motion is extrapolated to update spatiotemporal reference frames in VWM, supporting memory for surface features and thereby contributing to visually guided behavior in dynamic environments.

Constraints on multi-item working memory access: performance costs and retrieval dynamics

To support goal-directed behavior, working memory (WM) must flexibly access relevant information. While the mechanisms underlying single-item WM access are comparatively well-studied, less is known about the principles governing multi-item access. Some studies have suggested that dual-item retrieval can be as efficient as single-item access, but it remains unclear whether this reflects reduced inhibitory demands or truly parallel, cost-free retrieval. In Experiment 1, we manipulated the number of relevant vs. irrelevant items in a pre-and retro-cuing WM task. The rationale was that if reduced inhibitory demands benefit multi-item access, then having fewer irrelevant items to suppress would enhance performance. Instead, we found that selecting two out of three items was slower and less accurate than selecting one, arguing against the idea that diminished inhibition underlies multi-item retrieval efficiency. Experiments 2a and 2b further probed retrieval efficiency using a modified dual-access paradigm that leveraged object repetition benefits. By including a control condition to prevent temporal associations between repeated targets and non-targets, we observed that repetition benefits for each item were additive-consistent with serial or limited parallel retrieval-rather than overadditive, which would be expected under fully parallel, cost-free retrieval. These findings clarify key limitations of multi-item WM, with important implications for complex tasks such as language comprehension, decision-making, and problem solving.

Getting value out of working memory through strategic prioritisation: Implications for storage and control

Working memory is an active system responsible for the temporary maintenance and processing of information in the support of cognition and action. In keeping with this, a growing body of research has explored the close links between working memory and attention, and how these might be harnessed to impact performance and possibly improve working memory efficiency. This is theoretically and practically important, given that working memory is a central hub in complex cognition yet is extremely capacity- and resource-limited. We review work carried out over the last 10 years or so looking at how high "value" items in working memory can be strategically prioritised through selective attention, drawing principally from visual working memory paradigms with young adult participants, while also discussing how the core effects extend to different task domains and populations. A consistent set of core findings emerges, with improved memory for items that are allocated higher value but no change in overall task performance, and a recency advantage regardless of point allocation when items are encountered sequentially. Value-directed prioritisation is effortful, under top-down strategic control, and appears to vary with perceptual distraction and executive load. It is driven by processes operating during encoding, maintenance, and retrieval, though the extent to which these are influenced by different features of the task context remains to be mapped out. We discuss implications for working memory, attention, and strategic control, and note some possible future directions of travel for this promising line of research.

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants' performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and 2 with masks) or interruption (Experiments 3 and 4 with an odd-even task) occurred concurrently with the stages for the maintenance of prioritized information (long cue-and-interference/interruption interstimulus interval, e.g., Experiments 1 and 3) or the deployment of attention (short cue-and-interference/interruption interstimulus interval, e.g., Experiments 2 and 4). Our results demonstrate that perceptual interference or cognitive interruption attenuates the dimension-based RCB. These findings suggest that sustained attention is necessary for the effective prioritization of a specific dimension of VWM representations.

Retrospective cue benefits in visual working memory are limited to a single location at a time

Working memory (WM) performance can be improved by an informative cue presented during storage. This effect, termed a retrocue benefit, can be used to study limits on how human observers prioritize information stored in WM for behavioral output. There is disagreement about whether retrocue benefits extend to multiple WM locations. Here, we hypothesized that multiple retrocues may improve some aspects of memory performance (e.g., a reduction in random guessing) while worsening others (e.g., an increase in the probability of reporting a feature presented at a non-probed location). We tested this possibility in three experiments. Participants remembered arrays of four orientations or colors over a brief delay, and spatial retrocues instructed participants to prioritize zero, one, two, or all four remembered orientations for possible report. At the end of the trial, participants recalled the orientation that appeared at one location. The results of this study revealed that participants' recall errors were lower during cue-one relative to cue-two and cue-four trials, and this benefit was driven primarily by a reduction in random guessing during cue-one trials. We found no evidence suggesting that multiple spatial cues (i.e., during cue-two trials) induced a trade-off between memory precision, random guessing, and non-target reports compared to neutral trials (i.e., cue-zero or cue-four). Thus, cuing participants to prioritize information appearing at multiple unique spatial positions led to no improvement in memory performance compared to neutral or no-cue trials, providing additional support for the view that retrocue benefits on WM performance are limited to a single spatial location at a time.

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Does perceptual grouping improve visuospatial working memory? Optimized processing or encoding bias

Visual working memory has been defined as a system of limited capacity that enables the maintenance and manipulation of visual information. However, some perceptual features like Gestalt grouping could improve visual working memory effectiveness. In two different experiments, we aimed to explore how the presence of elements grouped by color similarity affects the change detection performance of both, grouped and non-grouped items. We combined a change detection task with a retrocue paradigm in which a six item array had to be remembered. An always valid, variable-delay retrocue appeared in some trials during the retention interval, either after 100 ms (iconic-trace period) or 1400 ms (working memory period), signaling the location of the probe. The results indicated that similarity grouping biased the information entered into the visual working memory, improving change detection accuracy only for previously grouped probes, but hindering change detection for non-grouped probes in certain conditions (Exp. 1). However, this bottom-up automatic encoding bias was overridden when participants were explicitly instructed to ignore grouped items as they were irrelevant for the task (Exp. 2).

A direct comparison of attentional orienting to spatial and temporal positions in visual working memory

Different visual attributes effectively guide attention to specific items in visual working memory (VWM), ensuring that particularly important memory contents are readily available. Predictable temporal structures contribute to this efficient use of VWM: items are prospectively prioritized when they are expected to be needed. Occasionally, however, visual events only gain relevance through their timing after they have passed. We investigated retrospective attentional orienting based on temporal position by directly comparing it with orienting to spatial locations, which is typically considered the most powerful selection mechanism. In a colour-change-detection task, in which items appeared sequentially at different locations, symbolic number cues validly indicated the temporal or spatial location of the upcoming probe item either before encoding (precues; Experiment 1) or during maintenance (retrocues; Experiments 1-3). Temporal and spatial cues were physically identical and only differed in their mapping onto either temporal or spatial positions. Predictive cues yielded cueing benefits (i.e., higher accuracy and shorter reaction times) as compared with neutral cues, with larger benefits for precues than for retrocues. Importantly, spatial and temporal cueing benefits did not differ. Equivalent retrocueing benefits were also observed across different cue-probe intervals and irrespective of whether spatial or temporal position was used as retrieval cue, indicating that items were directly bound to temporal position and not prioritized via a space-based mechanism. These findings show that spatial and temporal properties can be used equally well to flexibly prioritise representations held in VWM and they highlight the functional similarities of space and time in VWM.

Comparing the temporal dynamics and efficacy of task-relevant and task-irrelevant memory-driven attention

People's attention is well attracted to a stimulus matching their memory. For example, when people are required to remember the color of a visual object, stimuli matching the memory color powerfully capture attention. Remarkably, stimuli with the shape of the memory object, that is, irrelevant-matching stimuli were also found to capture attention. Here, we examined how task relevance affects the temporal dynamics and the strength of memory-driven attention. In the experiment, participants performed a visual search task while maintaining the color or shape of a colored shape. When participants were required to memorize the color of the memory sample, the shape of the sample stimulus is task-irrelevant feature and vice versa. Importantly, while a search item matching working memory in the task-relevant dimension was presented for one group of participants, an irrelevant-matching search item appeared for the other group of participants. Further, we varied stimulus onset asynchrony (SOA) between the memory sample and search items. We found that relevant-matching stimuli captured attention regardless of whether the SOA was short or long. However, attentional capture by irrelevant-matching stimuli depended on the SOA; no memory-driven capture was observed at the shortest SOA, but significant capture was found at longer SOAs. Further, the capture effects by relevant-matching stimuli were greater than that of irrelevant-matching stimuli. These findings suggest both task-relevant and -irrelevant features in working memory affect the attentional selection in visual search task, but its temporal dynamics and strength are modulated by the task-relevance.

Comparing the prioritization of items and feature-dimensions in visual working memory

Selective attention can be directed not only to external sensory inputs, but also to internal sensory representations held within visual working memory (VWM). To date, this phenomenon has been studied predominantly following retrospective cues directing attention to particular items, or their locations in memory. In addition to item-level attentional prioritization, recent studies have shown that selectively attending to feature dimensions in VWM can also improve memory recall performance. However, no study to date has directly compared item-based and dimension-based attention in VWM, nor their neural bases. Here, we compared the benefits of retrospective cues (retro-cues) that were directed either at a multifeature item or at a feature dimension that was shared between two spatially segregated items. Behavioral results revealed qualitatively similar attentional benefits in both recall accuracy and response time, but also showed that cueing benefits were larger after item cues. Concurrent electroencephalogram measurements further revealed a similar attenuation of posterior alpha oscillations following both item and dimension retro-cues when compared with noninformative, neutral retro-cues. We argue that attention can act flexibly to prioritize the most relevant information—at either the item or the dimension level—to optimize ensuing memory-based task performance, and we discuss the implications of the observed commonalities and differences between item-level and dimension-level prioritization in VWM.

Individual differences in working memory capacity are unrelated to the magnitudes of retrocue benefits

Previous studies have associated visual working memory (VWM) capacity with the use of internal attention. Retrocues, which direct internal attention to a particular object or feature dimension, can improve VWM performance (i.e., retrocue benefit, RCB). However, so far, no study has investigated the relationship between VWM capacity and the magnitudes of RCBs obtained from object-based and dimension-based retrocues. The present study explored individual differences in the magnitudes of object- and dimension-based RCBs and their relationships with VWM capacity. Participants completed a VWM capacity measurement, an object-based cue task, and a dimension-based cue task. We confirmed that both object- and dimension-based retrocues could improve VWM performance. We also found a significant positive correlation between the magnitudes of object- and dimension-based RCB indexes, suggesting a partly overlapping mechanism between the use of object- and dimension-based retrocues. However, our results provided no evidence for a correlation between VWM capacity and the magnitudes of the object- or dimension-based RCBs. Although inadequate attention control is usually assumed to be associated with VWM capacity, the results suggest that the internal attention mechanism for using retrocues in VWM retention is independent of VWM capacity.

Effect of attentional selection on working memory for depth in a retro-cueing paradigm

Recent studies have shown that the temporary storage and manipulation of depth information (working memory for depth; WMd) is largely different from that of visual information in a 2D context (visual working memory; VWM). Although there has been abundant evidence on VWM showing that cueing a memory item during retention could bias attention to its internal representation and thus improves its memory performance (a retro-cue effect), it is unknown whether such an effect differs for WMd that is nested in a 3D context compared with that in a conventional 2D context. Here, we used a change detection task to investigate the effect of attentional selection on WMd by testing several types of retro-cue. The memory array consisted of items positioned at various stereoscopic depth planes, and a cue was presented during retention. Participants needed to make judgments on whether the depth position of target (one memory item) had changed. Our study showed reliable valid retro-cue benefits but no invalid retro-cue cost, indicating that the relational information may be registered in WMd to prevent a strategical removal of the unattended item. There was also a slight improvement in memory performance for cueing depth order compared with that for cueing other feature dimensions or 2D locations. The attentional effect on memory representation in a 3D context is different from that in a 2D context, and the divergence may suggest the distinctive nature of working memory for depth.

Orienting Attention to Short-Term Memory Representations via Sensory Modality and Semantic Category Retro-Cues

There is growing interest in characterizing the neural mechanisms underlying the interactions between attention and memory. Current theories posit that reflective attention to memory representations generally involves a fronto-parietal attentional control network. The present study aimed to test this idea by manipulating how a particular short-term memory (STM) representation is accessed, that is, based on its input sensory modality or semantic category, during functional magnetic resonance imaging (fMRI). Human participants performed a novel variant of the retro-cue paradigm, in which they were presented with both auditory and visual non-verbal stimuli followed by Modality, Semantic, or Uninformative retro-cues. Modality and, to a lesser extent, Semantic retro-cues facilitated response time relative to Uninformative retro-cues. The univariate and multivariate pattern analyses (MVPAs) of fMRI time-series revealed three key findings. First, the posterior parietal cortex (PPC), including portions of the intraparietal sulcus (IPS) and ventral angular gyrus (AG), had activation patterns that spatially overlapped for both modality-based and semantic-based reflective attention. Second, considering both the univariate and multivariate analyses, Semantic retro-cues were associated with a left-lateralized fronto-parietal network. Finally, the experimental design enabled us to examine how dividing attention cross-modally within STM modulates the brain regions involved in reflective attention. This analysis revealed that univariate activation within bilateral portions of the PPC increased when participants simultaneously attended both auditory and visual memory representations. Therefore, prefrontal and parietal regions are flexibly recruited during reflective attention, depending on the representational feature used to selectively access STM representations.

The basis of report-difference superiority in delayed perceptual comparison tasks

A major role for visual short-term memory (VSTM) is to mediate perceptual comparisons of visual information across successive glances and brief temporal interruptions. Research that has focused on the comparison process has noted a marked tendency for performance to be better when participants are required to report a difference between the displays rather than report the absence of a difference (i.e. a sameness). We refer to this performance asymmetry as report-difference superiority (RDS). It has been suggested that RDS reflects the operation of a reflexive mechanism that generates a mismatch signal during the comparison of visual input with information maintained in VSTM. This bottom-up mechanism therefore gives evidence for the presence of a feature change but not for the absence of such a change; consequently, a sameness is harder to detect than a difference between two displays. We test this explanation, and determine whether by itself it is a sufficient explanation of the RDS. In a delayed comparison task we find the RDS effect is most prevalent when items retain the same display locations; however, the effect does persist even when compared item locations were scrambled across memory and test arrays. However, with a conjunction task this scrambling of locations was effective in wholly abolishing the RDS effect. We consider that the RDS effect is a consequence of local comparisons of features, as well as global statistical comparisons.

Working memory for stereoscopic depth is limited and imprecise-evidence from a change detection task

Most studies on visual working memory (VWM) and spatial working memory (SWM) have employed visual stimuli presented at the fronto-parallel plane and few have involved depth perception. VWM is often considered as a memory buffer for temporarily holding and manipulating visual information that relates to visual features of an object, and SWM for holding and manipulating spatial information that concerns the spatial location of an object. Although previous research has investigated the effect of stereoscopic depth on VWM, the question of how depth positions are stored in working memory has not been systematically investigated, leaving gaps in the existing literature on working memory. Here, we explore working memory for depth by using a change detection task. The memory items were presented at various stereoscopic depth planes perpendicular to the line of sight, with one item per depth plane. Participants were asked to make judgments on whether the depth position of the target (one of the memory items) had changed. The results showed a conservative response bias that observers tended to make 'no change' responses when detecting changes in depth. In addition, we found that similar to VWM, the change detection accuracy degraded with the number of memory items presented, but the accuracy was much lower than that reported for VWM, suggesting that the storage for depth information is severely limited and less precise than that for visual information. The detection sensitivity was higher for the nearest and farthest depths and was better when the probe was presented along with the other items originally in the memory array, indicating that how well the to-be-stored depth can be stored in working memory depends on its relation with the other depth positions.

The Different Brain Mechanisms of Object and Spatial Working Memory: Voxel-Based Morphometry and Resting-State Functional Connectivity

In working memory (WM), the ability to concurrently integrate different types of information and to maintain or manipulate them promotes the flow of ongoing tasks. WM is a key component of normal human cognition. In this study, we applied a combined voxel-based morphometry (VBM) and resting-state functional connectivity (rsFC) analysis to investigate the relationship between the ability of object and spatial working memory (WM), and regional gray matter density (GMD), as well as intrinsic functional connectivity. The VBM analysis showed a positive correlation between the individual difference of object WM and GMD in the right middle occipital gyrus (MOG) and the left superior temporal gyrus (STG), which are responsible for coding object information and processing the shape of an object. The individual difference of the spatial WM was positively related to GMD in the right middle frontal gyrus (MFG) located in the dorsolateral prefrontal cortex (dlPFC), which confirmed that it is an important region for memory stores and maintains WM spatial representations. Further functional connectivity analysis revealed that the individual difference of object WM was significantly correlated with the rsFC of right intraparietal sulcus (IPS) - left postcentral gyrus (PostCG)/right precentral gyrus (PreCG)/left Supplementary Motor Area (SMA). While the capacity of spatial WM was significantly associated with the FC strength of the left dlPFC - left precuneus, right dlPFC - right MFG, and the left superior frontal sulcus (SFS) - left SMA/ right inferior parietal lobe (IPL). Our findings suggest that object WM is associated with the structure and functional organization of the brain regions involved in the ventral pathway (occipital - temporal regions) and the capacity of spatial WM is related to the dorsal pathway (frontal - parietal regions).

The possibility to make choices modulates feature-based effects of reward

When making decisions, humans can maximize the positive outcome of their actions by choosing the option associated with the highest reward. We have recently shown that choices modulate effects of reward via a bias in spatial attention: Locations associated with a lower reward are anticipatorily suppressed, as indicated by delayed responses to low-reward targets and increased parieto-occipital alpha power. Here, we investigated whether this inhibition also occurs when reward is not coupled to location but to a nonspatial feature (color). We analyzed reaction times to single targets associated with a low or high reward as a function of whether a second trial type, choice-trials, were interleaved. In choice-trials, participants could choose either one of two targets to obtain the associated reward. Indeed, responses to low-reward targets were slower when choice-trials were present, magnifying the influence of reward, and this delay was more pronounced in trials immediately following a choice. No corresponding changes in parieto-occipital alpha power were observed, but the behavioral findings suggest that choices modulate a reward-related bias in feature-based attention in a similar manner as for spatial attention, and support the idea that reward primarily affects behaviour when it is of immediate relevance.

Task-dependent effects of voluntary space-based and involuntary feature-based attention on visual working memory

Previous research has shown that visual working memory (VWM) can be modulated by space-based or feature-based attentional selection. However, it remains unclear how the two modes of attention operate jointly to affect VWM, and in particular, if involuntary feature-based attention plays a role in VWM. In this study, a pre-cued change detection paradigm was employed to investigate the concurrent effects of space- and feature-based attention on VWM. Space-based attention was manipulated by informative spatial cueing and by varying the proximity between the test item and the cued (fixated) memory item, while feature-based attention was induced in an involuntary manner by having the test item to share the same color or shape with the cued item on a fraction of trials. The results showed that: (1) the memory performance for the cued items was always better than the uncued items, suggesting a beneficial effect of voluntary spatial attention; (2) with a brief duration of the memory array (250 ms), cue-test proximity benefited VWM in the shape judgment task but not in the color judgment task, whereas with a longer duration (1200 ms), no proximity effect was found for either task; (3) VWM was improved for the same-colored items regardless of the task and duration; (4) VWM was improved for the same-shaped items only in the shape judgment task with the longer duration of the memory array. A discrimination task further showed that the proximity effect associated with VWM reflects a perceptual bottleneck in memory encoding for shape but not for color with a brief display. Our results suggest that involuntary feature-based attention could be triggered by spatial cueing to modulate VWM; involuntary color-based attention facilitates VWM independently of task, whereas shape-based facilitation is task-dependent, i.e., confined only to the shape judgment task, presumably reflecting different attention-guiding potencies of the two features.

Optimal trans-saccadic integration relies on visual working memory

Saccadic eye movements alter the visual processing of objects of interest by bringing them from the periphery, where there is only low-resolution vision, to the high-resolution fovea. Evidence suggests that people are able to achieve trans-saccadic integration in a near-optimal manner; however the mechanisms underlying integration are still unclear. Visual working memory (VWM) is sustained across a saccade, and it has been suggested that this memory resource is used to store and compare the pre- and post- saccadic percepts. This study directly tested the hypothesis that VWM is necessary for optimal trans-saccadic integration, by introducing memory load during a saccade, and testing subsequent integration performance on feature similar and dissimilar stimuli. Results show that integration performance was impaired when there was an additional memory task. Additionally, performance on the memory task was affected by feature-specific integration stimuli. Our results suggest that VWM supports the integration of pre- and post- saccadic stimuli because integration performance is impaired under VWM load.

Multiple high-reward items can be prioritized in working memory but with greater vulnerability to interference

Emerging literature indicates that working memory and attention interact in determining what is retained over time, though the nature of this relationship and the impacts on performance across different task contexts remain to be mapped. In the present study, four experiments examined whether participants can prioritize one or more high-reward items within a four-item target array for the purposes of an immediate cued recall task, and the extent to which this mediates the disruptive impact of a postdisplay to-be-ignored suffix. All four experiments indicated that endogenous direction of attention toward high-reward items results in their improved recall. Furthermore, increasing the number of high-reward items from one to three (Experiments 1-3) produces no decline in recall performance for those items, while associating each item in an array with a different reward value results in correspondingly graded levels of recall performance (Experiment 4). These results suggest the ability to exert precise voluntary control in the prioritization of multiple targets. However, in line with recent outcomes drawn from serial visual memory, this endogenously driven focus on high-reward items results in greater susceptibility to exogenous suffix interference, relative to low-reward items. This contrasts with outcomes from cueing paradigms, indicating that different methods of attentional direction may not always result in equivalent outcomes on working memory performance.

The time course of encoding and maintenance of task-relevant versus irrelevant object features in working memory

Access to WM can be restricted on the basis of goal-relevant properties such as spatial location. However, the extent of voluntary control over which features of an attended multi-feature object are encoded and maintained in WM is debated. Some evidence suggests that attending to an object leads to obligatory storage of all of its features, whereas other evidence suggests that access to WM can be restricted to only goal-relevant features. Another possibility is that all features are initially encoded, but irrelevant features are removed from WM over time. To address these various possibilities, we used pattern classification of EEG signals to track the temporal evolution of representations reflecting the encoding and storage of task-relevant and irrelevant features in WM. In different blocks, participants remembered the orientation, color or both orientation and color of a colored, oriented grating. The color and orientation of the grating was randomly drawn from two distinct feature bins on each trial. To examine trial-specific activity reflecting storage of the object's features, a support vector machine (SVM) classifier was trained to classify what bin the stimulus features came from. Importantly, for orientation, the classifier produced reliably above-chance classification across the delay when orientation was task-relevant but not when it was task-irrelevant. Interestingly, orientation could be accurately classified on trials for which both orientation and color were remembered. Moreover, a separate measure corresponding to the probability of a feature belonging to the correct bin was significantly higher when orientation was task-relevant compared to task-irrelevant during encoding. Above-chance classification for color was only present during the initial 500 msec across all conditions. Our results suggest that although information about all of an object's features is present in the initial stimulus-evoked neural response, information about the task-irrelevant features is attenuated during stimulus encoding and is largely absent throughout the delay.

Evidence for the beneficial effect of perceptual grouping on visual working memory: an empirical study on illusory contour and a meta-analytic study

The capacity of visual working memory (VWM) is found to be extremely limited. Past research shows that VWM can be facilitated by Gestalt principles of grouping, however, it remains controversial whether factors like the type of Gestalt principles, the characteristics of stimuli and the nature of experimental design could affect the beneficial effect of grouping. In particular, studies have shown that perceptual grouping could improve memory performance for a feature that is relevant for grouping, but it is unclear whether the same improvement exists for a feature that is irrelevant for grouping. In this article, an empirical study and a meta-analytic study were conducted to investigate the effect of perceptual grouping on VWM. In the empirical study, we examined the grouping effect by employing a Kanizsa illusion in which memory items were grouped by illusory contour. We found that the memory performance was improved for the grouped items even though the tested feature was grouping irrelevant, and the improvement was not significantly different from the effect of grouping by physical connectedness or by solid occlusion. In the meta-analytic study, we systematically and quantitatively examined the effect of perceptual grouping on VWM by pulling the results from all eligible studies, and found that the beneficial grouping effect was robust but the magnitude of the effect can be affected by several moderators. Factors like the types of grouping methods, the duration and the layout of the memory display, and the characteristics of the tested feature moderated the grouping effect, whereas whether employing a cue or a verbal suppression task did not. Our study suggests that the underlying mechanism of the grouping benefit may be distinct with regard to grouping relevancy of the to-be-stored feature. The grouping effect on VWM may be independent of attention for a grouping relevant feature, but may rely on attentional prioritization for a grouping irrelevant feature.

Separate and combined effects of action relevance and motivational value on visual working memory

Visual working memory contents can be selectively weighted according to differences in their task-relevance. In the present study, we examined the influence of two more indirect selection biases established by a concurrent task or learned reward associations: action relevance and motivational value. In three experiments, memory performance was assessed with the same color change detection task. Potential action relevance and motivational value were each determined by a specific feature of the memory items (location or shape, respectively) and manipulated orthogonally. Investigated separately (Experiments 1A and 1B), both selection biases modulated visual working memory. In combination (Experiment 2), action relevance and motivational value still each exerted an influence, but not in a fully independent and additive manner. While action relevance impacted performance irrespective of the reward associated with the items, an effect of motivational value was only observed for action-relevant items. These results support the notion that visual working memory is automatically biased as an inherent part of action planning. More generally, these findings highlight the versatile nature of visual working memory: Contents can be flexibly weighted to reflect differences in their importance, taking into account several sources of information.

Selective weighting of action-related feature dimensions in visual working memory

Planning an action primes feature dimensions that are relevant for that particular action, increasing the impact of these dimensions on perceptual processing. Here, we investigated whether action planning also affects the short-term maintenance of visual information. In a combined memory and movement task, participants were to memorize items defined by size or color while preparing either a grasping or a pointing movement. Whereas size is a relevant feature dimension for grasping, color can be used to localize the goal object and guide a pointing movement. The results showed that memory for items defined by size was better during the preparation of a grasping movement than during the preparation of a pointing movement. Conversely, memory for color tended to be better when a pointing movement rather than a grasping movement was being planned. This pattern was not only observed when the memory task was embedded within the preparation period of the movement, but also when the movement to be performed was only indicated during the retention interval of the memory task. These findings reveal that a weighting of information in visual working memory according to action relevance can even be implemented at the representational level during maintenance, demonstrating that our actions continue to influence visual processing beyond the perceptual stage.

Manipulating the focus of attention in working memory: Evidence for a protection of multiple items against perceptual interference

Visual working memory representations can be shielded from interference by selective attentional focusing using retroactive cues (retro-cues). However, it is not clear how many representations can be effectively cued and which neural mechanisms provide the protection from distractors. To address these questions, we manipulated the number of attended items by means of a retro-cue (one, two, or three items) and presented a distractor display during the retention of information in working memory. Analyses of the raw error and a mixture model revealed that a general performance benefit was only present when one item was retro-cued. Nevertheless, a protection of the item representations against subsequent interference occurred also after a two-item cue. ERPs revealed a modulation of the posterior negative slow wave following the retro-cues, reflecting the applied working memory resources dependent on the number of attended representations. Further, the distractor information was encoded into working memory only when the number of attended items was not changed by the retro-cues (neutral and three-item conditions), reflected by a P3b following the distractor display. These results suggest that more than one item can be effectively protected from perceptual interference. We propose that the protective effect of selective attention within working memory is based on both a reduction of the number of focused representations and the attentional refreshing of item context and features.

Anticipatory access to group-level information in working memory

One assumption common to many serial recall models is that lists can be stored in a structured manner, as groups nested inside larger sequences. However, many of these theories fail to explain the dynamics by which those groups are accessed, and those models that do provide such an account have not been comprehensively tested. This article presents three experiments using a probed recall paradigm in which potential target positions were precued. Across all the experiments, it was found that a precue that targeted only a single group led to faster recall than one that targeted multiple groups, in cases where the number of positions precued was equated. In two of the three experiments, there was evidence (quantified using Bayes factors [BFs]) that responding under a precue targeting multiple groups was no faster than an uniformative control precue. The results suggest that retrieval of groups is a major bottleneck to recall items in structured lists and are consistent with models assuming that information about groups is retrieved prior to accessing elements in the groups themselves.

In search of the focus of attention in working memory: 13 years of the retro-cue effect

The concept of attention has a prominent place in cognitive psychology. Attention can be directed not only to perceptual information, but also to information in working memory (WM). Evidence for an internal focus of attention has come from the retro-cue effect: Performance in tests of visual WM is improved when attention is guided to the test-relevant contents of WM ahead of testing them. The retro-cue paradigm has served as a test bed to empirically investigate the functions and limits of the focus of attention in WM. In this article, we review the growing body of (behavioral) studies on the retro-cue effect. We evaluate the degrees of experimental support for six hypotheses about what causes the retro-cue effect: (1) Attention protects representations from decay, (2) attention prioritizes the selected WM contents for comparison with a probe display, (3) attended representations are strengthened in WM, (4) not-attended representations are removed from WM, (5) a retro-cue to the retrieval target provides a head start for its retrieval before decision making, and (6) attention protects the selected representation from perceptual interference. The extant evidence provides support for the last four of these hypotheses.

Retro-dimension-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants’ performance can be improved by a retro-object-cue. However, previous studies have not investigated whether participants’ performance can also be improved by a retro-dimension-cue. Three experiments investigated this issue. We used a recall task with a retro-dimension-cue in all experiments. In Experiment 1, we found benefits from retro-dimension-cues compared to neutral cues. This retro-dimension-cue benefit is reflected in an increased probability of reporting the target, but not in the probability of reporting the non-target, as well as increased precision with which this item is remembered. Experiment 2 replicated the retro-dimension-cue benefit and showed that the length of the blank interval after the cue disappeared did not influence recall performance. Experiment 3 replicated the results of Experiment 2 with a lower memory load. Our studies provide evidence that there is a robust retro-dimension-cue benefit in VWM. Participants can use internal attention to flexibly allocate cognitive resources to a particular dimension of memory representations. The results also support the feature-based storing hypothesis.

Different Cortical Mechanisms for Spatial vs. Feature-Based Attentional Selection in Visual Working Memory

The limited capacity of visual working memory (VWM) necessitates attentional mechanisms that selectively update and maintain only the most task-relevant content. Psychophysical experiments have shown that the retroactive selection of memory content can be based on visual properties such as location or shape, but the neural basis for such differential selection is unknown. For example, it is not known if there are different cortical modules specialized for spatial vs. feature-based mnemonic attention, in the same way that has been demonstrated for attention to perceptual input. Here, we used transcranial magnetic stimulation (TMS) to identify areas in human parietal and occipital cortex involved in the selection of objects from memory based on cues to their location (spatial information) or their shape (featural information). We found that TMS over the supramarginal gyrus (SMG) selectively facilitated spatial selection, whereas TMS over the lateral occipital cortex (LO) selectively enhanced feature-based selection for remembered objects in the contralateral visual field. Thus, different cortical regions are responsible for spatial vs. feature-based selection of working memory representations. Since the same regions are involved in terms of attention to external events, these new findings indicate overlapping mechanisms for attentional control over perceptual input and mnemonic representations.