Attention modulates maintenance of representations in visual short-term memory

A negative emotional state impairs individuals' ability to filter distractors from working memory: an ERP study

Capacity-limited visual working memory (VWM) requires that individuals have sufficient memory space and the ability to filter distractors. Negative emotional states are known to impact VWM storage, yet their influence on distractor filtering within VWM remains underexplored. We conducted direct neural measurement of participants (n = 56) who conducted a lateralized change detection task with distractors, while manipulating the emotional state by presenting neutral or negative images before each trial. We found a detrimental effect of distractors on memory accuracy under both neutral and negative emotional states. Using the event-related potential (ERP) component, contralateral delay activity (CDA; sensitive to VWM load), to observe the VWM load in each condition, we found that in the neutral state, the participants showed significantly higher late CDA amplitudes when remembering 4 targets compared with 2 targets and 2 targets with 2 distractors but no significant difference when remembering 2 targets compared with 2 targets with 2 distractors. In the negative state, no significant CDA amplitude differences were evident when remembering 4 targets and 2 targets, but CDA was significantly higher when remembering 2 targets with 2 distractors compared with 2 targets. These results suggest that the maximum number of items participants could store in VWM was lower under negative emotional states than under neutral emotional states. Importantly, the participants could filter out distractors when in a neutral emotional state but not in a negative emotional state, indicating that negative emotional states impair their ability to filter out distractors in VWM.

Maintenance of color memoranda in activity-quiescent working memory states: Evidence from impulse perturbation

In the present study, we used an impulse perturbation method to probe working memory maintenance of colors in neurally active and activity-quiescent states, focusing on a set of pre-registered analyses. We analyzed the electroencephalograph (EEG) data of 30 participants who completed a delayed match-to-sample working memory task, in which one of the two items that were presented was retro-cued as task relevant. The analyses revealed that both cued and uncued colors were decodable from impulse-evoked activity, the latter in contrast to previous reports of working memory for orientation gratings. Decoding of colors from oscillations in the alpha band showed that cued items could be decoded therein whereas uncued items could not. Overall, the outcomes suggest that subtle differences exist between the representation of colors, and that of stimuli with spatial properties, but the present results also demonstrate that regardless of their specific neural state, both are accessible through visual impulse perturbation.

Contralateral delay activity and alpha lateralization reflect retinotopic and screen-centered reference frames in visual memory

The visual system represents objects in a lateralized manner, with contralateral cortical hemispheres responsible for left and right visual hemifields. This organization extends to visual short-term memory (VSTM), as evidenced by electrophysiological indices of VSTM maintenance: contralateral delay activity (CDA) and alpha-band lateralization. However, it remains unclear if VSTM represents object locations in gaze-centered (retinotopic) or screen-centered (spatiotopic) coordinates, especially after eye movements. In two experiments, participants encoded the colors of target objects and made a lateral saccade during the maintenance interval, thereby shifting the object's location on the retina. A non-lateralized probe stimulus was then presented at the new fixation for a change detection task. The CDA maintained lateralization towards the target's original retinotopic location, unaffected by subsequent saccades, and did not invert polarity even when a saccade brought that location into the opposite hemifield. We also found conventional alpha lateralization towards the target's location before a saccade. After a saccade, however, alpha was lateralized towards the screen center regardless of the target's original location, even in a control condition without any memory requirements. This suggests that post-saccadic alpha-band lateralization reflects attentional processes unrelated to memory, while pre- and post-saccade CDA reflect VSTM maintenance in a retinotopic reference frame.

The effect of total sleep deprivation on working memory: evidence from diffusion model

STUDY OBJECTIVES

Working memory is crucial in human daily life and is vulnerable to sleep loss. The current study investigated the impact of sleep deprivation on working memory from the information processing perspective, to explore whether sleep deprivation affects the working memory via impairing information manipulation.

METHODS

Thirty-seven healthy adults attended two counterbalanced protocols: a normal sleep night and a total sleep deprivation (TSD). The N-back and the psychomotor vigilance task (PVT) assessed working memory and sustained attention. Response time distribution and drift-diffusion model analyses were applied to explore cognitive process alterations.

RESULTS

TSD increased the loading effect of accuracy, but not the loading effect of response time in the N-back task. TSD reduced the speed of information accumulation, increased the variability of the speed of accumulation, and elevated the decision threshold only in 1-back task. Moreover, the slow responses of PVT and N-back were severely impaired after TSD, mainly due to increased information accumulation variability.

CONCLUSIONS

The present study provides a new perspective to investigate behavioral performance by using response time distribution and drift-diffusion models, revealing that sleep deprivation affected multicognitive processes underlying working memory, especially information accumulation processes.

Exploring retro-cue effects on visual working memory: insights from double-cue paradigm

In the realm of visual working memory research, the retro-cue paradigm helps us study retro-cue effects such as retro-cue benefit (RCB) and retro-cue cost (RCC). RCB reflects better performance with cued items, while RCC indicates poorer performance with uncued items. Despite consistent evidence for RCB, it's still uncertain whether it remains when previously uncued items are cued afterward. Additionally, research findings have been inconsistent. This study combines prior experiments by controlling the proportion of cue types and the number of memory items. Besides, using a CDA index to assess the status of items after the cue appeared. Results showed better performance under the double-cue condition (involving two cues pointing inconsistently with only the second cue being valid) compared to the neutral-cue condition, and better performance under the single-cue condition compared to double-cue. EEG data revealed that after the appearance of the second cue in the double-cue condition, there was a significant increase in CDA wave amplitude compared to the single-cue condition. Behavior results suggests that RCB occurs under double-cue but to a lesser extent than the single-cue. And EEG outcomes indicates that individuals did not remove the uncued item from their visual working memory after the first cue. Instead, they kept it in a passive state and then shifted it to an active state after the appearance of the second cue.

Differential working memory function between phonological and visuospatial strategies: a magnetoencephalography study using a same visual task

Previous studies have reported that, in working memory, the processing of visuospatial information and phonological information have different neural bases. However, in these studies, memory items were presented via different modalities. Therefore, the modality in which the memory items were presented and the strategy for memorizing them were not rigorously distinguished. In the present study, we explored the neural basis of two working memory strategies. Nineteen right-handed young adults memorized seven sequential directions presented visually in a task in which the memory strategy was either visuospatial or phonological (visuospatial/phonological condition). Source amplitudes of theta-band (5-7 Hz) rhythm were estimated from magnetoencephalography during the maintenance period and further analyzed using cluster-based permutation tests. Behavioral results revealed that the accuracy rates showed no significant differences between conditions, while the reaction time in the phonological condition was significantly longer than that in the visuospatial condition. Theta activity in the phonological condition was significantly greater than that in the visuospatial condition, and the cluster in spatio-temporal matrix with p < 5% difference extended to right prefrontal regions in the early maintenance period and right occipito-parietal regions in the late maintenance period. The theta activity results did not indicate strategy-specific neural bases but did reveal the dynamics of executive function required for phonological processing. The functions seemed to move from attention control and inhibition control in the prefrontal region to inhibition of irrelevant information in the occipito-parietal region.

Purposeful listening in challenging conditions: A study of prediction during consecutive interpreting in noise

Prediction is often used during language comprehension. However, studies of prediction have tended to focus on L1 listeners in quiet conditions. Thus, it is unclear how listeners predict outside the laboratory and in specific communicative settings. Here, we report two eye-tracking studies which used a visual-world paradigm to investigate whether prediction during a consecutive interpreting task differs from prediction during a listening task in L2 listeners, and whether L2 listeners are able to predict in the noisy conditions that might be associated with this communicative setting. In a first study, thirty-six Dutch-English bilinguals either just listened to, or else listened to and then consecutively interpreted, predictable sentences presented on speech-shaped sound. In a second study, another thirty-six Dutch-English bilinguals carried out the same tasks in clear speech. Our results suggest that L2 listeners predict the meaning of upcoming words in noisy conditions. However, we did not find that predictive eye movements depended on task, nor that L2 listeners predicted upcoming word form. We also did not find a difference in predictive patterns when we compared our two studies. Thus, L2 listeners predict in noisy circumstances, supporting theories which posit that prediction regularly takes place in comprehension, but we did not find evidence that a subsequent production task or noise affects semantic prediction.

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants' performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and 2 with masks) or interruption (Experiments 3 and 4 with an odd-even task) occurred concurrently with the stages for the maintenance of prioritized information (long cue-and-interference/interruption interstimulus interval, e.g., Experiments 1 and 3) or the deployment of attention (short cue-and-interference/interruption interstimulus interval, e.g., Experiments 2 and 4). Our results demonstrate that perceptual interference or cognitive interruption attenuates the dimension-based RCB. These findings suggest that sustained attention is necessary for the effective prioritization of a specific dimension of VWM representations.

Better Controlled, Better Maintained: Sense of Agency Facilitates Working Memory

The cognitive effects of sense of agency (SoA) attract increasing attention. It is unclear how SoA influences working memory (WM). In the present study, participants first moved several boxes. One of the boxes was more or less controllable than the majority. After boxes stopped moving, to-be-remembered items appeared. Memory performance and SoA over them were subsequently tested. In Experiments 1a and 1b, the majority of boxes, serving as context, were under low and high control respectively. To further examine whether the maintenance stage was influenced, the effect of selective encoding was minimized in Experiments 2a and 2b. Experiment 2b further eliminated the impact of agency judgments and tested the relationship among SoA, WM, and preference. Memory was better for items with strong SoA in the high and low control contexts. The effect partly stems from the modulation of the maintenance stage in WM, in which reward-based processes could be engaged.

Prioritizing flexible working memory representations through retrospective attentional strengthening

Previous work has proposed two potential benefits of retrospective attention on working memory (WM): target strengthening and non-target inhibition. It remains unknown which hypothesis contributes to the improved WM performance, yet the neural mechanisms responsible for this attentional benefit are unclear. Here, we recorded electroencephalography (EEG) signals while 33 participants performed a retrospective-cue WM task. Multivariate pattern classification analysis revealed that only representations of target features were enhanced by valid retrospective attention during retention, supporting the target strengthening hypothesis. Further univariate analysis found that mid-frontal theta inter-trial phase coherence (ITPC) and ERP components were modulated by valid retrospective attention and correlated with individual differences and moment-to-moment fluctuations on behavioral outcomes, suggesting that both trait- and state-level variability in attentional preparatory processes influence goal-directed behavior. Furthermore, task-irrelevant target spatial location could be decoded from EEG signals, indicating that enhanced spatial binding of target representation is vital to high WM precision. Importantly, frontoparietal theta-alpha phase-amplitude coupling was increased by valid retrospective attention and predicted the reduced random guessing rates. This long-range connection supported top-down information flow in the engagement of frontoparietal networks, which might organize attentional states to integrate target features. Altogether, these results provide neurophysiological bases that retrospective attention improves WM precision by enhancing flexible target representation and emphasize the critical role of the frontoparietal attentional network in the control of WM representations.

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues - a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Temporal expectation based on the duration variability modulates alpha oscillations during working memory retention

While maintaining information over a delay of time, working memory (WM) also allows individuals to prepare the mnemonic contents for prospective utilisation. However, it remains unclear whether the expectation of the time of WM test could modulate neural responses during the retention interval of WM and subsequent performance. Here, we investigated whether temporal expectations based on the variability of delay duration can modulate 9-13 Hz alpha oscillations during WM retention and whether the expectation-induced alpha activity was associated with WM performance. Participants performed a retro-cueing WM task with magnetoencephalography (MEG) (Experiment 1) and a standard WM task with electroencephalography (EEG) (Experiment 2). The expectation of the timing of the WM test was manipulated by the temporal structure of the tasks with small or large variability in the delay durations. We showed that alpha oscillations during retention interval and WM performance varied with duration variability in both of the MEG and EEG experiments. The novel finding was greater alpha-power attenuation over the left frontal and parietal regions during WM retention when the duration variability was small and the test onset was predictable, compared to when the duration variability was large and the test onset was less predictable. Importantly, we observed a positive relationship in variability difference between the response benefit and alpha-power attenuation in the left posterior parietal regions at both MEG-source and EEG-electrode levels. Finally, we confirmed the behavioural benefit when a condition with a fixed delay-duration was included in a behavioural experiment (Experiment 3). When conjoined, the delay duration enables individuals to anticipate when the relevant information would be put to work, and alpha oscillations track the anticipatory states during WM maintenance.

No evidence that the retro-cue benefit requires reallocation of memory resources

Selective mechanisms allow us to prioritize items held in working memory. Does this reflect reallocation of working memory resources? We examined a critical prediction of this account-that reallocating more resources from one item to another should provide a greater benefit. We used a reward manipulation to create variable allocation of resources. Subsequently, a retro-cue instructed participants to drop a memory item. This retro-cue improved performance for the prioritized items relative to a neutral baseline. However, in contrast to the prevailing reallocation account, we found no difference between dropping a higher versus lower reward item. Importantly, removal of high versus low reward items led to better encoding of subsequently presented items, demonstrating that our reward manipulation was successful. While allocation of resources can influence the encoding and storage of new information into working memory, reallocation does not appear to be essential for selection effects in working memory.

Distributed networks for auditory memory differentially contribute to recall precision

Re-directing attention to objects in working memory can enhance their representational fidelity. However, how this attentional enhancement of memory representations is implemented across distinct, sensory and cognitive-control brain network is unspecified. The present fMRI experiment leverages psychophysical modelling and multivariate auditory-pattern decoding as behavioral and neural proxies of mnemonic fidelity. Listeners performed an auditory syllable pitch-discrimination task and received retro-active cues to selectively attend to a to-be-probed syllable in memory. Accompanied by increased neural activation in fronto-parietal and cingulo-opercular networks, valid retro-cues yielded faster and more perceptually sensitive responses in recalling acoustic detail of memorized syllables. Information about the cued auditory object was decodable from hemodynamic response patterns in superior temporal sulcus (STS), fronto-parietal, and sensorimotor regions. However, among these regions retaining auditory memory objects, neural fidelity in the left STS and its enhancement through attention-to-memory best predicted individuals' gain in auditory memory recall precision. Our results demonstrate how functionally discrete brain regions differentially contribute to the attentional enhancement of memory representations.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

A relational account of visual short-term memory (VSTM)

Visual short-term memory (VSTM) is an important resource that allows temporarily storing visual information. Current theories posit that elementary features (e.g., red, green) are encoded and stored independently of each other in VSTM. However, they have difficulty explaining the similarity effect, that similar items can be remembered better than dissimilar items. In Experiment 1, we tested (N = 20) whether the similarity effect may be due to storing items in a context-dependent manner in VSTM (e.g., as the reddest/yellowest item). In line with a relational account of VSTM, we found that the similarity effect is not due to feature similarity, but to an enhanced sensitivity for detecting changes when the relative colour of a to-be-memorised item changes (e.g., from reddest to not-reddest item; than when an item underwent the same change but retained its relative colour; e.g., still reddest). Experiment 2 (N = 20) showed that VSTM load, as indexed by the CDA amplitude in the EEG, was smaller when the colours were ordered so that they all had the same relationship than when the same colours were out-of-order, requiring encoding different relative colours. With this, we report two new effects in VSTM - a relational detection advantage that describes an enhanced sensitivity to relative changes in change detection, and a relational CDA effect, which reflects that VSTM load, as indexed by the CDA, scales with the number of (different) relative features between the memory items. These findings support a relational account of VSTM and question the view that VSTM stores features such as colours independently of each other.

A dynamic neural field model of continuous input integration

The ability of neural systems to turn transient inputs into persistent changes in activity is thought to be a fundamental requirement for higher cognitive functions. In continuous attractor networks frequently used to model working memory or decision making tasks, the persistent activity settles to a stable pattern with the stereotyped shape of a "bump" independent of integration time or input strength. Here, we investigate a new bump attractor model in which the bump width and amplitude not only reflect qualitative and quantitative characteristics of a preceding input but also the continuous integration of evidence over longer timescales. The model is formalized by two coupled dynamic field equations of Amari-type which combine recurrent interactions mediated by a Mexican-hat connectivity with local feedback mechanisms that balance excitation and inhibition. We analyze the existence, stability and bifurcation structure of single and multi-bump solutions and discuss the relevance of their input dependence to modeling cognitive functions. We then systematically compare the pattern formation process of the two-field model with the classical Amari model. The results reveal that the balanced local feedback mechanisms facilitate the encoding and maintenance of multi-item memories. The existence of stable subthreshold bumps suggests that different to the Amari model, the suppression effect of neighboring bumps in the range of lateral competition may not lead to a complete loss of information. Moreover, bumps with larger amplitude are less vulnerable to noise-induced drifts and distance-dependent interaction effects resulting in more faithful memory representations over time.

The part-list cuing effect in working memory: The influence of task presentation mode

The modulation of part-list cues on long-term memory has been well-documented, whereas its impact on working memory remains largely unknown. The current study recruited a working memory part-list cuing paradigm to investigate how re-exposing part-list items affected item representation in working memory, and more specifically, whether the cuing effect was modulated by the task presentation mode. Our results showed that when the part-list re-exposure and no-part-list re-exposure trials were presented in separate blocks, using the re-exposed items as retrieval cues (part-list cue condition) significantly impaired recognition speed, accuracy and elevated judgement criteria (Experiment 1a), whereas merely relearning the re-exposed items (part-list relearning condition) has no such effect (Experiment 1b). When the part-list cue trials are randomly interleaved with the no-part-list cue trials, recognition accuracy was significantly lower in the part-list cue condition, whereas the recognition speed and judgement criteria were not significantly different under the two conditions (Experiment 2). These results indicate that re-exposing subsets of previously memorized items as retrieval cues can reduce the strength of other representations in working memory. Moreover, the effect of part-list cues in working memory is affected by task presentation mode. The mechanisms of part-list cuing within working memory were discussed.

A direct comparison of attentional orienting to spatial and temporal positions in visual working memory

Different visual attributes effectively guide attention to specific items in visual working memory (VWM), ensuring that particularly important memory contents are readily available. Predictable temporal structures contribute to this efficient use of VWM: items are prospectively prioritized when they are expected to be needed. Occasionally, however, visual events only gain relevance through their timing after they have passed. We investigated retrospective attentional orienting based on temporal position by directly comparing it with orienting to spatial locations, which is typically considered the most powerful selection mechanism. In a colour-change-detection task, in which items appeared sequentially at different locations, symbolic number cues validly indicated the temporal or spatial location of the upcoming probe item either before encoding (precues; Experiment 1) or during maintenance (retrocues; Experiments 1–3). Temporal and spatial cues were physically identical and only differed in their mapping onto either temporal or spatial positions. Predictive cues yielded cueing benefits (i.e., higher accuracy and shorter reaction times) as compared with neutral cues, with larger benefits for precues than for retrocues. Importantly, spatial and temporal cueing benefits did not differ. Equivalent retrocueing benefits were also observed across different cue-probe intervals and irrespective of whether spatial or temporal position was used as retrieval cue, indicating that items were directly bound to temporal position and not prioritized via a space-based mechanism. These findings show that spatial and temporal properties can be used equally well to flexibly prioritise representations held in VWM and they highlight the functional similarities of space and time in VWM.

Visuospatial working memory abilities and spontaneous sensations perception

Aim: Body awareness arises when attending to and maintaining awareness of visuospatial body representations. By the same token, focussing on representations transfers them to working memory. Body awareness and working memory seemingly rely on similar processes and recruit common parietal areas involved in perception. Therefore, we asked whether visuospatial working memory abilities would define individual differences in the perception of spontaneous sensations (SPS), i.e., bodily sensations perceived in the absence of triggers (e.g., tactile stimulation or movement), when attending to the body.Method: Participants completed two visuospatial working memory tasks to assess various mechanisms: (i) the decay of representations was assessed through a Brown-Peterson task in which the delay between the memorandum presentation and its recall was manipulated, and (ii) the impact of distractors' interference and cognitive load (i.e., complexity) on recall performances were assessed through a complex span task that required the processing of distractors while maintaining a memorandum. A standard SPS task involving localization and characterization of SPS perceived on the hands was completed afterwards.Results: Low performance due to decay, distractors' interference and cognitive load in visuospatial working memory was associated with a decrease in the frequency of SPS. Additionally, low performance due to distractors' cognitive load predicted a decrease in the perception of surface-type sensations, and high performance despite distractors' interference led to a better perception of SPS on less sensitive areas of the hand.Conclusion: We discuss how visuospatial working memory processes might contribute to body awareness and perceptual distortions of the body.

Frontoparietal theta tACS nonselectively enhances encoding, maintenance, and retrieval stages in visuospatial working memory

Neurobiological and cognitive evidence suggests that working memory is processed through three distinctive and well-characterized phases: encoding, maintenance, and retrieval. Several studies have reported that applying theta transcranial alternating current stimulation (tACS) to the right prefrontal and parietal cortices can significantly improve visual working memory performance. However, it remains unclear whether the facilitative effect of tACS on visual working memory is due to a domain-general or stage-specific process. In this study, we combined pre-task right frontoparietal theta tACS (6 Hz, 15 min) with a stage-specific change detection paradigm that provided retro-cues during various stages of working memory. This stage-specific tagging via the use of retro-cues enabled us to probe whether theta tACS would create a nonspecific/additive effect that is equal in magnitude across all cognitive stages or would create a stage-specific effect that is interactive with the retro-cue in a particular stage (e.g., maintenance, retrieval). We observed significant retro-cue and theta tACS effects on visual working memory performance, but no interaction between them. This finding suggests that the aforementioned two factors can facilitate visual working memory processing independently in an additive manner. Furthermore, low-performers benefited more from tACS, and their VWM deficit seemed to have originated from the second half of the memory retention stage, which possibly suggests faster memory decay as the key to poor VWM performance. Together, we conclude that frontoparietal theta tACS likely creates a domain-general boost in visual attention, which in turn benefits overall visual working memory processes that are not specific to the information maintenance or retrieval stages.

Comparing the prioritization of items and feature-dimensions in visual working memory

Selective attention can be directed not only to external sensory inputs, but also to internal sensory representations held within visual working memory (VWM). To date, this phenomenon has been studied predominantly following retrospective cues directing attention to particular items, or their locations in memory. In addition to item-level attentional prioritization, recent studies have shown that selectively attending to feature dimensions in VWM can also improve memory recall performance. However, no study to date has directly compared item-based and dimension-based attention in VWM, nor their neural bases. Here, we compared the benefits of retrospective cues (retro-cues) that were directed either at a multifeature item or at a feature dimension that was shared between two spatially segregated items. Behavioral results revealed qualitatively similar attentional benefits in both recall accuracy and response time, but also showed that cueing benefits were larger after item cues. Concurrent electroencephalogram measurements further revealed a similar attenuation of posterior alpha oscillations following both item and dimension retro-cues when compared with noninformative, neutral retro-cues. We argue that attention can act flexibly to prioritize the most relevant information—at either the item or the dimension level—to optimize ensuing memory-based task performance, and we discuss the implications of the observed commonalities and differences between item-level and dimension-level prioritization in VWM.

Individual differences in working memory capacity are unrelated to the magnitudes of retrocue benefits

Previous studies have associated visual working memory (VWM) capacity with the use of internal attention. Retrocues, which direct internal attention to a particular object or feature dimension, can improve VWM performance (i.e., retrocue benefit, RCB). However, so far, no study has investigated the relationship between VWM capacity and the magnitudes of RCBs obtained from object-based and dimension-based retrocues. The present study explored individual differences in the magnitudes of object- and dimension-based RCBs and their relationships with VWM capacity. Participants completed a VWM capacity measurement, an object-based cue task, and a dimension-based cue task. We confirmed that both object- and dimension-based retrocues could improve VWM performance. We also found a significant positive correlation between the magnitudes of object- and dimension-based RCB indexes, suggesting a partly overlapping mechanism between the use of object- and dimension-based retrocues. However, our results provided no evidence for a correlation between VWM capacity and the magnitudes of the object- or dimension-based RCBs. Although inadequate attention control is usually assumed to be associated with VWM capacity, the results suggest that the internal attention mechanism for using retrocues in VWM retention is independent of VWM capacity.

Selection in working memory is resource-demanding: Concurrent task effects on the retro-cue effect

In a retro-cue paradigm, after memorizing a set of objects, people are cued to remember only a subset. Improved memory from the retro-cue suggests that selection processes can benefit items stored in working memory. Does selection in working memory require attention? If so, an attention-demanding task should disrupt retro-cue effects. Studies using a dual-task paradigm have found mixed results, with only one study (Janczyk & Berryhill, Attention, Perception, and Psychophysics, 76 (3), 715–724, 2014) showing a decreased retro-cue effect by a secondary task. Here we explore a potential issue in that study – the temporal overlap of the secondary task response with the memory test presentation. This raises questions about whether the secondary task was impairing selection processes in memory or was impacting the memory response. We replicated their paradigm by inserting a tone discrimination task at the retro-cue offset, but we also included a condition in which the tone task and the memory test were temporally separated. In Experiment 1, performing the tone task did not impair the retro-cue effect. In Experiment 2, we added an articulatory suppression task as in Janczyk and Berryhill’s study, and we found that the requirement to execute the tone task impaired retro-cue effects. This impairment was independent of whether the tone and memory tasks overlapped. These findings suggest that internal prioritization can be impaired by dual-task interference, but may only occur when such interference is robust enough, for example, due to switching between multiple tasks.

Estimating the statistical power to detect set-size effects in contralateral delay activity

The contralateral delay activity (CDA) is an event-related potential component commonly used to examine the online processes of visual working memory. Here, we provide a robust analysis of the statistical power that is needed to achieve reliable and reproducible results with the CDA. Using two very large EEG datasets that examined the contrast between CDA amplitude with set sizes 2 and 6 items and set sizes 2 and 4 items, we present a subsampling analysis that estimates the statistical power achieved with varying numbers of subjects and trials based on the proportion of significant tests in 10,000 iterations. We also generated simulated data using Bayesian multilevel modeling to estimate power beyond the bounds of the original datasets. The number of trials and subjects required depends critically on the effect size. Detecting the presence of the CDA-a reliable difference between contralateral and ipsilateral electrodes during the memory period-required only 30-50 clean trials with a sample of 25 subjects to achieve approximately 80% statistical power. However, for detecting a difference in CDA amplitude between two set sizes, a substantially larger number of trials and subjects were required; approximately 400 clean trials with 25 subjects to achieve 80% power. Thus, to achieve robust tests of how CDA activity differs across conditions, it is essential to be mindful of the estimated effect size. We recommend researchers designing experiments to detect set-size differences in the CDA collect substantially more trials per subject.

Effect of attentional selection on working memory for depth in a retro-cueing paradigm

Recent studies have shown that the temporary storage and manipulation of depth information (working memory for depth; WMd) is largely different from that of visual information in a 2D context (visual working memory; VWM). Although there has been abundant evidence on VWM showing that cueing a memory item during retention could bias attention to its internal representation and thus improves its memory performance (a retro-cue effect), it is unknown whether such an effect differs for WMd that is nested in a 3D context compared with that in a conventional 2D context. Here, we used a change detection task to investigate the effect of attentional selection on WMd by testing several types of retro-cue. The memory array consisted of items positioned at various stereoscopic depth planes, and a cue was presented during retention. Participants needed to make judgments on whether the depth position of target (one memory item) had changed. Our study showed reliable valid retro-cue benefits but no invalid retro-cue cost, indicating that the relational information may be registered in WMd to prevent a strategical removal of the unattended item. There was also a slight improvement in memory performance for cueing depth order compared with that for cueing other feature dimensions or 2D locations. The attentional effect on memory representation in a 3D context is different from that in a 2D context, and the divergence may suggest the distinctive nature of working memory for depth.

Neural measures of working memory in a bilateral change detection task

The change detection task is a widely used paradigm to examine visual working memory processes. Participants memorize a set of items and then, try to detect changes in the set after a retention period. The negative slow wave (NSW) and contralateral delay activity (CDA) are event-related potentials in the EEG signal that are commonly used in change detection tasks to track working memory load, as both increase with the number of items maintained in working memory (set size). While the CDA was argued to more purely reflect the memory-specific neural activity than the NSW, it also requires a lateralized design and attention shifts prior to memoranda onset, imposing more restrictions on the task than the NSW. The present study proposes a novel change detection task in which both CDA and NSW can be measured at the same time. Memory items were presented bilaterally, but their distribution in the left and right hemifield varied, inducing a target imbalance or "net load." NSW increased with set size, whereas CDA increased with net load. In addition, a multivariate linear classifier was able to decode the set size and net load from the EEG signal. CDA, NSW, and decoding accuracy predicted an individual's working memory capacity. In line with the notion of a bilateral advantage in working memory, accuracy, and CDA data suggest that participants tended to encode items relatively balanced. In sum, this novel change detection task offers a basis to make use of converging neural measures of working memory in a comprehensive paradigm.

Memory-driven capture occurs for individual features of an object

Items held in working memory (WM) capture attention (memory-driven capture). People can selectively prioritize specific object features in WM. Here, we examined whether feature-specific prioritization within WM modulates memory-driven capture. In Experiment 1, after remembering the color and orientation of a triangle, participants were instructed, via retro-cue, whether the color, the orientation, or both features were relevant. To measure capture, we asked participants to execute a subsequent search task, and we compared performance in displays that did and did not contain the memory-matching feature. Color attracted attention only when it was relevant. No capture by orientation was found. In Experiment 2, we presented the retro-cue at one of the four locations of the search display to direct attention to specific objects. We found capture by color and this capture was larger when it was indicated as relevant. Crucially, orientation also attracted attention, but only when it was relevant. These findings provide evidence for reciprocal interaction between internal prioritization and external attention on the features level. Specifically, internal feature-specific prioritization modulates memory-driven capture but this capture also depends on the salience of the features.

Implicit outcomes expectancies shape memory process: Electrophysiological evidence

The simple manipulation of pairing specific outcomes with the sample stimuli strongly affects discriminative learning and memory processes. This procedure has been named the Differential Outcomes Procedure (DOP) and is usually compared to a control condition (the non-differential procedure, NOP) consisting in the random administration of the outcomes after each correct response. Recent research has revealed that the DOP effect arises even under unconscious conditions. In this study, we explored the temporal dynamics of short-term memory processes in both the DOP and the NOP in the absence of awareness of either the outcome (Experiment 1A) or the initial sample stimulus (Experiment 1B) through the evoked-related potentials technique. Results showed distinctive electrophysiological activation patterns in the DOP compared with the NOP at encoding, maintenance and retrieval phases. The present findings provide electrophysiological evidence of implicit-prospective processes involved in the DOP. They elucidate the processes that result in improved visual recognition memory.

Temporal Expectations Prepare Visual Working Memory for Behavior

Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.

Bold moves: Inevitable saccadic selection in visual short-term memory

Selection for visual short-term memory (vstm) provides a basis for many cognitive functions. Saccadic eye movements sway this selection in favor of stimuli previously seen at locations congruent with their target. In three experiments, we provide converging evidence that this saccadic selection is implemented as a fundamental, inevitable selection process, rather than a top-down strategy. In particular, benefits for congruent over incongruent items were largely constant across set sizes ranging from two to eight items (Experiment 1), showing that saccadic selection imposes priorities on vstm irrespective of memory load and is effective even when only few representations need to be maintained. Moreover, a decrement in performance for incongruent items occurred reliably, whether the congruent location contained a task-relevant item or an irrelevant noise patch (Experiment 2). Finally, saccadic selection was immune to a strong manipulation of the observer's attentional priorities (Experiment 3). Given the prevalence of saccades in natural vision, our results demonstrate a fundamental and ecologically relevant selection mechanism for vstm: Saccades systematically eliminate information seen at non-target locations, while information at the saccade target remains available to recall. This simple heuristic is effective in the absence of informative cues and may incapacitate voluntary selection mechanisms that are incongruent with ongoing movement plans.

Action Real-Time Strategy Gaming Experience Related to Enhanced Capacity of Visual Working Memory

Action real-time strategy gaming (ARSG)—a major genre of action video gaming (AVG)—has both action and strategy elements. ARSG requires attention, visual working memory (VWM), sensorimotor skills, team cooperation, and strategy-making abilities, thus offering promising insights into the learning-induced plasticity. However, it is yet unknown whether the ARSG experience is related to the development of VWM capacity. Using both behavioral and event-related potential (ERP) measurements, this study tested whether ARSG experts had larger VWM capacity than non-experts in a change detection task. The behavioral results showed that ARSG experts had higher accuracy and larger VWM capacity than non-experts. In addition, the ERP results revealed that the difference wave of the contralateral delay activity (CDA) component (size 4–size 2) elicited by experts was significantly larger than that of non-experts, suggesting that the VWM capacity was higher in experts than in non-experts. Thus, the findings suggested that prolonged ARSG experience is correlative with the enhancement of VWM.

A dual mechanism underlying retroactive shifts of auditory spatial attention: dissociating target- and distractor-related modulations of alpha lateralization

Attention can be allocated to mental representations to select information from working memory. To date, it remains ambiguous whether such retroactive shifts of attention involve the inhibition of irrelevant information or the prioritization of relevant information. Investigating asymmetries in posterior alpha-band oscillations during an auditory retroactive cueing task, we aimed at differentiating those mechanisms. Participants were cued to attend two out of three sounds in an upcoming sound array. Importantly, the resulting working memory representation contained one laterally and one centrally presented item. A centrally presented retro-cue then indicated the lateral, the central, or both items as further relevant for the task (comparing the cued item(s) to a memory probe). Time–frequency analysis revealed opposing patterns of alpha lateralization depending on target eccentricity: A contralateral decrease in alpha power in target lateral trials indicated the involvement of target prioritization. A contralateral increase in alpha power when the central item remained relevant (distractor lateral trials) suggested the de-prioritization of irrelevant information. No lateralization was observed when both items remained relevant, supporting the notion that auditory alpha lateralization is restricted to situations in which spatial information is task-relevant. Altogether, the data demonstrate that retroactive attentional deployment involves excitatory and inhibitory control mechanisms.

Electrophysiological correlates of the differential outcomes effect in visual short-term memory

The differential outcomes procedure (DOP) consists in applying a specific outcome after each discriminative stimulus-correct response pairing, leading to improved performance in both memory and learning tasks (faster acquisition and/or higher response accuracy), compared to the non-differential outcomes procedure (NOP). The main aim of this study was to explore the electrophysiological correlates (ERPs) of the DOP in a visual short-term memory task, and to test whether a differential activation pattern would be observed depending on the outcomes condition (DOP vs. NOP). The ERP signals showed differences between both outcomes condition in all three phases of the short-term memory task: encoding, maintenance and retrieval. Our results are in accordance with the view that in the DOP condition the probe stimulus triggers a representation of the unique outcome, which remains active over the maintenance period (prospective process). In the NOP condition, in contrast, a representation of the probe stimulus is maintained (retrospective process). In addition, these results suggested that stimuli associated with unique outcomes captured attention involuntary at retrieval, decreasing the interference from distractor stimuli in the retrieval phase.

Neurocognitive mechanisms underlying working memory encoding and retrieval in Attention-Deficit/Hyperactivity Disorder

Working memory (WM) impairments in ADHD have been consistently reported along with deficits in attentional control. Yet, it is not clear which specific WM processes are affected in this condition. A deficient coupling between attention and WM has been reported. Nevertheless, most studies focus on the capacity to retain information rather than on the attention-dependent stages of encoding and retrieval. The current study uses a visual short-term memory binding task, measuring both behavioral and electrophysiological responses to characterize WM encoding, binding and retrieval comparing ADHD and non-ADHD matched adolescents. ADHD exhibited poorer accuracy and larger reaction times than non-ADHD on all conditions but especially when a change across encoding and test displays occurred. Binding manipulation affected equally both groups. Encoding P3 was larger in the non-ADHD group. Retrieval P3 discriminated change only in the non-ADHD group. Binding-dependent ERP modulations did not reveal group differences. Encoding and retrieval P3 were significantly correlated only in non-ADHD. These results suggest that while binding processes seem to be intact in ADHD, attention-related encoding and retrieval processes are compromised, resulting in a failure in the prioritization of relevant information. This new evidence can also inform recent theories of binding in visual WM.

Prioritization in visual working memory enhances memory retention and speeds up processing in a comparison task

Visual working memory retains visual information for controlling behavior. We studied how information in visual working memory is prioritized for being used. In two experiments, participants memorized the stimuli of a memory display for a brief interval, followed by a retro-cue. The retro-cue was either valid, indicating which stimulus from the memory display was relevant (i.e., had priority) in the upcoming comparison with a probe, or was neutral (uninformative). Next, the probe was presented, terminated by a mask, and participants reported whether it matched a stimulus from the memory display. The presentation duration of the probe was varied. Assessing performance as a function of presentation duration allowed to disentangle two components of working memory: memory retention and the speed of processing the probe for the memory-based comparison. Compared with neutral retro-cues, valid retro-cues improved retention and at the same time accelerated processing of the probe. These findings show for the first time that prioritization in working memory impacts on distinct mechanisms: retrospectively, it supports memory retention, and prospectively, it enhances perceptual processing in upcoming comparison tasks.

Retrospective Selection in Visual and Tactile Working Memory Is Mediated by Shared Control Mechanisms

Selective attention regulates the activation of working memory (WM) representations. Retro-cues, presented after memory sample stimuli have been stored, modulate these activation states by triggering shifts of attention to task-relevant samples. Here, we investigated whether the control of such attention shifts is modality-specific or shared across sensory modalities. Participants memorized bilateral tactile and visual sample stimuli before an auditory retro-cue indicated which visual and tactile stimuli had to be retained. Critically, these cued samples were located on the same side or opposite sides, thus requiring spatially congruent or incongruent attention shifts in tactile and visual WM. To track the attentional selection of retro-cued samples, tactile and visual contralateral delay activities (tCDA and CDA components) were measured. Clear evidence for spatial synergy effects from attention shifts in visual WM on concurrent shifts in tactile WM were observed: Tactile WM performance was impaired, and tCDA components triggered by retro-cues were strongly attenuated on opposite-sides relative to same-side trials. These spatial congruency effects were eliminated when cued attention shifts in tactile WM occurred in the absence of simultaneous shifts within visual WM. Results show that, in contrast to other modality-specific aspects of WM control, concurrent attentional selection processes within tactile and visual WM are mediated by shared supramodal control processes.

Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention

Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.

Retrospective Attention in Short-Term Memory Has a Lasting Effect on Long-Term Memory Across Age

OBJECTIVES

Declines in both short- and long-term memory are typical of healthy aging. Recent findings suggest that retrodictive attentional cues ("retro-cues") that indicate the location of to-be-probed items in short-term memory (STM) have a lasting impact on long-term memory (LTM) performance in young adults. Whether older adults can also use retro-cues to facilitate both STM and LTM is unknown.

METHOD

Young and older adults performed a visual STM task in which spatially informative retro-cues or noninformative neutral-cues were presented during STM maintenance of real-world objects. We tested participants' memory at both STM and LTM delays for objects that were previously cued with retrodictive or neutral-cues during STM order to measure the lasting impact of retrospective attention on LTM.

RESULTS

Older adults showed reduced STM and LTM capacity compared to young adults. However, they showed similar magnitude retro-cue memory benefits as young adults at both STM and LTM delays.

DISCUSSION

To the best of our knowledge, this is the first study to investigate whether retro-cues in STM facilitate the encoding of objects into LTM such that they are more likely to be subsequently retrieved by older adults. Our results support the idea that retrospective attention can be an effective means by which older adults can improve their STM and LTM performance, even in the context of reduced memory capacity.

EEG dynamics reveal a dissociation between storage and selective attention within working memory

Selective attention plays a prominent role in prioritizing information in working memory (WM), improving performance for attended representations. However, it remains unclear whether unattended WM representations suffer from information loss. Here we tested the hypothesis that within WM, selectively attending to an item and stopping storing other items are independent mechanisms. We recorded EEG while participants performed a WM recall task in which the item most likely to be tested was cued retrospectively during retention. By manipulating retro-cue reliability (i.e., the ratio of valid to invalid cue trials), we varied the incentive to retain non-cued items. Storage and selective attention in WM were measured during the retention interval by contralateral delay activity (CDA) and contralateral alpha power suppression, respectively. Soon after highly reliable cues, the cued item was attended, and non-cued items suffered information loss. However, for less reliable cues, initially the cued item was attended, but unattended items were kept in WM. Later during the delay, previously unattended items suffered information loss despite now attention being reallocated to their locations, presumably to strengthen their weakening traces. These results show that storage and attention in WM are distinct processes that can behave differently depending on the relative importance of representations.

Functional MRI and EEG Index Complementary Attentional Modulations

Functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) are two noninvasive methods commonly used to study neural mechanisms supporting visual attention in humans. Studies using these tools, which have complementary spatial and temporal resolutions, implicitly assume they index similar underlying neural modulations related to external stimulus and internal attentional manipulations. Accordingly, they are often used interchangeably for constraining understanding about the impact of bottom-up and top-down factors on neural modulations. To test this core assumption, we simultaneously manipulated bottom-up sensory inputs by varying stimulus contrast and top-down cognitive modulations by changing the focus of spatial attention. Each of the male and female subjects participated in both fMRI and EEG sessions performing the same experimental paradigm. We found categorically different patterns of attentional modulation on fMRI activity in early visual cortex and early stimulus-evoked potentials measured via EEG (e.g., the P1 component and steady-state visually-evoked potentials): fMRI activation scaled additively with attention, whereas evoked EEG components scaled multiplicatively with attention. However, across longer time scales, a contralateral negative-going potential and oscillatory EEG signals in the alpha band revealed additive attentional modulation patterns like those observed with fMRI. These results challenge prior assumptions that fMRI and early stimulus-evoked potentials measured with EEG can be interchangeably used to index the same neural mechanisms of attentional modulations at different spatiotemporal scales. Instead, fMRI measures of attentional modulations are more closely linked with later EEG components and alpha-band oscillations. Considered together, hemodynamic and electrophysiological signals can jointly constrain understanding of the neural mechanisms supporting cognition.SIGNIFICANCE STATEMENT fMRI and EEG have been used as tools to measure the location and timing of attentional modulations in visual cortex and are often used interchangeably for constraining computational models under the assumption that they index similar underlying neural processes. However, by varying attentional and stimulus parameters, we found differential patterns of attentional modulations of fMRI activity in early visual cortex and commonly used stimulus-evoked potentials measured via EEG. Instead, across longer time scales, a contralateral negative-going potential and EEG oscillations in the alpha band exhibited attentional modulations similar to those observed with fMRI. Together, these results suggest that different physiological processes assayed by these complementary techniques must be jointly considered when making inferences about the neural underpinnings of cognitive operations.

Test of a dynamic neural field model: spatial working memory is biased away from distractors

Attention facilitates the encoding (e.g., Awh, Anllo-Vento, & Hillyard, J Cognit Neurosci 12(5), 840-847, 2000) and maintenance of locations in spatial working memory (Awh, Vogel, & Oh, Atten, Percept Psychophys 78(4), 1043-1063, 2006). When individuals shift their attention during the maintenance period of a spatial working memory task, their memory of a target location tends to be biased in the direction of the attentional shift (Johnson & Spencer, 2016). Dynamic field theory predicts that in certain conditions, inhibitory mechanisms will result in biases away from distractors presented during the maintenance period of the task. Specifically, dynamic field theory predicts that memory responses will be biased toward distractors that are near the target location and biased away from distractors that are farther from the target location. In two experiments, the current study tested adults in a spatial memory task that required memorization of a single target location. On a subset of trials, a distractor appeared during the memory delay at different distances and directions from the target location. In contrast to the prediction, memory responses were biased away from distractors that were near the target location and not biased by distractors that were far from the target location, providing challenges for, dynamic field theory and other theories of spatial working memory.

Tracking working memory maintenance with pupillometry

Phasic pupillary responses were used to track the active maintenance of information in working memory (WM). In seven experiments participants performed various change detection tasks while their pupils were continuously recorded. Across the experiments phasic pupillary responses increased as the number of maintained items increased up to around 4-5 items consistent with behavioral estimates of capacity. Combining data across experiments demonstrated that phasic pupillary responses were related to behavioral estimates of capacity. Furthermore, phasic pupillary responses demonstrated WM load-dependent relations only when active maintenance was required. When instructed to passively stare at the items or to drop items from WM, the pupil remained near baseline levels. These phasic pupillary responses also tracked the time course of maintenance demonstrating sustained responses early in the delay period, but declined thereafter. Finally, phasic pupillary responses tracked selection processes at encoding (filtering and pre-cues), but did not suggest evidence for item removal following retro-cues. These results are consistent with the notion that maintaining items in WM requires the allocation of effortful attention and further suggest that phasic pupillary responses can be used to track the active maintenance of items in WM.

A Privileged Working Memory State and Potential Top-Down Modulation for Faces, Not Scenes

Top-down modulation is engaged during multiple stages of working memory (WM), including expectation, encoding, and maintenance. During WM maintenance period, an “incidental cue” can bring one of the two items into a privileged state and make the privileged item be recalled with higher precision, despite being irrelevant to which one to be probed as the target. With regard to the different representational states of WM, it’s unclear whether there is top-down modulation on earth sensory cortical areas. Here, We used this behavioral paradigm of “incidental cue” and event-related fMRI to investigate whether there were a privileged WM state and top-down modulation for complex stimuli including faces and natural scenes. We found that faces, not scenes, could enter into the privileged state with improved accuracy and response time of WM task. Meanwhile, cue-driven baseline activity shifts in fusiform face area (FFA) were identified by univariate analysis in the recognition of privileged faces, compared to that of non-privileged ones. In addition, the functional connectivity between FFA and right inferior frontal junction (IFJ), middle frontal gyrus (MFG), inferior frontal gyrus, right intraparietal sulcus (IPS), right precuneus and supplementary motor area was significantly enhanced, corresponding to the improved WM performance. Moreover, FFA connectivity with IFJ and IPS could predict WM improvements. These findings indicated that privileged WM state and potential top-down modulation existed for faces, but not scenes, during WM maintenance period.

The time course of encoding and maintenance of task-relevant versus irrelevant object features in working memory

Access to WM can be restricted on the basis of goal-relevant properties such as spatial location. However, the extent of voluntary control over which features of an attended multi-feature object are encoded and maintained in WM is debated. Some evidence suggests that attending to an object leads to obligatory storage of all of its features, whereas other evidence suggests that access to WM can be restricted to only goal-relevant features. Another possibility is that all features are initially encoded, but irrelevant features are removed from WM over time. To address these various possibilities, we used pattern classification of EEG signals to track the temporal evolution of representations reflecting the encoding and storage of task-relevant and irrelevant features in WM. In different blocks, participants remembered the orientation, color or both orientation and color of a colored, oriented grating. The color and orientation of the grating was randomly drawn from two distinct feature bins on each trial. To examine trial-specific activity reflecting storage of the object's features, a support vector machine (SVM) classifier was trained to classify what bin the stimulus features came from. Importantly, for orientation, the classifier produced reliably above-chance classification across the delay when orientation was task-relevant but not when it was task-irrelevant. Interestingly, orientation could be accurately classified on trials for which both orientation and color were remembered. Moreover, a separate measure corresponding to the probability of a feature belonging to the correct bin was significantly higher when orientation was task-relevant compared to task-irrelevant during encoding. Above-chance classification for color was only present during the initial 500 msec across all conditions. Our results suggest that although information about all of an object's features is present in the initial stimulus-evoked neural response, information about the task-irrelevant features is attenuated during stimulus encoding and is largely absent throughout the delay.

Retroactive Attentional Shifts Predict Performance in a Working Memory Task: Evidence by Lateralized EEG Patterns

Shifts of attention within working memory based on retroactive (retro-) cues were shown to facilitate performance in working memory tasks. Although posterior asymmetries in the EEG, such as the contralateral delay activity (CDA), have been used to study the active storage of lateralized working memory representations, results on the relation of such asymmetric effects to retro-cue benefits remain inconclusive. We recorded EEG in a retro-cue working memory task with lateralized items and a continuous performance response. Following either a selective or neutral retro-cue, participants adjusted the orientation of a central memory probe to the cued item. Selective retro-cues elicited an early posterior contralateral negativity (PCN), anterior directing attention negativity (ADAN) and a later modulation of CDA indicating that active storage was concentrated on the cued information. By dividing all trials into three within-condition performance quantiles, we could further show that high working memory accuracy was associated with a sustained increase of the CDA effect following the retro-cue. These results suggest that focusing resources on the active storage of relevant representations is an important factor regarding retro-cue benefits in working memory tasks.

Neural processing of working memory in adults with ADHD in a visuospatial change detection task with distractors

Individuals with Attention-Deficit Hyperactivity Disorder (ADHD) are often characterized by deficits in working memory (WM), which manifest in academic, professional, and mental health difficulties. To better understand the underlying mechanisms of these presumed WM deficits, we compared adults with ADHD to their peers on behavioral and neural indices of WM. We used a visuospatial change detection task with distractors which was designed to assess the brain’s ability to effectively filter out distractors from WM, in addition to testing for effects of WM load. Twenty-seven unmedicated adults with ADHD were compared to 27 matched peers on event-related potential (ERP) measures of WM, i.e., the contralateral delay activity (CDA). Despite severe impairments in everyday life functioning, findings showed no difference in deficits in behavioral tests of working memory for adults with ADHD compared to their peers. Interestingly, there were differences in neural activity between individuals with ADHD and their peers showing that the CDA of individuals with ADHD did not distinguish between high, distractor, and low memory load conditions. These data suggest, in the face of comparable behavioral performance, a difference in neural processing efficiency, wherein the brains of individuals with ADHD may not be as selective in the allocation of neural resources to perform a WM task.

Having More Choices Changes How Human Observers Weight Stable Sensory Evidence

Decision-making becomes slower when more choices are available. Existing models attribute this slowing to poor sensory processing, to attenuated rates of sensory evidence accumulation, or to increases in the amount of evidence required before committing to a decision (a higher decision threshold). However, studies have not isolated the effects of having more choices on sensory and decision-related processes from changes in task difficulty and divided attention. Here, we controlled task difficulty while independently manipulating the distribution of attention and the number of choices available to male and female human observers. We used EEG to measure steady-state visually evoked potentials (SSVEPs) and a frontal late positive deflection (LPD), EEG markers of sensory and postsensory decision-related processes, respectively. We found that dividing attention decreased SSVEP and LPD amplitudes, consistent with dampened sensory responses and slower rates of evidence accumulation, respectively. In contrast, having more choices did not alter SSVEP amplitude and led to a larger LPD. These results suggest that having more options largely spares early sensory processing and slows down decision-making via a selective increase in decision thresholds.SIGNIFICANCE STATEMENT When more choices are available, decision-making becomes slower. We tested whether this phenomenon is due to poor sensory processing, to reduced rates of evidence accumulation, or to increases in the amount of evidence required before committing to a decision (a higher decision threshold). We measured choice modulations of sensory and decision-related neural responses using EEG. We also minimized potential confounds from changes in the distribution of attention and task difficulty, which often covary with having more choices. Dividing attention reduced the activity levels of both sensory and decision-related responses. However, having more choices did not change sensory processing and led to larger decision-related responses. These results suggest that having more choices spares sensory processing and selectively increases decision thresholds.

Retrospective Cues Mitigate Information Loss in Human Cortex during Working Memory Storage

Working memory (WM) enables the flexible representation of information over short intervals. It is well established that WM performance can be enhanced by a retrospective cue presented during storage, yet the neural mechanisms responsible for this benefit are unclear. Here, we tested several explanations for retrospective cue benefits by quantifying changes in spatial WM representations reconstructed from alpha-band (8-12 Hz) EEG activity recorded from human participants (both sexes) before and after the presentation of a retrospective cue. This allowed us to track cue-related changes in WM representations with high temporal resolution (tens of milliseconds). Participants encoded the locations of two colored discs for subsequent report. During neutral trials, an uninformative cue instructed participants to remember the locations of both discs across a blank delay, and we observed a monotonic decrease in the fidelity of reconstructed spatial WM representations with time. During valid trials, a 100% reliable cue indicated that the color of the disc participants would be probed to report. Critically, valid cues were presented immediately after the termination of the encoding display ["valid early" (VE) trials] or midway through the delay period ["valid late" (VL) trials]. During VE trials, the gradual loss of location-specific information observed during neutral trials was eliminated, while during VL trials it was partially reversed. Our findings suggest that retrospective cues engage several different mechanisms that together serve to mitigate information loss during WM storage.SIGNIFICANCE STATEMENT Working memory (WM) performance can be improved by a cue presented during storage. This effect, termed a retrospective cue benefit, has been used to explore the limitations of attentional prioritization in WM. However, the mechanisms responsible for retrospective cue benefits are unclear. Here we tested several explanations for retrospective cue benefits by examining how they influence WM representations reconstructed from human EEG activity. This approach allowed us to visualize, quantify, and track the effects of retrospective cues with high temporal resolution (on the order of tens of milliseconds). We show that under different circumstances retrospective cues can both eliminate and even partially reverse information loss during WM storage, suggesting that retrospective cue benefits have manifold origins.