Theoretical distinction between functional states in working memory and their corresponding neural states

Representation and computation in visual working memory

The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.

Working memory forgetting: Bridging gaps between human and animal studies

The causes of forgetting in working memory (WM) remain a source of debate in cognitive psychology, partly because it has always been challenging to probe the complex neural mechanisms that govern rapid cognitive processes in humans. In this review, we argue that neural, and more precisely animal models, provide valuable tools for exploring the precise mechanisms of WM forgetting. First, we discuss theoretical perspectives concerning WM forgetting in humans. Then, we present neuronal correlates of WM in animals, starting from the initial evidence of delay activity observed in the prefrontal cortex to the later synaptic theory of WM. In the third part, specific theories of WM are discussed, including the notion that silent versus non-silent activity is more consistent with the processes of refreshing and decay proposed in human cognitive models. The review concludes with an exploration of the relationship between long-term memory and WM, revealing connections between these two forms of memory through the long-term synaptic hypothesis, which suggests that long-term storage of interference can potentially disrupt WM.

Maintenance of color memoranda in activity-quiescent working memory states: Evidence from impulse perturbation

In the present study, we used an impulse perturbation method to probe working memory maintenance of colors in neurally active and activity-quiescent states, focusing on a set of pre-registered analyses. We analyzed the electroencephalograph (EEG) data of 30 participants who completed a delayed match-to-sample working memory task, in which one of the two items that were presented was retro-cued as task relevant. The analyses revealed that both cued and uncued colors were decodable from impulse-evoked activity, the latter in contrast to previous reports of working memory for orientation gratings. Decoding of colors from oscillations in the alpha band showed that cued items could be decoded therein whereas uncued items could not. Overall, the outcomes suggest that subtle differences exist between the representation of colors, and that of stimuli with spatial properties, but the present results also demonstrate that regardless of their specific neural state, both are accessible through visual impulse perturbation.

Internal attention modulates the functional state of novel stimulus-response associations in working memory

Information in working memory (WM) is crucial for guiding behavior. However, not all WM representations are equally relevant simultaneously. Current theoretical frameworks propose a functional dissociation between 'latent' and 'active' states, in which relevant representations are prioritized into an optimal (active) state to face current demands, while relevant information that is not immediately needed is maintained in a dormant (latent) state. In this context, task demands can induce rapid and flexible prioritization of information from latent to active state. Critically, these functional states have been primarily studied using simple visual memories, with attention selecting and prioritizing relevant representations to serve as templates to guide subsequent behavior. It remains unclear whether more complex WM representations, such as novel stimulus-response associations, can also be prioritized into different functional states depending on their task relevance, and if so how these different formats relate to each other. In the present study, we investigated whether novel WM-guided actions can be brought into different functional states depending on current task demands. Our results reveal that planned actions can be flexibly prioritized when needed and show how their functional state modulates their influence on ongoing behavior. Moreover, they suggest the representations of novel actions of different functional states are maintained in WM via a non-orthogonal coding scheme, thus are prone to interference.

Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization

Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.

The Reactivation of working memory representations affects attentional guidance

Recent studies have suggested that the neural activity that supported working memory (WM) storage is dynamic over time and this dynamic storage decides memory performance. Does the temporal dynamic of the WM representation also affect visual search, and how does it interact with distractor suppression over time? To address these issues, we tracked the time course of the reactivation of WM representations during visual search by analyzing the electroencephalogram (EEG) and event-related optical signals (EROS) in Experiments 1 and 2, respectively, and investigated the interaction between the representation reactivation and distractor suppression in Experiment 3. Participants had to maintain a color in WM under high- or low-precision requirement and perform a subsequent search task. The reactivation of WM representations was defined by the above-chance decoding accuracy. The EEG results showed that compared with the low-precision requirement, WM-matching distractors captured more attention and the WM representation were reactivated more frequently under high-precision requirement. The EROS results showed that compared with the low-precision requirement, the increased activity in occipital cortex in the WM-matching versus WM-mismatching conditions was observed at 224 ms during visual search under high-precision requirement. Regression analysis showed that the representation reactivation during visual search directly predicted the behavioral WM-based attentional capture effect, while the representation reactivation before visual search impacted the WM-based attentional capture effect through the mediation of distractor suppression during visual search. These results suggest that the reactivation of WM representations and distractor suppression collectively determine WM-based attentional capture.

Are latent working memory items retrieved from long-term memory?

Switching one's focus of attention between to-be-remembered items in working memory (WM) is critical for cognition, but the mechanisms by which this is accomplished are unclear. A long-term memory (LTM) account suggests that switching attention away from an item, and passively retaining and reactivating such "latent" items back into the focus of attention involves episodic LTM retrieval processes, even for delays of only a few seconds. We tested this hypothesis using a two-item, double-retrocue WM task that requires participants to switch attention away from and reactivate items followed by subsequent LTM tests for reactivated items from the initial WM task (vs. continuously retained or untested control items). We compared performance on these tests between older adults (a population with LTM deficits) and young adults with either full (Experiment 1) or divided (Experiment 2) attention during the WM delay periods. The effects of reactivating latent items, as well as ageing and divided attention, had significant effects on WM performance, but did not interact with or systematically affect subsequent LTM for reactivated versus control items on item-, location-, or associative-recognition memory judgements made with either high or low confidence. Experiment 3 confirmed that these effects did not depend on whether or not young participants were warned about the subsequent LTM tests before performing the WM task. These dissociations between WM and LTM are inconsistent with the LTM account of latent WM; they are more consistent with the dynamic processing model of WM (Current Directions in Psychological Science).

Differences of resource allocation to active and passive states in visual working memory

Scholars have long sought to understand the separation between the active and passive states in visual working memory. Results of recent behavioral studies have provided insight into the independence of storage resources in these two states. To explore how humans distribute these resources in the active and passive states in visual working memory, we adopted the classic double-retro-cue paradigm combined with a continuous reported color wheel to ascertain whether the precision of representations maintained in active and passive states are adjustable according to the frequency of spatial cues. The results showed that two distinct resource allocation mechanisms exist in these two states beyond traditional visual working memory theory and provide further support for the separation hypothesis.

Spatial Configuration Effects on the Dissociation between Active and Latent States in Visual Working Memory

Visual working memory includes both active, recallable items and latent items not directly available for recall. During the online manipulation of active working memory, latent items gain robust retention. According to the dissociation account, active and passive memories exist in independent states, both of which take up their own cognitive resources. However, it is unclear whether dissociation is a universal phenomenon during memory maintenance. Given that memory information is retained as a binding of identity and location, the spatial proximity of memory items might shield the dissociation property. To test this, we adopted a retro-cue memory task where the cued and uncued items were separated in the active and latent states. In Experiment 1, the memory items were presented at a relatively large spatial distance. The results supported the dissociation account for well-separated items. However, Experiment 2 rejected the dissociation for closer-in items, possibly because items in visual working memory were spatially labeled. These findings suggest that while memory maintenance generally conforms to the dissociation account, the spatial configuration of memory items can affect the dissociation property between the active and latent neural states in visual working memory.

Are irrelevant items actively deleted from visual working memory?: No evidence from repulsion and attraction effects in dual-retrocue tasks

Some theories propose that working memory (WM) involves the active deletion of irrelevant information, including items that were retained in WM, but are no longer relevant for ongoing cognition. Considerable evidence suggests that active-deletion occurs for categorical representations, but whether it also occurs for recall of features that are typically bound together in an object, such as line orientations, is unclear. In two experiments, with or without binding instructions, healthy young adults maintained two orientations, focused attention to recall the orientation cued first, and then switched attention to recall the orientation cued second, at which point the uncued orientation was no longer relevant on the trial. In contrast to the active-deletion hypothesis, the results showed that the no-longer-relevant items exerted the strongest bias on participants' recall, which was either repulsive or attractive depending on both the degree of difference between the target and nontarget orientations and the proximity to cardinal axes. We suggest that visual WM can bind features like line orientations into chunked representations, and an irrelevant feature of a chunked object cannot be actively deleted - it biases recall of the target feature. Models of WM need to be updated to explain this and related dynamic phenomena.

To be or not to be relevant: Comparing short- and long-term consequences across working memory prioritization procedures

Priority-based allocation of attentional resources has shown robust effects in working memory (WM) with both cue-based and reward-based prioritization. However, direct comparisons between these effects in WM are needed. Additionally, the consequences of WM prioritization for remembering in the long term remain unclear for both prioritization procedures. Here, we tested and compared the immediate and long-term memory (LTM) effects of cue-based versus reward-based retrospective prioritization of WM content. Participants encoded four memory items and were then indicated to prioritize one of the items through the presentation of either a retro-cue or a reward pattern. We then tested their immediate and delayed memory. The results of the first experiment showed better memory for prioritized than for unprioritized information in WM and LTM, but the WM effect was driven solely by the retro-cue, making it difficult to interpret any reward-based effects in LTM. In the second experiment, using a more explicit and meaningful reward-based manipulation, the results showed a prioritization benefit in WM for both prioritization procedures. In LTM, however, the prioritization effect was predominantly driven by the retro-cue manipulation. Taken together, we found that (1) the way in which attention is directed in WM impacts the size of the prioritization benefit in WM, (2) WM prioritization generally results in a prioritization effect in LTM, and (3) that the effect in LTM is more robust for cue-based prioritization. Exploratory analyses indicated that the LTM effect of cue-based prioritization reflected a cost in performance for noncued items rather than a benefit for cued items.

Prioritization sharpens working memories but does not protect them from distraction

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased toward visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. In five behavioral experiments, we used different forms of retrospective cues (indicating the likelihood of testing each item and/or the reward for responding correctly to each item) to manipulate the prioritization of items in working memory before visual distraction. We examined the effects of distraction with nonparametric analyses and a novel distractor intrusion model. We found that memory responses were more precise (lower absolute response errors and stronger memory signals) for items that were prioritized. However, these prioritized items were not immune to distraction, and their memory responses were biased toward the visual distractors to the same degree as were unprioritized items. Our findings demonstrate that the benefits associated with prioritization in working memory do not include protection from distraction biases. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Good-enough attentional guidance

Theories of attention posit that attentional guidance operates on information held in a target template within memory. The template is often thought to contain veridical target features, akin to a photograph, and to guide attention to objects that match the exact target features. However, recent evidence suggests that attentional guidance is highly flexible and often guided by non-veridical features, a subset of features, or only associated features. We integrate these findings and propose that attentional guidance maximizes search efficiency based on a 'good-enough' principle to rapidly localize candidate target objects. Candidates are then serially interrogated to make target-match decisions using more precise information. We suggest that good-enough guidance optimizes the speed-accuracy-effort trade-offs inherent in each stage of visual search.

Humans, fish, spiders and bees inherited working memory and attention from their last common ancestor

All brain processes that generate behaviour, apart from reflexes, operate with information that is in an "activated" state. This activated information, which is known as working memory (WM), is generated by the effect of attentional processes on incoming information or information previously stored in short-term or long-term memory (STM or LTM). Information in WM tends to remain the focus of attention; and WM, attention and STM together enable information to be available to mental processes and the behaviours that follow on from them. WM and attention underpin all flexible mental processes, such as solving problems, making choices, preparing for opportunities or threats that could be nearby, or simply finding the way home. Neither WM nor attention are necessarily conscious, and both may have evolved long before consciousness. WM and attention, with similar properties, are possessed by humans, archerfish, and other vertebrates; jumping spiders, honey bees, and other arthropods; and members of other clades, whose last common ancestor (LCA) is believed to have lived more than 600 million years ago. It has been reported that very similar genes control the development of vertebrate and arthropod brains, and were likely inherited from their LCA. Genes that control brain development are conserved because brains generate adaptive behaviour. However, the neural processes that generate behaviour operate with the activated information in WM, so WM and attention must have existed prior to the evolution of brains. It is proposed that WM and attention are widespread amongst animal species because they are phylogenetically conserved mechanisms that are essential to all mental processing, and were inherited from the LCA of vertebrates, arthropods, and some other animal clades.

The facilitating effect of identical objects in visual working memory

According to the associative network of memory representations proposed by embedded processes models, the links between related memory representations were automatically established, which rendered these representations more easily activated. The present study adopted color recall tasks to explore whether the memory performance of identical objects was enhanced via the strengthening links between them, producing facilitating effect of identical objects. In Experiment 1, the number of identical items was manipulated. The results evidenced the facilitating effect, which was positively related to the number of identical objects. Experiment 2 modulated the spatial location of identical objects, which suggested that the facilitating effect was absent when two pairs of identical objects were located diagonally. Furthermore, Experiment 3 suggested that the facilitating effect was observed for the identical items which were presented in the second and fourth quadrants, rather than the first and third quadrants. Together, these results evidenced the facilitating effect of identical objects, which, however, was affected by spatial bias.

Reactivating ordinal position information from auditory sequence memory in human brains

Retaining a sequence of events in their order is a core ability of many cognitive functions, such as speech recognition, movement control, and episodic memory. Although content representations have been widely studied in working memory (WM), little is known about how ordinal position information of an auditory sequence is retained in the human brain as well as its coding characteristics. In fact, there is still a lack of an efficient approach to directly accessing the stored ordinal position code during WM retention. Here, 31 participants performed an auditory sequence WM task with their brain activities recorded using electroencephalography (EEG). We developed new triggering events that could successfully reactivate neural representations of ordinal position during the delay period. Importantly, the ordinal position reactivation is further related to recognition behavior, confirming its indexing of WM storage. Furthermore, the ordinal position code displays an intriguing “stable-dynamic” format, i.e. undergoing the same dynamic neutral trajectory in the multivariate neural space during both encoding and retention (whenever reactivated). Overall, our results provide an effective approach to accessing the behaviorally-relevant ordinal position information in auditory sequence WM and reveal its new temporal characteristics.

Interhemispheric Connectivity Supports Load-Dependent Working Memory Maintenance for Complex Visual Stimuli

Abstract Introduction: One manipulation used to study the neural basis of working memory (WM) is to vary the information load at encoding, then measure activity and connectivity during maintenance in the delay period. A hallmark finding is increased delay activity and connectivity between frontoparietal brain regions with increased load. Most WM studies, however, employ simple stimuli during encoding and unfilled intervals during the delay. In this study, we asked how delay period activity and connectivity change during low and high load maintenance of complex stimuli. Methods: Twenty-two participants completed a modified Sternberg WM task with two or five naturalistic scenes as stimuli during scalp electroencephalography (EEG). On each trial, the delay was filled with phase-scrambled scenes to provide a visual perceptual control with similar color and spatial frequency as presented during encoding. Functional connectivity during the delay was assessed by the phase-locking value (PLV). Results: Results showed reduced theta/alpha delay activity amplitude during high compared with low WM load across frontal, central, and parietal sources. A network with higher connectivity during low load consisted of increased PLV between (1) left frontal and right posterior temporal sources in the theta/alpha bands, (2) right anterior temporal and left central sources in the alpha and lower beta bands, and (3) left anterior temporal and posterior temporal sources in the theta, alpha, and lower beta bands. Discussion: The findings suggest a role for interhemispheric connectivity during WM maintenance of complex stimuli with load modulation when limited attentional resources are essential for filtering. Impact statement The patterns of brain connectivity subserving working memory (WM) have largely been investigated to date using simple stimuli, including letters, digits, and shapes and during unfilled WM delay intervals. Fewer studies describe functional connectivity changes during the maintenance of more naturalistic stimuli in the presence of distractors. In the present study, we employed a scene-based WM task during electroencephalography in healthy humans and found that during low-load WM maintenance with distractors increased interhemispheric connectivity in frontotemporal networks. These findings suggest a role for increased interhemispheric connectivity during maintenance of complex stimuli when attentional resources are essential for filtering.

Neural Reinstatement Tracks Spread of Attention between Object Features in Working Memory

Attention can be allocated in working memory (WM) to select and privilege relevant content. It is unclear whether attention selects individual features or whole objects in WM. Here, we used behavioral measures, eye-tracking, and EEG to test the hypothesis that attention spreads between an object's features in WM. Twenty-six participants completed a WM task that asked them to recall the angle of one of two oriented, colored bars after a delay while EEG and eye-tracking data were collected. During the delay, an orthogonal "incidental task" cued the color of one item for a match/mismatch judgment. On congruent trials (50%), the cued item was probed for subsequent orientation recall; on incongruent trials (50%), the other memory item was probed. As predicted, selecting the color of an object in WM brought other features of the cued object into an attended state as revealed by EEG decoding, oscillatory α-power, gaze bias, and improved orientation recall performance. Together, the results show that attentional selection spreads between an object's features in WM, consistent with object-based attentional selection. Analyses of neural processing at recall revealed that the selected object was automatically compared with the probe, whether it was the target for recall or not. This provides a potential mechanism for the observed benefits of nonpredictive cueing in WM, where a selected item is prioritized for subsequent decision-making.

Priority-based transformations of stimulus representation in visual working memory

How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent neural networks (RNNs) with a long short-term memory (LSTM) architecture to perform a 2-back WM task. Visualization of LSTM hidden layer activity using Principal Component Analysis (PCA) confirmed that stimulus representations undergo a representational transformation–consistent with a flip—while transitioning from the functional status of UMI to PMI. Demixed (d)PCA of the same data identified two representational trajectories, one each within a UMI subspace and a PMI subspace, both undergoing a reversal of stimulus coding axes. dPCA of data from an EEG dataset also provided evidence for priority-based transformations of the representational code, albeit with some differences. This type of transformation could allow for retention of unprioritized information in WM while preventing it from interfering with concurrent behavior. The results from this initial exploration suggest that the algorithmic details of how this transformation is carried out by RNNs, versus by the human brain, may differ.

Working memory and active sampling of the environment: Medial temporal contributions

Working memory (WM) refers to the ability to maintain and actively process information-either derived from perception or long-term memory (LTM)-for intelligent thought and action. This chapter focuses on the contributions of the temporal lobe, particularly medial temporal lobe (MTL) to WM. First, neuropsychological evidence for the involvement of MTL in WM maintenance is reviewed, arguing for a crucial role in the case of retaining complex relational bindings between memorized features. Next, MTL contributions at the level of neural mechanisms are covered-with a focus on WM encoding and maintenance, including interactions with ventral temporal cortex. Among WM use processes, we focus on active sampling of environmental information, a key input source to capacity-limited WM. MTL contributions to the bidirectional relationship between active sampling and memory are highlighted-WM control of active sampling and sampling as a way of selecting input to WM. Memory-based sampling studies relying on scene and object inspection, visual-based exploration behavior (e.g., vicarious behavior), and memory-guided visual search are reviewed. The conclusion is that MTL serves an important function in the selection of information from perception and transfer from LTM to capacity-limited WM.

Pinging the brain with visual impulses reveals electrically active, not activity-silent, working memories

Persistently active neurons during mnemonic periods have been regarded as the mechanism underlying working memory maintenance. Alternatively, neuronal networks could instead store memories in fast synaptic changes, thus avoiding the biological cost of maintaining an active code through persistent neuronal firing. Such "activity-silent" codes have been proposed for specific conditions in which memories are maintained in a nonprioritized state, as for unattended but still relevant short-term memories. A hallmark of this "activity-silent" code is that these memories can be reactivated from silent, synaptic traces. Evidence for "activity-silent" working memory storage has come from human electroencephalography (EEG), in particular from the emergence of decodability (EEG reactivations) induced by visual impulses (termed pinging) during otherwise "silent" periods. Here, we reanalyze EEG data from such pinging studies. We find that the originally reported absence of memory decoding reflects weak statistical power, as decoding is possible based on more powered analyses or reanalysis using alpha power instead of raw voltage. This reveals that visual pinging EEG "reactivations" occur in the presence of an electrically active, not silent, code for unattended memories in these data. This crucial change in the evidence provided by this dataset prompts a reinterpretation of the mechanisms of EEG reactivations. We provide 2 possible explanations backed by computational models, and we discuss the relationship with TMS-induced EEG reactivations.

The storage resources of the active and passive states are independent in visual working memory

Recently, multiple studies have proposed that mnemonic representations can be maintained in qualitatively different neural states in visual working memory (VWM): the active state and the passive state. However, it remains unclear whether the storage resources in the two distinct states are independent of each other. To address this issue, we adopted retro-cue paradigms in Experiments 1 and 2 and a sequential change detection paradigm in Experiment 3 to examine whether memory performance in one storage state was independent of the influence of load variation in the other. The results from these three behavioral experiments showed that load variation in the active state does not affect memory performance in the passive state, and vice versa. The current study provides evidence that active and passive states do not compete for resources to maintain working memory (WM) representations, thus supporting resource dissociation between the two distinct states in VWM.

A direct comparison of attentional orienting to spatial and temporal positions in visual working memory

Different visual attributes effectively guide attention to specific items in visual working memory (VWM), ensuring that particularly important memory contents are readily available. Predictable temporal structures contribute to this efficient use of VWM: items are prospectively prioritized when they are expected to be needed. Occasionally, however, visual events only gain relevance through their timing after they have passed. We investigated retrospective attentional orienting based on temporal position by directly comparing it with orienting to spatial locations, which is typically considered the most powerful selection mechanism. In a colour-change-detection task, in which items appeared sequentially at different locations, symbolic number cues validly indicated the temporal or spatial location of the upcoming probe item either before encoding (precues; Experiment 1) or during maintenance (retrocues; Experiments 1–3). Temporal and spatial cues were physically identical and only differed in their mapping onto either temporal or spatial positions. Predictive cues yielded cueing benefits (i.e., higher accuracy and shorter reaction times) as compared with neutral cues, with larger benefits for precues than for retrocues. Importantly, spatial and temporal cueing benefits did not differ. Equivalent retrocueing benefits were also observed across different cue-probe intervals and irrespective of whether spatial or temporal position was used as retrieval cue, indicating that items were directly bound to temporal position and not prioritized via a space-based mechanism. These findings show that spatial and temporal properties can be used equally well to flexibly prioritise representations held in VWM and they highlight the functional similarities of space and time in VWM.

A Hierarchy of Functional States in Working Memory

Extensive research has examined how information is maintained in working memory (WM), but it remains unknown how WM is used to guide behavior. We addressed this question by combining human electrophysiology (50 subjects, male and female) with pattern analyses, cognitive modeling, and a task requiring the prolonged maintenance of two WM items and priority shifts between them. This enabled us to discern neural states coding for memories that were selected to guide the next decision from states coding for concurrently held memories that were maintained for later use, and to examine how these states contribute to WM-based decisions. Selected memories were encoded in a functionally active state. This state was reflected in spontaneous brain activity during the delay period, closely tracked moment-to-moment fluctuations in the quality of evidence integration, and also predicted when memories would interfere with each other. In contrast, concurrently held memories were encoded in a functionally latent state. This state was reflected only in stimulus-evoked brain activity, tracked memory precision at longer timescales, but did not engage with ongoing decision dynamics. Intriguingly, the two functional states were highly flexible, as priority could be dynamically shifted back and forth between memories without degrading their precision. These results delineate a hierarchy of functional states, whereby latent memories supporting general maintenance are transformed into active decision circuits to guide flexible behavior.SIGNIFICANCE STATEMENT Working memory enables maintenance of information that is no longer available in the environment. Abundant neuroscientific work has examined where in the brain working memories are stored, but it remains unknown how they are represented and used to guide behavior. Our study shows that working memories are represented in qualitatively different formats, depending on behavioral priorities. Memories that are selected for guiding behavior are encoded in an active state that transforms sensory input into decision variables, whereas other concurrently held memories are encoded in a latent state that supports precise maintenance without affecting ongoing cognition. These results dissociate mechanisms supporting memory storage and usage, and open the door to reveal not only where memories are stored but also how.