Reevaluating the Sensory Account of Visual Working Memory Storage

Beyond Routine Maintenance: Current Trends in Working Memory Research

Working memory (WM) is an evolving concept. Our understanding of the neural functions that support WM develops iteratively alongside the approaches used to study it, and both can be profoundly shaped by available tools and prevailing theoretical paradigms. Here, the organizers of the 2024 Working Memory Symposium-inspired by this year's meeting-highlight current trends and looming questions in WM research. This review is organized into sections describing (1) ongoing efforts to characterize WM function across sensory modalities, (2) the growing appreciation that WM representations are malleable to context and future actions, (3) the enduring problem of how multiple WM items and features are structured and integrated, and (4) new insights about whether WM shares function with other cognitive processes that have conventionally been considered distinct. This review aims to chronicle where the field is headed and calls attention to issues that are paramount for future research.

Supramodal and cross-modal representations of working memory in higher-order cortex

Working memory is essential for guiding our behaviors in daily life, where sensory information continuously flows from the external environment. While numerous studies have shown the involvement of sensory areas in maintaining working memory in a feature-specific manner, the challenge of utilizing retained sensory representations without interference from incoming stimuli of the same feature remains unresolved. To overcome this, essential information needs to be maintained dually in a form distinct from sensory representations. Here, using working memory tasks to retain braille patterns presented tactually or visually during fMRI scanning, we discovered two distinct forms of high-level working memory representations in the parietal and prefrontal cortex, together with modality-dependent sensory representations. First, we found supramodal representations in the superior parietal cortex that encoded braille identity in a consistent form, regardless of the involved sensory modality. Second, we observed that the prefrontal cortex and inferior parietal cortex specifically encoded cross-modal representations, which emerged during tasks requiring the association of information across sensory modalities, indicating a different high-level representation for integrating a broad range of sensory information. These findings suggest a framework for working memory maintenance that incorporates two distinct types of high-level representations-supramodal and cross-modal-operating alongside sensory representations.

Load effect of visual working memory on distractor interference: An investigation with two replication experiments

Konstantinou et al. (Experiment 1B; Attention, Perception, & Psychophysics, 76, 1985-1997, 2014) reported that an increase in visual short-term memory (VSTM) load reduced distractor interference in the flanker task. Yao et al. (Experiment 3; Attention, Perception, & Psychophysics, 82, 3291-3313, 2020) replicated the design of Konstantinou et al.'s experiment and showed that the VSTM load did not modulate the distractor interference effect, contradicting the original findings. However, it is unknown whether differences in task-design between the two experiments contributed to the inconsistent results. Therefore, we first replicated the original two studies with Experiment 1 (N = 54) and Experiment 2 (N = 54) and performed a statistical comparison between the data from these two experiments. In a third experiment (N = 28), we incorporated articulatory suppression into the design to exclude possible effects of verbalization. According to the ANOVA analyses, the VSTM load did not change the level of distractor interference in all three experiments, indicating that differences in task design alone do not explain the inconsistency.

Distractor anticipation during working memory is associated with theta and beta oscillations across spatial scales

Introduction

Anticipating distractors during working memory maintenance is critical to reduce their disruptive effects. In this study, we aimed to identify the oscillatory correlates of this process across different spatial scales of neural activity.

Methods

We simultaneously recorded local field potentials (LFP) from the lateral prefrontal cortex (LPFC) and electroencephalograms (EEG) from the scalp of monkeys performing a modified memory-guided saccade (MGS) task. The monkeys were required to remember the location of a target visual stimulus while anticipating distracting visual stimulus, flashed at 50% probability during the delay period.

Results

We found significant theta-band activity across spatial scales during anticipation of a distractor, closely linked with underlying working memory dynamics, through decoding and cross-temporal generalization analyses. EEG particularly reflected reactivation of memory around the anticipated time of a distractor, even in the absence of stimuli. During this anticipated time, beta-band activity exhibited transiently enhanced intrahemispheric communication between the LPFC and occipitoparietal brain areas. These oscillatory phenomena were observed only when the monkeys successfully performed the task, implicating their possible functional role in mitigating anticipated distractors.

Discussion

Our results demonstrate that distractor anticipation recruits multiple oscillatory processes across the brain during working memory maintenance, with a key activity observed predominantly in the theta and beta bands.

Neural dynamics of reselecting visual and motor contents in working memory after external interference

In everyday tasks, we must often shift our focus away from internal representations held in working memory to engage with perceptual events in the external world. Here, we investigated how our internal focus is reestablished following an interrupting task by tracking the reselection of visual representations and their associated action plans in working memory. Specifically, we ask whether reselection occurs for both visual and motor memory attributes and when this reselection occurs. We developed a visual-motor working-memory task in which participants were retrospectively cued to select one of two memory items before being interrupted by a perceptual discrimination task. To determine what information was reselected, the memory items had distinct visual and motor attributes. To determine when internal representations were reselected, the interrupting task was presented at one of three distinct time points following the retro-cue. We employed electroencephalography time-frequency analyses to track the initial selection and later reselection of visual and motor representations, as operationalized through modulations of posterior alpha (8-12 Hz) activity relative to the memorized item location (visual) and of central beta (13-30 Hz) activity relative to the required response hand (motor). Our results showed that internal visual and motor contents were concurrently reselected immediately after completing the interrupting task, rather than only when internal information was required for memory-guided behavior. Thus, following interruption, we swiftly resume our internal focus in working memory through the simultaneous reselection of memorized visual representations and their associated action plans, thereby restoring internal contents to a ready-to-use state.Significance statement A key challenge for working memory is to maintain past visual representations and their associated actions while engaging with the external environment. Our cognitive system must, therefore, often juggle multiple tasks within a common time frame. Despite the ubiquity of multi-task situations in everyday life, working memory has predominantly been studied devoid of additional perceptual, attentional, and response demands during the retention interval. Here, we investigate the neural dynamics of returning to internal contents following task-relevant interruptions. Particularly, we identify which attributes of internal representations are reselected and when this reselection occurs. Our findings demonstrate that both visual and motor contents are reselected immediately and in tandem after completion of an external, interrupting task.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.Significance Statement We demonstrate that remembering a visual stimulus evokes responses in visual cortex that differ in spatial extent compared to seeing the same stimulus. Perception evokes tuned responses in early visual areas that increase in size up the visual hierarchy. Prior work showed that feedback inputs associated with long-term memory originate from later visual areas with larger receptive fields resulting in uniformly wide spatial tuning even in primary visual cortex. We replicate these results and show that the same pattern holds when maintaining in working memory a recently viewed stimulus. That trial-to-trial difficulty is reflected in the accuracy and precision of these representations suggests that visual cortex is flexibly used for processing visuospatial information, regardless of where that information originates.

A finite set of content-free pointers in visual working memory: magnetoencephalography (MEG) evidence

Human visual working memory (VWM) is known to be capacity-limited, but the nature of this limit continues to be debated. Recent work has proposed that VWM is supported by a finite (~3) set of content-free pointers, acting as stand-ins for individual objects and binding features together. According to this proposal, the pointers do not represent features within themselves, but rather bind features represented elsewhere together. The current study set out to test if neural hallmarks resembling these content-free pointers can be observed with magnetoencephalography (MEG). Based on two VWM delay-match-to-sample experiments (N = 20 each) examining memory for simple and complex objects, we report a sustained response in MEG over right posterior cortex whose magnitude tracks the core hypothesized properties of this content-free pointer system: load-dependent, capacity-limited, and content-free. These results provide novel evidence for a finite set of content-free pointers underlying VWM.

The role of variation in phonological and semantic working memory capacities in sentence comprehension: neural evidence from healthy and brain-damaged individuals

Research on the role of working memory (WM) in language processing has typically focused on WM for phonological information. However, considerable behavioral evidence supports the existence of a separate semantic WM system that plays a greater role in language processing. We review the neural evidence that supports the distinction between phonological and semantic WM capacities and discuss how individual differences in these capacities relate to sentence processing. In terms of neural substrates, findings from multivariate functional MRI for healthy participants and voxel-based lesion-symptom mapping for brain-damaged participants imply that the left supramarginal gyrus supports phonological WM, whereas the left inferior frontal gyrus (LIFG) and angular gyrus support semantic WM. In sentence comprehension, individual variation in semantic but not phonological WM related to performance in resolving semantic information and the LIFG region implicated in semantic WM showed fMRI activation during the resolution of semantic interference. Moreover, variation for brain-damaged participants in the integrity of a fiber tract supporting semantic WM had a greater relation to the processing of complex sentences than did the integrity of fiber tracts supporting phonological WM. Overall, the neural findings provide converging evidence regarding the distinction of these two capacities and the greater contribution of individual differences in semantic than phonological WM capacity to sentence processing.

Bifurcation in space: Emergence of functional modularity in the neocortex

How does functional modularity emerge in a cortex composed of repeats of a canonical local circuit? Focusing on distributed working memory, we show that a rigorous description of bifurcation in space describes the emergence of modularity. A connectome-based model of monkey cortex displays bifurcation in space during decision-making and working memory, demonstrating this new concept's generality. In a generative model and multi-regional cortex models of both macaque monkey and mouse, we found an inverted-V-shaped profile of neuronal timescales across the cortical hierarchy during working memory, providing an experimentally testable prediction of modularity. The cortex displays simultaneously many bifurcations in space, so that the corresponding modules could potentially subserve distinct internal mental processes. Therefore, a distributed process subserves the brain's functional specificity. We propose that bifurcation in space, resulting from connectivity and macroscopic gradients of neurobiological properties across the cortex, represents a fundamental principle for understanding the brain's modular organization.

Advancing working memory research through cortico-cortical transcranial magnetic stimulation

The neural underpinnings of working memory (WM) have been of continuous scientific interest for decades. As the understanding of WM progresses and new theories, such as the distributed view of WM, develop, the need to advance the methods used to study WM also arises. This perspective discusses how building from the state-of-the-art in the field of transcranial magnetic stimulation (TMS), and utilising cortico-cortical TMS, may pave the way for testing some of the predictions proposed by the distributed WM view. Further, after briefly discussing current barriers that need to be overcome for implementing cortico-cortical TMS for WM research, examples of how cortico-cortical TMS may be employed in the context of WM research are provided, guided by the ongoing debate on the sensory recruitment framework.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.

Re-evaluating human MTL in working memory: insights from intracranial recordings

The study of human working memory (WM) holds significant importance in neuroscience; yet, exploring the role of the medial temporal lobe (MTL) in WM has been limited by the technological constraints of noninvasive methods. Recent advancements in human intracranial neural recordings have indicated the involvement of the MTL in WM processes. These recordings show that different regions of the MTL are involved in distinct aspects of WM processing and also dynamically interact with each other and the broader brain network. These findings support incorporating the MTL into models of the neural basis of WM. This integration can better reflect the complex neural mechanisms underlying WM and enhance our understanding of WM's flexibility, adaptability, and precision.

Anatomical Connectivity Constrains Dynamic Functional Connectivity among Neural Systems: Implications for Cognition and Behavior

Leslie Ungerleider had a tremendous impact across many different areas of cognitive neuroscience. Her ideas and her approach, as well as her findings, will continue to impact the field for generations to come. One of the most impactful aspects of her approach was her focus on the ways that anatomical connections constrain functional communications among brain regions. Furthermore, she emphasized that changes in these functional communications, whether from lesions to the anatomical connections or temporary modulations of the efficacy of information transmission resulting from selective attention, have consequences for cognition and behavior. By necessity, this short review cannot cover the vast amount of research that contributed to or benefited from Leslie's work. Rather, we focus on one line of research that grew directly from some of Leslie's early work and her mentoring on these important concepts. This research and the many other lines of research that arose from these same origins has helped develop our understanding of the visual system, and cognitive systems more generally, as collections of highly organized, specialized, dynamic, and interacting subsystems.

Maintenance of Bodily Expressions Modulates Functional Connectivity Between Prefrontal Cortex and Extrastriate Body Area During Working Memory Processing

Background/Objectives: As a form of visual input, bodily expressions can be maintained and manipulated in visual working memory (VWM) over a short period of time. While the prefrontal cortex (PFC) plays an indispensable role in top-down control, it remains largely unclear whether this region also modulates the VWM storage of bodily expressions during a delay period. Therefore, the two primary goals of this study were to examine whether the emotional bodies would elicit heightened brain activity among areas such as the PFC and extrastriate body area (EBA) and whether the emotional effects subsequently modulate the functional connectivity patterns for active maintenance during delay periods. Methods: During functional magnetic resonance imaging (fMRI) scanning, participants performed a delayed-response task in which they were instructed to view and maintain a body stimulus in working memory before emotion categorization (happiness, anger, and neutral). If processing happy and angry bodies consume increased cognitive demands, stronger PFC activation and its functional connectivity with perceptual areas would be observed. Results: Results based on univariate and multivariate analyses conducted on the data collected during stimulus presentation revealed an enhanced processing of the left PFC and left EBA. Importantly, subsequent functional connectivity analyses performed on delayed-period data using a psychophysiological interaction model indicated that functional connectivity between the PFC and EBA increases for happy and angry bodies compared to neutral bodies. Conclusions: The emotion-modulated coupling between the PFC and EBA during maintenance deepens our understanding of the functional organization underlying the VWM processing of bodily information.

The human posterior parietal cortices orthogonalize the representation of different streams of information concurrently coded in visual working memory

The key to adaptive visual processing lies in the ability to maintain goal-directed visual representation in the face of distraction. In visual working memory (VWM), distraction may come from the coding of distractors or other concurrently retained targets. This fMRI study reveals a common representational geometry that our brain uses to combat both types of distractions in VWM. Specifically, using fMRI pattern decoding, the human posterior parietal cortex is shown to orthogonalize the representations of different streams of information concurrently coded in VWM, whether they are targets and distractors, or different targets concurrently held in VWM. The latter is also seen in the human occipitotemporal cortex. Such a representational geometry provides an elegant and simple solution to enable independent information readout, effectively combating distraction from the different streams of information, while accommodating their concurrent representations. This representational scheme differs from mechanisms that actively suppress or block the encoding of distractors to reduce interference. It is likely a general neural representational principle that supports our ability to represent information beyond VWM in other situations where multiple streams of visual information are tracked and processed simultaneously.

Visual event boundaries trigger forgetting despite active maintenance in visual working memory

The contents of visual perception are inherently dynamic-just as we experience objects in space, so too events in time. The boundaries between these events have downstream consequences. For example, memory for incidentally encountered items is impaired when walking through a doorway, perhaps because event boundaries serve as cues to clear obsolete information from previous events. Although this kind of "memory flushing" can be adaptive, work on visual working memory (VWM) has focused on the opposite function of active maintenance in the face of distraction. How do these two cognitive operations interact? In this study, observers watched animations in which they walked through three-dimensionally rendered rooms with picture frames on the walls. Within the frames, observers either saw images that they had to remember ("encoding") or recalled images they had seen in the immediately preceding frame ("test"). Half of the time, a doorway was crossed during the delay between encoding and test. Across experiments, there was a consistent memory decrement for the first image encoded in the doorway compared to the no-doorway condition while equating time elapsed, distance traveled, and distractibility of the doorway. This decrement despite top-down VWM efforts highlights the power of event boundaries to structure what and when we forget.

Beta-band neural variability reveals age-related dissociations in human working memory maintenance and deletion

Maintaining and removing information in mind are 2 fundamental cognitive processes that decline sharply with age. Using a combination of beta-band neural oscillations, which have been implicated in the regulation of working memory contents, and cross-trial neural variability, an undervalued property of brain dynamics theorized to govern adaptive cognitive processes, we demonstrate an age-related dissociation between distinct working memory functions-information maintenance and post-response deletion. Load-dependent decreases in beta variability during maintenance predicted memory performance of younger, but not older adults. Surprisingly, the post-response phase emerged as the predictive locus of working memory performance for older adults, with post-response beta variability correlated with memory performance of older, but not younger adults. Single-trial analysis identified post-response beta power elevation as a frequency-specific signature indexing memory deletion. Our findings demonstrate the nuanced interplay between age, beta dynamics, and working memory, offering valuable insights into the neural mechanisms of cognitive decline in agreement with the inhibition deficit theory of aging.

EEG decoding reveals task-dependent recoding of sensory information in working memory

Working memory (WM) supports future behavior by retaining perceptual information obtained in the recent past. The present study tested the hypothesis that WM recodes sensory information in a format that better supports behavioral goals. We recorded EEG while participants performed color delayed-estimation tasks where the colorwheel for the response was either randomly rotated or held fixed across trials. Accordingly, observers had to remember the exact colors in the Rotation condition, whereas they could prepare for a response based on the fixed mapping between the colors and their corresponding locations on the colorwheel in the No-Rotation condition. Results showed that the color reports were faster and more precise in the No-Rotation condition even when exactly the same set of colors were tested in both conditions. To investigate how the color information was maintained in the brain, we decoded the color using a multivariate EEG classification method. The decoding was limited to the stimulus encoding period in the Rotation condition, whereas it continued to be significant during the maintenance period in the No-Rotation condition, indicating that the color information was actively maintained in the condition. Follow-up analyses suggested that the prolonged decoding was not merely driven by the covert shift of attention but rather by the recoding of sensory information into an action-oriented response format. Together, these results provide converging evidence that WM flexibly recodes sensory information depending on the specific task context to optimize subsequent behavioral performance.

Perceptual encoding benefit of visual memorability on visual memory formation

Human observers often exhibit remarkable consistency in remembering specific visual details, such as certain face images. This phenomenon is commonly attributed to visual memorability, a collection of stimulus attributes that enhance the long-term retention of visual information. However, the exact contributions of visual memorability to visual memory formation remain elusive as these effects could emerge anywhere from early perceptual encoding to post-perceptual memory consolidation processes. To clarify this, we tested three key predictions from the hypothesis that visual memorability facilitates early perceptual encoding that supports the formation of visual short-term memory (VSTM) and the retention of visual long-term memory (VLTM). First, we examined whether memorability benefits in VSTM encoding manifest early, even within the constraints of a brief stimulus presentation (100-200 ms; Experiment 1). We achieved this by manipulating stimulus presentation duration in a VSTM change detection task using face images with high- or low-memorability while ensuring they were equally familiar to the participants. Second, we assessed whether this early memorability benefit increases the likelihood of VSTM retention, even with post-stimulus masking designed to interrupt post-perceptual VSTM consolidation processes (Experiment 2). Last, we investigated the durability of memorability benefits by manipulating memory retention intervals from seconds to 24 h (Experiment 3). Across experiments, our data suggest that visual memorability has an early impact on VSTM formation, persisting across variable retention intervals and predicting subsequent VLTM overnight. Combined, these findings highlight that visual memorability enhances visual memory within 100-200 ms following stimulus onset, resulting in robust memory traces resistant to post-perceptual interruption and long-term forgetting.

Preserved recognition of basic visual features despite lack of awareness of shape: Evidence from a case of neglect

Human visual experience of objects comprises a combination of visual features, such as color, position, and shape. Spatial attention is thought to play a role in creating a coherent perceptual experience, integrating visual information coming from a given location, but the mechanisms underlying this process are not fully understood. Deficits of spatial attention in which this integration process does not occur normally, such as neglect, can provide insights regarding the mechanisms of spatial attention in visual object recognition. In this study, we describe a series of experiments conducted with an individual with neglect, DH. DH presents characteristic lack of awareness of the left side of individual objects, evidenced by poor object and face recognition, and impaired word reading. However, he exhibits intact recognition of color within the boundaries of the same objects he fails to recognize. Furthermore, he can also report the orientation and location of a colored region on the neglected left side despite lack of awareness of the shape of the region. Overall, DH shows selective lack of awareness of shape despite intact processing of basic visual features in the same spatial location. DH's performance raises intriguing questions and challenges about the role of spatial attention in the formation of coherent object percepts and visual awareness.

Images with harder-to-reconstruct visual representations leave stronger memory traces

Much of what we remember is not because of intentional selection, but simply a by-product of perceiving. This raises a foundational question about the architecture of the mind: how does perception interface with and influence memory? Here, inspired by a classic proposal relating perceptual processing to memory durability, the level-of-processing theory, we present a sparse coding model for compressing feature embeddings of images, and show that the reconstruction residuals from this model predict how well images are encoded into memory. In an open memorability dataset of scene images, we show that reconstruction error not only explains memory accuracy, but also response latencies during retrieval, subsuming, in the latter case, all of the variance explained by powerful vision-only models. We also confirm a prediction of this account with 'model-driven psychophysics'. This work establishes reconstruction error as an important signal interfacing perception and memory, possibly through adaptive modulation of perceptual processing.

The causal involvement of the visual cortex in visual working memory remains uncertain

The role of the early visual cortex in visual working memory (VWM) is a matter of current debate. Neuroimaging studies have consistently shown that visual areas encode the content of working memory, while transcranial magnetic stimulation (TMS) studies have presented incongruent results. Thus, we lack conclusive evidence supporting the causal role of early visual areas in VWM. In a recent registered report, Phylactou et al. (Phylactou P, Shimi A, Konstantinou N 2023 R. Soc. Open Sci. 10, 230321 (doi:10.1098/rsos.230321)) sought to tackle this controversy via two well-powered TMS experiments, designed to correct possible methodological issues of previous attempts identified in a preceding systematic review and meta-analysis (Phylactou P, Traikapi A, Papadatou-Pastou M, Konstantinou N 2022 Psychon. Bull. Rev. 29, 1594-1624 (doi:10.3758/s13423-022-02107-y)). However, a key part of their critique and experimental design was based on a misunderstanding of the visual system. They disregarded two important anatomical facts, namely that early visual areas of each hemisphere represent the contralateral visual hemifield, and that each hemisphere receives equally strong input from each eye-both leading to confounded conditions and artefactual effects in their studies. Here, we explain the correct anatomy, describe why their experiments failed to address current issues in the literature and perform a thorough reanalysis of their TMS data revealing important null results. We conclude that the causal role of the visual cortex in VWM remains uncertain.

Multifaceted consequences of visual distraction during natural behaviour

Visual distraction is a ubiquitous aspect of everyday life. Studying the consequences of distraction during temporally extended tasks, however, is not tractable with traditional methods. Here we developed a virtual reality approach that segments complex behaviour into cognitive subcomponents, including encoding, visual search, working memory usage, and decision-making. Participants copied a model display by selecting objects from a resource pool and placing them into a workspace. By manipulating the distractibility of objects in the resource pool, we discovered interfering effects of distraction across the different cognitive subcomponents. We successfully traced the consequences of distraction all the way from overall task performance to the decision-making processes that gate memory usage. Distraction slowed down behaviour and increased costly body movements. Critically, distraction increased encoding demands, slowed visual search, and decreased reliance on working memory. Our findings illustrate that the effects of visual distraction during natural behaviour can be rather focal but nevertheless have cascading consequences.

An embarrassment of richnesses: the PFC isn't the content NCC

Recent years have seen the rise of several theories saying that the prefrontal cortex (PFC) is a neural correlate of visual consciousness (NCC). Especially popular here are theories saying that the PFC is the 'content NCC' for vision, i.e. it contains those brain areas that are not only necessary for consciousness, but also determine 'what' it is that we visually experience (e.g. whether we experience green or red). This article points out how this "upper-deck" form of PFC theory is at odds with the character of visual experience: on the one hand, visual consciousness appears to contain copious amounts of content, with many properties (such as object, shape, or color) being simultaneously represented in many parts of the visual field. On the other hand, the functions that the PFC carries out (e.g. attention and working memory) are each dedicated to processing only a relatively small subset of available visual stimuli. In short, the PFC probably does not produce enough or the right kind of visual representations for it to supply all of the content found in visual experience, in which case the idea that the PFC is the content NCC for vision is probably false. This article also discusses data thought to undercut the idea that visual experience is informationally rich (inattentional blindness, etc.), along with theories of vision according to which "ensemble statistics" are used to represent features in the periphery of the visual field. I'll argue that these lines of evidence fail to close the apparently vast gap between the amount of visual content represented in the visual experience and the amount represented in the PFC.

A dynamic neural resource model bridges sensory and working memory

Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or 'iconic' memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these time scales. Here, we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.

Divergent roles of early visual cortex and inferior frontal junction in visual working memory

BACKGROUND

Recent studies indicate that both prefrontal and visual regions play critical roles in visual working memory (VWM), with prefrontal regions mainly associated with executive functions, and visual cortices linked to representations of memory contents. VWM involves the selective filtering of irrelevant information, yet the specific contributions of the prefrontal regions and visual cortex in this process remain unclear.

OBJECTIVE

To understand the dynamic causal roles of prefrontal and visual regions in VWM.

METHODS

The differentiation of VWM components was achieved using a computational model that incorporated a swap rate for non-target stimuli. Single-pulse magnetic transcranial stimulation (spTMS) was delivered to the early visual cortex (EVC) and the inferior frontal junction (IFJ) across different phases of an orientation recall task that with or without distractors.

RESULTS

Our results indicate that spTMS over the EVC and IFJ influences VWM particularly when distractors are present. VWM precision can be impacted by spTMS applied to either region during the early retention, while spTMS effect is especially prominent when EVC is stimulated during the late retention phase and when directed at the ipsilateral EVC. Conversely, the probability of accurately recalling the target exhibited comparable patterns when spTMS was administered to either the EVC or IFJ.

CONCLUSIONS

We highlight the "sensory recruitment" of VWM characterized by critical involvement of EVC particularly in the information-filtering process within VWM. The maintenance of memory content representations necessitates ongoing communication between the EVC and IFJ throughout the entirety of the VWM process in a dynamic pattern.

Perceptual similarity judgments do not predict the distribution of errors in working memory

Population coding models provide a quantitative account of visual working memory (VWM) retrieval errors with a plausible link to the response characteristics of sensory neurons. Recent work has provided an important new perspective linking population coding to variables of signal detection, including d-prime, and put forward a new hypothesis: that the distribution of recall errors on, for example, a color wheel, is a consequence of the psychological similarity between points in that stimulus space, such that the exponential-like psychophysical distance scaling function can fulfil the role of population tuning and obviate the need to fit a tuning width parameter to recall data. Using four different visual feature spaces, we measured psychophysical similarity and memory errors in the same participants. Our results revealed strong evidence for a common source of variability affecting similarity judgments and recall estimates but did not support any consistent relationship between psychophysical similarity functions and VWM errors. At the group level, the responsiveness functions obtained from the psychophysical similarity task diverged strongly from those that provided the best fit to working memory errors. At the individual level, we found convincing evidence against an association between observed and best-fitting similarity functions. Finally, our results show that the newly proposed exponential-like responsiveness function has in general no advantage over the canonical von Mises (circular normal) function assumed by previous population coding models. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The Reactivation of working memory representations affects attentional guidance

Recent studies have suggested that the neural activity that supported working memory (WM) storage is dynamic over time and this dynamic storage decides memory performance. Does the temporal dynamic of the WM representation also affect visual search, and how does it interact with distractor suppression over time? To address these issues, we tracked the time course of the reactivation of WM representations during visual search by analyzing the electroencephalogram (EEG) and event-related optical signals (EROS) in Experiments 1 and 2, respectively, and investigated the interaction between the representation reactivation and distractor suppression in Experiment 3. Participants had to maintain a color in WM under high- or low-precision requirement and perform a subsequent search task. The reactivation of WM representations was defined by the above-chance decoding accuracy. The EEG results showed that compared with the low-precision requirement, WM-matching distractors captured more attention and the WM representation were reactivated more frequently under high-precision requirement. The EROS results showed that compared with the low-precision requirement, the increased activity in occipital cortex in the WM-matching versus WM-mismatching conditions was observed at 224 ms during visual search under high-precision requirement. Regression analysis showed that the representation reactivation during visual search directly predicted the behavioral WM-based attentional capture effect, while the representation reactivation before visual search impacted the WM-based attentional capture effect through the mediation of distractor suppression during visual search. These results suggest that the reactivation of WM representations and distractor suppression collectively determine WM-based attentional capture.

Electrophysiological hallmarks for event relations and event roles in working memory

The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.

Cell type-specific connectome predicts distributed working memory activity in the mouse brain

Recent advances in connectomics and neurophysiology make it possible to probe whole-brain mechanisms of cognition and behavior. We developed a large-scale model of the multiregional mouse brain for a cardinal cognitive function called working memory, the brain's ability to internally hold and process information without sensory input. The model is built on mesoscopic connectome data for interareal cortical connections and endowed with a macroscopic gradient of measured parvalbumin-expressing interneuron density. We found that working memory coding is distributed yet exhibits modularity; the spatial pattern of mnemonic representation is determined by long-range cell type-specific targeting and density of cell classes. Cell type-specific graph measures predict the activity patterns and a core subnetwork for memory maintenance. The model shows numerous attractor states, which are self-sustained internal states (each engaging a distinct subset of areas). This work provides a framework to interpret large-scale recordings of brain activity during cognition, while highlighting the need for cell type-specific connectomics.

A construct-first approach to consciousness science

We propose a new approach to consciousness science that instead of comparing complex theoretical positions deconstructs existing theories, takes their central assumptions while disregarding their auxiliary hypotheses, and focuses its investigations on the main constructs that these central assumptions rely on (like global workspace, recurrent processing, metarepresentation). Studying how these main constructs are anchored in lower-level constructs characterizing underlying neural processing will not just offer an alternative to theory comparisons but will also take us one step closer to empirical resolutions. Moreover, exploring the compatibility and possible combinations of the lower-level constructs will allow for new theoretical syntheses. This construct-first approach will improve our ability to understand the commitments of existing theories and pave the way for moving beyond them.

Fronto-parietal theta high-definition transcranial alternating current stimulation may modulate working memory under postural control conditions in young healthy adults

Objects

This study aimed to investigate the immediate effects of fronto-parietal θ HD-tACS on a dual task of working memory-postural control.

Methods

In this within-subject cross-over pilot study, we assessed the effects of 20 min of 6 Hz-tACS targeting both the left dorsolateral prefrontal cortex (lDLPFC) and posterior parietal cortex (PPC) in 20 healthy adults (age: 21.6 ± 1.3 years). During each session, single- and dual-task behavioral tests (working memory single-task, static tandem standing, and a dual-task of working memory-postural control) and closed-eye resting-state EEG were assessed before and immediately after stimulation.

Results

Within the tACS group, we found a 5.3% significant decrease in working memory response time under the dual-task following tACS (t = -3.157, p = 0.005, Cohen's d = 0.742); phase synchronization analysis revealed a significant increase in the phase locking value (PLV) of θ band between F3 and P3 after tACS (p = 0.010, Cohen's d = 0.637). Correlation analyses revealed a significant correlation between increased rs-EEG θ power in the F3 and P3 channels and faster reaction time (r = -0.515, p = 0.02; r = -0.483, p = 0.031, respectively) in the dual-task working memory task after tACS. However, no differences were observed on either upright postural control performance or rs-EEG results (p-values <0.05).

Conclusion

Fronto-parietal θ HD-tACS has the potential of being a neuromodulatory tool for improving working memory performance in dual-task situations, but its effect on the modulation of concurrently performed postural control tasks requires further investigation.

Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues

Attention can be deployed among external sensory stimuli or internal working memory (WM) representations, and recent primate studies have revealed that these external and internal selections share a common neural basis in the prefrontal cortex (PFC). However, it remains to be elucidated how PFC implements these selections, especially in humans. The present study aimed to further investigate whether PFC responded differentially to the peripheral and central retrospective cues (retro-cues) that induced attention selection among WM representations. To achieve this, we combined magnetoencephalography (MEG, Experiment 1) and transcranial magnetic stimulation (TMS, Experiment 2) with an orientation-recall paradigm. Experiment 1 found that a peripheral retro-cue with 100% reliability had a greater benefit on WM performance than a central retro-cue, while this advantage of peripheral over central cues vanished when the cue reliability dropped to 50% (non-informative). MEG source analysis indicated that the 100% peripheral retro-cue elicited earlier (∼125 ms) PFC responses than the central retro-cue (∼275 ms). Meanwhile, Granger causality analysis showed that PFC had earlier (0-200 ms) top-down signals projecting to the superior parietal lobule (SPL) and the lateral occipital cortex (LOC) after the onset of peripheral retro-cues, while these top-down signals appeared later (300-500 ms) after the onset of central retro-cues. Importantly, PFC activity within this period of 300-500 ms correlated with the peripheral advantage in behavior. Moreover, Experiment 2 applied TMS at different time points to test the causal influence of brain activity on behavior and found that stimulating PFC at 100 ms abolished the behavioral benefit of the peripheral retro-cue, as well as its advantage over the central retro-cue. Taken together, our results suggested that the advantage of peripheral over central retro-cues in the mnemonic domain is realized through faster top-down control from PFC, which challenged traditional opinions that the top-down control of attention on WM required at least 300 ms to appear. The present study highlighted that in addition to the causal role of PFC in attention selection of WM representations, timing was critical as well and faster was better.

Parietal-driven visual working memory representation in occipito-temporal cortex

Human fMRI studies have documented extensively that the content of visual working memory (VWM) can be reliably decoded from fMRI voxel response patterns during the delay period in both the occipito-temporal cortex (OTC), including early visual areas (EVC), and the posterior parietal cortex (PPC).1,2,3,4 Further work has revealed that VWM signal in OTC is largely sustained by feedback from associative areas such as prefrontal cortex (PFC) and PPC.4,5,6,7,8,9 It is unclear, however, if feedback during VWM simply restores sensory representations initially formed in OTC or if it can reshape the representational content of OTC during VWM delay. Taking advantage of a recent finding showing that object representational geometry differs between OTC and PPC in perception,10 here we find that, during VWM delay, the object representational geometry in OTC becomes more aligned with that of PPC during perception than with itself during perception. This finding supports the role of feedback in shaping the content of VWM in OTC, with the VWM content of OTC more determined by information retained in PPC than by the sensory information initially encoded in OTC.

Assessing the interaction between working memory and perception through time

Content maintained in visual working memory changes concurrent visual processing, suggesting that visual working memory may recruit an overlapping neural representation with visual perception. However, it remains unclear whether visual working memory representations persist as a sensory code through time, or are recoded later into an abstract code. Here, we directly contrasted a temporal decay + visual code account and a temporal decay + abstract code account within the temporal dynamics of the interaction between working memory and perception. By manipulating the ISI (inter-stimulus interval) between working memory encoding and a perceptual discrimination task, we found that task-relevant and therefore actively maintained perceptual information parametrically altered participants' ability to discriminate perceptual stimuli even 4 s after encoding, whereas task-irrelevant information caused only an acutely transient effect. While continuously present, the size of this shift in discrimination thresholds gradually decreased over time. Concomitantly, the size of the bias in working memory reports increased over time. The opposing directions of threshold and bias effects are consistent with the local maintenance of information in perceptual areas, explained by a temporal decay + visual code account. As the maintained representation decays over time, its ability to alter incoming perceptual signals decreases (reduced threshold effects) while its likelihood of being impacted by those same signals increases (increased bias effects). Altogether, these results suggest that the readout of working memory relies on a sensory representation at a cost of increased interference by ongoing perception.

Strategic control of location and ordinal context in visual working memory

Working memory (WM) requires encoding stimulus identity and context (e.g. where or when stimuli were encountered). To explore the neural bases of the strategic control of context binding in WM, we acquired fMRI while subjects performed delayed recognition of 3 orientation patches presented serially and at different locations. The recognition probe was an orientation patch with a superimposed digit, and pretrial instructions directed subjects to respond according to its location ("location-relevant"), to the ordinal position corresponding to its digit ("order-relevant"), or to just its orientation (relative to all three samples; "context-irrelevant"). Delay period signal in PPC was greater for context-relevant than for "context-irrelevant" trials, and multivariate decoding revealed strong sensitivity to context binding requirements (relevant vs. "irrelevant") and to context domain ("location-" vs. "order-relevant") in both occipital cortex and PPC. At recognition, multivariate inverted encoding modeling revealed markedly different patterns in these 2 regions, suggesting different context-processing functions. In occipital cortex, an active representation of the location of each of the 3 samples was reinstated regardless of the trial type. The pattern in PPC, by contrast, suggested a trial type-dependent filtering of sample information. These results indicate that PPC exerts strategic control over the representation of stimulus context in visual WM.

Dual-functional network regulation underlies the central executive system in working memory

The frontoparietal network (FPN) and cingulo-opercular network (CON) may exert top-down regulation corresponding to the central executive system (CES) in working memory (WM); however, contributions and regulatory mechanisms remain unclear. We examined network interaction mechanisms underpinning the CES by depicting CON- and FPN-mediated whole-brain information flow in WM. We used datasets from participants performing verbal and spatial working memory tasks, divided into encoding, maintenance, and probe stages. We used general linear models to obtain task-activated CON and FPN nodes to define regions of interest (ROI); an online meta-analysis defined alternative ROIs for validation. We calculated whole-brain functional connectivity (FC) maps seeded by CON and FPN nodes at each stage using beta sequence analysis. We used Granger causality analysis to obtain the connectivity maps and assess task-level information flow patterns. For verbal working memory, the CON functionally connected positively and negatively to task-dependent and task-independent networks, respectively, at all stages. FPN FC patterns were similar only in the encoding and maintenance stages. The CON elicited stronger task-level outputs. Main effects were: stable CON→FPN, CON→DMN, CON→visual areas, FPN→visual areas, and phonological areas→FPN. The CON and FPN both up-regulated task-dependent and down-regulated task-independent networks during encoding and probing. Task-level output was slightly stronger for the CON. CON→FPN, CON→DMN, visual areas→CON, and visual areas→FPN showed consistent effects. The CON and FPN might together underlie the CES's neural basis and achieve top-down regulation through information interaction with other large-scale functional networks, and the CON may be a higher-level regulatory core in WM.

Lifespan differences in visual short-term memory load-modulated functional connectivity

Working memory is critical to higher-order executive processes and declines throughout the adult lifespan. However, our understanding of the neural mechanisms underlying this decline is limited. Recent work suggests that functional connectivity between frontal control and posterior visual regions may be critical, but examinations of age differences therein have been limited to a small set of brain regions and extreme group designs (i.e., comparing young and older adults). In this study, we build on previous research by using a lifespan cohort and a whole-brain approach to investigate working memory load-modulated functional connectivity in relation to age and performance. The article reports on analysis of the Cambridge center for Ageing and Neuroscience (Cam-CAN) data. Participants from a population-based lifespan cohort (N = 101, age 23-86) performed a visual short-term memory task during functional magnetic resonance imaging. Visual short-term memory was measured with a delayed recall task for visual motion with three different loads. Whole-brain load-modulated functional connectivity was estimated using psychophysiological interactions in a hundred regions of interest, sorted into seven networks (Schaefer et al., 2018, Yeo et al., 2011). Results showed that load-modulated functional connectivity was strongest within the dorsal attention and visual networks during encoding and maintenance. With increasing age, load-modulated functional connectivity strength decreased throughout the cortex. Whole-brain analyses for the relation between connectivity and behavior were non-significant. Our results give additional support to the sensory recruitment model of working memory. We also demonstrate the widespread negative impact of age on the modulation of functional connectivity by working memory load. Older adults might already be close to ceiling in terms of their neural resources at the lowest load and therefore less able to further increase connectivity with increasing task demands.

Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance

The role of the sensory visual cortex during visual short-term memory (VSTM) remains controversial. This controversy is possibly due to methodological issues in previous attempts to investigate the effects of transcranial magnetic stimulation (TMS) on VSTM. The aim of this study was to use TMS, while covering previous methodological deficits. Sixty-four young adults were recruited to participate in two experiments (Experiment 1: n = 36; Experiment 2: n = 28) using a VSTM orientation change-detection task under TMS. Monocular vision was ensured using red-blue goggles combined with red-blue stimuli. Double-pulse TMS was delivered at different times (Experiment 1: 0, 200 or 1000 ms; Experiment 2: 200, 1000 ms) during a 2 s maintenance phase, on one side of the occipital hemisphere. In Experiment 2, a sham TMS condition was introduced. Decreased detection sensitivity (d') in the ipsilateral occipital hemisphere to visual hemifield, and in the real TMS (compared with sham TMS) condition indicated inhibitory TMS effects, and thus, a causal involvement of the sensory visual cortex during early (200 ms) and late (1000 ms) maintenance in VSTM. These findings are aligned with sensory recruitment, which proposes that both perceptual and memory processes rely upon the same neural substrates in the sensory visual cortex. The methods used in this study were preregistered and had received in-principle acceptance on 6 June 2022 (Stage 1 protocol can be found in: https://doi.org/10.17605/OSF.IO/EMPDT).

Spectrotemporal content of human auditory working memory represented in functional connectivity patterns

Recent research suggests that working memory (WM), the mental sketchpad underlying thinking and communication, is maintained by multiple regions throughout the brain. Whether parts of a stable WM representation could be distributed across these brain regions is, however, an open question. We addressed this question by examining the content-specificity of connectivity-pattern matrices between subparts of cortical regions-of-interest (ROI). These connectivity patterns were calculated from functional MRI obtained during a ripple-sound auditory WM task. Statistical significance was assessed by comparing the decoding results to a null distribution derived from a permutation test considering all comparable two- to four-ROI connectivity patterns. Maintained WM items could be decoded from connectivity patterns across ROIs in frontal, parietal, and superior temporal cortices. All functional connectivity patterns that were specific to maintained sound content extended from early auditory to frontoparietal cortices. Our results demonstrate that WM maintenance is supported by content-specific patterns of functional connectivity across different levels of cortical hierarchy.

Perceptual bias contextualized in visually ambiguous stimuli

The visual appearance of an object is a function of stimulus properties as well as perceptual biases imposed by the observer. The context-specific trade-off between both can be measured accurately in a perceptual judgment task, involving grouping by proximity in ambiguous dot lattices. Such grouping depends lawfully on a stimulus parameter of the dot lattices known as their aspect ratio (AR), whose effect is modulated by a perceptual bias representing the preference for a cardinal orientation. In two experiments, we investigated how preceding context can lead to bias modulation, either in a top-down fashion via visual working memory (VWM) or bottom-up via sensory priming. In Experiment 1, we embedded the perceptual judgment task in a change detection paradigm and studied how the factors of VWM load (complexity of the memory array) and content (congruency in orientation to the ensuing dot lattice) affect the prominence of perceptual bias. A robust vertical orientation bias was observed, which was increased by VWM load and modulated by congruent VWM content. In Experiment 2, dot lattices were preceded by oriented primes. Here, primes regardless of orientation elicited a vertical orientation bias in dot lattices compared to a neutral baseline. Taken together, the two experiments demonstrate that top-down context (VWM load and content) effectively controls orientation bias modulation, while bottom-up context (i.e., priming) merely acts as an undifferentiated trigger to perceptual bias. These findings characterize the temporal context sensitivity of Gestalt perception, shed light on the processes responsible for different perceptual outcomes of ambiguous stimuli, and identify some of the mechanisms controlling perceptual bias.

The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate-argument structure; (iv) logical operators; (v) inferential promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures - that is, LoTs - only prove more flexible and well-supported over time.

Opening Questions in Visual Working Memory

In this reflective piece on visual working memory, I depart from the laboriously honed skills of writing a review. Instead of integrating approaches, synthesizing evidence, and building a cohesive perspective, I scratch my head and share niggles and puzzlements. I expose where my scholarship and understanding are stumped by findings and standard views in the literature.

Decoding perceptual awareness across the brain with a no-report fMRI masking paradigm

Does perceptual awareness arise within the sensory regions of the brain or within higher-level regions (e.g., the frontal lobe)? To answer this question, researchers traditionally compare neural activity when observers report being aware versus being unaware of a stimulus. However, it is unclear whether the resulting activations are associated with the conscious perception of the stimulus or the post-perceptual processes associated with reporting that stimulus. To address this limitation, we used both report and no-report conditions in a visual masking paradigm while participants were scanned using functional MRI (fMRI). We found that the overall univariate response to visible stimuli in the frontal lobe was robust in the report condition but disappeared in the no-report condition. However, using multivariate patterns, we could still decode in both conditions whether a stimulus reached conscious awareness across the brain, including in the frontal lobe. These results help reconcile key discrepancies in the recent literature and provide a path forward for identifying the neural mechanisms associated with perceptual awareness.

From remembering to reconstruction: The transformative neural representation of episodic memory

Although memory has long been recognized as a generative process, neural research of memory in recent decades has been predominantly influenced by Tulving's "mental time traveling" perspective and focused on the reactivation and consolidation of encoded memory representations. With the development of multiple powerful analytical approaches to characterize the contents and formats of neural representations, recent studies are able to provide detailed examinations of the representations at various processing stages and have provided exciting new insights into the transformative nature of episodic memory. These studies have revealed the rapid, substantial, and continuous transformation of memory representation during the encoding, maintenance, consolidation, and retrieval of both single and multiple events, as well as event sequences. These transformations are characterized by the abstraction, integration, differentiation, and reorganization of memory representations, enabling the long-term retention and generalization of memory. These studies mark a significant shift in perspective from remembering to reconstruction, which might better reveal the nature of memory and its roles in supporting more effective learning, adaptive decision-making, and creative problem solving.

Context-specific abnormalities of the central executive network in first-episode psychosis: relationship with cognition

BACKGROUND

Cognitive impairments, which contribute to the profound functional deficits observed in psychotic disorders, have found to be associated with abnormalities in trial-level cognitive control. However, neural tasks operate within the context of sustained cognitive states, which can be assessed with 'background connectivity' following the removal of task effects. To date, little is known about the integrity of brain processes supporting the maintenance of a cognitive state in individuals with psychotic disorders. Thus, here we examine background connectivity during executive processing in a cohort of participants with first-episode psychosis (FEP).

METHODS

The following fMRI study examined background connectivity of the dorsolateral prefrontal cortex (DLPFC), during working memory engagement in a group of 43 patients with FEP, relative to 35 healthy controls (HC). Findings were also examined in relation to measures of executive function.

RESULTS

The FEP group relative to HC showed significantly lower background DLPFC connectivity with bilateral superior parietal lobule (SPL) and left inferior parietal lobule. Background connectivity between DLPFC and SPL was also positively associated with overall cognition across all subjects and in our FEP group. In comparison, resting-state frontoparietal connectivity did not differ between groups and was not significantly associated with overall cognition, suggesting that psychosis-related alterations in executive networks only emerged during states of goal-oriented behavior.

CONCLUSIONS

These results provide novel evidence indicating while frontoparietal connectivity at rest appears intact in psychosis, when engaged during a cognitive state, it is impaired possibly undermining cognitive control capacities in FEP.

Phonological Working Memory Representations in the Left Inferior Parietal Lobe in the Face of Distraction and Neural Stimulation

The neural basis of phonological working memory (WM) was investigated through an examination of the effects of irrelevant speech distractors and disruptive neural stimulation from transcranial magnetic stimulation (TMS). Embedded processes models argue that the same regions involved in speech perception are used to support phonological WM whereas buffer models assume that a region separate from speech perception regions is used to support WM. Thus, according to the embedded processes approach but not the buffer approach, irrelevant speech and TMS to the speech perception region should disrupt the decoding of phonological WM representations. According to the buffer account, decoding of WM items should be possible in the buffer region despite distraction and should be disrupted with TMS to this region. Experiment 1 used fMRI and representational similarity analyses (RSA) with a delayed recognition memory paradigm using nonword stimuli. Results showed that decoding of memory items in the speech perception regions (superior temporal gyrus, STG) was possible in the absence of distractors. However, the decoding evidence in the left STG was susceptible to interference from distractors presented during the delay period whereas decoding in the proposed buffer region (supramarginal gyrus, SMG) persisted. Experiment 2 examined the causal roles of the speech processing region and the buffer region in phonological WM performance using TMS. TMS to the SMG during the early delay period caused a disruption in recognition performance for the memory nonwords, whereas stimulations at the STG and an occipital control region did not affect WM performance. Taken together, results from the two experiments are consistent with predictions of a buffer model of phonological WM, pointing to a critical role of the left SMG in maintaining phonological representations.

Flexible recoding of visual input for memory storage

Working memory enables us to maintain relevant past information for future behavior. In this issue of Neuron, Kwak and Curtis (2022) demonstrate that early visual areas do not simply maintain but flexibly recode sensory percepts into mnemonic codes containing goal-relevant information.