Serial representation of items during working memory maintenance at letter-selective cortical sites

Beyond Routine Maintenance: Current Trends in Working Memory Research

Working memory (WM) is an evolving concept. Our understanding of the neural functions that support WM develops iteratively alongside the approaches used to study it, and both can be profoundly shaped by available tools and prevailing theoretical paradigms. Here, the organizers of the 2024 Working Memory Symposium-inspired by this year's meeting-highlight current trends and looming questions in WM research. This review is organized into sections describing (1) ongoing efforts to characterize WM function across sensory modalities, (2) the growing appreciation that WM representations are malleable to context and future actions, (3) the enduring problem of how multiple WM items and features are structured and integrated, and (4) new insights about whether WM shares function with other cognitive processes that have conventionally been considered distinct. This review aims to chronicle where the field is headed and calls attention to issues that are paramount for future research.

Processes and measurements: a framework for understanding neural oscillations in field potentials

Various neuroscientific theories maintain that brain oscillations are important for neuronal computation, but opposing views claim that these macroscale dynamics are 'exhaust fumes' of more relevant processes. Here, we approach the question of whether oscillations are functional or epiphenomenal by distinguishing between measurements and processes, and by reviewing whether causal or inferentially useful links exist between field potentials, electric fields, and neurobiological events. We introduce a vocabulary for the role of brain signals and their underlying processes, demarcating oscillations as a distinct entity where both processes and measurements can exhibit periodicity. Leveraging this distinction, we suggest that electric fields, oscillating or not, are causally and computationally relevant, and that field potential signals can carry information even without causality.

Phase of firing does not reflect temporal order in sequence memory of humans and recurrent neural networks

The temporal order of a sequence of events has been thought to be reflected in the ordered firing of neurons at different phases of theta oscillations. Here we assess this by measuring single neuron activity (1,420 neurons) and local field potentials (921 channels) in the medial temporal lobe of 16 patients with epilepsy performing a working-memory task for temporal order. During memory maintenance, we observe theta oscillations, preferential firing of single neurons to theta phase and a close relationship between phase of firing and item position. However, the firing order did not match item order. Training recurrent neural networks to perform an analogous task, we also show the generation of theta oscillations, theta phase-dependent firing related to item position and, again, no match between firing and item order. Rather, our results suggest a mechanistic link between phase order, stimulus timing and oscillation frequency. In both biological and artificial neural networks, we provide evidence supporting the role of phase of firing in working-memory processing.

A domain-general process for theta-rhythmic sampling of either environmental information or internally stored information

Many everyday tasks, such as shopping for groceries, require the sampling of both environmental information and internally stored information. Selective attention involves the preferential processing and sampling of behaviorally important information from the external environment, while working memory involves the preferential processing and sampling of behaviorally important, internally stored information. These essential cognitive processes share neural resources within a large-scale network that includes frontal, parietal, and sensory cortices, and these shared neural resources can lead to between-domain interactions. Previous research has linked external sampling during selective attention and internal sampling during working memory to theta-rhythmic (3-8 Hz) neural activity in higher-order (e.g., frontal cortices) and sensory regions (e.g., visual cortices). Such theta-rhythmic neural activity might help to resolve the competition for shared neural resources by isolating neural activity associated with different functions over time. Here, we used EEG and a dual-task design (i.e., a task that required both external and internal sampling) to directly compare (i) theta-dependent fluctuations in behavioral performance during external sampling with (ii) theta-dependent fluctuations in behavioral performance during internal sampling. Our findings are consistent with a domain-general, theta-rhythmic process for sampling either external information or internal information. We further demonstrate that interactions between external and internal information-specifically, when to-be-detected information matches to-be-remembered information-are not dependent on theta-band activity (i.e., theta phase). Given that these theta-independent 'match effects' occur during early processing stages (peaking at 75 ms), we propose that theta-rhythmic sampling modulates external and internal information during later processing stages.

Local and interareal alpha and low-beta band oscillation dynamics underlie the bilateral field advantage in visual working memory

Visual working memory has a limited maximum capacity, which can be larger if stimuli are presented bilaterally vs. unilaterally. However, the neuronal mechanisms underlying this bilateral field advantage are not known. Visual working memory capacity is predicted by oscillatory delay-period activity, specifically, by a decrease in alpha (8 to 12 Hz) band amplitudes in posterior brain regions reflecting attentional deployment and related shifts in excitation, as well as a concurrent increase of prefrontal oscillation amplitudes and interareal synchronization in multiple frequencies reflecting active maintenance of information. Here, we asked whether posterior alpha suppression or prefrontal oscillation enhancement explains the bilateral field advantage. We recorded brain activity with high-density electroencephalography, while subjects (n = 26, 14 males) performed a visual working memory task with uni- and bilateral visual stimuli. The bilateral field advantage was associated with early suppression of low-alpha (6 to 10 Hz) and alpha-beta (10 to 17 Hz) band amplitudes, and a subsequent alpha-beta amplitude increase, which, along with a concurrent load-dependent interareal synchronization in the high-alpha band (10 to 15 Hz), correlated with hit rates and reaction times and thus predicted higher maximum capacities in bilateral than unilateral visual working memory. These results demonstrate that the electrophysiological basis of the bilateral field advantage in visual working memory is both in the changes in attentional deployment and enhanced interareal integration.

Visual Processing by Hierarchical and Dynamic Multiplexing

The complexity of natural environments requires highly flexible mechanisms for adaptive processing of single and multiple stimuli. Neuronal oscillations could be an ideal candidate for implementing such flexibility in neural systems. Here, we present a framework for structuring attention-guided processing of complex visual scenes in humans, based on multiplexing and phase coding schemes. Importantly, we suggest that the dynamic fluctuations of excitability vary rapidly in terms of magnitude, frequency and wave-form over time, i.e., they are not necessarily sinusoidal or sustained oscillations. Different elements of single objects would be processed within a single cycle (burst) of alpha activity (7-14 Hz), allowing for the formation of coherent object representations while separating multiple objects across multiple cycles. Each element of an object would be processed separately in time-expressed as different gamma band bursts (>30 Hz)-along the alpha phase. Since the processing capacity per alpha cycle is limited, an inverse relationship between object resolution and size of attentional spotlight ensures independence of the proposed mechanism from absolute object complexity. Frequency and wave-shape of those fluctuations would depend on the nature of the object that is processed and on cognitive demands. Multiple objects would further be organized along the phase of slower fluctuations (e.g., theta), potentially driven by saccades. Complex scene processing, involving covert attention and eye movements, would therefore be associated with multiple frequency changes in the alpha and lower frequency range. This framework embraces the idea of a hierarchical organization of visual processing, independent of environmental temporal dynamics.

Improving working memory by electrical stimulation and cross-frequency coupling

Working memory (WM) is essential for the temporary storage and processing of information required for complex cognitive tasks and relies on neuronal theta and gamma oscillations. Given the limited capacity of WM, researchers have investigated various methods to improve it, including transcranial alternating current stimulation (tACS), which modulates brain activity at specific frequencies. One particularly promising approach is theta-gamma peak-coupled-tACS (TGCp-tACS), which simulates the natural interaction between theta and gamma oscillations that occurs during cognitive control in the brain. The aim of this study was to improve WM in healthy young adults with TGCp-tACS, focusing on both behavioral and neurophysiological outcomes. Thirty-one participants completed five WM tasks under both sham and verum stimulation conditions. Electroencephalography (EEG) recordings before and after stimulation showed that TGCp-tACS increased power spectral density (PSD) in the high-gamma region at the stimulation site, while PSD decreased in the theta and delta regions throughout the cortex. From a behavioral perspective, although no significant changes were observed in most tasks, there was a significant improvement in accuracy in the 14-item Sternberg task, indicating an improvement in phonological WM. In conclusion, TGCp-tACS has the potential to promote and improve the phonological component of WM. To fully realize the cognitive benefits, further research is needed to refine the stimulation parameters and account for individual differences, such as baseline cognitive status and hormonal factors.

Working memory enhancement using real-time phase-tuned transcranial alternating current stimulation

BACKGROUND

Prior work has shown that transcranial alternating current stimulation (tACS) of parietooccipital alpha oscillations (8-14 Hz) can modulate working memory (WM) performance as a function of the phase lag to endogenous oscillations. However, leveraging this effect using real-time phase-tuned tACS has not been feasible so far due to stimulation artifacts preventing continuous phase tracking.

OBJECTIVES AND HYPOTHESIS

We aimed to develop a system that tracks and adapts the phase lag between tACS and ongoing parietooccipital alpha oscillations in real-time. We hypothesized that such real-time phase-tuned tACS enhances working memory performance, depending on the phase lag.

METHODS

We developed real-time phase-tuned closed-loop amplitude-modulated tACS (CLAM-tACS) targeting parietooccipital alpha oscillations. CLAM-tACS was applied at six different phase lags relative to ongoing alpha oscillations while participants (N = 21) performed a working memory task. To exclude that behavioral effects of CLAM-tACS were mediated by other factors such as sensory co-stimulation, a second group of participants (N = 25) received equivalent stimulation of the forehead.

RESULTS

WM accuracy improved in a phase lag dependent manner (p = 0.0350) in the group receiving parietooccipital stimulation, with the strongest enhancement observed at 330° phase lag between tACS and ongoing alpha oscillations (p = 0.00273, d = 0.976). Moreover, across participants, modulation of frontoparietal alpha oscillations correlated both in amplitude (p = 0.0248) and phase (p = 0.0270) with the modulation of WM accuracy. No such effects were observed in the control group receiving frontal stimulation.

CONCLUSIONS

Our results demonstrate the feasibility and efficacy of real-time phase-tuned CLAM-tACS in modulating both brain activity and behavior, thereby paving the way for further investigation into brain-behavior relationships and the exploration of innovative therapeutic applications.

Distinct Hippocampal Oscillation Dynamics in Trace Eyeblink Conditioning Task for Retrieval and Consolidation of Associations

Trace eyeblink conditioning (TEBC) has been widely used to study associative learning in both animals and humans. In this paradigm, conditioned responses (CRs) to conditioned stimuli (CS) serve as a measure for retrieving learned associations between the CS and the unconditioned stimuli (US) within a trial. Memory consolidation, that is, learning over time, can be quantified as an increase in the proportion of CRs across training sessions. However, how hippocampal oscillations differentiate between successful memory retrieval within a session and consolidation across TEBC training sessions remains unknown. To address this question, we recorded local field potentials (LFPs) from the rat dorsal hippocampus during TEBC and investigated hippocampal oscillation dynamics associated with these two functions. We show that transient broadband responses to the CS were correlated with memory consolidation, as indexed by an increase in CRs across TEBC sessions. In contrast, induced alpha (8-10 Hz) and beta (16-20 Hz) band responses were correlated with the successful retrieval of the CS-US association within a session, as indexed by the difference in trials with and without CR.

Online and offline effects of parietal 10 Hz repetitive transcranial magnetic stimulation on working memory in healthy controls

Parietal alpha activity shows a specific pattern of phasic changes during working memory. It decreases during the encoding and recall phases but increases during the maintenance phase. This study tested whether online rTMS delivered to the parietal cortex during the maintenance phase of a working memory task would increase alpha activity and hence improve working memory. Then, 46 healthy volunteers were randomly assigned to two groups to receive 3-day parietal 10 Hz online rTMS (either real or sham, 3600 pulses in total) that were time-locked to the maintenance phase of a spatial span task (180 trials in total). Behavioral performance on another spatial span task and EEG signals during a change detection task were recorded on the day before the first rTMS (pretest) and the day after the last rTMS (posttest). We found that rTMS improved performance on both online and offline spatial span tasks. For the offline change detection task, rTMS enhanced alpha activity within the maintenance phase and improved interference control of working memory at both behavioral (K score) and neural (contralateral delay activity) levels. These results suggested that rTMS with alpha frequency time-locked to the maintenance phase is a promising way to boost working memory.

Cross-frequency coupling in cortico-hippocampal networks supports the maintenance of sequential auditory information in short-term memory

It has been suggested that cross-frequency coupling in cortico-hippocampal networks enables the maintenance of multiple visuo-spatial items in working memory. However, whether this mechanism acts as a global neural code for memory retention across sensory modalities remains to be demonstrated. Intracranial EEG data were recorded while drug-resistant patients with epilepsy performed a delayed matched-to-sample task with tone sequences. We manipulated task difficulty by varying the memory load and the duration of the silent retention period between the to-be-compared sequences. We show that the strength of theta-gamma phase amplitude coupling in the superior temporal sulcus, the inferior frontal gyrus, the inferior temporal gyrus, and the hippocampus (i) supports the short-term retention of auditory sequences; (ii) decodes correct and incorrect memory trials as revealed by machine learning analysis; and (iii) is positively correlated with individual short-term memory performance. Specifically, we show that successful task performance is associated with consistent phase coupling in these regions across participants, with gamma bursts restricted to specific theta phase ranges corresponding to higher levels of neural excitability. These findings highlight the role of cortico-hippocampal activity in auditory short-term memory and expand our knowledge about the role of cross-frequency coupling as a global biological mechanism for information processing, integration, and memory in the human brain.

The theta-gamma code in predictive processing and mnemonic updating

Predictive processing has become a leading theory about how the brain works. Yet, it remains an open question how predictive processes are realized in the brain. Here I discuss theta-gamma coupling as one potential neural mechanism for prediction and model updating. Building on Lisman and colleagues SOCRATIC model, theta-gamma coupling has been associated with phase precession and learning phenomena in medio-temporal lobe of rodents, where it completes and retains a sequence of places or items (i.e., predictive models). These sequences may be updated upon prediction errors (i.e., model updating), signaled by dopaminergic inputs from prefrontal networks. This framework, spanning the molecular to the network level, matches excitingly well with recent findings on predictive processing, mnemonic updating, and perceptual foraging for the theta-gamma code in human cognition. In sum, I use the case of theta-gamma coupling to link the predictive processing account, a very general concept of how the brain works, to specific neural processes which may implement predictive processing and model updating at the cognitive, network, cellular and molecular level.

Harmonic memory signals in the human cerebral cortex induced by semantic relatedness of words

When we memorize multiple words simultaneously, semantic relatedness among those words assists memory. For example, the information about "apple", "banana," and "orange" will be connected via a common concept of "fruits" and become easy to retain and recall. Neural mechanisms underlying this semantic integration in verbal working memory remain unclear. Here I used electroencephalography (EEG) and investigated neural signals when healthy human participants memorized five nouns semantically related (Sem trial) or not (NonSem trial). The regularity of oscillatory signals (8-30 Hz) during the retention period was found to be lower in NonSem than Sem trials, indicating that memorizing words unrelated to each other induced a non-harmonic (irregular) waveform in the temporal cortex. These results suggest that (i) semantic features of a word are retained as a set of neural oscillations at specific frequencies and (ii) memorizing words sharing a common semantic feature produces harmonic brain responses through a resonance or integration (sharing) of the oscillatory signals.

Hippocampal-cortical interactions during event boundaries support retention of complex narrative events

According to most memory theories, encoding involves continuous communication between the hippocampus and neocortex, but recent work has shown that key moments at the end of an event, called event boundaries, may be especially critical for memory formation. We sought to determine how communication between the hippocampus and neocortical regions during the encoding of naturalistic events related to subsequent retrieval of those events and whether this was particularly important at event boundaries. Participants encoded and recalled two cartoon movies during fMRI scanning. Higher functional connectivity between the hippocampus and the posterior medial network (PMN) at an event's offset is related to the subsequent successful recall of that event. Furthermore, hippocampal-PMN offset connectivity also predicted the amount of detail retrieved after a 2-day delay. These data demonstrate that the relationship between memory encoding and hippocampal-neocortical interaction is dynamic and biased toward boundaries.

Behavioral fluctuation reflecting theta-rhythmic activation of sequential working memory

Sequential working memory, the ability to actively maintain sequential information, is essential for human cognition. The neural representation of each item in sequential working memory is thought to be activated rhythmically within the theta (3-7 Hz) range of human electrophysiology. In the current study, we predicted that if neural representations of sequential working memory items were truly activated rhythmically, periodic fluctuations in behavior would be evident. That is, the ease and speed of recalling each memory item would oscillate depending on the interval between memory encoding and recall, affected by the rhythmic neural representation. We conducted detailed analyses of reaction times for retrieving sequential and non-sequential information in eight experiments (total n = 125). The results revealed that reaction times for recalling sequential information showed fluctuation in the theta range as a function of the interval between memory encoding and recall, which was significantly stronger than that observed when the task did not require participants to remember the sequential order. Taken together, the current findings revealed that participants' behavior exhibited theta-rhythmic fluctuation when recalling sequential information in a relatively large sample, supporting theta phase-dependent coding of sequential working memory.

Neurophysiological mechanisms of cognition in the developing brain: Insights from intracranial EEG studies

The quest to understand how the development of the brain supports the development of complex cognitive functions is fueled by advances in cognitive neuroscience methods. Intracranial EEG (iEEG) recorded directly from the developing human brain provides unprecedented spatial and temporal resolution for mapping the neurophysiological mechanisms supporting cognitive development. In this paper, we focus on episodic memory, the ability to remember detailed information about past experiences, which improves from childhood into adulthood. We review memory effects based on broadband spectral power and emphasize the importance of isolating narrowband oscillations from broadband activity to determine mechanisms of neural coordination within and between brain regions. We then review evidence of developmental variability in neural oscillations and present emerging evidence linking the development of neural oscillations to the development of memory. We conclude by proposing that the development of oscillations increases the precision of neural coordination and may be an essential factor underlying memory development. More broadly, we demonstrate how recording neural activity directly from the developing brain holds immense potential to advance our understanding of cognitive development.

"Leader-Follower" Dynamic Perturbation Manipulates Multi-Item Working Memory in Humans

Manipulating working memory (WM) is a central yet challenging notion. Previous studies suggest that WM items with varied memory strengths reactivate at different latencies, supporting a time-based mechanism. Motivated by this view, here we developed a purely bottom-up "Leader-Follower" behavioral approach to manipulate WM in humans. Specifically, task-irrelevant flickering color disks that are bound to each of the memorized items are presented during the delay period, and the ongoing luminance sequences of the color disks follow a Leader-Follower relationship, that is, a hundreds of milliseconds temporal lag. We show that this dynamic behavioral approach leads to better memory performance for the item associated with the temporally advanced luminance sequence (Leader) than the item with the temporally lagged luminance sequence (Follower), yet with limited effectiveness. Together, our findings constitute evidence for the essential role of temporal dynamics in WM operation and offer a promising, noninvasive WM manipulation approach.

Differential working memory function between phonological and visuospatial strategies: a magnetoencephalography study using a same visual task

Previous studies have reported that, in working memory, the processing of visuospatial information and phonological information have different neural bases. However, in these studies, memory items were presented via different modalities. Therefore, the modality in which the memory items were presented and the strategy for memorizing them were not rigorously distinguished. In the present study, we explored the neural basis of two working memory strategies. Nineteen right-handed young adults memorized seven sequential directions presented visually in a task in which the memory strategy was either visuospatial or phonological (visuospatial/phonological condition). Source amplitudes of theta-band (5-7 Hz) rhythm were estimated from magnetoencephalography during the maintenance period and further analyzed using cluster-based permutation tests. Behavioral results revealed that the accuracy rates showed no significant differences between conditions, while the reaction time in the phonological condition was significantly longer than that in the visuospatial condition. Theta activity in the phonological condition was significantly greater than that in the visuospatial condition, and the cluster in spatio-temporal matrix with p < 5% difference extended to right prefrontal regions in the early maintenance period and right occipito-parietal regions in the late maintenance period. The theta activity results did not indicate strategy-specific neural bases but did reveal the dynamics of executive function required for phonological processing. The functions seemed to move from attention control and inhibition control in the prefrontal region to inhibition of irrelevant information in the occipito-parietal region.

Fields or firings? Comparing the spike code and the electromagnetic field hypothesis

Where is consciousness? Neurobiological theories of consciousness look primarily to synaptic firing and "spike codes" as the physical substrate of consciousness, although the specific mechanisms of consciousness remain unknown. Synaptic firing results from electrochemical processes in neuron axons and dendrites. All neurons also produce electromagnetic (EM) fields due to various mechanisms, including the electric potential created by transmembrane ion flows, known as "local field potentials," but there are also more meso-scale and macro-scale EM fields present in the brain. The functional role of these EM fields has long been a source of debate. We suggest that these fields, in both their local and global forms, may be the primary seat of consciousness, working as a gestalt with synaptic firing and other aspects of neuroanatomy to produce the marvelous complexity of minds. We call this assertion the "electromagnetic field hypothesis." The neuroanatomy of the brain produces the local and global EM fields but these fields are not identical with the anatomy of the brain. These fields are produced by, but not identical with, the brain, in the same manner that twigs and leaves are produced by a tree's branches and trunk but are not the same as the branches and trunk. As such, the EM fields represent the more granular, both spatially and temporally, aspects of the brain's structure and functioning than the neuroanatomy of the brain. The brain's various EM fields seem to be more sensitive to small changes than the neuroanatomy of the brain. We discuss issues with the spike code approach as well as the various lines of evidence supporting our argument that the brain's EM fields may be the primary seat of consciousness. This evidence (which occupies most of the paper) suggests that oscillating neural EM fields may make firing in neural circuits oscillate, and these oscillating circuits may help unify and guide conscious cognition.

Rhythmic temporal coordination of neural activity prevents representational conflict during working memory

Selective attention¹ is characterized by alternating states associated with either attentional sampling or attentional shifting, helping to prevent functional conflicts by isolating function-specific neural activity in time.^2,3,4,5 We hypothesized that such rhythmic temporal coordination might also help to prevent representational conflicts during working memory.⁶ Multiple items can be simultaneously held in working memory, and these items can be represented by overlapping neural populations.^7,8,9 Traditional theories propose that the short-term storage of to-be-remembered items occurs through persistent neural activity,^10,11,12 but when neurons are simultaneously representing multiple items, persistent activity creates a potential for representational conflicts. In comparison, more recent, "activity-silent" theories of working memory propose that synaptic changes also contribute to short-term storage of to-be-remembered items.^13,14,15,16 Transient bursts in neural activity,¹⁷ rather than persistent activity, could serve to occasionally refresh these synaptic changes. Here, we used EEG and response times to test whether rhythmic temporal coordination helps to isolate neural activity associated with different to-be-remembered items, thereby helping to prevent representational conflicts. Consistent with this hypothesis, we report that the relative strength of different item representations alternates over time as a function of the frequency-specific phase. Although RTs were linked to theta (∼6 Hz) and beta (∼25 Hz) phases during a memory delay, the relative strength of item representations only alternated as a function of the beta phase. The present findings (1) are consistent with rhythmic temporal coordination being a general mechanism for preventing functional or representational conflicts during cognitive processes and (2) inform models describing the role of oscillatory dynamics in organizing working memory.^{13,18,19,20,21}.

Gamma amplitude is coupled to opposed hippocampal theta-phase states during the encoding and retrieval of episodic memories in humans

Computational models and in vivo studies in rodents suggest that the emergence of gamma activity (40-140 Hz) during memory encoding and retrieval is coupled to opposed-phase states of the underlying hippocampal theta rhythm (4-9 Hz).^{1,2,3,4,5,6,7,8,9,10} However, direct evidence for whether human hippocampal gamma-modulated oscillatory activity in memory processes is coupled to opposed-phase states of the ongoing theta rhythm remains elusive. Here, we recorded local field potentials (LFPs) directly from the hippocampus of 10 patients with epilepsy, using depth electrodes. We used a memory encoding and retrieval task whereby trial unique sequences of pictures depicting real-life episodes were presented, and 24 h later, participants were asked to recall them upon the appearance of the first picture of the encoded episodic sequence. We found theta-to-gamma cross-frequency coupling that was specific to the hippocampus during both the encoding and retrieval of episodic memories. We also revealed that gamma was coupled to opposing theta phases during both encoding and recall processes. Additionally, we observed that the degree of theta-gamma phase opposition between encoding and recall was associated with participants' memory performance, so gamma power was modulated by theta phase for both remembered and forgotten trials, although only for remembered trials the dominant theta phase was different for encoding and recall trials. The current results offer direct empirical evidence in support of hippocampal theta-gamma phase opposition models in human long-term memory and provide fundamental insights into mechanistic predictions derived from computational and animal work, thereby contributing to establishing similarities and differences across species.

Rhythmic attentional scanning

Sensory processing, short-term memory, and decision-making often deal with multiple items, or options, simultaneously. I review evidence suggesting that the brain handles such multiple items by "rhythmic attentional scanning (RAS)": each item is processed in a separate cycle of the theta rhythm, involving several gamma cycles, to reach an internally consistent representation in the form of a gamma-synchronized neuronal group. Within each theta cycle, items that are extended in representational space are scanned by traveling waves. Such scanning might go across small numbers of simple items linked into a chunk.

Attention in flux

Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.

ROSE: A Neurocomputational Architecture for Syntax

A comprehensive model of natural language processing in the brain must accommodate four components: representations, operations, structures and encoding. It further requires a principled account of how these different components mechanistically, and causally, relate to each another. While previous models have isolated regions of interest for structure-building and lexical access, and have utilized specific neural recording measures to expose possible signatures of syntax, many gaps remain with respect to bridging distinct scales of analysis that map onto these four components. By expanding existing accounts of how neural oscillations can index various linguistic processes, this article proposes a neurocomputational architecture for syntax, termed the ROSE model (Representation, Operation, Structure, Encoding). Under ROSE, the basic data structures of syntax are atomic features, types of mental representations (R), and are coded at the single-unit and ensemble level. Elementary computations (O) that transform these units into manipulable objects accessible to subsequent structure-building levels are coded via high frequency broadband γ activity. Low frequency synchronization and cross-frequency coupling code for recursive categorial inferences (S). Distinct forms of low frequency coupling and phase-amplitude coupling (δ-θ coupling via pSTS-IFG; θ-γ coupling via IFG to conceptual hubs in lateral and ventral temporal cortex) then encode these structures onto distinct workspaces (E). Causally connecting R to O is spike-phase/LFP coupling; connecting O to S is phase-amplitude coupling; connecting S to E is a system of frontotemporal traveling oscillations; connecting E back to lower levels is low-frequency phase resetting of spike-LFP coupling. This compositional neural code has important implications for algorithmic accounts, since it makes concrete predictions for the appropriate level of study for psycholinguistic parsing models. ROSE is reliant on neurophysiologically plausible mechanisms, is supported at all four levels by a range of recent empirical research, and provides an anatomically precise and falsifiable grounding for the basic property of natural language syntax: hierarchical, recursive structure-building.

Phase separation of competing memories along the human hippocampal theta rhythm

Competition between overlapping memories is considered one of the major causes of forgetting, and it is still unknown how the human brain resolves such mnemonic conflict. In the present magnetoencephalography (MEG) study, we empirically tested a computational model that leverages an oscillating inhibition algorithm to minimise overlap between memories. We used a proactive interference task, where a reminder word could be associated with either a single image (non-competitive condition) or two competing images, and participants were asked to always recall the most recently learned word-image association. Time-resolved pattern classifiers were trained to detect the reactivated content of target and competitor memories from MEG sensor patterns, and the timing of these neural reactivations was analysed relative to the phase of the dominant hippocampal 3 Hz theta oscillation. In line with our pre-registered hypotheses, target and competitor reactivations locked to different phases of the hippocampal theta rhythm after several repeated recalls. Participants who behaviourally experienced lower levels of interference also showed larger phase separation between the two overlapping memories. The findings provide evidence that the temporal segregation of memories, orchestrated by slow oscillations, plays a functional role in resolving mnemonic competition by separating and prioritising relevant memories under conditions of high interference.

Rhythms of human attention and memory: An embedded process perspective

It remains a dogma in cognitive neuroscience to separate human attention and memory into distinct modules and processes. Here we propose that brain rhythms reflect the embedded nature of these processes in the human brain, as evident from their shared neural signatures: gamma oscillations (30-90 Hz) reflect sensory information processing and activated neural representations (memory items). The theta rhythm (3-8 Hz) is a pacemaker of explicit control processes (central executive), structuring neural information processing, bit by bit, as reflected in the theta-gamma code. By representing memory items in a sequential and time-compressed manner the theta-gamma code is hypothesized to solve key problems of neural computation: (1) attentional sampling (integrating and segregating information processing), (2) mnemonic updating (implementing Hebbian learning), and (3) predictive coding (advancing information processing ahead of the real time to guide behavior). In this framework, reduced alpha oscillations (8-14 Hz) reflect activated semantic networks, involved in both explicit and implicit mnemonic processes. Linking recent theoretical accounts and empirical insights on neural rhythms to the embedded-process model advances our understanding of the integrated nature of attention and memory - as the bedrock of human cognition.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

Is Cortical Theta-Gamma Phase-Amplitude Coupling Memory-Specific?

One of the proposed neural mechanisms involved in working memory is coupling between the theta phase and gamma amplitude. For example, evidence from intracranial recordings shows that coupling between hippocampal theta and cortical gamma oscillations increases selectively during working memory tasks. Theta-gamma phase-amplitude coupling can also be measured non-invasively through scalp EEG; however, EEG can only assess coupling within cortical areas, and it is not yet clear if this cortical-only coupling is truly memory-specific, or a more general phenomenon. We tested this directly by measuring cortical coupling during three different conditions: a working memory task, an attention task, and a passive perception condition. We find similar levels of theta-gamma coupling in all three conditions, suggesting that cortical theta-gamma phase-amplitude coupling is not a memory-specific signal, but instead reflects some other attentional or perceptual processes. Implications for understanding the brain dynamics of visual working memory are discussed.

Fluid Intelligence Emerges from Representing Relations

Based on recent findings in cognitive neuroscience and psychology as well as computational models of working memory and reasoning, I argue that fluid intelligence (fluid reasoning) can amount to representing in the mind the key relation(s) for the task at hand. Effective representation of relations allows for enormous flexibility of thinking but depends on the validity and robustness of the dynamic patterns of argument-object (role-filler) bindings, which encode relations in the brain. Such a reconceptualization of the fluid intelligence construct allows for the simplification and purification of its models, tests, and potential brain mechanisms.

A model of working memory for encoding multiple items and ordered sequences exploiting the theta-gamma code

Recent experimental evidence suggests that oscillatory activity plays a pivotal role in the maintenance of information in working memory, both in rodents and humans. In particular, cross-frequency coupling between theta and gamma oscillations has been suggested as a core mechanism for multi-item memory. The aim of this work is to present an original neural network model, based on oscillating neural masses, to investigate mechanisms at the basis of working memory in different conditions. We show that this model, with different synapse values, can be used to address different problems, such as the reconstruction of an item from partial information, the maintenance of multiple items simultaneously in memory, without any sequential order, and the reconstruction of an ordered sequence starting from an initial cue. The model consists of four interconnected layers; synapses are trained using Hebbian and anti-Hebbian mechanisms, in order to synchronize features in the same items, and desynchronize features in different items. Simulations show that the trained network is able to desynchronize up to nine items without a fixed order using the gamma rhythm. Moreover, the network can replicate a sequence of items using a gamma rhythm nested inside a theta rhythm. The reduction in some parameters, mainly concerning the strength of GABAergic synapses, induce memory alterations which mimic neurological deficits. Finally, the network, isolated from the external environment (“imagination phase”) and stimulated with high uniform noise, can randomly recover sequences previously learned, and link them together by exploiting the similarity among items.

Reward-Based Decision-Making Engages Distinct Modes of Cross-Frequency Coupling

Prefrontal cortex exerts control over sensory and motor systems via cross-frequency coupling. However, it is unknown whether these signals play a role in reward-based decision-making and whether such dynamic network configuration is altered in a major depressive episode. We recruited men and women with and without depression to perform a streamlined version of the Expenditure of Effort for Reward Task during recording of electroencephalography. Goal-directed behavior was quantified as willingness to exert physical effort to obtain reward, and reward-evaluation was the degree to which the decision to exert effort was modulated by incentive level. We found that the amplitude of frontal-midline theta oscillations was greatest in participants with the greatest reward-evaluation. Furthermore, coupling between frontal theta phase and parieto-occipital gamma amplitude was positively correlated with reward-evaluation. In addition, goal-directed behavior was positively correlated with coupling between frontal delta phase to motor beta amplitude. Finally, we performed a factor analysis to derive 2 symptom dimensions and found that mood symptoms positively tracked with reward-evaluation and motivation symptoms negatively tracked with goal-directed behavior. Altogether, these results provide evidence that 2 aspects of reward-based decision-making are instantiated by different modes of prefrontal top-down control and are modulated in different symptom dimensions of depression.

Fronto-medial theta coordinates posterior maintenance of working memory content

How does the human brain manage multiple bits of information to guide goal-directed behavior? Successful working memory (WM) functioning has consistently been linked to oscillatory power in the theta frequency band (4–8 Hz) over fronto-medial cortex (fronto-medial theta [FMT]). Specifically, FMT is thought to reflect the mechanism of an executive sub-system that coordinates maintenance of memory contents in posterior regions. However, direct evidence for the role of FMT in controlling specific WM content is lacking. Here, we collected high-density electroencephalography (EEG) data while participants engaged in WM-dependent tasks and then used multivariate decoding methods to examine WM content during the maintenance period. Engagement of WM was accompanied by a focal increase in FMT. Importantly, decoding of WM content was driven by posterior sites, which, in turn, showed increased functional theta coupling with fronto-medial channels. Finally, we observed a significant slowing of FMT frequency with increasing WM load, consistent with the hypothesized broadening of a theta “duty cycle” to accommodate additional WM items. Together, these findings demonstrate that frontal theta orchestrates posterior maintenance of WM content. Moreover, the observed frequency slowing elucidates the function of FMT oscillations by specifically supporting phase-coding accounts of WM.

•

FMT power supports WM functions

•

During WM performance, posterior/parietal regions are coupled with FMT

•

Multivariate decoding of WM content is mediated by these same posterior channels

•

Frontal theta frequency slows with WM load supporting phase-coding models

Working Memory and Transcranial-Alternating Current Stimulation-State of the Art: Findings, Missing, and Challenges

Working memory (WM) is a cognitive process that involves maintaining and manipulating information for a short period of time. WM is central to many cognitive processes and declines rapidly with age. Deficits in WM are seen in older adults and in patients with dementia, schizophrenia, major depression, mild cognitive impairment, Alzheimer's disease, etc. The frontal, parietal, and occipital cortices are significantly involved in WM processing and all brain oscillations are implicated in tackling WM tasks, particularly theta and gamma bands. The theta/gamma neural code hypothesis assumes that retained memory items are recorded via theta-nested gamma cycles. Neuronal oscillations can be manipulated by sensory, invasive- and non-invasive brain stimulations. Transcranial alternating-current stimulation (tACS) and repetitive transcranial magnetic stimulation (rTMS) are frequency-tuned non-invasive brain stimulation (NIBS) techniques that have been used to entrain endogenous oscillations in a frequency-specific manner. Compared to rTMS, tACS demonstrates superior cost, tolerability, portability, and safety profile, making it an attractive potential tool for improving cognitive performance. Although cognitive research with tACS is still in its infancy compared to rTMS, a number of studies have shown a promising WM enhancement effect, especially in the elderly and patients with cognitive deficits. This review focuses on the various methods and outcomes of tACS on WM in healthy and unhealthy human adults and highlights the established findings, unknowns, challenges, and perspectives important for translating laboratory tACS into realistic clinical settings. This will allow researchers to identify gaps in the literature and develop frequency-tuned tACS protocols with promising safety and efficacy outcomes. Therefore, research efforts in this direction should help to consider frequency-tuned tACS as a non-pharmacological tool of cognitive rehabilitation in physiological aging and patients with cognitive deficits.

Theta rhythmicity governs human behavior and hippocampal signals during memory-dependent tasks

Memory formation and reinstatement are thought to lock to the hippocampal theta rhythm, predicting that encoding and retrieval processes appear rhythmic themselves. Here, we show that rhythmicity can be observed in behavioral responses from memory tasks, where participants indicate, using button presses, the timing of encoding and recall of cue-object associative memories. We find no evidence for rhythmicity in button presses for visual tasks using the same stimuli, or for questions about already retrieved objects. The oscillations for correctly remembered trials center in the slow theta frequency range (1-5 Hz). Using intracranial EEG recordings, we show that the memory task induces temporally extended phase consistency in hippocampal local field potentials at slow theta frequencies, but significantly more for remembered than forgotten trials, providing a potential mechanistic underpinning for the theta oscillations found in behavioral responses.

An oscillatory pipelining mechanism supporting previewing during visual exploration and reading

Humans have a remarkable ability to efficiently explore visual scenes and text using eye movements. Humans typically make eye movements (saccades) every ~250 ms. Since saccade initiation and execution take 100 ms, this leaves only ~150 ms to recognize the fixated object (or word) while simultaneously previewing candidates for the next saccade goal. We propose a pipelining mechanism where serial processing occurs within a specific brain region, whereas parallel processing occurs across different brain regions. The mechanism is timed by alpha oscillations that coordinate the saccades, visual recognition, and previewing in the cortical hierarchy. Consequently, the neuronal mechanism supporting natural vision and saccades must be studied in unison to uncover the brain mechanisms supporting visual exploration and reading.

Disentangling neocortical alpha/beta and hippocampal theta/gamma oscillations in human episodic memory formation

To form an episodic memory, we must first process a vast amount of sensory information about the to-be-encoded event and then bind these sensory representations together to form a coherent memory trace. While these two cognitive capabilities are thought to have two distinct neural origins, with neocortical alpha/beta oscillations supporting information representation and hippocampal theta-gamma phase-amplitude coupling supporting mnemonic binding, evidence for a dissociation between these two neural markers is conspicuously absent. To address this, seventeen human participants completed an associative memory task that first involved processing information about three sequentially-presented stimuli, and then binding these stimuli together into a coherent memory trace, all the while undergoing MEG recordings. We found that decreases in neocortical alpha/beta power during sequence perception, but not mnemonic binding, correlated with enhanced memory performance. Hippocampal theta/gamma phase-amplitude coupling, however, showed the opposite pattern; increases during mnemonic binding (but not sequence perception) correlated with enhanced memory performance. These results demonstrate that memory-related decreases in neocortical alpha/beta power and memory-related increases in hippocampal theta/gamma phase-amplitude coupling arise at distinct stages of the memory formation process. We speculate that this temporal dissociation reflects a functional dissociation in which neocortical alpha/beta oscillations could support the processing of incoming information relevant to the memory, while hippocampal theta-gamma phase-amplitude coupling could support the binding of this information into a coherent memory trace.

Working Memory and Cross-Frequency Coupling of Neuronal Oscillations

Working memory (WM) is the active retention and processing of information over a few seconds and is considered an essential component of cognitive function. The reduced WM capacity is a common feature in many diseases, such as schizophrenia, attention deficit hyperactivity disorder (ADHD), mild cognitive impairment (MCI), and Alzheimer's disease (AD). The theta-gamma neural code is an essential component of memory representations in the multi-item WM. A large body of studies have examined the association between cross-frequency coupling (CFC) across the cerebral cortices and WM performance; electrophysiological data together with the behavioral results showed the associations between CFC and WM performance. The oscillatory entrainment (sensory, non-invasive electrical/magnetic, and invasive electrical) remains the key method to investigate the causal relationship between CFC and WM. The frequency-tuned non-invasive brain stimulation is a promising way to improve WM performance in healthy and non-healthy patients with cognitive impairment. The WM performance is sensitive to the phase and rhythm of externally applied stimulations. CFC-transcranial-alternating current stimulation (CFC-tACS) is a recent approach in neuroscience that could alter cognitive outcomes. The studies that investigated (1) the association between CFC and WM and (2) the brain stimulation protocols that enhanced WM through modulating CFC by the means of the non-invasive brain stimulation techniques have been included in this review. In principle, this review can guide the researchers to identify the most prominent form of CFC associated with WM processing (e.g., theta/gamma phase-amplitude coupling), and to define the previously published studies that manipulate endogenous CFC externally to improve WM. This in turn will pave the path for future studies aimed at investigating the CFC-tACS effect on WM. The CFC-tACS protocols need to be thoroughly studied before they can be considered as therapeutic tools in patients with WM deficits.

The what and when of olfactory working memory in humans

Encoding and retaining novel sequences of sensory stimuli in working memory is crucial for adaptive behavior. A fundamental challenge for the central nervous system is to maintain each sequence item in an active and discriminable state, while also preserving their temporal context. Nested neural oscillations have been postulated to disambiguate the "what" and "when" of sequences, but the mechanisms by which these multiple streams of information are coordinated in the human brain remain unclear. Drawing from foundational animal studies, we recorded local field potentials from the human piriform cortex and hippocampus during a working memory task in which subjects experienced sequences of three distinct odors. Our data revealed a unique organization of odor memories across multiple timescales of the theta rhythm. During encoding, odors elicited greater gamma at distinct theta phases in both regions, time stamping their positions in the sequence, whereby the robustness of this effect was predictive of temporal order memory. During maintenance, stimulus-driven patterns of theta-coupled gamma were spontaneously reinstated in piriform cortex, recapitulating the order of the initial sequence. Replay events were time compressed across contiguous theta cycles, coinciding with periods of enhanced piriform-hippocampal theta-phase synchrony, and their prevalence forecasted subsequent recall accuracy on a trial-by-trial basis. Our data provide a novel link between endogenous replay orchestrated by the theta rhythm and short-term retention of sequential memories in the human brain.

Volitional learning promotes theta phase coding in the human hippocampus

While behavioral evidence shows that volitionally controlled learning benefits human memory, little is known about the neural mechanisms underlying this effect. Insights from spatial navigation research in rodents point to the relevance of hippocampal theta oscillations. However, the mechanisms through which theta might support the beneficial effects of active learning in humans are currently unknown. Here, we demonstrate hippocampal theta oscillations increase during volitional learning, promoting a segregation of task-relevant representational signals according to their semantic content. Our results constitute a direct link to the animal literature on hippocampal theta oscillations and its relation to volition and memory processes.

Electrophysiological studies in rodents show that active navigation enhances hippocampal theta oscillations (4–12 Hz), providing a temporal framework for stimulus-related neural codes. Here we show that active learning promotes a similar phase coding regime in humans, although in a lower frequency range (3–8 Hz). We analyzed intracranial electroencephalography (iEEG) from epilepsy patients who studied images under either volitional or passive learning conditions. Active learning increased memory performance and hippocampal theta oscillations and promoted a more accurate reactivation of stimulus-specific information during memory retrieval. Representational signals were clustered to opposite phases of the theta cycle during encoding and retrieval. Critically, during active but not passive learning, the temporal structure of intracycle reactivations in theta reflected the semantic similarity of stimuli, segregating conceptually similar items into more distant theta phases. Taken together, these results demonstrate a multilayered mechanism by which active learning improves memory via a phylogenetically old phase coding scheme.

Theta-phase dependent neuronal coding during sequence learning in human single neurons

The ability to maintain a sequence of items in memory is a fundamental cognitive function. In the rodent hippocampus, the representation of sequentially organized spatial locations is reflected by the phase of action potentials relative to the theta oscillation (phase precession). We investigated whether the timing of neuronal activity relative to the theta brain oscillation also reflects sequence order in the medial temporal lobe of humans. We used a task in which human participants learned a fixed sequence of pictures and recorded single neuron and local field potential activity with implanted electrodes. We report that spikes for three consecutive items in the sequence (the preferred stimulus for each cell, as well as the stimuli immediately preceding and following it) were phase-locked at distinct phases of the theta oscillation. Consistent with phase precession, spikes were fired at progressively earlier phases as the sequence advanced. These findings generalize previous findings in the rodent hippocampus to the human temporal lobe and suggest that encoding stimulus information at distinct oscillatory phases may play a role in maintaining sequential order in memory.

An oscillating computational model can track pseudo-rhythmic speech by using linguistic predictions

Neuronal oscillations putatively track speech in order to optimize sensory processing. However, it is unclear how isochronous brain oscillations can track pseudo-rhythmic speech input. Here we propose that oscillations can track pseudo-rhythmic speech when considering that speech time is dependent on content-based predictions flowing from internal language models. We show that temporal dynamics of speech are dependent on the predictability of words in a sentence. A computational model including oscillations, feedback, and inhibition is able to track pseudo-rhythmic speech input. As the model processes, it generates temporal phase codes, which are a candidate mechanism for carrying information forward in time. The model is optimally sensitive to the natural temporal speech dynamics and can explain empirical data on temporal speech illusions. Our results suggest that speech tracking does not have to rely only on the acoustics but could also exploit ongoing interactions between oscillations and constraints flowing from internal language models.

Sequence structure organizes items in varied latent states of working memory neural network

In memory experiences, events do not exist independently but are linked with each other via structure-based organization. Structure context largely influences memory behavior, but how it is implemented in the brain remains unknown. Here, we combined magnetoencephalogram (MEG) recordings, computational modeling, and impulse-response approaches to probe the latent states when subjects held a list of items in working memory (WM). We demonstrate that sequence context reorganizes WM items into distinct latent states, that is, being reactivated at different latencies during WM retention, and the reactivation profiles further correlate with recency behavior. In contrast, memorizing the same list of items without sequence task requirements weakens the recency effect and elicits comparable neural reactivations. Computational modeling further reveals a dominant function of sequence context, instead of passive memory decaying, in characterizing recency effect. Taken together, sequence structure context shapes the way WM items are stored in the human brain and essentially influences memory behavior.

Is short-term memory capacity (7±2) really predicted by theta to gamma cycle length ratio?

Several studies suggest that EEG parameters, reflecting top-down processes in the brain, may predict cognitive performance, e.g. short-term memory (STM) capacity. According to Lisman and Idiart's model, STM capacity is predicted by theta and gamma EEG waves and their ratio. This model suggests that the more periods of gamma band waves fit into one period of theta band waves, the more information can be stored. We replicated the study by Kaminski et al. (2011), which recorded spontaneous EEG activity and measured verbal STM capacity with a modified digit span task from the Wechsler battery. Our study included more subjects and two EEG recording sessions. We discuss the possible limits of EEG correlates of STM capacity as EEG parameters were not stable across the two measurements and no correlation was found between the theta/gamma ratio and performance in the digit span task.

Emergence of Neuronal Synchronisation in Coupled Areas

One of the most fundamental questions in the field of neuroscience is the emergence of synchronous behaviour in the brain, such as phase, anti-phase, and shift-phase synchronisation. In this work, we investigate how the connectivity between brain areas can influence the phase angle and the neuronal synchronisation. To do this, we consider brain areas connected by means of excitatory and inhibitory synapses, in which the neuron dynamics is given by the adaptive exponential integrate-and-fire model. Our simulations suggest that excitatory and inhibitory connections from one area to another play a crucial role in the emergence of these types of synchronisation. Thus, in the case of unidirectional interaction, we observe that the phase angles of the neurons in the receiver area depend on the excitatory and inhibitory synapses which arrive from the sender area. Moreover, when the neurons in the sender area are synchronised, the phase angle variability of the receiver area can be reduced for some conductance values between the areas. For bidirectional interactions, we find that phase and anti-phase synchronisation can emerge due to excitatory and inhibitory connections. We also verify, for a strong inhibitory-to-excitatory interaction, the existence of silent neuronal activities, namely a large number of excitatory neurons that remain in silence for a long time.

Temporally coherent perturbation of neural dynamics during retention alters human multi-item working memory

Temporarily storing a list of items in working memory (WM), a fundamental ability in cognition, has been posited to rely on the temporal dynamics of multi-item neural representations during retention. However, the causal evidence, particularly in human subjects, is still lacking, let alone WM manipulation. Here, we develop a novel "dynamic perturbation" approach to manipulate the relative memory strength of WM items held in human brain, by presenting temporally correlated luminance sequences during retention to interfere with the multi-item neural dynamics. Six experiments on more than 150 subjects confirm the effectiveness of this WM manipulation approach. A computational model combining continuous attractor neural network (CANN) and short-term synaptic plasticity (STP) principles further reproduces all the empirical findings. The model reveals that the "dynamic perturbation" modifies the synaptic efficacies of WM items through STP principles, eventually leading to changes in their relative memory strengths. Our results support the causal role of temporal dynamics of neural network in mediating multi-item WM, and offer a promising, purely bottom-up approach to manipulate WM.

Stable maintenance of multiple representational formats in human visual short-term memory

Visual short-term memory (VSTM) enables humans to form a stable and coherent representation of the external world. However, the nature and temporal dynamics of the neural representations in VSTM that support this stability are barely understood. Here we combined human intracranial electroencephalography (iEEG) recordings with analyses using deep neural networks and semantic models to probe the representational format and temporal dynamics of information in VSTM. We found clear evidence that VSTM maintenance occurred in two distinct representational formats which originated from different encoding periods. The first format derived from an early encoding period (250 to 770 ms) corresponded to higher-order visual representations. The second format originated from a late encoding period (1,000 to 1,980 ms) and contained abstract semantic representations. These representational formats were overall stable during maintenance, with no consistent transformation across time. Nevertheless, maintenance of both representational formats showed substantial arrhythmic fluctuations, i.e., waxing and waning in irregular intervals. The increases of the maintained representational formats were specific to the phases of hippocampal low-frequency activity. Our results demonstrate that human VSTM simultaneously maintains representations at different levels of processing, from higher-order visual information to abstract semantic representations, which are stably maintained via coupling to hippocampal low-frequency activity.

Oscillatory brain activity and maintenance of verbal and visual working memory: A systematic review

Brain oscillations likely play a significant role in the storage of information in working memory (WM). Despite the wide popularity of the topic, current attempts to summarize the research in the field are narrative reviews. We address this gap by providing a descriptive systematic review, in which we investigated oscillatory correlates of maintenance of verbal and visual information in WM. The systematic approach enabled us to challenge some common views popularized by previous research. The identified literature (100 EEG/MEG studies) highlighted the importance of theta oscillations in verbal WM: frontal midline theta enhanced with load in most verbal studies, while more equivocal results have been obtained in visual studies. Increasing WM load affected alpha activity in most studies, but the direction of the effect was inconsistent: the ratio of studies that found alpha increase versus decrease with increasing load was 80/20% in the verbal WM domain and close to 60/40% in the visual domain. Alpha asymmetry (left < right) was a common finding in both verbal and visual WM studies. Beta and gamma activity studies yielded the least convincing data: a diversity in the spatial and frequency distribution of beta activity prevented us from making a coherent conclusion; gamma rhythm was virtually neglected in verbal WM studies with no systematic support for sustained gamma changes during the delay in EEG studies in general.

Time cells in the human hippocampus and entorhinal cortex support episodic memory

The organization of temporal information is critical for the encoding and retrieval of episodic memories. In the rodent hippocampus and entorhinal cortex, evidence accumulated over the last decade suggests that populations of "time cells" in the hippocampus encode temporal information. We identify time cells in humans using intracranial microelectrode recordings obtained from 27 human epilepsy patients who performed an episodic memory task. We show that time cell activity predicts the temporal organization of retrieved memory items. We also uncover evidence of ramping cell activity in humans, which represents a complementary type of temporal information. These findings establish a cellular mechanism for the representation of temporal information in the human brain needed to form episodic memories.

Theoretical distinction between functional states in working memory and their corresponding neural states

Working memory (WM) is important for guiding behaviour, but not always for the next possible action. Here we define a WM item that is currently relevant for guiding behaviour as the functionally "active" item; whereas items maintained in WM, but not immediately relevant to behaviour, are defined as functionally "latent". Traditional neurophysiological theories of WM proposed that content is maintained via persistent neural activity (e.g., stable attractors); however, more recent theories have highlighted the potential role for "activity-silent" mechanisms (e.g., short-term synaptic plasticity). Given these somewhat parallel dichotomies, functionally active and latent cognitive states of WM have been associated with storage based on persistent-activity and activity-silent neural mechanisms, respectively. However, in this article we caution against a one-to-one correspondence between functional and activity states. We argue that the principal theoretical requirement for active and latent WM is that the corresponding neural states play qualitatively different functional roles. We consider a number of candidate solutions, and conclude that the neurophysiological mechanisms for functionally active and latent WM items are theoretically independent of the distinction between persistent activity-based and activity-silent forms of WM storage.

Cue-triggered activity replay in human early visual cortex

The recall of learned temporal sequences by a visual cue is an important form of experience-based neural plasticity. Here we observed such reactivation in awake human visual cortex using intracranial recording. After repeated exposure to a moving dot, a flash of the dot was able to trigger neural reactivation in the downstream receptive field along the motion path. This effect was observed only when the cue appeared near the receptive field. The estimated traveling speed was faster compared to the activation induced by the real motion. We suggest a range-limited, time-compressed reactivation as a result of repeated visual exposure in awake human visual cortex.