Hippocampal replays appear after a single experience and incorporate greater detail with more experience

Hippocampal Place Cell Sequences Are Impaired in a Rat Model of Fragile X Syndrome

Fragile X syndrome (FXS) is a neurodevelopmental disorder that can cause impairments in spatial cognition and memory. The hippocampus is thought to support spatial cognition through the activity of place cells, neurons with spatial receptive fields. Coordinated firing of place cell populations is organized by different oscillatory patterns in the hippocampus during specific behavioral states. Theta rhythms organize place cell populations during awake exploration. Sharp wave-ripples organize place cell population reactivation during waking rest. Here, we examined the coordination of CA1 place cell populations during active behavior and subsequent rest in a rat model of FXS (Fmr1 knock-out rats). While the organization of individual place cells by the theta rhythm was normal, the coordinated activation of sequences of place cells during individual theta cycles was impaired in Fmr1 knock-out rats. Furthermore, the subsequent replay of place cell sequences was impaired during waking rest following active exploration. Together, these results expand our understanding of how genetic modifications that model those observed in FXS affect hippocampal physiology and suggest a potential mechanism underlying impaired spatial cognition in FXS.

Spatial localization of hippocampal replay requires dopamine signaling

Sequenced reactivations of hippocampal neurons called replays, concomitant with sharp-wave ripples in the local field potential, are critical for the consolidation of episodic memory, but whether replays depend on the brain's reward or novelty signals is unknown. Here, we combined chemogenetic silencing of dopamine neurons in ventral tegmental area (VTA) and simultaneous electrophysiological recordings in dorsal hippocampal CA1, in freely behaving male rats experiencing changes to reward magnitude and environmental novelty. Surprisingly, VTA silencing did not prevent ripple increases where reward was increased, but caused dramatic, aberrant ripple increases where reward was unchanged. These increases were associated with increased reverse-ordered replays. On familiar tracks this effect disappeared, and ripples tracked reward prediction error (RPE), indicating that non-VTA reward signals were sufficient to direct replay. Our results reveal a novel dependence of hippocampal replay on dopamine, and a role for a VTA-independent RPE signal that is reliable only in familiar environments.

Topography of putative bi-directional interaction between hippocampal sharp-wave ripples and neocortical slow oscillations

Systems consolidation relies on coordination between hippocampal sharp-wave ripples (SWRs) and neocortical UP/DOWN states during sleep. However, whether this coupling exists across the neocortex and the mechanisms enabling it remains unknown. By combining electrophysiology in mouse hippocampus (HPC) and retrosplenial cortex (RSC) with wide-field imaging of the dorsal neocortex, we found spatially and temporally precise bi-directional hippocampo-neocortical interaction. HPC multi-unit activity and SWR probability were correlated with UP/DOWN states in the default mode network (DMN), with the highest modulation by the RSC in deep sleep. Further, some SWRs were preceded by the high rebound excitation accompanying DMN DOWN → UP transitions, whereas large-amplitude SWRs were often followed by DOWN states originating in the RSC. We explain these electrophysiological results with a model in which the HPC and RSC are weakly coupled excitable systems capable of bi-directional perturbation and suggest that the RSC may act as a gateway through which SWRs can perturb downstream cortical regions via cortico-cortical propagation of DOWN states.

Exploring replay

Animals face uncertainty about their environments due to initial ignorance or subsequent changes. They therefore need to explore. However, the algorithmic structure of exploratory choices in the brain still remains largely elusive. Artificial agents face the same problem, and a venerable idea in reinforcement learning is that they can plan appropriate exploratory choices offline, during the equivalent of quiet wakefulness or sleep. Although offline processing in humans and other animals, in the form of hippocampal replay and preplay, has recently been the subject of highly informative modelling, existing methods only apply to known environments. Thus, they cannot predict exploratory replay choices during learning and/or behaviour in the face of uncertainty. Here, we extend an influential theory of hippocampal replay and examine its potential role in approximately optimal exploration, deriving testable predictions for the patterns of exploratory replay choices in a paradigmatic spatial navigation task. Our modelling provides a normative interpretation of the available experimental data suggestive of exploratory replay. Furthermore, we highlight the importance of sequence replay, and license a range of new experimental paradigms that should further our understanding of offline processing.

Hippocampal place cell sequences are impaired in a rat model of Fragile X Syndrome

Fragile X Syndrome (FXS) is a neurodevelopmental disorder that can cause impairments in spatial cognition and memory. The hippocampus is thought to support spatial cognition through the activity of place cells, neurons with spatial receptive fields. Coordinated firing of place cell populations is organized by different oscillatory patterns in the hippocampus during specific behavioral states. Theta rhythms organize place cell populations during awake exploration. Sharp wave-ripples organize place cell population reactivation during waking rest. Here, we examined the coordination of CA1 place cell populations during active behavior and subsequent rest in a rat model of FXS (Fmr1 knockout rats). While the organization of individual place cells by the theta rhythm was normal, the coordinated activation of sequences of place cells during individual theta cycles was impaired in Fmr1 knockout rats. Further, the subsequent replay of place cell sequences was impaired during waking rest following active exploration. Together, these results expand our understanding of how genetic modifications that model those observed in FXS affect hippocampal physiology and suggest a potential mechanism underlying impaired spatial cognition in FXS.

Spatial localization of hippocampal replay requires dopamine signaling

Sequenced reactivations of hippocampal neurons called replays, concomitant with sharp-wave ripples in the local field potential, are critical for the consolidation of episodic memory, but whether replays depend on the brain's reward or novelty signals is unknown. Here we combined chemogenetic silencing of dopamine neurons in ventral tegmental area (VTA) and simultaneous electrophysiological recordings in dorsal hippocampal CA1, in freely behaving male rats experiencing changes to reward magnitude and environmental novelty. Surprisingly, VTA silencing did not prevent ripple increases where reward was increased, but caused dramatic, aberrant ripple increases where reward was unchanged. These increases were associated with increased reverse-ordered replays. On familiar tracks this effect disappeared, and ripples tracked reward prediction error, indicating that non-VTA reward signals were sufficient to direct replay. Our results reveal a novel dependence of hippocampal replay on dopamine, and a role for a VTA-independent reward prediction error signal that is reliable only in familiar environments.

Topography of putative bidirectional interaction between hippocampal sharp wave ripples and neocortical slow oscillations

Systems consolidation relies on coordination between hippocampal sharp-wave ripples (SWRs) and neocortical UP/DOWN states during sleep. However, whether this coupling exists across neocortex and the mechanisms enabling it remain unknown. By combining electrophysiology in mouse hippocampus (HPC) and retrosplenial cortex (RSC) with widefield imaging of dorsal neocortex, we found spatially and temporally precise bidirectional hippocampo-neocortical interaction. HPC multi-unit activity and SWR probability was correlated with UP/DOWN states in mouse default mode network, with highest modulation by RSC in deep sleep. Further, some SWRs were preceded by the high rebound excitation accompanying DMN DOWN→UP transitions, while large-amplitude SWRs were often followed by DOWN states originating in RSC. We explain these electrophysiological results with a model in which HPC and RSC are weakly coupled excitable systems capable of bi-directional perturbation and suggest RSC may act as a gateway through which SWRs can perturb downstream cortical regions via cortico-cortical propagation of DOWN states.

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments

During both sleep and awake immobility, hippocampal place cells reactivate time-compressed versions of sequences representing recently experienced trajectories in a phenomenon known as replay. Intriguingly, spontaneous sequences can also correspond to forthcoming trajectories in novel environments experienced later, in a phenomenon known as preplay. Here, we present a model showing that sequences of spikes correlated with the place fields underlying spatial trajectories in both previously experienced and future novel environments can arise spontaneously in neural circuits with random, clustered connectivity rather than pre-configured spatial maps. Moreover, the realistic place fields themselves arise in the circuit from minimal, landmark-based inputs. We find that preplay quality depends on the network's balance of cluster isolation and overlap, with optimal preplay occurring in small-world regimes of high clustering yet short path lengths. We validate the results of our model by applying the same place field and preplay analyses to previously published rat hippocampal place cell data. Our results show that clustered recurrent connectivity can generate spontaneous preplay and immediate replay of novel environments. These findings support a framework whereby novel sensory experiences become associated with preexisting "pluripotent" internal neural activity patterns.

Repetition dynamically and rapidly increases cortical, but not hippocampal, offline reactivation

No sooner is an experience over than its neural representation begins to be transformed through memory reactivation during offline periods. The lion's share of prior research has focused on understanding offline reactivation within the hippocampus. However, it is hypothesized that consolidation processes involve offline reactivation in cortical regions as well as coordinated reactivation in the hippocampus and cortex. Using fMRI, we presented novel and repeated paired associates to participants during encoding and measured offline memory reactivation for those events during an immediate post-encoding rest period. post-encoding reactivation frequency of repeated and once-presented events did not differ in the hippocampus. However, offline reactivation in widespread cortical regions and hippocampal-cortical coordinated reactivation were significantly enhanced for repeated events. These results provide evidence that repetition might facilitate the distribution of memory representations across cortical networks, a hallmark of systems-level consolidation. Interestingly, we found that offline reactivation frequency in both hippocampus and cortex explained variance in behavioral success on an immediate associative recognition test for the once-presented information, potentially indicating a role of offline reactivation in maintaining these novel, weaker, memories. Together, our findings highlight that endogenous offline reactivation can be robustly and significantly modulated by study repetition.

Learning, Fast and Slow: Single- and Many-Shot Learning in the Hippocampus

The hippocampus is critical for memory and spatial navigation. The ability to map novel environments, as well as more abstract conceptual relationships, is fundamental to the cognitive flexibility that humans and other animals require to survive in a dynamic world. In this review, we survey recent advances in our understanding of how this flexibility is implemented anatomically and functionally by hippocampal circuitry, during both active exploration (online) and rest (offline). We discuss the advantages and limitations of spike timing-dependent plasticity and the more recently discovered behavioral timescale synaptic plasticity in supporting distinct learning modes in the hippocampus. Finally, we suggest complementary roles for these plasticity types in explaining many-shot and single-shot learning in the hippocampus and discuss how these rules could work together to support the learning of cognitive maps.

A theory of hippocampal function: New developments

We develop further here the only quantitative theory of the storage of information in the hippocampal episodic memory system and its recall back to the neocortex. The theory is upgraded to account for a revolution in understanding of spatial representations in the primate, including human, hippocampus, that go beyond the place where the individual is located, to the location being viewed in a scene. This is fundamental to much primate episodic memory and navigation: functions supported in humans by pathways that build 'where' spatial view representations by feature combinations in a ventromedial visual cortical stream, separate from those for 'what' object and face information to the inferior temporal visual cortex, and for reward information from the orbitofrontal cortex. Key new computational developments include the capacity of the CA3 attractor network for storing whole charts of space; how the correlations inherent in self-organizing continuous spatial representations impact the storage capacity; how the CA3 network can combine continuous spatial and discrete object and reward representations; the roles of the rewards that reach the hippocampus in the later consolidation into long-term memory in part via cholinergic pathways from the orbitofrontal cortex; and new ways of analysing neocortical information storage using Potts networks.

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments

During both sleep and awake immobility, hippocampal place cells reactivate time-compressed versions of sequences representing recently experienced trajectories in a phenomenon known as replay. Intriguingly, spontaneous sequences can also correspond to forthcoming trajectories in novel environments experienced later, in a phenomenon known as preplay. Here, we present a model showing that sequences of spikes correlated with the place fields underlying spatial trajectories in both previously experienced and future novel environments can arise spontaneously in neural circuits with random, clustered connectivity rather than pre-configured spatial maps. Moreover, the realistic place fields themselves arise in the circuit from minimal, landmark-based inputs. We find that preplay quality depends on the network's balance of cluster isolation and overlap, with optimal preplay occurring in small-world regimes of high clustering yet short path lengths. We validate the results of our model by applying the same place field and preplay analyses to previously published rat hippocampal place cell data. Our results show that clustered recurrent connectivity can generate spontaneous preplay and immediate replay of novel environments. These findings support a framework whereby novel sensory experiences become associated with preexisting "pluripotent" internal neural activity patterns.

Distributed and dynamical communication: a mechanism for flexible cortico-cortical interactions and its functional roles in visual attention

Perceptual and cognitive processing relies on flexible communication among cortical areas; however, the underlying neural mechanism remains unclear. Here we report a mechanism based on the realistic spatiotemporal dynamics of propagating wave patterns in neural population activity. Using a biophysically plausible, multiarea spiking neural circuit model, we demonstrate that these wave patterns, characterized by their rich and complex dynamics, can account for a wide variety of empirically observed neural processes. The coordinated interactions of these wave patterns give rise to distributed and dynamic communication (DDC) that enables flexible and rapid routing of neural activity across cortical areas. We elucidate how DDC unifies the previously proposed oscillation synchronization-based and subspace-based views of interareal communication, offering experimentally testable predictions that we validate through the analysis of Allen Institute Neuropixels data. Furthermore, we demonstrate that DDC can be effectively modulated during attention tasks through the interplay of neuromodulators and cortical feedback loops. This modulation process explains many neural effects of attention, underscoring the fundamental functional role of DDC in cognition.

Selection of experience for memory by hippocampal sharp wave ripples

Experiences need to be tagged during learning for further consolidation. However, neurophysiological mechanisms that select experiences for lasting memory are not known. By combining large-scale neural recordings in mice with dimensionality reduction techniques, we observed that successive maze traversals were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered. When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials, and their specific spike content decoded the trial blocks that surrounded them. During postexperience sleep, SPW-Rs continued to replay those trial blocks that were reactivated most frequently during waking SPW-Rs. Replay content of awake SPW-Rs may thus provide a neurophysiological tagging mechanism to select aspects of experience that are preserved and consolidated for future use.

The hippocampus contributes to retroactive stimulus associations during trace fear conditioning

Binding events that occur at different times are essential for memory formation. In trace fear conditioning, animals associate a tone and footshock despite no temporal overlap. The hippocampus is thought to mediate this learning by maintaining a memory of the tone until shock occurrence, however, evidence for sustained hippocampal tone representations is lacking. Here, we demonstrate a retrospective role for the hippocampus in trace fear conditioning. Bulk calcium imaging revealed sustained increases in CA1 activity after footshock that were not observed after tone termination. Optogenetic silencing of CA1 immediately after footshock impaired subsequent memory. Additionally, footshock increased the number of sharp-wave ripples compared to baseline during conditioning. Therefore, post-shock hippocampal activity likely supports learning by reactivating and linking latent tone and shock representations. These findings highlight an underappreciated function of post-trial hippocampal activity in enabling retroactive temporal associations during new learning, as opposed to persistent maintenance of stimulus representations.

The generative grammar of the brain: a critique of internally generated representations

The past decade of progress in neurobiology has uncovered important organizational principles for network preconfiguration and neuronal selection that suggest a generative grammar exists in the brain. In this Perspective, I discuss the competence of the hippocampal neural network to generically express temporally compressed sequences of neuronal firing that represent novel experiences, which is envisioned as a form of generative neural syntax supporting a neurobiological perspective on brain function. I compare this neural competence with the hippocampal network performance that represents specific experiences with higher fidelity after new learning during replay, which is envisioned as a form of neural semantic that supports a complementary neuropsychological perspective. I also demonstrate how the syntax of network competence emerges a priori during early postnatal life and is followed by the later development of network performance that enables rapid encoding and memory consolidation. Thus, I propose that this generative grammar of the brain is essential for internally generated representations, which are crucial for the cognitive processes underlying learning and memory, prospection, and inference, which ultimately underlie our reason and representation of the world.

Cortical reactivations predict future sensory responses

Many theories of offline memory consolidation posit that the pattern of neurons activated during a salient sensory experience will be faithfully reactivated, thereby stabilizing the pattern1,2. However, sensory-evoked patterns are not stable but, instead, drift across repeated experiences3-6. Here, to investigate the relationship between reactivations and the drift of sensory representations, we imaged the calcium activity of thousands of excitatory neurons in the mouse lateral visual cortex. During the minute after a visual stimulus, we observed transient, stimulus-specific reactivations, often coupled with hippocampal sharp-wave ripples. Stimulus-specific reactivations were abolished by local cortical silencing during the preceding stimulus. Reactivations early in a session systematically differed from the pattern evoked by the previous stimulus-they were more similar to future stimulus response patterns, thereby predicting both within-day and across-day representational drift. In particular, neurons that participated proportionally more or less in early stimulus reactivations than in stimulus response patterns gradually increased or decreased their future stimulus responses, respectively. Indeed, we could accurately predict future changes in stimulus responses and the separation of responses to distinct stimuli using only the rate and content of reactivations. Thus, reactivations may contribute to a gradual drift and separation in sensory cortical response patterns, thereby enhancing sensory discrimination7.

Selection of experience for memory by hippocampal sharp wave ripples

A general wisdom is that experiences need to be tagged during learning for further consolidation. However, brain mechanisms that select experiences for lasting memory are not known. Combining large-scale neural recordings with a novel application of dimensionality reduction techniques, we observed that successive traversals in the maze were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered (trial number). When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials and their unique spike content most often decoded the trial in which they occurred. In turn, during post-experience sleep, SPW-Rs continued to replay those trials that were reactivated most frequently during awake SPW-Rs. These findings suggest that replay content of awake SPW-Rs provides a tagging mechanism to select aspects of experience that are preserved and consolidated for future use.

Generalization of procedural motor sequence learning after a single practice trial

When humans begin learning new motor skills, they typically display early rapid performance improvements. It is not well understood how knowledge acquired during this early skill learning period generalizes to new, related skills. Here, we addressed this question by investigating factors influencing generalization of early learning from a skill A to a different, but related skill B. Early skill generalization was tested over four experiments (N = 2095). Subjects successively learned two related motor sequence skills (skills A and B) over different practice schedules. Skill A and B sequences shared ordinal (i.e., matching keypress locations), transitional (i.e., ordered keypress pairs), parsing rule (i.e., distinct sequence events like repeated keypresses that can be used as a breakpoint for segmenting the sequence into smaller units) structures, or possessed no structure similarities. Results showed generalization for shared parsing rule structure between skills A and B after only a single 10-second practice trial of skill A. Manipulating the initial practice exposure to skill A (1 to 12 trials) and inter-practice rest interval (0-30 s) between skills A and B had no impact on parsing rule structure generalization. Furthermore, this generalization was not explained by stronger sensorimotor mapping between individual keypress actions and their symbolic representations. In contrast, learning from skill A did not generalize to skill B during early learning when the sequences shared only ordinal or transitional structure features. These results document sequence structure that can be very rapidly generalized during initial learning to facilitate generalization of skill.

Rethinking the hippocampal cognitive map as a meta-learning computational module

A hallmark of biological intelligence is the ability to adaptively draw on past experience to guide behaviour under novel situations. Yet, the neurobiological principles that underlie this form of meta-learning remain relatively unexplored. In this Opinion, we review the existing literature on hippocampal spatial representations and reinforcement learning theory and describe a novel theoretical framework that aims to account for biological meta-learning. We conjecture that so-called hippocampal cognitive maps of familiar environments are part of a larger meta-representation (meta-map) that encodes information states and sources, which support exploration and provides a foundation for learning. We also introduce concrete hypotheses on how these generic states can be encoded using a principle of superposition.

Distinct encoding and post-encoding representational formats contribute to episodic sequence memory formation

In episodic encoding, an unfolding experience is rapidly transformed into a memory representation that binds separate episodic elements into a memory form to be later recollected. However, it is unclear how brain activity changes over time to accommodate the encoding of incoming information. This study aimed to investigate the dynamics of the representational format that contributed to memory formation of sequential episodes. We combined representational similarity analysis and multivariate decoding approaches on EEG data to compare whether "category-level" or "item-level" representations supported memory formation during the online encoding of a picture triplet sequence and offline, in the period that immediately followed encoding. The findings revealed a gradual integration of category-level representation during the online encoding of the picture sequence and a rapid item-based neural reactivation of the encoded sequence at the episodic offset. However, we found that only memory reinstatement at episodic offset was associated with successful memory retrieval from long-term memory. These results suggest that post-encoding memory reinstatement is crucial for the rapid formation of unique memory for episodes that unfold over time. Overall, the study sheds light on the dynamics of representational format changes that take place during the formation of episodic memories.

Resolving the prefrontal mechanisms of adaptive cognitive behaviors: A cross-species perspective

The prefrontal cortex (PFC) enables a staggering variety of complex behaviors, such as planning actions, solving problems, and adapting to new situations according to external information and internal states. These higher-order abilities, collectively defined as adaptive cognitive behavior, require cellular ensembles that coordinate the tradeoff between the stability and flexibility of neural representations. While the mechanisms underlying the function of cellular ensembles are still unclear, recent experimental and theoretical studies suggest that temporal coordination dynamically binds prefrontal neurons into functional ensembles. A so far largely separate stream of research has investigated the prefrontal efferent and afferent connectivity. These two research streams have recently converged on the hypothesis that prefrontal connectivity patterns influence ensemble formation and the function of neurons within ensembles. Here, we propose a unitary concept that, leveraging a cross-species definition of prefrontal regions, explains how prefrontal ensembles adaptively regulate and efficiently coordinate multiple processes in distinct cognitive behaviors.

Non-overlapping sets of neurons encode behavioral response determinants across different tasks in the posterior medial prefrontal cortex

Higher mammals are able to simultaneously learn and perform a wide array of complex behaviors, which raises questions about how the neural representations of multiple tasks coexist within the same neural network. Do neurons play invariant roles across different tasks? Alternatively, do the same neurons play different roles in different tasks? To address these questions, we examined neuronal activity in the posterior medial prefrontal cortex of primates while they were performing two versions of arm-reaching tasks that required the selection of multiple behavioral tactics (i.e., the internal protocol of action selection), a critical requirement for the activation of this area. During the performance of these tasks, neurons in the pmPFC exhibited selective activity for the tactics, visuospatial information, action, or their combination. Surprisingly, in 82% of the tactics-selective neurons, the selective activity appeared in a particular task but not in both. Such task-specific neuronal representation appeared in 72% of the action-selective neurons. In addition, 95% of the neurons representing visuospatial information showed such activity exclusively in one task but not in both. Our findings indicate that the same neurons can play different roles across different tasks even though the tasks require common information, supporting the latter hypothesis.

The two tales of hippocampal sharp-wave ripple content: The rigid and the plastic

Sharp-wave ripples, prominently in the CA1 region of the hippocampus, are short oscillatory events accompanied by bursts of neural firing. Ripples and associated hippocampal place cell sequences communicate with cortical ensembles during slow-wave sleep, which has been shown to be critical for systems consolidation of episodic memories. This consolidation is not limited to a newly formed memory trace; instead, ripples appear to reactivate and consolidate memories spanning various experiences. Despite this broad spanning influence, ripples remain capable of producing precise memories. The underlying mechanisms that enable ripples to consolidate memories broadly and with specificity across experiences remain unknown. In this review, we discuss data that uncovers circuit-level processes that generate ripples and influence their characteristics during consolidation. Based on current knowledge, we propose that memory emerges from the integration of two parallel consolidation pathways in CA1: the rigid and plastic pathways. The rigid pathway generates ripples stochastically, providing a backbone upon which dynamic plastic pathway inputs carrying novel information are integrated.

Once is enough for hippocampal replay

In this issue of Neuron, Berners-Lee et al. (2022) reveal how neural dynamics in the hippocampus change after a single experience, offering a candidate mechanism for how hippocampal plasticity supports episodic memory.