Potential factors influencing replay across CA1 during sharp-wave ripples

Prefrontal cortical ripples mediate top-down suppression of hippocampal reactivation during sleep memory consolidation

Consolidation of initially encoded hippocampal representations in the neocortex through reactivation is crucial for long-term memory formation and is facilitated by the coordination of hippocampal sharp-wave ripples (SWRs) with cortical slow and spindle oscillations during non-REM sleep. Recent evidence suggests that high-frequency cortical ripples can also coordinate with hippocampal SWRs in support of consolidation; however, the contribution of cortical ripples to reactivation remains unclear. We used high-density, continuous recordings in the hippocampus (area CA1) and prefrontal cortex (PFC) over the course of spatial learning and show that independent PFC ripples dissociated from SWRs are prevalent in NREM sleep and predominantly suppress hippocampal activity. PFC ripples paradoxically mediate top-down suppression of hippocampal reactivation rather than coordination, and this suppression is stronger for assemblies that are reactivated during coordinated CA1-PFC ripples for consolidation of recent experiences. Further, we show non-canonical, serial coordination of independent cortical ripples with slow and spindle oscillations, which are known signatures of memory consolidation. These results establish a role for prefrontal cortical ripples in top-down regulation of behaviorally relevant hippocampal representations during consolidation.

A machine learning toolbox for the analysis of sharp-wave ripples reveals common waveform features across species

The study of sharp-wave ripples has advanced our understanding of memory function, and their alteration in neurological conditions such as epilepsy is considered a biomarker of dysfunction. Sharp-wave ripples exhibit diverse waveforms and properties that cannot be fully characterized by spectral methods alone. Here, we describe a toolbox of machine-learning models for automatic detection and analysis of these events. The machine-learning architectures, which resulted from a crowdsourced hackathon, are able to capture a wealth of ripple features recorded in the dorsal hippocampus of mice across awake and sleep conditions. When applied to data from the macaque hippocampus, these models are able to generalize detection and reveal shared properties across species. We hereby provide a user-friendly open-source toolbox for model use and extension, which can help to accelerate and standardize analysis of sharp-wave ripples, lowering the threshold for its adoption in biomedical applications.

Cortical ripples mediate top-down suppression of hippocampal reactivation during sleep memory consolidation

Consolidation of initially encoded hippocampal representations in the neocortex through reactivation is crucial for long-term memory formation, and is facilitated by the coordination of hippocampal sharp-wave ripples (SWRs) with cortical oscillations during non-REM sleep. However, the contribution of high-frequency cortical ripples to consolidation is still unclear. We used continuous recordings in the hippocampus and prefrontal cortex (PFC) over the course of spatial learning and show that independent PFC ripples, when dissociated from SWRs, predominantly suppress hippocampal activity in non-REM sleep. PFC ripples paradoxically mediate top-down suppression of hippocampal reactivation, which is inversely related to reactivation strength during coordinated CA1-PFC ripples. Further, we show non-canonical, serial coordination of ripples with cortical slow and spindle oscillations. These results establish a role for cortical ripples in regulating consolidation.

Topological analysis of sharp-wave ripple waveforms reveals input mechanisms behind feature variations

The reactivation of experience-based neural activity patterns in the hippocampus is crucial for learning and memory. These reactivation patterns and their associated sharp-wave ripples (SWRs) are highly variable. However, this variability is missed by commonly used spectral methods. Here, we use topological and dimensionality reduction techniques to analyze the waveform of ripples recorded at the pyramidal layer of CA1. We show that SWR waveforms distribute along a continuum in a low-dimensional space, which conveys information about the underlying layer-specific synaptic inputs. A decoder trained in this space successfully links individual ripples with their expected sinks and sources, demonstrating how physiological mechanisms shape SWR variability. Furthermore, we found that SWR waveforms segregated differently during wakefulness and sleep before and after a series of cognitive tasks, with striking effects of novelty and learning. Our results thus highlight how the topological analysis of ripple waveforms enables a deeper physiological understanding of SWRs.

Theta-band phase locking during encoding leads to coordinated entorhinal-hippocampal replay

Precisely timed interactions between hippocampal and cortical neurons during replay epochs are thought to support learning. Indeed, research has shown that replay is associated with heightened hippocampal-cortical synchrony. Yet many caveats remain in our understanding. Namely, it remains unclear how this offline synchrony comes about, whether it is specific to particular behavioral states, and how-if at all-it relates to learning. In this study, we sought to address these questions by analyzing coordination between CA1 cells and neurons of the deep layers of the medial entorhinal cortex (dMEC) while rats learned a novel spatial task. During movement, we found a subset of dMEC cells that were particularly locked to hippocampal LFP theta-band oscillations and that were preferentially coordinated with hippocampal replay during offline periods. Further, dMEC synchrony with CA1 replay peaked ∼10 ms after replay initiation in CA1, suggesting that the distributed replay reflects extra-hippocampal information propagation and is specific to "offline" periods. Finally, theta-modulated dMEC cells showed a striking experience-dependent increase in synchronization with hippocampal replay trajectories, mirroring the animals' acquisition of the novel task and coupling to the hippocampal local field. Together, these findings provide strong support for the hypothesis that synergistic hippocampal-cortical replay supports learning and highlights phase locking to hippocampal theta oscillations as a potential mechanism by which such cross-structural synchrony comes about.

A scoping review of the relationship between alcohol, memory consolidation and ripple activity: An overview of common methodologies to analyse ripples

Alcohol abuse is not only responsible for 5.3% of the total deaths in the world but also has a substantial impact on neurological and memory disabilities throughout the population. One extensively studied brain area involved in cognitive functions is the hippocampus. Evidence in several rodent models has shown that ethanol produces cognitive impairment in hippocampal-dependent tasks and that the damage is varied according to the stage of development at which the rodent was exposed to ethanol and the dose. To the authors' knowledge, there is a biomarker for cognitive processes in the hippocampus that remains relatively understudied in association with memory impairment by alcohol administration. This biomarker is called sharp wave-ripples (SWRs) which are synchronous neuronal population events that are well known to be involved in memory consolidation. Methodologies for facilitated or automatic identification of ripples and their analysis have been reported for a wider bandwidth than SWRs. This review is focused on communicating the state of the art about the relationship between alcohol, memory consolidation and ripple activity, as well as the use of the common methodologies to identify SWRs automatically.

Hippocampal memory reactivation during sleep is correlated with specific cortical states of the retrosplenial and prefrontal cortices

Episodic memories are thought to be stabilized through the coordination of cortico-hippocampal activity during sleep. However, the timing and mechanism of this coordination remain unknown. To investigate this, we studied the relationship between hippocampal reactivation and slow-wave sleep up and down states of the retrosplenial cortex (RTC) and prefrontal cortex (PFC). We found that hippocampal reactivations are strongly correlated with specific cortical states. Reactivation occurred during sustained cortical Up states or during the transition from up to down state. Interestingly, the most prevalent interaction with memory reactivation in the hippocampus occurred during sustained up states of the PFC and RTC, while hippocampal reactivation and cortical up-to-down state transition in the RTC showed the strongest coordination. Reactivation usually occurred within 150-200 msec of a cortical Up state onset, indicating that a buildup of excitation during cortical Up state activity influences the probability of memory reactivation in CA1. Conversely, CA1 reactivation occurred 30-50 msec before the onset of a cortical down state, suggesting that memory reactivation affects down state initiation in the RTC and PFC, but the effect in the RTC was more robust. Our findings provide evidence that supports and highlights the complexity of bidirectional communication between cortical regions and the hippocampus during sleep.

Hippocampo-cortical circuits for selective memory encoding, routing, and replay

Traditionally considered a homogeneous cell type, hippocampal pyramidal cells have been recently shown to be highly diverse. However, how this cellular diversity relates to the different hippocampal network computations that support memory-guided behavior is not yet known. We show that the anatomical identity of pyramidal cells is a major organizing principle of CA1 assembly dynamics, the emergence of memory replay, and cortical projection patterns in rats. Segregated pyramidal cell subpopulations encoded trajectory and choice-specific information or tracked changes in reward configuration respectively, and their activity was selectively read out by different cortical targets. Furthermore, distinct hippocampo-cortical assemblies coordinated the reactivation of complementary memory representations. These findings reveal the existence of specialized hippocampo-cortical subcircuits and provide a cellular mechanism that supports the computational flexibility and memory capacities of these structures.

Progress on the hippocampal circuits and functions based on sharp wave ripples

Sharp wave ripples (SWRs) are high-frequency synchronization events generated by hippocampal neuronal circuits during various forms of learning and reactivated during memory consolidation and recall. There is mounting evidence that SWRs are essential for storing spatial and social memories in rodents and short-term episodic memories in humans. Sharp wave ripples originate mainly from the hippocampal CA3 and subiculum, and can be transmitted to modulate neuronal activity in cortical and subcortical regions for long-term memory consolidation and behavioral guidance. Different hippocampal subregions have distinct functions in learning and memory. For instance, the dorsal CA1 is critical for spatial navigation, episodic memory, and learning, while the ventral CA1 and dorsal CA2 may work cooperatively to store and consolidate social memories. Here, we summarize recent studies demonstrating that SWRs are essential for the consolidation of spatial, episodic, and social memories in various hippocampal-cortical pathways, and review evidence that SWR dysregulation contributes to cognitive impairments in neurodegenerative and neurodevelopmental diseases.

Hippocampal sharp wave-ripple dynamics in NREM sleep encode motivation for anticipated physical activity

Physical activity is an integral part of every mammal's daily life, and as a driver of Darwinian fitness, required coordinated evolution of the body and brain. The decision to engage in physical activity is driven either by survival needs or by motivation for the rewarding qualities of physical activity itself. Rodents exhibit innate and learned motivation for voluntary wheel running, and over time run longer and farther, reflecting increased incentive salience and motivation for this consummatory behavior. Dynamic coordination of neural and somatic physiology are necessary to ensure the ability to perform behaviors that are motivationally variable. Hippocampal sharp wave-ripples (SWRs) have evolved both cognitive and metabolic functions, which in modern mammals may facilitate body-brain coordination. To determine if SWRs encode aspects of exercise motivation we monitored hippocampal CA1 SWRs and running behaviors in adult mice, while manipulating the incentive salience of the running experience. During non-REM (NREM) sleep, the duration of SWRs before (but not after) running positively correlated with future running duration, and larger pyramidal cell assemblies were activated in longer SWRs, suggesting that the CA1 network encodes exercise motivation at the level of neuronal spiking dynamics. Inter-Ripple-intervals (IRI) before but not after running were negatively correlated with running duration, reflecting more SWR bursting, which increases with learning. In contrast, SWR rates before and after running were positively correlated with running duration, potentially reflecting a tuning of metabolic demand for that day's anticipated and actual energy expenditure rather than motivation. These results suggest a novel role for CA1 in exercise behaviors and specifically that cell assembly activity during SWRs encodes motivation for anticipated physical activity.

SIGNIFICANCE STATEMENT

Darwinian fitness is increased by body-brain coordination through internally generated motivation, though neural substrates are poorly understood. Specific hippocampal rhythms (i.e., CA1 SWRs), which have a well-established role in reward learning, action planning and memory consolidation, have also been shown to modulate systemic [glucose]. Using a mouse model of voluntary physical activity that requires body-brain coordination, we monitored SWR dynamics when animals were highly motivated and anticipated rewarding exercise (i.e., when body-brain coordination is of heightened importance). We found that during non-REM sleep before exercise, SWR dynamics (which reflect cognitive and metabolic functions) were correlated with future time spent exercising. This suggests that SWRs support cognitive and metabolic facets that motivate behavior by coordinating the body and brain.

Disrupting ripples: Methods, results, and caveats in closed-loop approaches in rodents

Hippocampal ripple oscillations have been associated with memory reactivations during wake and sleep. These reactivations should contribute to working memory and memory consolidation respectively. In the past decade studies have moved from being observational to actively disrupting ripple-related activity in closed-loop approaches to enable causal investigations into their function. All together these studies have been able to provide evidence that wake, task-related ripple activity is important for working memory and planning but less important for stabilisation of spatial representations. Rest and sleep-related ripple activity, in contrast, is important for long-term memory performance and thus memory consolidation. In this review, we summarise results from different closed-loop approaches in rodents. Further, we highlight differences in detection and stimulation methods as well as controls and discuss how these differences could influence outcomes.

Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition

Simultaneous localization and mapping (SLAM) represents a fundamental problem for autonomous embodied systems, for which the hippocampal/entorhinal system (H/E-S) has been optimized over the course of evolution. We have developed a biologically-inspired SLAM architecture based on latent variable generative modeling within the Free Energy Principle and Active Inference (FEP-AI) framework, which affords flexible navigation and planning in mobile robots. We have primarily focused on attempting to reverse engineer H/E-S "design" properties, but here we consider ways in which SLAM principles from robotics may help us better understand nervous systems and emergent minds. After reviewing LatentSLAM and notable features of this control architecture, we consider how the H/E-S may realize these functional properties not only for physical navigation, but also with respect to high-level cognition understood as generalized simultaneous localization and mapping (G-SLAM). We focus on loop-closure, graph-relaxation, and node duplication as particularly impactful architectural features, suggesting these computational phenomena may contribute to understanding cognitive insight (as proto-causal-inference), accommodation (as integration into existing schemas), and assimilation (as category formation). All these operations can similarly be describable in terms of structure/category learning on multiple levels of abstraction. However, here we adopt an ecological rationality perspective, framing H/E-S functions as orchestrating SLAM processes within both concrete and abstract hypothesis spaces. In this navigation/search process, adaptive cognitive equilibration between assimilation and accommodation involves balancing tradeoffs between exploration and exploitation; this dynamic equilibrium may be near optimally realized in FEP-AI, wherein control systems governed by expected free energy objective functions naturally balance model simplicity and accuracy. With respect to structure learning, such a balance would involve constructing models and categories that are neither too inclusive nor exclusive. We propose these (generalized) SLAM phenomena may represent some of the most impactful sources of variation in cognition both within and between individuals, suggesting that modulators of H/E-S functioning may potentially illuminate their adaptive significances as fundamental cybernetic control parameters. Finally, we discuss how understanding H/E-S contributions to G-SLAM may provide a unifying framework for high-level cognition and its potential realization in artificial intelligences.

Replay, the default mode network and the cascaded memory systems model

The spontaneous replay of patterns of activity related to past experiences and memories is a striking feature of brain activity, as is the coherent activation of sets of brain areas - particularly those comprising the default mode network (DMN) - during rest. We propose that these two phenomena are strongly intertwined and that their potential functions overlap. In the 'cascaded memory systems model' that we outline here, we hypothesize that the DMN forms the backbone for the propagation of replay, mediating interactions between the hippocampus and the neocortex that enable the consolidation of new memories. The DMN may also independently ignite replay cascades, which support reactivation of older memories or high-level semantic representations. We suggest that transient cortical activations, inducing long-range correlations across the neocortex, are a key mechanism supporting a hierarchy of representations that progresses from simple percepts to semantic representations of causes and, finally, to whole episodes.

Inhibition allocates spikes during hippocampal ripples

Sets of spikes emitted sequentially across neurons constitute fundamental pulse packets in neural information processing, including offline memory replay during hippocampal sharp-wave ripples (SWRs). The relative timing of neuronal spikes is fine-tuned in each spike sequence but can vary between different sequences. However, the microcircuitry mechanism that enables such flexible spike sequencing remains unexplored. We recorded the membrane potentials of multiple hippocampal CA1 pyramidal cells in mice and found that the neurons were transiently hyperpolarized prior to SWRs. The pre-SWR hyperpolarizations were spatiotemporally heterogeneous, and larger hyperpolarizations were associated with later spikes during SWRs. Intracellular blockade of Cl--mediated inhibition reduced pre-SWR hyperpolarizations and advanced spike times. Single-unit recordings also revealed that the pre-SWR firing rates of inhibitory interneurons predicted the SWR-relevant spike times of pyramidal cells. Thus, pre-SWR inhibitory activity determines the sequential spike times of pyramidal cells and diversifies the repertoire of sequence patterns.

An update to Hippocampome.org by integrating single-cell phenotypes with circuit function in vivo

Understanding brain operation demands linking basic behavioral traits to cell-type specific dynamics of different brain-wide subcircuits. This requires a system to classify the basic operational modes of neurons and circuits. Single-cell phenotyping of firing behavior during ongoing oscillations in vivo has provided a large body of evidence on entorhinal-hippocampal function, but data are dispersed and diverse. Here, we mined literature to search for information regarding the phase-timing dynamics of over 100 hippocampal/entorhinal neuron types defined in Hippocampome.org. We identified missing and unresolved pieces of knowledge (e.g., the preferred theta phase for a specific neuron type) and complemented the dataset with our own new data. By confronting the effect of brain state and recording methods, we highlight the equivalences and differences across conditions and offer a number of novel observations. We show how a heuristic approach based on oscillatory features of morphologically identified neurons can aid in classifying extracellular recordings of single cells and discuss future opportunities and challenges towards integrating single-cell phenotypes with circuit function.

Alterations of Neuronal Dynamics as a Mechanism for Cognitive Impairment in Epilepsy

Epilepsy is commonly associated with cognitive and behavioral deficits that dramatically affect the quality of life of patients. In order to identify novel therapeutic strategies aimed at reducing these deficits, it is critical first to understand the mechanisms leading to cognitive impairments in epilepsy. Traditionally, seizures and epileptiform activity in addition to neuronal injury have been considered to be the most significant contributors to cognitive dysfunction. In this review we however highlight the role of a new mechanism: alterations of neuronal dynamics, i.e. the timing at which neurons and networks receive and process neural information. These alterations, caused by the underlying etiologies of epilepsy syndromes, are observed in both animal models and patients in the form of abnormal oscillation patterns in unit firing, local field potentials, and electroencephalogram (EEG). Evidence suggests that such mechanisms significantly contribute to cognitive impairment in epilepsy, independently of seizures and interictal epileptiform activity. Therefore, therapeutic strategies directly targeting neuronal dynamics rather than seizure reduction may significantly benefit the quality of life of patients.

Memories replayed: reactivating past successes and new dilemmas

Our experiences continue to be processed 'offline' in the ensuing hours of both wakefulness and sleep. During these different brain states, the memory formed during our experience is replayed or reactivated. Here, we discuss the unique challenges in studying offline reactivation, the growth in both the experimental and analytical techniques available across different animals from rodents to humans to capture these offline events, the important challenges this innovation has brought, our still modest understanding of how reactivation drives diverse synaptic changes across circuits, and how these changes differ (if at all), and perhaps complement, those at memory formation. Together, these discussions highlight critical emerging issues vital for identifying how reactivation affects circuits, and, in turn, behaviour, and provides a broader context for the contributions in this special issue. This article is part of the Theo Murphy meeting issue 'Memory reactivation: replaying events past, present and future'.