Spatial Memory Sequence Encoding and Replay During Modeled Theta and Ripple Oscillations

CA3 Circuit Model Compressing Sequential Information in Theta Oscillation and Replay

The hippocampus plays a critical role in the compression and retrieval of sequential information. During wakefulness, it achieves this through theta phase precession and theta sequences. Subsequently, during periods of sleep or rest, the compressed information reactivates through sharp-wave ripple events, manifesting as memory replay. However, how these sequential neuronal activities are generated and how they store information about the external environment remain unknown. We developed a hippocampal cornu ammonis 3 (CA3) computational model based on anatomical and electrophysiological evidence from the biological CA3 circuit to address these questions. The model comprises theta rhythm inhibition, place input, and CA3-CA3 plastic recurrent connection. The model can compress the sequence of the external inputs, reproduce theta phase precession and replay, learn additional sequences, and reorganize previously learned sequences. A gradual increase in synaptic inputs, controlled by interactions between theta-paced inhibition and place inputs, explained the mechanism of sequence acquisition. This model highlights the crucial role of plasticity in the CA3 recurrent connection and theta oscillational dynamics and hypothesizes how the CA3 circuit acquires, compresses, and replays sequential information.

Sensory representation of visual stimuli in the coupling of low-frequency phase to spike times

Neural synchronization has been engaged in several brain mechanisms. Previous studies have shown that the interaction between the time of spiking activity and phase of local field potentials (LFPs) plays a key role in many cognitive functions. However, the potential role of this spike-LFP phase coupling (SPC) in neural coding is not fully understood. Here, we sought to investigate the role of this SPC for encoding the sensory properties of visual stimuli. To this end, we measured SPC strength in the preferred and anti-preferred motion directions of stimulus presented inside the receptive field of middle temporal (MT) neurons. We found a selective response in terms of SPC strength for different directions of motion. Remarkably, this selective function is inverted with respect to the spiking activity. In other words, the least SPC occurs for the preferred direction (based on the spike rate), and vice versa; the strongest SPC is induced in the anti-preferred direction. Altogether, these findings imply that the neural system may use spike-LFP phase coupling in the primate visual cortex to encode sensory information.

Measuring Synchronization between Spikes and Local Field Potential Based on the Kullback-Leibler Divergence

Neurophysiological studies have shown that there is a close relationship between spikes and local field potential (LFP), which reflects crucial neural coding information. In this paper, we used a new method to evaluate the synchronization between spikes and LFP. All possible phases of LFP from −π to π were first binned into a freely chosen number of bins; then, the probability of spikes falling in each bin was calculated, and the deviation degree from the uniform distribution based on the Kullback–Leibler divergence was calculated to define the synchronization between spikes and LFP. The simulation results demonstrate that the method is rapid, basically unaffected by the total number of spikes, and can adequately resist the noise of spike trains. We applied this method to the experimental data of patients with intractable epilepsy, and we observed the synchronization between spikes and LFP in the formation of memory. These results show that our proposed method is a powerful tool that can quantitatively measure the synchronization between spikes and LFP.

Adaptation Modulates Spike-Phase Coupling Tuning Curve in the Rat Primary Auditory Cortex

Adaptation is an important mechanism that causes a decrease in the neural response both in terms of local field potentials (LFP) and spiking activity. We previously showed this reduction effect in the tuning curve of the primary auditory cortex. Moreover, we revealed that a repeated stimulus reduces the neural response in terms of spike-phase coupling (SPC). In the current study, we examined the effect of adaptation on the SPC tuning curve. To this end, employing the phase-locking value (PLV) method, we estimated the spike-LFP coupling. The data was obtained by a simultaneous recording from four single-electrodes in the primary auditory cortex of 15 rats. We first investigated whether the neural system may use spike-LFP phase coupling in the primary auditory cortex to encode sensory information. Secondly, we investigated the effect of adaptation on this potential SPC tuning. Our data showed that the coupling between spikes’ times and the LFP phase in beta oscillations represents sensory information (different stimulus frequencies), with an inverted bell-shaped tuning curve. Furthermore, we showed that adaptation to a specific frequency modulates SPC tuning curve of the adapter and its neighboring frequencies. These findings could be useful for interpretation of feature representation in terms of SPC and the underlying neural mechanism of adaptation.

Mechanisms of neural organization and rhythmogenesis during hippocampal and cortical ripples

Neural activity during ripples has attracted great theoretical and experimental attention over the last three decades. Perhaps one reason for such interest is that ripples occur during quiet waking moments and during sleep, times when we reflect and dream about what has just occurred and what we expect to happen next. The hope is that understanding such 'offline' activity may yield insights into reflection, planning, and the purposes of sleep. This review focuses on the mechanisms by which neurons organize during these high-frequency events. In studying ripples, broader principles have emerged that relate intrinsic neural properties, network topology and synaptic plasticity in controlling neural activity. Ripples, therefore, serve as an excellent model for studying how properties of a neural network relate to neural dynamics. This article is part of the Theo Murphy meeting issue 'Memory reactivation: replaying events past, present and future'.

Modeling awake hippocampal reactivations with model-based bidirectional search

Hippocampal offline reactivations during reward-based learning, usually categorized as replay events, have been found to be important for performance improvement over time and for memory consolidation. Recent computational work has linked these phenomena to the need to transform reward information into state-action values for decision making and to propagate it to all relevant states of the environment. Nevertheless, it is still unclear whether an integrated reinforcement learning mechanism could account for the variety of awake hippocampal reactivations, including variety in order (forward and reverse reactivated trajectories) and variety in the location where they occur (reward site or decision-point). Here, we present a model-based bidirectional search model which accounts for a variety of hippocampal reactivations. The model combines forward trajectory sampling from current position and backward sampling through prioritized sweeping from states associated with large reward prediction errors until the two trajectories connect. This is repeated until stabilization of state-action values (convergence), which could explain why hippocampal reactivations drastically diminish when the animal's performance stabilizes. Simulations in a multiple T-maze task show that forward reactivations are prominently found at decision-points while backward reactivations are exclusively generated at reward sites. Finally, the model can generate imaginary trajectories that are not allowed to the agent during task performance. We raise some experimental predictions and implications for future studies of the role of the hippocampo-prefronto-striatal network in learning.

Hippocampal-Cortical Memory Trace Transfer and Reactivation Through Cell-Specific Stimulus and Spontaneous Background Noise

The hippocampus plays important roles in memory formation and retrieval through sharp-wave-ripples. Recent studies have shown that certain neuron populations in the prefrontal cortex (PFC) exhibit coordinated reactivations during awake ripple events. These experimental findings suggest that the awake ripple is an important biomarker, through which the hippocampus interacts with the neocortex to assist memory formation and retrieval. However, the computational mechanisms of this ripple based hippocampal-cortical coordination are still not clear due to the lack of unified models that include both the hippocampal and cortical networks. In this work, using a coupled biophysical model of both CA1 and PFC, we investigate possible mechanisms of hippocampal-cortical memory trace transfer and the conditions that assist reactivation of the transferred memory traces in the PFC. To validate our model, we first show that the local field potentials generated in the hippocampus and PFC exhibit ripple range activities that are consistent with the recent experimental studies. Then we demonstrate that during ripples, sequence replays can successfully transfer the information stored in the hippocampus to the PFC recurrent networks. We investigate possible mechanisms of memory retrieval in PFC networks. Our results suggest that the stored memory traces in the PFC network can be retrieved through two different mechanisms, namely the cell-specific input representing external stimuli and non-specific spontaneous background noise representing spontaneous memory recall events. Importantly, in both cases, the memory reactivation quality is robust to network connection loss. Finally, we find out that the quality of sequence reactivations is enhanced by both increased number of SWRs and an optimal background noise intensity, which tunes the excitability of neurons to a proper level. Our study presents a mechanistic explanation for the memory trace transfer from the hippocampus to neocortex through ripple coupling in awake states and reports two different mechanisms by which the stored memory traces can be successfully retrieved.

Theta-modulation drives the emergence of connectivity patterns underlying replay in a network model of place cells

Place cells of the rodent hippocampus fire action potentials when the animal traverses a particular spatial location in any environment. Therefore for any given trajectory one observes a repeatable sequence of place cell activations. When the animal is quiescent or sleeping, one can observe similar sequences of activation known as replay, which underlie the process of memory consolidation. However, it remains unclear how replay is generated. Here we show how a temporally asymmetric plasticity rule during spatial exploration gives rise to spontaneous replay in a model network by shaping the recurrent connectivity to reflect the topology of the learned environment. Crucially, the rate of this encoding is strongly modulated by ongoing rhythms. Oscillations in the theta range optimize learning by generating repeated pre-post pairings on a time-scale commensurate with the window for plasticity, while lower and higher frequencies generate learning rates which are lower by orders of magnitude.

Circuit mechanisms of hippocampal reactivation during sleep

The hippocampus is important for memory and learning, being a brain site where initial memories are formed and where sharp wave - ripples (SWR) are found, which are responsible for mapping recent memories to long-term storage during sleep-related memory replay. While this conceptual schema is well established, specific intrinsic and network-level mechanisms driving spatio-temporal patterns of hippocampal activity during sleep, and specifically controlling off-line memory reactivation are unknown. In this study, we discuss a model of hippocampal CA1-CA3 network generating spontaneous characteristic SWR activity. Our study predicts the properties of CA3 input which are necessary for successful CA1 ripple generation and the role of synaptic interactions and intrinsic excitability in spike sequence replay during SWRs. Specifically, we found that excitatory synaptic connections promote reactivation in both CA3 and CA1, but the different dynamics of sharp waves in CA3 and ripples in CA1 result in a differential role for synaptic inhibition in modulating replay: promoting spike sequence specificity in CA3 but not in CA1 areas. Finally, we describe how awake learning of spatial trajectories leads to synaptic changes sufficient to drive hippocampal cells' reactivation during sleep, as required for sleep-related memory consolidation.

Hippocampal CA1 Ripples as Inhibitory Transients

Memories are stored and consolidated as a result of a dialogue between the hippocampus and cortex during sleep. Neurons active during behavior reactivate in both structures during sleep, in conjunction with characteristic brain oscillations that may form the neural substrate of memory consolidation. In the hippocampus, replay occurs within sharp wave-ripples: short bouts of high-frequency activity in area CA1 caused by excitatory activation from area CA3. In this work, we develop a computational model of ripple generation, motivated by in vivo rat data showing that ripples have a broad frequency distribution, exponential inter-arrival times and yet highly non-variable durations. Our study predicts that ripples are not persistent oscillations but result from a transient network behavior, induced by input from CA3, in which the high frequency synchronous firing of perisomatic interneurons does not depend on the time scale of synaptic inhibition. We found that noise-induced loss of synchrony among CA1 interneurons dynamically constrains individual ripple duration. Our study proposes a novel mechanism of hippocampal ripple generation consistent with a broad range of experimental data, and highlights the role of noise in regulating the duration of input-driven oscillatory spiking in an inhibitory network.

Our memories are consolidated while we sleep through a bidirectional exchange of information between two brain areas called cortex and hippocampus. Neurons that were active in behavioral tasks reactivate again in both structures during sleep in a process of linking and modifying memories from the short term storage of the hippocampus to permanent storage in the neocortex. This process occurs mainly during short oscillatory hippocampal electrical events called sharp wave-ripples. We propose a novel mechanism of ripple generation consistent with a wide range of experimental data, to explain how hippocampal network properties shape ripple frequency and duration. Understanding the neuronal mechanism underlying ripples is crucial to explaining how the interaction between hippocampus and cortex during sleep enables memory consolidation.

Memory trace replay: the shaping of memory consolidation by neuromodulation

The consolidation of memories for places and events is thought to rely, at the network level, on the replay of spatially tuned neuronal firing patterns representing discrete places and spatial trajectories. This occurs in the hippocampal-entorhinal circuit during sharp wave ripple events (SWRs) that occur during sleep or rest. Here, we review theoretical models of lingering place cell excitability and behaviorally induced synaptic plasticity within cell assemblies to explain which sequences or places are replayed. We further provide new insights into how fluctuations in cholinergic tone during different behavioral states might shape the direction of replay and how dopaminergic release in response to novelty or reward can modulate which cell assemblies are replayed.

Transition between encoding and consolidation/replay dynamics via cholinergic modulation of CAN current: A modeling study

Hippocampal place cells that are activated sequentially during active waking get reactivated in a temporally compressed (5-20 times) manner during slow-wave-sleep and quiet waking. The two-stage model of the hippocampus suggests that neural activity during awaking supports encoding function while temporally compressed reactivation (replay) supports consolidation. However, the mechanisms supporting different neural activity with different temporal scales during encoding and consolidation remain unclear. Based on the idea that acetylcholine modulates functional transition between encoding and consolidation, we tested whether the cholinergic modulation may adjust intrinsic network dynamics to support different temporal scales for these two modes of operation. Simulations demonstrate that cholinergic modulation of the calcium activated non-specific cationic (CAN) current and the synaptic transmission may be sufficient to switch the network dynamics between encoding and consolidation modes. When the CAN current is active and the synaptic transmission is suppressed, mimicking the high acetylcholine condition during active waking, a slow propagation of multiple spikes is evident. This activity resembles the firing pattern of place cells and time cells during active waking. On the other hand, when CAN current is suppressed and the synaptic transmission is intact, mimicking the low acetylcholine condition during slow-wave-sleep, a time compressed fast (∼10 times) activity propagation of the same set of cells is evident. This activity resembles the time compressed firing pattern of place cells during replay and pre-play, achieving a temporal compression factor in the range observed in vivo (5-20 times). These observations suggest that cholinergic system could adjust intrinsic network dynamics suitable for encoding and consolidation through the modulation of the CAN current and synaptic conductance in the hippocampus.

A bayesian model of polychronicity

A significant feature of spiking neural networks with varying connection delays, such as those in the brain, is the existence of strongly connected groups of neurons known as polychronous neural groups (PNGs). Polychronous groups are found in large numbers in these networks and are proposed by Izhikevich (2006a) to provide a neural basis for representation and memory. When exposed to a familiar stimulus, spiking neural networks produce consistencies in the spiking output data that are the hallmarks of PNG activation. Previous methods for studying the PNG activation response to stimuli have been limited by the template-based methods used to identify PNG activation. In this letter, we outline a new method that overcomes these difficulties by establishing for the first time a probabilistic interpretation of PNG activation. We then demonstrate the use of this method by investigating the claim that PNGs might provide the foundation of a representational system.