Temporal context and latent state inference in the hippocampal splitter signal

Error-driven changes in hippocampal representations accompany flexible re-learning

Flexible behavior requires both the learning of new associations, and the suppression of previous ones, but how neural circuits achieve this balance remains unclear. Here we show that continuous changes in hippocampal representations, known as drift, may facilitate this process. We used voluntary head-fixation and calcium imaging to record from CA1 in rats during an odor-guided navigation task that required frequent re-learning. We found systematic representational changes over the course of the multi-hour sessions that were increased following errors. A simple neural network model revealed that such error-driven drift can enable flexible re-learning by allowing new associations to form from new neural patterns. A consequence of this is that previous associations are maintained in latent synaptic weights. These findings reconcile the apparent tension between representational drift and stable memory storage, demonstrating how dynamic neural codes could support both flexible behavior and lasting memories.

Hippocampal output suppresses orbitofrontal cortex schema cell formation

Both the orbitofrontal cortex (OFC) and the hippocampus (HC) are implicated in the formation of cognitive maps and their generalization into schemas. However, how these areas interact in supporting this function remains unclear, with some proposals supporting a serial model in which the OFC draws on task representations created by the HC to extract key behavioral features and others suggesting a parallel model in which both regions construct representations that highlight different types of information. In the present study, we tested between these two models by asking how schema correlates in rat OFC would be affected by inactivating the output of the HC, after learning and during transfer across problems. We found that the prevalence and content of schema correlates were unaffected by inactivating one major HC output area, the ventral subiculum, after learning, whereas inactivation during transfer accelerated their formation. These results favor the proposal that the OFC and HC operate in parallel to extract different features defining cognitive maps and schemas.

A Hippocampal-Parietal Network for Reference Frame Coordination

Navigating space and forming memories based on spatial experience are crucial for survival, including storing memories in an allocentric (map-like) framework and conversion into egocentric (body-centered) action. The hippocampus and parietal cortex (PC) comprise a network for coordinating these reference frames, though the mechanism remains unclear. We used a task requiring remembering previous spatial locations to make correct future action and observed that hippocampus can encode the allocentric place, while PC encodes upcoming actions and relays this to hippocampus. Transformation from location to action unfolds gradually, with "Came From" signals diminishing and future action representations strengthening. PC sometimes encodes previous spatial locations in a route-based reference frame and conveys this to hippocampus. The signal for the future location appears first in PC, and then in hippocampus, in the form of an egocentric direction of future goal locations, suggesting egocentric encoding recently observed in hippocampus may originate in PC (or another "upstream" structure). Bidirectional signaling is apparent between PC and hippocampus and suggests a coordinated mechanism for integrating allocentric, route-centered, and egocentric spatial reference frames at the network level during navigation.

Hidden state inference requires abstract contextual representations in the ventral hippocampus

The ability to use subjective, latent contextual representations to influence decision-making is crucial for everyday life. The hippocampus is hypothesized to bind together otherwise abstract combinations of stimuli to represent such latent contexts, to support the process of hidden state inference. Yet evidence for a role of the hippocampus in hidden state inference remains limited. We found that the ventral hippocampus is required for mice to perform hidden state inference during a two-armed bandit task. Hippocampal neurons differentiate the two abstract contexts required for this strategy in a manner similar to the differentiation of spatial locations, and their activity is essential for appropriate dopamine dynamics. These findings offer insight into how latent contextual information is used to optimize decisions, and they emphasize a key role for the hippocampus in hidden state inference.

Parallel maturation of rodent hippocampal memory and CA1 task representations

Hippocampal-dependent memory is known to emerge late in ontogeny, and its full development is protracted. Yet the changes in hippocampal neuronal function that underlie this delayed and gradual maturation remain relatively unexplored. To address this gap, we recorded ensembles of CA1 neurons while charting the development of hippocampal-dependent spatial working memory (WM) in rat pups (∼2-4 weeks of age). We found a sharp transition in WM development, with age of inflection varying considerably between individual animals. In parallel with the sudden emergence of WM, hippocampal spatial representations became abruptly task specific, remapping between encoding and retrieval phases of the task. Further, we show how the development of task-phase remapping could partly be explained by changes in place-field size during this developmental period as well as the onset of precise temporal coordination of CA1 excitatory input. Together, these results suggest that a hallmark of hippocampal memory development may be the emergence of contextually specific CA1 representations driven by the maturation of CA1 micro-circuits.

Coordinated Interactions between the Hippocampus and Retrosplenial Cortex in Spatial Memory

While a hippocampal-cortical dialogue is generally thought to mediate memory consolidation, which is crucial for engram function, how it works remains largely unknown. Here, we examined the interplay of neural signals from the retrosplenial cortex (RSC), a neocortical region, and from the hippocampus in memory consolidation by simultaneously recording sharp-wave ripples (SWRs) of dorsal hippocampal CA1 and neural signals of RSC in free-moving mice during the delayed spatial alternation task (DSAT) and subsequent sleep. Hippocampal-RSC coordination during SWRs was identified in nonrapid eye movement (NREM) sleep, reflecting neural reactivation of decision-making in the task, as shown by a peak reactivation strength within SWRs. Using modified generalized linear models (GLMs), we traced information flow through the RSC-CA1-RSC circuit around SWRs during sleep following DSAT. Our findings show that after spatial training, RSC excitatory neurons typically increase CA1 activity prior to hippocampal SWRs, potentially initiating hippocampal memory replay, while inhibitory neurons are activated by hippocampal outputs in post-SWRs. We further identified certain excitatory neurons in the RSC that encoded spatial information related to the DSAT. These neurons, classified as splitters and location-related cells, showed varied responses to hippocampal SWRs. Overall, our study highlights the complex dynamics between the RSC and hippocampal CA1 region during SWRs in NREM sleep, underscoring their critical interplay in spatial memory consolidation.

Integration of rate and phase codes by hippocampal cell-assemblies supports flexible encoding of spatiotemporal context

Spatial information is encoded by location-dependent hippocampal place cell firing rates and sub-second, rhythmic entrainment of spike times. These rate and temporal codes have primarily been characterized in low-dimensional environments under limited cognitive demands; but how is coding configured in complex environments when individual place cells signal several locations, individual locations contribute to multiple routes and functional demands vary? Quantifying CA1 population dynamics of male rats during a decision-making task, here we show that the phase of individual place cells' spikes relative to the local theta rhythm shifts to differentiate activity in different place fields. Theta phase coding also disambiguates repeated visits to the same location during different routes, particularly preceding spatial decisions. Using unsupervised detection of cell assemblies alongside theoretical simulation, we show that integrating rate and phase coding mechanisms dynamically recruits units to different assemblies, generating spiking sequences that disambiguate episodes of experience and multiplexing spatial information with cognitive context.

Expectancy-related changes in firing of dopamine neurons depend on hippocampus

The orbitofrontal cortex (OFC) and hippocampus (HC) both contribute to the cognitive maps that support flexible behavior. Previously, we used the dopamine neurons to measure the functional role of OFC. We recorded midbrain dopamine neurons as rats performed an odor-based choice task, in which expected rewards were manipulated across blocks. We found that ipsilateral OFC lesions degraded dopaminergic prediction errors, consistent with reduced resolution of the task states. Here we have repeated this experiment in male rats with ipsilateral HC lesions. The results show HC also shapes the task states, however unlike OFC, which provides information local to the trial, the HC is necessary for estimating upper-level hidden states that distinguish blocks. The results contrast the roles of the OFC and HC in cognitive mapping and suggest that the dopamine neurons access rich information from distributed regions regarding the environment's structure, potentially enabling this teaching signal to support complex behaviors.

Learning temporal relationships between symbols with Laplace Neural Manifolds

Firing across populations of neurons in many regions of the mammalian brain maintains a temporal memory, a neural timeline of the recent past. Behavioral results demonstrate that people can both remember the past and anticipate the future over an analogous internal timeline. This paper presents a mathematical framework for building this timeline of the future. We assume that the input to the system is a time series of symbols-sparse tokenized representations of the present-in continuous time. The goal is to record pairwise temporal relationships between symbols over a wide range of time scales. We assume that the brain has access to a temporal memory in the form of the real Laplace transform. Hebbian associations with a diversity of synaptic time scales are formed between the past timeline and the present symbol. The associative memory stores the convolution between the past and the present. Knowing the temporal relationship between the past and the present allows one to infer relationships between the present and the future. With appropriate normalization, this Hebbian associative matrix can store a Laplace successor representation and a Laplace predecessor representation from which measures of temporal contingency can be evaluated. The diversity of synaptic time constants allows for learning of non-stationary statistics as well as joint statistics between triplets of symbols. This framework synthesizes a number of recent neuroscientific findings including results from dopamine neurons in the mesolimbic forebrain.

The homogenous hippocampus: How hippocampal cells process available and potential goals

We present here a view of the firing patterns of hippocampal cells that is contrary, both functionally and anatomically, to conventional wisdom. We argue that the hippocampus responds to efference copies of goals encoded elsewhere; and that it uses these to detect and resolve conflict or interference between goals in general. While goals can involve space, hippocampal cells do not encode spatial (or other special types of) memory, as such. We also argue that the transverse circuits of the hippocampus operate in an essentially homogeneous way along its length. The apparently different functions of different parts (e.g. memory retrieval versus anxiety) result from the different (situational/motivational) inputs on which those parts perform the same fundamental computational operations. On this view, the key role of the hippocampus is the iterative adjustment, via Papez-like circuits, of synaptic weights in cell assemblies elsewhere.

Hippocampal and orbitofrontal neurons contribute to complementary aspects of associative structure

The ability to establish associations between environmental stimuli is fundamental for higher-order brain functions like state inference and generalization. Both the hippocampus and orbitofrontal cortex (OFC) play pivotal roles in this, demonstrating complex neural activity changes after associative learning. However, how precisely they contribute to representing learned associations remains unclear. Here, we train head-restrained mice to learn four 'odor-outcome' sequence pairs composed of several task variables-the past and current odor cues, sequence structure of 'cue-outcome' arrangement, and the expected outcome; and perform calcium imaging from these mice throughout learning. Sequence-splitting signals that distinguish between paired sequences are detected in both brain regions, reflecting associative memory formation. Critically, we uncover differential contents in represented associations by examining, in each area, how these task variables affect splitting signal generalization between sequence pairs. Specifically, the hippocampal splitting signals are influenced by the combination of past and current cues that define a particular sensory experience. In contrast, the OFC splitting signals are similar between sequence pairs that share the same sequence structure and expected outcome. These findings suggest that the hippocampus and OFC uniquely and complementarily organize the acquired associative structure.

Paradoxical replay can protect contextual task representations from destructive interference when experience is unbalanced

Experience replay is a powerful mechanism to learn efficiently from limited experience. Despite several decades of compelling experimental results, the factors that determine which experiences are selected for replay remain unclear. A particular challenge for current theories is that on tasks that feature unbalanced experience, rats paradoxically replay the less-experienced trajectory. To understand why, we simulated a feedforward neural network with two regimes: rich learning (structured representations tailored to task demands) and lazy learning (unstructured, task-agnostic representations). Rich, but not lazy, representations degraded following unbalanced experience, an effect that could be reversed with paradoxical replay. To test if this computational principle can account for the experimental data, we examined the relationship between paradoxical replay and learned task representations in the rat hippocampus. Strikingly, we found a strong association between the richness of learned task representations and the paradoxicality of replay. Taken together, these results suggest that paradoxical replay specifically serves to protect rich representations from the destructive effects of unbalanced experience, and more generally demonstrate a novel interaction between the nature of task representations and the function of replay in artificial and biological systems.

Working memory features are embedded in hippocampal place fields

Hippocampal principal neurons display both spatial tuning properties and memory features. Whether this distinction corresponds to separate neuron types or a context-dependent continuum has been debated. We report here that the task-context ("splitter") feature is highly variable along both trial and spatial position axes. Neurons acquire or lose splitter features across trials even when place field features remain unaltered. Multiple place fields of the same neuron can individually encode both past or future run trajectories, implying that splitter fields are under the control of assembly activity. Place fields can be differentiated into subfields by the behavioral choice of the animal, and splitting within subfields evolves across trials. Interneurons also differentiate choices by integrating inputs from pyramidal cells. Finally, bilateral optogenetic inactivation of the medial entorhinal cortex reversibly decreases the fraction of splitter fields. Our findings suggest that place or splitter features are different manifestations of the same hippocampal computation.

Latent representations in hippocampal network model co-evolve with behavioral exploration of task structure

To successfully learn real-life behavioral tasks, animals must pair actions or decisions to the task's complex structure, which can depend on abstract combinations of sensory stimuli and internal logic. The hippocampus is known to develop representations of this complex structure, forming a so-called "cognitive map". However, the precise biophysical mechanisms driving the emergence of task-relevant maps at the population level remain unclear. We propose a model in which plateau-based learning at the single cell level, combined with reinforcement learning in an agent, leads to latent representational structures codependently evolving with behavior in a task-specific manner. In agreement with recent experimental data, we show that the model successfully develops latent structures essential for task-solving (cue-dependent "splitters") while excluding irrelevant ones. Finally, our model makes testable predictions concerning the co-dependent interactions between split representations and split behavioral policy during their evolution.

Distinguishing examples while building concepts in hippocampal and artificial networks

The hippocampal subfield CA3 is thought to function as an auto-associative network that stores experiences as memories. Information from these experiences arrives directly from the entorhinal cortex as well as indirectly through the dentate gyrus, which performs sparsification and decorrelation. The computational purpose for these dual input pathways has not been firmly established. We model CA3 as a Hopfield-like network that stores both dense, correlated encodings and sparse, decorrelated encodings. As more memories are stored, the former merge along shared features while the latter remain distinct. We verify our model's prediction in rat CA3 place cells, which exhibit more distinct tuning during theta phases with sparser activity. Finally, we find that neural networks trained in multitask learning benefit from a loss term that promotes both correlated and decorrelated representations. Thus, the complementary encodings we have found in CA3 can provide broad computational advantages for solving complex tasks.

Localized APP expression results in progressive network dysfunction by disorganizing spike timing

Progressive cognitive decline in Alzheimer's disease could either be caused by a spreading molecular pathology or by an initially focal pathology that causes aberrant neuronal activity in a larger network. To distinguish between these possibilities, we generated a mouse model with expression of mutant human amyloid precursor protein (APP) in only hippocampal CA3 cells. We found that performance in a hippocampus-dependent memory task was impaired in young adult and aged mutant mice. In both age groups, we then recorded from the CA1 region, which receives inputs from APP-expressing CA3 cells. We observed that theta oscillation frequency in CA1 was reduced along with disrupted relative timing of principal cells. Highly localized pathology limited to the presynaptic CA3 cells is thus sufficient to cause aberrant firing patterns in postsynaptic neuronal networks, which indicates that disease progression is not only from spreading pathology but also mediated by progressively advancing physiological dysfunction.

Accounting for multiscale processing in adaptive real-world decision-making via the hippocampus

For adaptive real-time behavior in real-world contexts, the brain needs to allow past information over multiple timescales to influence current processing for making choices that create the best outcome as a person goes about making choices in their everyday life. The neuroeconomics literature on value-based decision-making has formalized such choice through reinforcement learning models for two extreme strategies. These strategies are model-free (MF), which is an automatic, stimulus-response type of action, and model-based (MB), which bases choice on cognitive representations of the world and causal inference on environment-behavior structure. The emphasis of examining the neural substrates of value-based decision making has been on the striatum and prefrontal regions, especially with regards to the "here and now" decision-making. Yet, such a dichotomy does not embrace all the dynamic complexity involved. In addition, despite robust research on the role of the hippocampus in memory and spatial learning, its contribution to value-based decision making is just starting to be explored. This paper aims to better appreciate the role of the hippocampus in decision-making and advance the successor representation (SR) as a candidate mechanism for encoding state representations in the hippocampus, separate from reward representations. To this end, we review research that relates hippocampal sequences to SR models showing that the implementation of such sequences in reinforcement learning agents improves their performance. This also enables the agents to perform multiscale temporal processing in a biologically plausible manner. Altogether, we articulate a framework to advance current striatal and prefrontal-focused decision making to better account for multiscale mechanisms underlying various real-world time-related concepts such as the self that cumulates over a person's life course.

Linking temporal coordination of hippocampal activity to memory function

Oscillations in neural activity are widespread throughout the brain and can be observed at the population level through the local field potential. These rhythmic patterns are associated with cycles of excitability and are thought to coordinate networks of neurons, in turn facilitating effective communication both within local circuits and across brain regions. In the hippocampus, theta rhythms (4-12 Hz) could contribute to several key physiological mechanisms including long-range synchrony, plasticity, and at the behavioral scale, support memory encoding and retrieval. While neurons in the hippocampus appear to be temporally coordinated by theta oscillations, they also tend to fire in sequences that are developmentally preconfigured. Although loss of theta rhythmicity impairs memory, these sequences of spatiotemporal representations persist in conditions of altered hippocampal oscillations. The focus of this review is to disentangle the relative contribution of hippocampal oscillations from single-neuron activity in learning and memory. We first review cellular, anatomical, and physiological mechanisms underlying the generation and maintenance of hippocampal rhythms and how they contribute to memory function. We propose candidate hypotheses for how septohippocampal oscillations could support memory function while not contributing directly to hippocampal sequences. In particular, we explore how theta rhythms could coordinate the integration of upstream signals in the hippocampus to form future decisions, the relevance of such integration to downstream regions, as well as setting the stage for behavioral timescale synaptic plasticity. Finally, we leverage stimulation-based treatment in Alzheimer's disease conditions as an opportunity to assess the sufficiency of hippocampal oscillations for memory function.

Single neurons in the human medial temporal lobe flexibly shift representations across spatial and memory tasks

Investigations into how individual neurons encode behavioral variables of interest have revealed specific representations in single neurons, such as place and object cells, as well as a wide range of cells with conjunctive encodings or mixed selectivity. However, as most experiments examine neural activity within individual tasks, it is currently unclear if and how neural representations change across different task contexts. Within this discussion, the medial temporal lobe is particularly salient, as it is known to be important for multiple behaviors including spatial navigation and memory, however the relationship between these functions is currently unclear. Here, to investigate how representations in single neurons vary across different task contexts in the medial temporal lobe, we collected and analyzed single-neuron activity from human participants as they completed a paired-task session consisting of a passive-viewing visual working memory and a spatial navigation and memory task. Five patients contributed 22 paired-task sessions, which were spike sorted together to allow for the same putative single neurons to be compared between the different tasks. Within each task, we replicated concept-related activations in the working memory task, as well as target-location and serial-position responsive cells in the navigation task. When comparing neuronal activity between tasks, we first established that a significant number of neurons maintained the same kind of representation, responding to stimuli presentations across tasks. Further, we found cells that changed the nature of their representation across tasks, including a significant number of cells that were stimulus responsive in the working memory task that responded to serial position in the spatial task. Overall, our results support a flexible encoding of multiple, distinct aspects of different tasks by single neurons in the human medial temporal lobe, whereby some individual neurons change the nature of their feature coding between task contexts.

Using multi-task experiments to test principles of hippocampal function

Investigations of hippocampal functions have revealed a dizzying array of findings, from lesion-based behavioral deficits, to a diverse range of characterized neural activations, to computational models of putative functionality. Across these findings, there remains an ongoing debate about the core function of the hippocampus and the generality of its representation. Researchers have debated whether the hippocampus's primary role relates to the representation of space, the neural basis of (episodic) memory, or some more general computation that generalizes across various cognitive domains. Within these different perspectives, there is much debate about the nature of feature encodings. Here, we suggest that in order to evaluate hippocampal responses-investigating, for example, whether neuronal representations are narrowly targeted to particular tasks or if they subserve domain-general purposes-a promising research strategy may be the use of multi-task experiments, or more generally switching between multiple task contexts while recording from the same neurons in a given session. We argue that this strategy-when combined with explicitly defined theoretical motivations that guide experiment design-could be a fruitful approach to better understand how hippocampal representations support different behaviors. In doing so, we briefly review key open questions in the field, as exemplified by articles in this special issue, as well as previous work using multi-task experiments, and extrapolate to consider how this strategy could be further applied to probe fundamental questions about hippocampal function.

Single neurons in the human medial temporal lobe flexibly shift representations across spatial and memory tasks

Investigations into how individual neurons encode behavioral variables of interest have revealed specific representations in single neurons, such as place and object cells, as well as a wide range of cells with conjunctive encodings or mixed selectivity. However, as most experiments examine neural activity within individual tasks, it is currently unclear if and how neural representations change across different task contexts. Within this discussion, the medial temporal lobe is particularly salient, as it is known to be important for multiple behaviors including spatial navigation and memory, however the relationship between these functions is currently unclear. Here, to investigate how representations in single neurons vary across different task contexts in the MTL, we collected and analyzed single-neuron activity from human participants as they completed a paired-task session consisting of a passive-viewing visual working memory and a spatial navigation and memory task. Five patients contributed 22 paired-task sessions, which were spike sorted together to allow for the same putative single neurons to be compared between the different tasks. Within each task, we replicated concept-related activations in the working memory task, as well as target-location and serial-position responsive cells in the navigation task. When comparing neuronal activity between tasks, we first established that a significant number of neurons maintained the same kind of representation, responding to stimuli presentations across tasks. Further, we found cells that changed the nature of their representation across tasks, including a significant number of cells that were stimulus responsive in the working memory task that responded to serial position in the spatial task. Overall, our results support a flexible encoding of multiple, distinct aspects of different tasks by single neurons in the human MTL, whereby some individual neurons change the nature of their feature coding between task contexts.