Hippocampal signals modify orbitofrontal representations to learn new paths

Hippocampal output suppresses orbitofrontal cortex schema cell formation

Both the orbitofrontal cortex (OFC) and the hippocampus (HC) are implicated in the formation of cognitive maps and their generalization into schemas. However, how these areas interact in supporting this function remains unclear, with some proposals supporting a serial model in which the OFC draws on task representations created by the HC to extract key behavioral features and others suggesting a parallel model in which both regions construct representations that highlight different types of information. In the present study, we tested between these two models by asking how schema correlates in rat OFC would be affected by inactivating the output of the HC, after learning and during transfer across problems. We found that the prevalence and content of schema correlates were unaffected by inactivating one major HC output area, the ventral subiculum, after learning, whereas inactivation during transfer accelerated their formation. These results favor the proposal that the OFC and HC operate in parallel to extract different features defining cognitive maps and schemas.

Prediction, inference, and generalization in orbitofrontal cortex

Our understanding of the orbitofrontal cortex (OFC) has significantly evolved over the past few decades. This prefrontal region has been associated with a wide range of cognitive functions, including a popular view that it primarily signals the expected value of each possible option, allowing downstream areas to use these value signals for decision-making. However, the discovery of rich, task-related information within the OFC and its essential role in inference-based behaviors has shifted our perspective and led to the proposal that the OFC holds a cognitive map used by both humans and animals for making predictions and inferences. Recent studies have further shown that these cognitive maps can be abstracted and generalized, serving both immediate and future needs. In this review, we trace the research journey leading to these evolving insights, discuss the potential neural mechanisms supporting the OFC's roles in prediction, inference, and generalization, and compare the OFC with the hippocampus, another critical region for cognitive mapping, while also exploring the interactions between these two areas.

[Synchronized neural rhythms in rat hippocampal CA1 region and orbitofrontal cortex are involved in learning and memory consolidation in spatial goal-directed tasks]

OBJECTIVES

To investigate the neural mechanisms of rhythmic activity in the hippocampal CA1 region and orbitofrontal cortex (OFC) during a spatial goal-directed task.

METHODS

Four long-Evans rats were trained to perform a spatial goal-directed task in a land-based water maze (Cheese-board maze). The task was divided into 5 periods: Pre-test, Pre-sleep, Learning, Post-sleep, and Post-test. During the Learning phase, the task was split into two goal navigation and two reward acquisition processes with a total of 8 learning stages. Local field potentials (LFP) from the CA1 and the OFC were recorded, and power spectral density analysis was performed on Theta (6-12 Hz), Beta (15-30 Hz), Low gamma (30-60 Hz), and High gamma (60-90 Hz) bands. Coherence, phase-locking value (PLV), and phase-amplitude cross coupling (PAC) were used to assess the interactions between the CA1 and the OFC during learning and memory.

RESULTS

During the task training, the rats showed consistent rhythms of OFC neural activity across the task states (P>0.05) while exhibiting significant changes in Beta and High gamma rhythms in the CA1 region (P<0.05). Coherence and PLV between the CA1 and the OFC were higher during goal navigation, especially in the stable learning phase (Stage 8 vs Stage 1, P<0.01). The rats showed stronger cross-frequency coupling between CA1-Theta and OFC-Low gamma in the Post-test phase than in the Pre-test phase (P<0.05).

CONCLUSIONS

Learning and memory consolidation in goal-directed tasks involve synchronized activity between the CA1 region and the OFC, and cross-frequency coupling plays a key role in maintaining short-term memory of reward locations in rats.

Rhythmic modulation of dorsal hippocampus across distinct behavioral timescales during spatial set-shifting

Previous work has shown frequency-specific modulation of dorsal hippocampus (dHPC) neural activity during simple behavioral tasks, suggesting shifts in neural population activity throughout different task phases and animal behaviors. Relatively little is known about task-relevant orchestrated shifts in theta, beta, and gamma rhythms across multiple behavioral timescales during a complex task that requires repeated adaptation of behavioral strategies based on changing reward contingencies. To address this gap in knowledge, we used a spatial set-shifting task to determine whether dHPC plays a specific role in strategy switching. The task requires rats to use two spatial strategies on an elevated plus maze: 1) alternating between East and West reward locations or 2) always going to the same reward location (e.g., only East or only West). Across specific timescales (session-based alignments, comparisons of trial types, within trial epochs), dHPC associated differentially with all three temporal categories. Across a session, we observed a decrease in theta and beta power before, and an increase in theta power after, the target strategy changed. Beta power was increased around the point at which rats learn the current rule. Comparing trial types, on trials before a rat learned the correct strategy, beta power increased. Within a single trial, after an incorrect (but not correct) choice, beta and gamma power increased while the rat returned to start a new trial. If gamma (but not beta) power was high during this return, the rat was more likely to make a correct choice on the next trial. On the other hand, low gamma power during the return was associated with incorrect trials. Rhythmic activity in dHPC, therefore, appears to track task demands, with the strength of each rhythmic frequency differentially associating with specific behaviors across three distinct timescales.

Context-dependent decision-making in the primate hippocampal-prefrontal circuit

What is good in one scenario may be bad in another. Despite the ubiquity of such contextual reasoning in everyday choice, how the brain flexibly uses different valuation schemes across contexts remains unknown. We addressed this question by monitoring neural activity from the hippocampus (HPC) and orbitofrontal cortex (OFC) of two monkeys performing a state-dependent choice task. We found that HPC neurons encoded state information as it became available and then, at the time of choice, relayed this information to the OFC via theta synchronization. During choice, the OFC represented value in a state-dependent manner; many OFC neurons uniquely coded for value in only one state but not the other. This suggests a functional dissociation whereby the HPC encodes contextual information that is broadcast to the OFC via theta synchronization to select a state-appropriate value subcircuit, thereby allowing for contextual reasoning in value-based choice.

Prefrontal serotonin depletion delays reversal learning and increases theta synchronization of the infralimbic-prelimbic-orbitofrontal prefrontal cortex circuit

Introduction

Prefrontal serotonin plays a role in the expression of flexible behavior during reversal learning tasks as its depletion delays reversal learning. However, the mechanisms by which serotonin modulates the prefrontal cortex functions during reversal learning remain unclear. Nevertheless, serotonin has been shown to modulate theta activity during spatial learning and memory.

Methods

We evaluated the effects of prefrontal serotonin depletion on theta activity in the prefrontal infralimbic, prelimbic, and orbitofrontal (IL, PL, and OFC) subregions of male rats during a spatial reversal learning task in an aquatic T-maze.

Results

Prefrontal serotonin depletion delayed spatial reversal learning and increased theta activity power in the PL and OFC. Furthermore, animals with serotonin depletion had increased functional coupling between the OFC and the IL and PL cortices compared with the control group.

Discussion

These results indicate that serotonin regulates reversal learning through modulation of prefrontal theta activity by tuning both the power and functional synchronization of the prefrontal subregions.

Forming cognitive maps for abstract spaces: the roles of the human hippocampus and orbitofrontal cortex

How does the human brain construct cognitive maps for decision-making and inference? Here, we conduct an fMRI study on a navigation task in multidimensional abstract spaces. Using a deep neural network model, we assess learning levels and categorized paths into exploration and exploitation stages. Univariate analyses show higher activation in the bilateral hippocampus and lateral prefrontal cortex during exploration, positively associated with learning level and response accuracy. Conversely, the bilateral orbitofrontal cortex (OFC) and retrosplenial cortex show higher activation during exploitation, negatively associated with learning level and response accuracy. Representational similarity analysis show that the hippocampus, entorhinal cortex, and OFC more accurately represent destinations in exploitation than exploration stages. These findings highlight the collaboration between the medial temporal lobe and prefrontal cortex in learning abstract space structures. The hippocampus may be involved in spatial memory formation and representation, while the OFC integrates sensory information for decision-making in multidimensional abstract spaces.

Regional specialization manifests in the reliability of neural population codes

The brain has the remarkable ability to learn and guide the performance of complex tasks. Decades of lesion studies suggest that different brain regions perform specialized functions in support of complex behaviors1-3. Yet recent large-scale studies of neural activity reveal similar patterns of activity and encoding distributed widely throughout the brain4-6. How these distributed patterns of activity and encoding are compatible with regional specialization of brain function remains unclear. Two frontal brain regions, the dorsal medial prefrontal cortex (dmPFC) and orbitofrontal cortex (OFC), are a paradigm of this conundrum. In the setting complex behaviors, the dmPFC is necessary for choosing optimal actions2,7,8, whereas the OFC is necessary for waiting for3,9 and learning from2,7,9-12 the outcomes of those actions. Yet both dmPFC and OFC encode both choice- and outcome-related quantities13-20. Here we show that while ensembles of neurons in the dmPFC and OFC of rats encode similar elements of a cognitive task with similar patterns of activity, the two regions differ in when that coding is consistent across trials ("reliable"). In line with the known critical functions of each region, dmPFC activity is more reliable when animals are making choices and less reliable preceding outcomes, whereas OFC activity shows the opposite pattern. Our findings identify the dynamic reliability of neural population codes as a mechanism whereby different brain regions may support distinct cognitive functions despite exhibiting similar patterns of activity and encoding similar quantities.

Making Sense of the Multiplicity and Dynamics of Navigational Codes in the Brain

Since the discovery of conspicuously spatially tuned neurons in the hippocampal formation over 50 years ago, characterizing which, where, and how neurons encode navigationally relevant variables has been a major thrust of navigational neuroscience. While much of this effort has centered on the hippocampal formation and functionally-adjacent structures, recent work suggests that spatial codes, in some form or another, can be found throughout the brain, even in areas traditionally associated with sensation, movement, and executive function. In this review, we highlight these unexpected results, draw insights from comparison of these codes across contexts, regions, and species, and finally suggest an avenue for future work to make sense of these diverse and dynamic navigational codes.

Reversal learning: It's just a phase

Being able to let go of behaviors that are no longer valuable and adopt actions that achieve the same outcome is fundamental for animal survival. A new study offers clues on the neural mechanisms that allow animals to reverse their behavior as needed.