Prefrontal cortex focally modulates hippocampal place cell firing patterns

Remapping revisited: how the hippocampus represents different spaces

The representation of distinct spaces by hippocampal place cells has been linked to changes in their place fields (the locations in the environment where the place cells discharge strongly), a phenomenon that has been termed 'remapping'. Remapping has been assumed to be accompanied by the reorganization of subsecond cofiring relationships among the place cells, potentially maximizing hippocampal information coding capacity. However, several observations challenge this standard view. For example, place cells exhibit mixed selectivity, encode non-positional variables, can have multiple place fields and exhibit unreliable discharge in fixed environments. Furthermore, recent evidence suggests that, when measured at subsecond timescales, the moment-to-moment cofiring of a pair of cells in one environment is remarkably similar in another environment, despite remapping. Here, I propose that remapping is a misnomer for the changes in place fields across environments and suggest instead that internally organized manifold representations of hippocampal activity are actively registered to different environments to enable navigation, promote memory and organize knowledge.

Theta oscillations as a substrate for medial prefrontal-hippocampal assembly interactions

The execution of cognitive functions requires coordinated circuit activity across different brain areas that involves the associated firing of neuronal assemblies. Here, we tested the circuit mechanism behind assembly interactions between the hippocampus and the medial prefrontal cortex (mPFC) of adult rats by recording neuronal populations during a rule-switching task. We identified functionally coupled CA1-mPFC cells that synchronized their activity beyond that expected from common spatial coding or oscillatory firing. When such cell pairs fired together, the mPFC cell strongly phase locked to CA1 theta oscillations and maintained consistent theta firing phases, independent of the theta timing of their CA1 counterpart. These functionally connected CA1-mPFC cells formed interconnected assemblies. While firing together with their CA1 assembly partners, mPFC cells fired along specific theta sequences. Our results suggest that upregulated theta oscillatory firing of mPFC cells can signal transient interactions with specific CA1 assemblies, thus enabling distributed computations.

Sharp-wave-ripple-associated activity in the medial prefrontal cortex supports spatial rule switching

Previous studies have highlighted an important role for hippocampal sharp-wave ripples in spatial alternation learning, as well as in modulating activity in the medial prefrontal cortex (mPFC). However, the direct influence of hippocampal sharp-wave ripples on mPFC activity during spatial alternation learning has not been investigated. Here, we train Long Evans rats on a three-arm radial maze to perform a sequence of alternations. Three alternation sequences needed to be learned, and while learning a sequence, the activity in the mPFC was inhibited either directly following sharp-wave ripples in the hippocampus (on-time condition) or with a randomized delay (delayed condition). In the on-time condition, the behavioral performance is significantly worse compared to the same animals in the delayed inhibition condition, as measured by a lower correct alternation performance and more perseverative behavior. This indicates that the activity in the mPFC directly following hippocampal sharp-wave ripples is necessary for spatial rule switching.

Optogenetic disruption of the prelimbic cortex alters long-term decision strategy but not valuation on a spatial delay discounting task

Rats demonstrate a preference for smaller, immediate rewards over larger, delayed ones, a phenomenon known as delay-discounting (DD). Behavior arises from the interaction of multiple decision-making systems, and the medial prefrontal cortex (mPFC) has been identified as a central component in the mediation between these decision systems. To investigate the role of the prelimbic (PL) subregion of mPFC on decision strategy interaction, we compared two cohorts of rats (ChR2-opsin-expressing 'Active' and opsin-absent 'Control') on a spatial delay-discounting task while delivering in-vivo light stimulation into PL at the choice point of select trials. By analyzing the overall delay-adjustment along with deliberative and procedural behavioral strategy markers, our study revealed differences in the decision strategies used between the active and control animals despite both groups showing similar valuations. Control animals developed the expected shift from deliberative to procedural decision strategy on this task (indicated by reaching delay-stability, particularly during late-session laps); however, active-virus animals repeatedly over-adjusted around their preferred delay throughout the entire session, suggesting a significant deficit in procedural decision-making on this task. Active animals showed a significant decrease in proportion of vicarious trial and error events (VTE, a behavior correlated with deliberative processes) on delay adjustment laps relative to control animals. This points to a more nuanced role for VTE, not just in executing deliberation, but in shifting from deliberative to procedural processes. This opto-induced change in VTE was especially pronounced for late-session adjustment laps. We found no other session-by-session or lap-by-lap effects, leaving a particular role for PL in the long-term development of procedural strategies on this task.

Tonic excitation of nucleus reuniens decreases prefrontal-hippocampal coordination during slow-wave states

The nucleus reuniens of the thalamus (RE) is an important node between the medial prefrontal cortex (mPFC) and the hippocampus (HPC). Previously, we have shown that its mode of activity and its influence in mPFC-HPC communication is dependent upon brain state. During slow-wave states, RE units are closely and rhythmically coupled to the ongoing mPFC-slow oscillation (SO), while during activated (theta) states, RE neurons fire in an arrhythmic and tonically active manner. Inactivating the RE selectively impoverishes coordination of the SO between mPFC and HPC and interestingly, both mPFC and RE stimulation during the SO cause larger responses in the HPC than during theta. It is unclear if the activity patterns within the RE across states may play a role in both phenomena. Here, we optogenetically excited RE neurons in a tonic fashion to assess the impact on mPFC-HPC coupling. This stimulation decreased the influence of mPFC stimulation in the HPC during SO states, in a manner similar to what is observed across state changes into theta. Importantly, this type of stimulation had no effect on evoked responses during theta. Perhaps more interestingly, tonic optogenetic excitation of the RE also decreased mPFC-HPC SO coherence. Thus, it may not be the integrity of the RE per se that is responsible for efficient communication between mPFC and HPC, but rather the particular state in which RE neurons find themselves. Our results have direct implications for how distant brain regions can communicate most effectively, an issue that is ultimately important for activity-dependent processes occurring during slow-wave sleep-dependent memory consolidation.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Dimensions and mechanisms of memory organization

Memory formation is dynamic in nature, and acquisition of new information is often influenced by previous experiences. Memories sharing certain attributes are known to interact so that retrieval of one increases the likelihood of retrieving the other, raising the possibility that related memories are organized into associative mnemonic structures of interconnected representations. Although the formation and retrieval of single memories have been studied extensively, very little is known about the brain mechanisms that organize and link related memories. Here we review studies that suggest the existence of mnemonic structures in humans and animal models. These studies suggest three main dimensions of experience that can serve to organize related memories: time, space, and perceptual/conceptual similarities. We propose potential molecular, cellular, and systems mechanisms that might support organization of memories according to these dimensions.

Information Theoretic Approaches to Deciphering the Neural Code with Functional Fluorescence Imaging

Information theoretic metrics have proven useful in quantifying the relationship between behaviorally relevant parameters and neuronal activity with relatively few assumptions. However, these metrics are typically applied to action potential (AP) recordings and were not designed for the slow timescales and variable amplitudes typical of functional fluorescence recordings (e.g., calcium imaging). The lack of research guidelines on how to apply and interpret these metrics with fluorescence traces means the neuroscience community has yet to realize the power of information theoretic metrics. Here, we used computational methods to create mock AP traces with known amounts of information. From these, we generated fluorescence traces and examined the ability of different information metrics to recover the known information values. We provide guidelines for how to use information metrics when applying them to functional fluorescence and demonstrate their appropriate application to GCaMP6f population recordings from mouse hippocampal neurons imaged during virtual navigation.

Prefrontal cortical activity predicts the occurrence of nonlocal hippocampal representations during spatial navigation

The receptive field of a neuron describes the regions of a stimulus space where the neuron is consistently active. Sparse spiking outside of the receptive field is often considered to be noise, rather than a reflection of information processing. Whether this characterization is accurate remains unclear. We therefore contrasted the sparse, temporally isolated spiking of hippocampal CA1 place cells to the consistent, temporally adjacent spiking seen within their spatial receptive fields ("place fields"). We found that isolated spikes, which occur during locomotion, are strongly phase coupled to hippocampal theta oscillations and transiently express coherent nonlocal spatial representations. Further, prefrontal cortical activity is coordinated with and can predict the occurrence of future isolated spiking events. Rather than local noise within the hippocampus, sparse, isolated place cell spiking reflects a coordinated cortical-hippocampal process consistent with the generation of nonlocal scenario representations during active navigation.

Do hippocampal pyramidal cells respond to nonspatial stimuli?

There are currently a number of theories of rodent hippocampal function. They fall into two major groups that differ in the role they impute to space in hippocampal information processing. On one hand, the cognitive map theory sees space as crucial and central, with other types of nonspatial information embedded in a primary spatial framework. On the other hand, most other theories see the function of the hippocampal formation as broader, treating all types of information as equivalent and concentrating on the processes carried out irrespective of the specific material being represented, stored, and manipulated. One crucial difference, therefore, is the extent to which theories see hippocampal pyramidal cells as representing nonspatial information independently of a spatial framework. Studies have reported the existence of single hippocampal unit responses to nonspatial stimuli, both to simple sensory inputs as well as to more complex stimuli such as objects, conspecifics, rewards, and time, and these findings been interpreted as evidence in favor of a broader hippocampal function. Alternatively, these nonspatial responses might actually be feature-in-place signals where the spatial nature of the response has been masked by the fact that the objects or features were only presented in one location or one spatial context. In this article, we argue that when tested in multiple locations, the hippocampal response to nonspatial stimuli is almost invariably dependent on the animal's location. Looked at collectively, the data provide strong support for the cognitive map theory.

Cognitive mapping: Anchoring our brain's sense of space in a dynamic world

In complex environments, we rely on knowing our current location and pathways to others in order to flexibly navigate. But viable routes often change. New research suggests how the brain tracks where we are regardless of paths available to us.

Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation

Humans and non-human animals show great flexibility in spatial navigation, including the ability to return to specific locations based on as few as one single experience. To study spatial navigation in the laboratory, watermaze tasks, in which rats have to find a hidden platform in a pool of cloudy water surrounded by spatial cues, have long been used. Analogous tasks have been developed for human participants using virtual environments. Spatial learning in the watermaze is facilitated by the hippocampus. In particular, rapid, one-trial, allocentric place learning, as measured in the delayed-matching-to-place variant of the watermaze task, which requires rodents to learn repeatedly new locations in a familiar environment, is hippocampal dependent. In this article, we review some computational principles, embedded within a reinforcement learning framework, that utilise hippocampal spatial representations for navigation in watermaze tasks. We consider which key elements underlie their efficacy, and discuss their limitations in accounting for hippocampus-dependent navigation, both in terms of behavioural performance (i.e. how well do they reproduce behavioural measures of rapid place learning) and neurobiological realism (i.e. how well do they map to neurobiological substrates involved in rapid place learning). We discuss how an actor-critic architecture, enabling simultaneous assessment of the value of the current location and of the optimal direction to follow, can reproduce one-trial place learning performance as shown on watermaze and virtual delayed-matching-to-place tasks by rats and humans, respectively, if complemented with map-like place representations. The contribution of actor-critic mechanisms to delayed-matching-to-place performance is consistent with neurobiological findings implicating the striatum and hippocampo-striatal interaction in delayed-matching-to-place performance, given that the striatum has been associated with actor-critic mechanisms. Moreover, we illustrate that hierarchical computations embedded within an actor-critic architecture may help to account for aspects of flexible spatial navigation. The hierarchical reinforcement learning approach separates trajectory control via a temporal-difference error from goal selection via a goal prediction error and may account for flexible, trial-specific, navigation to familiar goal locations, as required in some arm-maze place memory tasks, although it does not capture one-trial learning of new goal locations, as observed in open field, including watermaze and virtual, delayed-matching-to-place tasks. Future models of one-shot learning of new goal locations, as observed on delayed-matching-to-place tasks, should incorporate hippocampal plasticity mechanisms that integrate new goal information with allocentric place representation, as such mechanisms are supported by substantial empirical evidence.

Potential roles of the rodent medial prefrontal cortex in conflict resolution between multiple decision-making systems

Mammalian decision-making is mediated by the interaction of multiple, neurally and computationally separable decision systems. Having multiple systems requires a mechanism to manage conflict and converge onto the selection of singular actions. A long history of evidence has pointed to the prefrontal cortex as a central component in processing the interactions between distinct decision systems and resolving conflicts among them. In this chapter we review four theories of how that interaction might occur and identify how the medial prefrontal cortex in the rodent may be involved in each theory. We then present experimental predictions implied by the neurobiological data in the context of each theory as a starting point for future investigation of medial prefrontal cortex and decision-making.

Time as the fourth dimension in the hippocampus

Experiences of animal and human beings are structured by the continuity of space and time coupled with the uni-directionality of time. In addition to its pivotal position in spatial processing and navigation, the hippocampal system also plays a central, multiform role in several types of temporal processing. These include timing and sequence learning, at scales ranging from meso-scales of seconds to macro-scales of minutes, hours, days and beyond, encompassing the classical functions of short term memory, working memory, long term memory, and episodic memories (comprised of information about when, what, and where). This review article highlights the principal findings and behavioral contexts of experiments in rats showing: 1) timing: tracking time during delays by hippocampal 'time cells' and during free behavior by hippocampal-afferent lateral entorhinal cortex ramping cells; 2) 'online' sequence processing: activity coding sequences of events during active behavior; 3) 'off-line' sequence replay: during quiescence or sleep, orderly reactivation of neuronal assemblies coding awake sequences. Studies in humans show neurophysiological correlates of episodic memory comparable to awake replay. Neural mechanisms are discussed, including ion channel properties, plateau and ramping potentials, oscillations of excitation and inhibition of population activity, bursts of high amplitude discharges (sharp wave ripples), as well as short and long term synaptic modifications among and within cell assemblies. Specifically conceived neural network models will suggest processes supporting the emergence of scalar properties (Weber's law), and include different classes of feedforward and recurrent network models, with intrinsic hippocampal coding for 'transitions' (sequencing of events or places).

Context-Dependent Multiplexing by Individual VTA Dopamine Neurons

Dopamine (DA) neurons of the VTA track cues and rewards to generate a reward prediction error signal during Pavlovian conditioning. Here we explored how these neurons respond to a self-paced, operant task in freely moving mice. The animal could trigger a reward-predicting cue by remaining in a specific location of an operant box for a brief time before moving to a spout for reward collection. VTA DA neurons were identified using DAT-Cre male mice that carried an optrode with minimal impact on the behavioral task. In vivo single-unit recordings revealed transient fast spiking responses to the cue and reward in correct trials, while for incorrect ones the activity paused, reflecting positive and negative error signals of a reward prediction. In parallel, a majority of VTA DA neurons simultaneously encoded multiple actions (e.g., movement velocity, acceleration, distance to goal, and licking) in sustained slow firing modulation. Applying a GLM, we show that such multiplexed encoding of rewarding and motor variables by individual DA neurons was only apparent while the mouse was engaged in the task. Downstream targets may exploit such goal-directed multiplexing of VTA DA neurons to adjust actions to optimize the task's outcome.SIGNIFICANCE STATEMENT VTA DA neurons code for multiple functions, including the reward prediction error but also motivation and locomotion. Here we show that about half of the recorded VTA DA neurons perform multiplexing: they exploit the phasic and tonic activity modes to encode, respectively, the cue/reward responses and motor parameters, most prominently when the mouse engages in a self-paced operand task. VTA non-DA neurons, by contrast, encode motor parameters regardless of task engagement.

Spatial encoding in dorsomedial prefrontal cortex and hippocampus is related during deliberation

Deliberation is thought to involve the internal simulation of the outcomes of candidate actions, the valuation of those outcomes, and the selection of the actions with the highest expected value. While it is known that deliberation involves prefrontal cortical areas, specifically the dorsomedial prefrontal cortex (dmPFC), as well as the hippocampus (HPC) and other brain regions, how these areas process prospective information and select actions is not well understood. We recorded simultaneously from ensembles in dmPFC and CA1 of dorsal HPC in rats during performance of a spatial contingency switching task, and examined the relationships between spatial and reward encoding in these two areas during deliberation at the choice point. We found that CA1 and dmPFC represented either goal locations or the current position simultaneously, but that when goal locations were encoded, HPC and dmPFC did not always represent the same goal location. Ensemble activity in dmPFC predicted when HPC would represent goal locations, but on a broad timescale on the order of seconds. Also, reward encoding in dmPFC increased during hippocampal theta cycles where CA1 ensembles represented the goal location. These results suggest that dmPFC and HPC share prospective information during deliberation, that dmPFC may influence whether HPC represents prospective information, and that information recalled about goal locations by HPC may be integrated into dmPFC reward representations on fast timescales.

Dorsomedial prefrontal cortex and hippocampus represent strategic context even while simultaneously changing representation throughout a task session

Dorsomedial prefrontal cortex (dmPFC) and hippocampus (HPC) are thought to play complementary roles in a spatial working memory and decision-making network, where spatial information from HPC informs representations in dmPFC, and contextual information from dmPFC biases how HPC recalls that information. We recorded simultaneously from neural ensembles in rodent dmPFC and HPC as rats performed a rule-switching task, and found that ensembles in dmPFC and HPC simultaneously encoded task contingencies and other time-varying information. While ensembles in HPC transitioned to represent new contingencies at the same time as rats updated their strategies to be consistent with the new contingency, dmPFC ensembles transitioned earlier. Neural representations of other time-varying information also changed faster in dmPFC than in HPC. Our results suggest that HPC and dmPFC represent contingencies while simultaneously representing other information which changes over time, and that this contextual information is integrated into hippocampal representations more slowly than in dmPFC.

Hippocampus-nidopallium caudolaterale interactions exist in the goal-directed behavior of pigeon

Avian hippocampus (Hp) and nidopallium caudolaterale (NCL) are believed to play key roles in goal-directed behavior. However, it is still unclear whether there are interactions between the two brain regions in the goal-directed behavior of pigeons. To investigate the interactions between the Hp and the NCL in the goal-directed behavior, we recorded local field potential (LFP) signals from the two regions simultaneously when the pigeons performed a goal-directed decision-making task. Amplitude-amplitude coupling analysis revealed that the coupling value between the LFP recorded from the Hp and that from the NCL increased significantly (P < 0.05) in slow gamma-band (40-60 Hz) during the turning area. In addition, the LFP functional network analysis demonstrated the LFP functional connections between the Hp and the NCL increased significantly (P < 0.05) in the turning area. The result of partial directed coherence (PDC) analysis showed that the predominant direction of information flow is thought to be from the Hp to the NCL. These findings suggest that there are causal functional interactions between the Hp and the NCL by which information is transmitted between the two regions relevant to goal-directed behavior.

Disrupting the medial prefrontal cortex alters hippocampal sequences during deliberative decision making

Current theories of deliberative decision making suggest that deliberative decisions arise from imagined simulations that require interactions between the prefrontal cortex and hippocampus. In rodent navigation experiments, hippocampal theta sequences advance from the location of the rat ahead to the subsequent goal. To examine the role of the medial prefrontal cortex (mPFC) on the hippocampus, we disrupted the mPFC with DREADDs (designer receptors exclusively activated by designer drugs). Using the Restaurant Row foraging task, we found that mPFC disruption resulted in decreased vicarious trial and error behavior, reduced the number of theta sequences, and impaired theta sequences in hippocampus. mPFC disruption led to larger changes in the initiation of the hippocampal theta sequences that represent the current location of the rat rather than to the later portions that represent the future outcomes. These data suggest that the mPFC likely provides an important component to the initiation of deliberative sequences and provides support for an episodic-future thinking, working memory interpretation of deliberation. NEW & NOTEWORTHY The medial prefrontal cortex (mPFC) and hippocampus interact during deliberative decision making. Disruption of the mPFC impaired hippocampal processes, including the local and nonlocal representations of space along each theta cycle and the initiation of hippocampal theta sequences, while sparing place cell firing characteristics and phase precession. mPFC disruption reduced the deliberative behavioral process vicarious trial and error and improved economic behaviors on this task.

Insensitivity of Place Cells to the Value of Spatial Goals in a Two-Choice Flexible Navigation Task

Hippocampal place cells show position-specific activity thought to reflect a self-localization signal. Several reports also point to some form of goal encoding by place cells. We investigated this by asking whether they also encode the value of spatial goals, which is crucial information for optimizing goal-directed navigation. We used a continuous place navigation task in which male rats navigate to one of two (freely chosen) unmarked locations and wait, triggering the release of reward, which is then located and consumed elsewhere. This allows sampling of place fields and dissociates spatial goal from reward consumption. The two goals varied in the amount of reward provided, allowing assessment of whether the rats factored goal value into their navigational choice and of possible neural correlates of this value. Rats successfully learned the task, indicating goal localization, and they preferred higher-value goals, indicating processing of goal value. Replicating previous findings, there was goal-related activity in the out-of-field firing of CA1 place cells, with a ramping-up of firing rate during the waiting period, but no general overrepresentation of goals by place fields, an observation that we extended to CA3 place cells. Importantly, place cells were not modulated by goal value. This suggests that dorsal hippocampal place cells encode space independently of its associated value despite the effect of that value on spatial behavior. Our findings are consistent with a model of place cells in which they provide a spontaneously constructed value-free spatial representation rather than encoding other navigationally relevant but nonspatial information.SIGNIFICANCE STATEMENT We investigated whether hippocampal place cells, which compute a self-localization signal, also encode the relative value of places, which is essential information for optimal navigation. When choosing between two spatial goals of different value, rats preferred the higher-value goal. We saw out-of-field goal firing in place cells, replicating previous observations that the cells are influenced by the goal, but their activity was not modulated by the value of these goals. Our results suggest that place cells do not encode all of the navigationally relevant aspects of a place, but instead form a value-free "map" that links to such aspects in other parts of the brain.

The ventral hippocampus is involved in multi-goal obstacle-rich spatial navigation

A large body of evidence shows that the hippocampus is necessary for successful spatial navigation. Various studies have shown anatomical and functional differences between the dorsal (DHC) and ventral (VHC) portions of this structure. The DHC is primarily involved in spatial navigation and contains cells with small place fields. The VHC is primarily involved in context and emotional encoding contains cells with large place fields and receives major projections from the medial prefrontal cortex. In the past, spatial navigation experiments have used relatively simple tasks that may not have required a strong coordination along the dorsoventral hippocampal axis. In this study, we tested the hypothesis that the DHC and VHC may be critical for goal-directed navigation in obstacle-rich environments. We used a learning task in which animals memorize the location of a set of rewarded feeders, and recall these locations in the presence of small or large obstacles. We report that bilateral DHC or VHC inactivation impaired spatial navigation in both large and small obstacle conditions. Importantly, this impairment did not result from a deficit in the spatial memory for the set of feeders (i.e., recognition of the goal locations) because DHC or VHC inactivation did not affect recall performance when there was no obstacle on the maze. We also show that the behavioral performance of the animals was correlated with several measures of maze complexity and that these correlations were significantly affected by inactivation only in the large object condition. These results suggest that as the complexity of the environment increases, both DHC and VHC are required for spatial navigation.

Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis

While the neurobiology of simple and habitual choices is relatively well known, our current understanding of goal-directed choices and planning in the brain is still limited. Theoretical work suggests that goal-directed computations can be productively associated to model-based (reinforcement learning) computations, yet a detailed mapping between computational processes and neuronal circuits remains to be fully established. Here we report a computational analysis that aligns Bayesian nonparametrics and model-based reinforcement learning (MB-RL) to the functioning of the hippocampus (HC) and the ventral striatum (vStr)-a neuronal circuit that increasingly recognized to be an appropriate model system to understand goal-directed (spatial) decisions and planning mechanisms in the brain. We test the MB-RL agent in a contextual conditioning task that depends on intact hippocampus and ventral striatal (shell) function and show that it solves the task while showing key behavioral and neuronal signatures of the HC-vStr circuit. Our simulations also explore the benefits of biological forms of look-ahead prediction (forward sweeps) during both learning and control. This article thus contributes to fill the gap between our current understanding of computational algorithms and biological realizations of (model-based) reinforcement learning.

Decoding Pigeon Behavior Outcomes Using Functional Connections among Local Field Potentials

Recent studies indicate that the local field potential (LFP) carries information about an animal's behavior, but issues regarding whether there are any relationships between the LFP functional networks and behavior tasks as well as whether it is possible to employ LFP network features to decode the behavioral outcome in a single trial remain unresolved. In this study, we developed a network-based method to decode the behavioral outcomes in pigeons by using the functional connectivity strength values among LFPs recorded from the nidopallium caudolaterale (NCL). In our method, the functional connectivity strengths were first computed based on the synchronization likelihood. Second, the strength values were unwrapped into row vectors and their dimensions were then reduced by principal component analysis. Finally, the behavioral outcomes in single trials were decoded using leave-one-out combined with the k-nearest neighbor method. The results showed that the LFP functional network based on the gamma-band was related to the goal-directed behavior of pigeons. Moreover, the accuracy of the network features (74 ± 8%) was significantly higher than that of the power features (61 ± 12%). The proposed method provides a powerful tool for decoding animal behavior outcomes using a neural functional network.

Ventral Midline Thalamus Is Necessary for Hippocampal Place Field Stability and Cell Firing Modulation

The reuniens (Re) and rhomboid (Rh) nuclei of the ventral midline thalamus are reciprocally connected with the hippocampus (Hip) and the medial prefrontal cortex (mPFC). Growing evidence suggests that these nuclei might play a crucial role in cognitive processes requiring Hip-mPFC interactions, including spatial navigation. Here, we tested the effect of ReRh lesions on the firing properties and spatial activity of dorsal hippocampal CA1 place cells as male rats explored a familiar or a novel environment. We found no change in the spatial characteristics of CA1 place cells in the familiar environment following ReRh lesions. Contrariwise, spatial coherence was decreased during the first session in a novel environment. We then investigated field stability of place cells recorded across 5 d both in the familiar and in a novel environment presented in a predefined sequence. While the remapping capacity of the place cells was not affected by the lesion, our results clearly demonstrated a disruption of the CA1 cellular representation of both environments in ReRh rats. More specifically, we found ReRh lesions to produce (1) a pronounced and long-lasting decrease of place field stability and (2) a strong alteration of overdispersion (i.e., firing variability). Thus, in ReRh rats, exploration of a novel environment appears to interfere with the representation of the familiar one, leading to decreased field stability in both environments. The present study shows the involvement of ReRh nuclei in the long-term spatial stability of CA1 place fields.SIGNIFICANCE STATEMENT Growing evidence suggest that the ventral midline thalamic nuclei (reuniens and rhomboid) might play a substantial role in various cognitive tasks including spatial memory. In the present article, we show that the lesions of these nuclei impair the spatial representations encoded by CA1 place cells of both familiar and novel environments. First, reduced variability of place cell firing appears to indicate an impairment of attentional processes. Second, impaired stability of place cell representations could explain the long-term memory deficits observed in previous behavioral studies.

Differential involvement of the medial prefrontal cortex across variants of contextual fear conditioning

The context preexposure facilitation effect (CPFE) is a contextual fear conditioning paradigm in which learning about the context, acquiring the context-shock association, and retrieving/expressing contextual fear are temporally dissociated into three distinct phases. In contrast, learning about the context and the context-shock association happens concurrently in standard contextual fear conditioning (sCFC). By infusing the GABA_A receptor agonist muscimol into medial prefrontal cortex (mPFC) in adolescent Long-Evans rats, the current set of experiments examined the functional role of the mPFC in each phase of the CPFE and sCFC. In the CPFE, the mPFC is necessary for the following: acquisition and/or consolidation of context memory (Experiment 1), reconsolidation of a context memory to include shock (Experiment 2), and expression of contextual fear memory during a retention test (Experiment 3). In contrast to the CPFE, inactivation of the mPFC prior to conditioning in sCFC has no effect on acquisition, consolidation, or retention of a contextual fear memory (Experiment 4). Interestingly, the mPFC is not required for acquiring a context-shock association (measured by post-shock freezing) in the CPFE or sCFC (Experiment 2b and 4). Taken together, these results indicate that the mPFC is differentially recruited across stages of learning and variants of contextual fear conditioning (CPFE versus sCFC). More specifically, separating out learning about the context and the context-shock association necessitates activation of the medial prefrontal cortex during early learning and/or consolidation.

Integrating Spatial Working Memory and Remote Memory: Interactions between the Medial Prefrontal Cortex and Hippocampus

In recent years, two separate research streams have focused on information sharing between the medial prefrontal cortex (mPFC) and hippocampus (HC). Research into spatial working memory has shown that successful execution of many types of behaviors requires synchronous activity in the theta range between the mPFC and HC, whereas studies of memory consolidation have shown that shifts in area dependency may be temporally modulated. While the nature of information that is being communicated is still unclear, spatial working memory and remote memory recall is reliant on interactions between these two areas. This review will present recent evidence that shows that these two processes are not as separate as they first appeared. We will also present a novel conceptualization of the nature of the medial prefrontal representation and how this might help explain this area’s role in spatial working memory and remote memory recall.

Network mechanisms of hippocampal laterality, place coding, and goal-directed navigation

The hippocampus and associated structures are responsible for episodic memory in humans. In rodents, the most prominent behavioral correlate of hippocampal neural activity is place coding, which is thought to underlie spatial navigation. While episodic memory is considered to be unique to humans in a restricted context, it has been proposed that the same neural circuitry and algorithms that enable spatial coding and navigation also support episodic memory. Here we review the recent progress in neural circuit mechanisms of hippocampal activity by introducing several topics: (1) cooperation and specialization of the bilateral hippocampi, (2) the role of synaptic plasticity in gamma phase-locking of spikes and place cell formation, (3) impaired goal-related activity and oscillations in a mouse model of mental disorders, and (4) a prefrontal-thalamo-hippocampal circuit for goal-directed spatial navigation.

The Interplay of Hippocampus and Ventromedial Prefrontal Cortex in Memory-Based Decision Making

Episodic memory and value-based decision making are two central and intensively studied research domains in cognitive neuroscience, but we are just beginning to understand how they interact to enable memory-based decisions. The two brain regions that have been associated with episodic memory and value-based decision making are the hippocampus and the ventromedial prefrontal cortex, respectively. In this review article, we first give an overview of these brain–behavior associations and then focus on the mechanisms of potential interactions between the hippocampus and ventromedial prefrontal cortex that have been proposed and tested in recent neuroimaging studies. Based on those possible interactions, we discuss several directions for future research on the neural and cognitive foundations of memory-based decision making.

Hippocampus activation related to 'real-time' processing of visuospatial change

The delay associated with cerebral processing time implies a lack of real-time representation of changes in the observed environment. To bridge this gap for motor actions in a dynamical environment, the brain uses predictions of the most plausible future reality based on previously provided information. To optimise these predictions, adjustments to actual experiences are necessary. This requires a perceptual memory buffer. In our study we gained more insight how the brain treats (real-time) information by comparing cerebral activations related to judging past-, present- and future locations of a moving ball, respectively. Eighteen healthy subjects made these estimations while fMRI data was obtained. All three conditions evoked bilateral dorsal-parietal and premotor activations, while judgment of the location of the ball at the moment of judgment showed increased bilateral posterior hippocampus activation relative to making both future and past judgments at the one-second time-sale. Since the condition of such 'real-time' judgments implied undistracted observation of the ball's actual movements, the associated hippocampal activation is consistent with the concept that the hippocampus participates in a top-down exerted sensory gating mechanism. In this way, it may play a role in novelty (saliency) detection.

Spatial cognition in mice and rats: similarities and differences in brain and behavior

The increasing use of mice models in cognitive tasks that were originally designed for rats raises crucial questions about cross-species comparison in the study of spatial cognition. The present review focuses on the major neuroethological differences existing between mice and rats, with particular attention given to the neurophysiological basis of space coding. While little difference is found in the basic properties of space representation in these two species, it appears that the stability of this representation changes more drastically over time in mice than in rats. We consider several hypotheses dealing with attentional, perceptual, and genetic aspects and offer some directions for future research that might help in deciphering hippocampal function in learning and memory processes. WIREs Cogn Sci 2016, 7:406-421. doi: 10.1002/wcs.1411 For further resources related to this article, please visit the WIREs website.

Representation of memories in the cortical-hippocampal system: Results from the application of population similarity analyses

Here we consider the value of neural population analysis as an approach to understanding how information is represented in the hippocampus and cortical areas and how these areas might interact as a brain system to support memory. We argue that models based on sparse coding of different individual features by single neurons in these areas (e.g., place cells, grid cells) are inadequate to capture the complexity of experience represented within this system. By contrast, population analyses of neurons with denser coding and mixed selectivity reveal new and important insights into the organization of memories. Furthermore, comparisons of the organization of information in interconnected areas suggest a model of hippocampal-cortical interactions that mediates the fundamental features of memory.

Is there a pilot in the brain? Contribution of the self-positioning system to spatial navigation

Since the discovery of place cells, the hippocampus is thought to be the neural substrate of a cognitive map. The later discovery of head direction cells, grid cells and border cells, as well as of cells with more complex spatial signals, has led to the idea that there is a brain system devoted to providing the animal with the information required to achieve efficient navigation. Current questioning is focused on how these signals are integrated in the brain. In this review, we focus on the issue of how self-localization is performed in the hippocampal place cell map. To do so, we first shortly review the sensory information used by place cells and then explain how this sensory information can lead to two coding modes, respectively based on external landmarks (allothetic information) and self-motion cues (idiothetic information). We hypothesize that these two modes can be used concomitantly with the rat shifting from one mode to the other during its spatial displacements. We then speculate that sequential reactivation of place cells could participate in the resetting of self-localization under specific circumstances and in learning a new environment. Finally, we provide some predictions aimed at testing specific aspects of the proposed ideas.

A video based feedback system for control of an active commutator during behavioral physiology

Background

To investigate the relationship between neural function and behavior it is necessary to record neuronal activity in the brains of freely behaving animals, a technique that typically involves tethering to a data acquisition system. Optimally this approach allows animals to behave without any interference of movement or task performance. Currently many laboratories in the cognitive and behavioral neuroscience fields employ commercial motorized commutator systems using torque sensors to detect tether movement induced by the trajectory behaviors of animals.

Results

In this study we describe a novel motorized commutator system which is automatically controlled by video tracking. To obtain accurate head direction data two light emitting diodes were used and video image noise was minimized by physical light source manipulation. The system calculates the rotation of the animal across a single trial by processing head direction data and the software, which calibrates the motor rotation angle, subsequently generates voltage pulses to actively untwist the tether. This system successfully provides a tether twist-free environment for animals performing behavioral tasks and simultaneous neural activity recording.

Conclusions

To the best of our knowledge, it is the first to utilize video tracking generated head direction to detect tether twisting and compensate with a motorized commutator system. Our automatic commutator control system promises an affordable and accessible method to improve behavioral neurophysiology experiments, particularly in mice.

Electronic supplementary material

The online version of this article (doi:10.1186/s13041-015-0152-8) contains supplementary material, which is available to authorized users.

Noradrenergic signaling in the medial prefrontal cortex and amygdala differentially regulates vicarious trial-and-error in a spatial decision-making task

In uncertain choice situations, we deliberately search and evaluate possible options before taking an action. Once we form a preference regarding the current situation, we take an action more automatically and with less deliberation. In rats, the deliberation process can be seen in vicarious trial-and-error behavior (VTE), which is a head-orienting behavior toward options at a choice point. Recent neurophysiological findings suggest that VTE reflects the rat's thinking about future options as deliberation, expectation, and planning when rats feel conflict. VTE occurs depending on the demand: an increase occurs during initial learning, and a decrease occurs with progression in learning. However, the brain circuit underlying the regulation of VTE has not been thoroughly examined. In situations in which VTE often appears, the medial prefrontal cortex (mPFC) and the amygdala (AMY) are crucial for learning and decision making. Our previous study reported that noradrenaline regulates VTE. Here, to investigate whether the mPFC and AMY are involved in regulation of VTE, we examined the effects of local injection of clonidine, an alpha2 adrenergic autoreceptor agonist, into either region in rats during VTE and choice behavior during a T-maze choice task. Injection of clonidine into either region impaired selection of the advantageous choice in the task. Furthermore, clonidine injection into the mPFC suppressed occurrence of VTE in the early phase of the task, whereas injection into the AMY inhibited the decrease in VTE in the later phase and thus maintained a high level of VTE throughout the task. These results suggest that the mPFC and AMY play a role in the increase and decrease in VTE, respectively, and that noradrenergic mechanisms mediate the dynamic regulation of VTE over experiences.

Medial septum regulates the hippocampal spatial representation

The hippocampal circuitry undergoes attentional modulation by the cholinergic medial septum. However, it is unclear how septal activation regulates the spatial properties of hippocampal neurons. We investigated here what is the functional effect of selective-cholinergic and non-selective septal stimulation on septo-hippocampal system. We show for the first time selective activation of cholinergic cells and their differential network effect in medial septum of freely-behaving transgenic rats. Our data show that depolarization of cholinergic septal neurons evokes frequency-dependent response from the non-cholinergic septal neurons and hippocampal interneurons. Our findings provide vital evidence that cholinergic effect on septo-hippocampal axis is behavior-dependent. During the active behavioral state the activation of septal cholinergic projections is insufficient to evoke significant change in the spiking of the hippocampal neurons. The efficiency of septo-hippocampal processing during active exploration relates to the firing patterns of the non-cholinergic theta-bursting cells. Non-selective septal theta-burst stimulation resets the spiking of hippocampal theta cells, increases theta synchronization, entrains the spiking of hippocampal place cells, and tunes the spatial properties in a timing-dependent manner. The spatial properties are augmented only when the stimulation is applied in the periphery of the place field or 400–650 ms before the animals approached the center of the field. In summary, our data show that selective cholinergic activation triggers a robust network effect in the septo-hippocampal system during inactive behavioral state, whereas the non-cholinergic septal activation regulates hippocampal functional properties during explorative behavior. Together, our findings uncover fast septal modulation on hippocampal network and reveal how septal inputs up-regulate and down-regulate the encoding of spatial representation.

Dorsal hippocampus and medial prefrontal cortex each contribute to the retrieval of a recent spatial memory in rats

Systems-level consolidation models propose that recent memories are initially hippocampus-dependent. When remote, they are partially or completely dependent upon the medial prefrontal cortex (mPFC). An implication of the mPFC in recent memory, however, is still debated. Different amounts of muscimol (MSCI 0, 30, 50, 80 and 250 ng in 1 µL PBS) were used to assess the impact of inactivation of the dorsal hippocampus (dHip) or the mPFC (targeting the prelimbic cortex) on a 24-h delayed retrieval of a platform location that rats had learned drug-free in a water maze. The two smallest amounts of MSCI (30 and 50 ng) did not affect recall, whatever the region. 80 ng MSCI infused into the dHip disrupted spatial memory retrieval, as did the larger amount. Infusion of MSCI into the mPFC did not alter performance in the 0-80 ng range. At 250 ng, it induced an as dramatic memory impairment as after efficient dHip inactivation. Stereological quantifications showed that 80 ng MSCI in the dHip and 250 ng MSCI in the mPFC induced a more than 80% reduction of c-Fos expression, suggesting that, beyond the amounts infused, it is the magnitude of the neuronal activity decrease which is determinant as to the functional outcome of the inactivation. Because, based on the literature, even 250 ng MSCI is a small amount, our results point to a contribution of the mPFC to the recall of a recently acquired spatial memory and thereby extend our knowledge about the functions of this major actor of cognition.

Homeostatic regulation of memory systems and adaptive decisions

While it is clear that many brain areas process mnemonic information, understanding how their interactions result in continuously adaptive behaviors has been a challenge. A homeostatic-regulated prediction model of memory is presented that considers the existence of a single memory system that is based on a multilevel coordinated and integrated network (from cells to neural systems) that determines the extent to which events and outcomes occur as predicted. The “multiple memory systems of the brain” have in common output that signals errors in the prediction of events and/or their outcomes, although these signals differ in terms of what the error signal represents (e.g., hippocampus: context prediction errors vs. midbrain/striatum: reward prediction errors). The prefrontal cortex likely plays a pivotal role in the coordination of prediction analysis within and across prediction brain areas. By virtue of its widespread control and influence, and intrinsic working memory mechanisms. Thus, the prefrontal cortex supports the flexible processing needed to generate adaptive behaviors and predict future outcomes. It is proposed that prefrontal cortex continually and automatically produces adaptive responses according to homeostatic regulatory principles: prefrontal cortex may serve as a controller that is intrinsically driven to maintain in prediction areas an experience-dependent firing rate set point that ensures adaptive temporally and spatially resolved neural responses to future prediction errors. This same drive by prefrontal cortex may also restore set point firing rates after deviations (i.e. prediction errors) are detected. In this way, prefrontal cortex contributes to reducing uncertainty in prediction systems. An emergent outcome of this homeostatic view may be the flexible and adaptive control that prefrontal cortex is known to implement (i.e. working memory) in the most challenging of situations. Compromise to any of the prediction circuits should result in rigid and suboptimal decision making and memory as seen in addiction and neurological disease. © 2013 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

Hippocampal-cortical interaction in decision making

When making a decision it is often necessary to consider the available alternatives in order to choose the most appropriate option. This deliberative process, where the pros and cons of each option are considered, relies on memories of past actions and outcomes. The hippocampus and prefrontal cortex are required for memory encoding, memory retrieval and decision making, but it is unclear how these areas support deliberation. Here we examine the potential neural substrates of these processes in the rat. The rat is a powerful model to investigate the network mechanisms underlying deliberation in the mammalian brain given the anatomical and functional conservation of its hippocampus and prefrontal cortex to other mammalian systems. Importantly, it is amenable to large scale neural recording while performing laboratory tasks that exploit its natural decision-making behavior. Focusing on findings in the rat, we discuss how hippocampal-cortical interactions could provide a neural substrate for deliberative decision making.

The hippocampo-cortical loop: spatio-temporal learning and goal-oriented planning in navigation

We present a neural network model where the spatial and temporal components of a task are merged and learned in the hippocampus as chains of associations between sensory events. The prefrontal cortex integrates this information to build a cognitive map representing the environment. The cognitive map can be used after latent learning to select optimal actions to fulfill the goals of the animal. A simulation of the architecture is made and applied to learning and solving tasks that involve both spatial and temporal knowledge. We show how this model can be used to solve the continuous place navigation task, where a rat has to navigate to an unmarked goal and wait for 2 seconds without moving to receive a reward. The results emphasize the role of the hippocampus for both spatial and timing prediction, and the prefrontal cortex in the learning of goals related to the task.