Hierarchical organization of context in the hippocampal episodic code

Working memory features are embedded in hippocampal place fields

Hippocampal principal neurons display both spatial tuning properties and memory features. Whether this distinction corresponds to separate neuron types or a context-dependent continuum has been debated. We report here that the task-context ("splitter") feature is highly variable along both trial and spatial position axes. Neurons acquire or lose splitter features across trials even when place field features remain unaltered. Multiple place fields of the same neuron can individually encode both past or future run trajectories, implying that splitter fields are under the control of assembly activity. Place fields can be differentiated into subfields by the behavioral choice of the animal, and splitting within subfields evolves across trials. Interneurons also differentiate choices by integrating inputs from pyramidal cells. Finally, bilateral optogenetic inactivation of the medial entorhinal cortex reversibly decreases the fraction of splitter fields. Our findings suggest that place or splitter features are different manifestations of the same hippocampal computation.

Contextual memory engrams, and the neuromodulatory influence of the locus coeruleus

Here, we review the basis of contextual memory at a conceptual and cellular level. We begin with an overview of the philosophical foundations of traversing space, followed by theories covering the material bases of contextual representations in the hippocampus (engrams), exploring functional characteristics of the cells and subfields within. Next, we explore various methodological approaches for investigating contextual memory engrams, emphasizing plasticity mechanisms. This leads us to discuss the role of neuromodulatory inputs in governing these dynamic changes. We then outline a recent hypothesis involving noradrenergic and dopaminergic projections from the locus coeruleus (LC) to different subregions of the hippocampus, in sculpting contextual representations, giving a brief description of the neuroanatomical and physiological properties of the LC. Finally, we examine how activity in the LC influences contextual memory processes through synaptic plasticity mechanisms to alter hippocampal engrams. Overall, we find that phasic activation of the LC plays an important role in promoting new learning and altering mnemonic processes at the behavioral and cellular level through the neuromodulatory influence of NE/DA in the hippocampus. These findings may provide insight into mechanisms of hippocampal remapping and memory updating, memory processes that are potentially dysregulated in certain psychiatric and neurodegenerative disorders.

Emergence of the Hippocampus as a Vector for Goal-Directed Spatial Navigation

The hippocampus, which is deeply involved in episodic memory, plays a pivotal role in spatial navigation, an essential animal behavior. Spatial navigation requires the calculation of the distance and direction from a current to the final position, i.e., a vector to a goal. Place cells in the mammalian hippocampus maximally increase their firing rates when the animal passes a particular location and then encode the animal's current location. The entorhinal cortex, one synapse upstream of the hippocampus, contains both grid and head direction cells that encode distance and direction information, respectively. However, the question of whether the hippocampus generates a vector for goal-directed navigation during the integration of distance and direction to the destination remains unclear. Mounting evidence of the cell types involved in spatial navigation has been obtained mainly in mammalian model animals such as rats and mice. Recent advances in wireless and miniaturized neural activity monitoring devices have begun to yield results not only in model organisms but also in wild mammals, birds, fish, and insects. A scrutiny of the literature examining neural correlates of spatial navigation across multiple animal species reveals that few place cells or grid cells have been found, but that head direction cells are commonly present in multiple animal species. Exceptionally, rodent-like place cells were only found in the medial pallium of tufted titmice, a food-caching bird. The medial pallium is an avian brain region homologous to the mammalian hippocampus. By contrast, rodent-like head direction cells are found in the medial pallium of quails. Head direction cells are also found in the medial pallium of streaked shearwaters, a migratory bird. The avian hippocampus contains information about the animal's current location or direction, but the neural encoding may differ depending on the ecological characteristics of the bird species. The place cells of bats, which are mammals, fly in three-dimensional space and encode vectorial information toward the goal. Training rats with an ingenious task that required them to choose a direction for each run in a maze suggested that place cells encode a vector for goal-directed spatial navigation. Thus, the scrutiny of the literature on spatial navigation-related neuronal activity across multiple animal species suggests that depending on a combination of external conditions such as the context in which the animal is situated (e.g., the context or the framework composed of landmarks in the environment) and internal conditions such as the ecological and behavioral characteristics of the animal, hippocampal neurons can be identified as place cells or head direction cells. We thus propose a conjecture that primitively, the hippocampus, or its homolog, contains information about the travel direction and that the emergence of the hippocampus during evolution has enabled the generation of vector information to the goal for advanced spatial navigation such as the search for the shortcut path and episodic memory capacity.

How our understanding of memory replay evolves

Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.

Temporal context and latent state inference in the hippocampal splitter signal

The hippocampus is thought to enable the encoding and retrieval of ongoing experience, the organization of that experience into structured representations like contexts, maps, and schemas, and the use of these structures to plan for the future. A central goal is to understand what the core computations supporting these functions are, and how these computations are realized in the collective action of single neurons. A potential access point into this issue is provided by 'splitter cells', hippocampal neurons that fire differentially on the overlapping segment of trajectories that differ in their past and/or future. However, the literature on splitter cells has been fragmented and confusing, owing to differences in terminology, behavioral tasks, and analysis methods across studies. In this review, we synthesize consistent findings from this literature, establish a common set of terms, and translate between single-cell and ensemble perspectives. Most importantly, we examine the combined findings through the lens of two major theoretical ideas about hippocampal function: representation of temporal context and latent state inference. We find that unique signature properties of each of these models are necessary to account for the data, but neither theory, by itself, explains all of its features. Specifically, the temporal gradedness of the splitter signal is strong support for temporal context, but is hard to explain using state models, while its flexibility and task-dependence is naturally accounted for using state inference, but poses a challenge otherwise. These theories suggest a number of avenues for future work, and we believe their application to splitter cells is a timely and informative domain for testing and refining theoretical ideas about hippocampal function.

A Review of Neurologgers for Extracellular Recording of Neuronal Activity in the Brain of Freely Behaving Wild Animals

Simultaneous monitoring of animal behavior and neuronal activity in the brain enables us to examine the neural underpinnings of behaviors. Conventionally, the neural activity data are buffered, amplified, multiplexed, and then converted from analog to digital in the head-stage amplifier, following which they are transferred to a storage server via a cable. Such tethered recording systems, intended for indoor use, hamper the free movement of animals in three-dimensional (3D) space as well as in large spaces or underwater, making it difficult to target wild animals active under natural conditions; it also presents challenges in realizing its applications to humans, such as the Brain-Machine Interfaces (BMI). Recent advances in micromachine technology have established a wireless logging device called a neurologger, which directly stores neural activity on ultra-compact memory media. The advent of the neurologger has triggered the examination of the neural correlates of 3D flight, underwater swimming of wild animals, and translocation experiments in the wild. Examples of the use of neurologgers will provide an insight into understanding the neural underpinnings of behaviors in the natural environment and contribute to the practical application of BMI. Here we outline the monitoring of the neural underpinnings of flying and swimming behaviors using neurologgers. We then focus on neuroethological findings and end by discussing their future perspectives.

Complementary roles of differential medial entorhinal cortex inputs to the hippocampus for the formation and integration of temporal and contextual memory (Systems Neuroscience)

In humans and rodents, the entorhinal cortical (EC)-hippocampal (HPC) circuit is crucial for the formation and recall of memory, preserving both spatial information and temporal information about the occurrence of past events. Both modeling and experimental studies have revealed circuits within this network that play crucial roles in encoding space and context. However, our understanding about the time-related aspects of memory is just beginning to be understood. In this review, we first describe updates regarding recent anatomical discoveries for the EC-HPC network, as several important neural circuits critical for memory formation have been discovered by newly developed neural tracing technologies. Second, we examine the complementary roles of multiple medial entorhinal cortical inputs, including newly discovered circuits, into the hippocampus for the temporal and spatial aspects of memory. Finally, we will discuss how temporal and contextual memory information is integrated in HPC cornu ammonis 1 cells. We provide new insights into the neural circuit mechanisms for anatomical and functional segregation and integration of the temporal and spatial aspects of memory encoding in the EC-HPC networks.

Granule cells in the infrapyramidal blade of the dentate gyrus are activated during paradoxical (REM) sleep hypersomnia but not during wakefulness: a study using TRAP mice

STUDY OBJECTIVES

Determine whether in the hippocampus and the supramammillary nucleus (SuM) the same neurons are reactivated when mice are exposed one week apart to two periods of wakefulness (W-W), paradoxical sleep rebound (PSR-PSR) or a period of W followed by a period of PSR (W-PSR).

METHODS

We combined the innovative TRAP2 mice method in which neurons expressing cFos permanently express tdTomato after tamoxifen injection with cFos immunohistochemistry.

RESULTS

We found out that a large number of tdTomato+ and cFos+ cells are localized in the dentate gyrus (DG) after PSR and W while CA1 and CA3 contained both types of neurons only after W. The number of cFos+ cells in the infrapyramidal but not the suprapyramidal blade of the DG was positively correlated with the amount of PS. In addition, we did not find double-labeled cells in the DG whatever the group of mice. In contrast, a high percentage of CA1 neurons were double-labeled in W-W mice. Finally, in the supramammillary nucleus, a large number of cells were double-labeled in W-W, PSR-PSR but not in W-PSR mice.

CONCLUSIONS

Altogether, our results are the first to show that different neurons are activated during W and PS in the supramammillary nucleus and the hippocampus. Further, we showed for the first time that granule cells of the infrapyramidal blade of the DG are activated during PS but not during W. Further experiments are now needed to determine whether these granule cells belong to memory engrams inducing memory reactivation during PS.

Genetic Depletion of BDNF Impairs Extinction Learning of a Spatial Appetitive Task in the Presence or Absence of the Acquisition Context

Brain derived neurotropic factor (BDNF) supports neuronal survival, growth, and differentiation and is involved in forms of hippocampus-dependent and independent learning, as well as hippocampus-dependent learning. Extinction learning comprises active inhibition of no-longer relevant learned information, in conjunction with a decreased response of a previously learned behavior. It is highly dependent on context, and evidence exists that it requires hippocampal activation. The participation of BDNF in memory processing is experience-dependent. For example, BDNF has been associated with synaptic plasticity needed for spatial learning, and it is involved in acquisition and extinction learning of fear conditioning. However, little is known about its role in spatial appetitive extinction learning. In this study, we evaluated to what extent BDNF contributes to spatial appetitive extinction learning in the presence (ABA) or absence (AAA) of exposure to the acquisition context. Daily training, of BDNF^+/--mice or their wildtype (WT) littermates, to reach acquisition criterion in a T-maze, resulted in a similar performance outcome. However, extinction learning was delayed in the AAA, and impaired in the ABA-paradigm compared to performance in WT littermates. Trial-by-trial learning analysis indicated differences in the integration of the context into extinction learning by BDNF^+/--mice compared to WT littermates. Taken together, these results support an important role for BDNF in processes that relate to information updating and retrieval that in turn are crucial for effective extinction learning.

The mysteries of remote memory

Long-lasting memories form the basis of our identity as individuals and lie central in shaping future behaviours that guide survival. Surprisingly, however, our current knowledge of how such memories are stored in the brain and retrieved, as well as the dynamics of the circuits involved, remains scarce despite seminal technical and experimental breakthroughs in recent years. Traditionally, it has been proposed that, over time, information initially learnt in the hippocampus is stored in distributed cortical networks. This process-the standard theory of memory consolidation-would stabilize the newly encoded information into a lasting memory, become independent of the hippocampus, and remain essentially unmodifiable throughout the lifetime of the individual. In recent years, several pieces of evidence have started to challenge this view and indicate that long-lasting memories might already ab ovo be encoded, and subsequently stored in distributed cortical networks, akin to the multiple trace theory of memory consolidation. In this review, we summarize these recent findings and attempt to identify the biologically plausible mechanisms based on which a contextual memory becomes remote by integrating different levels of analysis: from neural circuits to cell ensembles across synaptic remodelling and epigenetic modifications. From these studies, remote memory formation and maintenance appear to occur through a multi-trace, dynamic and integrative cellular process ranging from the synapse to the nucleus, and represent an exciting field of research primed to change quickly as new experimental evidence emerges.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Experience-Related Changes in Place Cell Responses to New Sensory Configuration That Does Not Occur in the Natural Environment in the Rat Hippocampus

The hippocampal formation (HF) is implicated in a comparator that detects sensory conflict (mismatch) among convergent inputs. This suggests that new place cells encoding the new configuration with sensory mismatch develop after the HF learns to accept the new configuration as a match. To investigate this issue, HF CA1 place cell activity in rats was analyzed after the adaptation of the rats to the same sensory mismatch condition. The rats were placed on a treadmill on a stage that was translocated in a figure 8-shaped pathway. We recorded HF neuronal activities under three conditions; (1) an initial control session, in which both the stage and the treadmill moved forward, (2) a backward (mismatch) session, in which the stage was translocated backward while the rats locomoted forward on the treadmill, and (3) the second control session. Of the 161 HF neurons, 56 place-differential activities were recorded from the HF CA1 subfield. These place-differential activities were categorized into four types; forward-related, backward-related, both-translocation-related, and session-dependent. Forward-related activities showed predominant spatial firings in the forward sessions, while backward-related activities showed predominant spatial firings in the backward sessions. Both-translocation-related activities showed consistent spatial firings in both the forward and backward conditions. On the other hand, session-dependent activities showed different spatial firings across the sessions. Detailed analyses of the place fields indicated that mean place field sizes were larger in the forward-related, backward-related, and both-translocation-related activities than in the session-dependent activities. Furthermore, firing rate distributions in the place fields were negatively skewed and asymmetric, which is similar to place field changes that occur after repeated experience. These results demonstrate that the HF encodes a naturally impossible new configuration of sensory inputs after adaptation, suggesting that the HF is capable of updating its stored memory to accept a new configuration as a match by repeated experience.

Deciphering Neural Codes of Memory during Sleep

Memories of experiences are stored in the cerebral cortex. Sleep is critical for the consolidation of hippocampal memory of wake experiences into the neocortex. Understanding representations of neural codes of hippocampal-neocortical networks during sleep would reveal important circuit mechanisms in memory consolidation and provide novel insights into memory and dreams. Although sleep-associated ensemble spike activity has been investigated, identifying the content of memory in sleep remains challenging. Here we revisit important experimental findings on sleep-associated memory (i.e., neural activity patterns in sleep that reflect memory processing) and review computational approaches to the analysis of sleep-associated neural codes (SANCs). We focus on two analysis paradigms for sleep-associated memory and propose a new unsupervised learning framework ('memory first, meaning later') for unbiased assessment of SANCs.

Hippocampal-prefrontal theta phase synchrony in planning of multi-step actions based on memory retrieval

Planning of multi-step actions based on the retrieval of acquired information is essential for efficient foraging. The hippocampus (HPC) and prefrontal cortex (PFC) may play critical roles in this process. However, in rodents, many studies investigating such roles utilized T-maze tasks that only require one-step actions (i.e., selection of one of two alternatives), in which memory retrieval and selection of an action based on the retrieval cannot be clearly differentiated. In monkeys, PFC has been suggested to be involved in planning of multi-step actions; however, the synchrony between HPC and PFC has not been evaluated. To address the combined role of the regions in planning of multi-step actions, we introduced a task in rats that required three successive nose-poke responses to three sequentially illuminated nose-poke holes. During the task, local field potentials (LFP) and spikes from hippocampal CA1 and medial PFC (mPFC) were simultaneously recorded. The position of the first hole indicated whether the following two holes would be presented in a predictable sequence or not. During the first nose-poke period, phase synchrony of LFPs in the theta range (4-10 Hz) between the regions was not different between predictable and unpredictable trials. However, only in trials of predictable sequences, the magnitude of theta phase synchrony during the first nose-poke period was negatively correlated with latency of the two-step ahead nose-poke response. Our findings point to the HPC-mPFC theta phase synchrony as a key mechanism underlying planning of multi-step actions based on memory retrieval rather than the retrieval itself.

Neuronal circuits and physiological roles of the basal ganglia in terms of transmitters, receptors and related disorders

The authors have reviewed recent research advances in basal ganglia circuitry and function, as well as in related disorders from multidisciplinary perspectives derived from the results of morphological, electrophysiological, behavioral, biochemical and molecular biological studies. Based on their expertise in their respective fields, as denoted in the text, the authors discuss five distinct research topics, as follows: (1) area-specific dopamine receptor expression of astrocytes in basal ganglia, (2) the role of physiologically released dopamine in the striatum, (3) control of behavioral flexibility by striatal cholinergic interneurons, (4) regulation of phosphorylation states of DARPP-32 by protein phosphatases and (5) physiological perspective on deep brain stimulation with optogenetics and closed-loop control for ameliorating parkinsonism.

Fast Sequences of Non-spatial State Representations in Humans

Fast internally generated sequences of neural representations are suggested to support learning and online planning. However, these sequences have only been studied in the context of spatial tasks and never in humans. Here, we recorded magnetoencephalography (MEG) while human subjects performed a novel non-spatial reasoning task. The task required selecting paths through a set of six visual objects. We trained pattern classifiers on the MEG activity elicited by direct presentation of the visual objects alone and tested these classifiers on activity recorded during periods when no object was presented. During these object-free periods, the brain spontaneously visited representations of approximately four objects in fast sequences lasting on the order of 120 ms. These sequences followed backward trajectories along the permissible paths in the task. Thus, spontaneous fast sequential representation of states can be measured non-invasively in humans, and these sequences may be a fundamental feature of neural computation across tasks.

•

Task requires navigating between objects whose neural representations can be decoded

•

After task has been learned, spontaneous MEG activity encodes reverse paths

•

These spontaneous sequences are up to four states long

•

Sequences might be cognate with rodent hippocampal “replay”

Episodic-like memory trace in awake replay of hippocampal place cell activity sequences

Episodic memory retrieval of events at a specific place and time is effective for future planning. Sequential reactivation of the hippocampal place cells along familiar paths while the animal pauses is well suited to such a memory retrieval process. It is, however, unknown whether this awake replay represents events occurring along the path. Using a subtask switching protocol in which the animal experienced three subtasks as 'what' information in a maze, I here show that the replay represents a trial type, consisting of path and subtask, in terms of neuronal firing timings and rates. The actual trial type to be rewarded could only be reliably predicted from replays that occurred at the decision point. This trial-type representation implies that not only 'where and when' but also 'what' information is contained in the replay. This result supports the view that awake replay is an episodic-like memory retrieval process.