Reward Expectancy Strengthens CA1 Theta and Beta Band Synchronization and Hippocampal-Ventral Striatal Coupling

Optogenetic Mapping of Rhythmic Phase-Dependent Excitability in the Mouse Striatum

The striatum is thought to switch flexibly between multiple converging inputs to support adaptive behavior. The "communication through coherence" (CTC) hypothesis is a potential mechanism to implement such a flexible switching. For CTC to work in the striatum, striatal excitability must show rhythmic fluctuations, such as those related to the phase of the striatal local field potential (LFP). To test this fundamental requirement, we delivered a constant input stimulus to ChR2-expressing striatal fast-spiking PV+ interneurons (FSIs) in head-fixed awake mice (PV-Cre:Ai-32, n = 18, 9 female) and determined whether the response to this stimulus varied with LFP phase. We found that approximately one-third (41.2%) of FSIs exhibited significant phase-dependent excitability in at least one LFP frequency band. Phase-dependent excitability was most prominent in the delta (2-5 Hz) frequency band, both in terms of prevalence (23.5% of FSIs sampled) and magnitude (phase modulation strength: 22% of average response). The most excitable phase tended to align with endogenous phase-locking, again most clearly in the delta band. These results bolster the functional relevance of the striatal field potential and spike-field relationships and provide proof-of-principle support for the possibility of CTC in the striatum.

Rhythmic modulation of dorsal hippocampus across distinct behavioral timescales during spatial set-shifting

Previous work has shown frequency-specific modulation of dorsal hippocampus (dHPC) neural activity during simple behavioral tasks, suggesting shifts in neural population activity throughout different task phases and animal behaviors. Relatively little is known about task-relevant orchestrated shifts in theta, beta, and gamma rhythms across multiple behavioral timescales during a complex task that requires repeated adaptation of behavioral strategies based on changing reward contingencies. To address this gap in knowledge, we used a spatial set-shifting task to determine whether dHPC plays a specific role in strategy switching. The task requires rats to use two spatial strategies on an elevated plus maze: 1) alternating between East and West reward locations or 2) always going to the same reward location (e.g., only East or only West). Across specific timescales (session-based alignments, comparisons of trial types, within trial epochs), dHPC associated differentially with all three temporal categories. Across a session, we observed a decrease in theta and beta power before, and an increase in theta power after, the target strategy changed. Beta power was increased around the point at which rats learn the current rule. Comparing trial types, on trials before a rat learned the correct strategy, beta power increased. Within a single trial, after an incorrect (but not correct) choice, beta and gamma power increased while the rat returned to start a new trial. If gamma (but not beta) power was high during this return, the rat was more likely to make a correct choice on the next trial. On the other hand, low gamma power during the return was associated with incorrect trials. Rhythmic activity in dHPC, therefore, appears to track task demands, with the strength of each rhythmic frequency differentially associating with specific behaviors across three distinct timescales.

Circuit dynamics of superficial and deep CA1 pyramidal cells and inhibitory cells in freely-moving macaques

Diverse neuron classes in hippocampal CA1 have been identified through the heterogeneity of their cellular/molecular composition. How these classes relate to hippocampal function and the network dynamics that support cognition in primates remains unclear. Here we report inhibitory functional cell groups in CA1 of freely-moving macaques whose diverse response profiles to network states and each other suggest distinct and specific roles in the functional microcircuit of CA1. In addition, pyramidal cells that were segregated into superficial and deep layers differed in firing rate, burstiness, and sharp-wave ripple-associated firing. They also showed strata-specific spike-timing interactions with inhibitory cell groups, suggestive of segregated neural populations. Furthermore, ensemble recordings revealed that cell assemblies were preferentially organized according to these strata. These results suggest sublayer-specific circuit organization in hippocampal CA1 of the freely-moving macaques that may underlie its role in cognition.

Theta Phase Entrainment of Single-Cell Spiking in Rat Somatosensory Barrel Cortex and Secondary Visual Cortex Is Enhanced during Multisensory Discrimination Behavior

Phase entrainment of cells by theta oscillations is thought to globally coordinate the activity of cell assemblies across different structures, such as the hippocampus and neocortex. This coordination is likely required for optimal processing of sensory input during recognition and decision-making processes. In quadruple-area ensemble recordings from male rats engaged in a multisensory discrimination task, we investigated phase entrainment of cells by theta oscillations in areas along the corticohippocampal hierarchy: somatosensory barrel cortex (S1BF), secondary visual cortex (V2L), perirhinal cortex (PER), and dorsal hippocampus (dHC). Rats discriminated between two 3D objects presented in tactile-only, visual-only, or both tactile and visual modalities. During task engagement, S1BF, V2L, PER, and dHC LFP signals showed coherent theta-band activity. We found phase entrainment of single-cell spiking activity to locally recorded as well as hippocampal theta activity in S1BF, V2L, PER, and dHC. While phase entrainment of hippocampal spikes to local theta oscillations occurred during sustained epochs of task trials and was nonselective for behavior and modality, somatosensory and visual cortical cells were only phase entrained during stimulus presentation, mainly in their preferred modality (S1BF, tactile; V2L, visual), with subsets of cells selectively phase-entrained during cross-modal stimulus presentation (S1BF: visual; V2L: tactile). This effect could not be explained by modulations of firing rate or theta amplitude. Thus, hippocampal cells are phase entrained during prolonged epochs, while sensory and perirhinal neurons are selectively entrained during sensory stimulus presentation, providing a brief time window for coordination of activity.

Hippocampal beta rhythms as a bridge between sensory learning and memory-guided decision-making

A pillar of systems neuroscience has been the study of neural oscillations. Research into these oscillations spans brain areas, species, and disciplines, giving us common ground for discussing typically disparate fields of neuroscience. In this review, we aim to strengthen the dialog between sensory systems research and learning and memory systems research by examining a 15-40 Hz oscillation known as the beta rhythm. Starting with foundational observations based largely in olfactory systems neuroscience, we review evidence suggesting beta-based activity may extend across sensory systems generally, as well as into the hippocampus and areas well known for coordinating decisions and memory-guided behaviors. After evaluating this work, we propose a framework wherein the hippocampal beta oscillation and its diverse coupling with other brain areas can support both sensory learning and memory-guided decision-making. Using this framework, we also propose circuitries that may support these processes, and experiments to test our hypothesis.

Selective Modulation of Hippocampal Theta Oscillations in Response to Morphine versus Natural Reward

Despite the overlapping neural circuits underlying natural and drug rewards, several studies have suggested different behavioral and neurochemical mechanisms in response to drug vs. natural rewards. The strong link between hippocampal theta oscillations (4-12 Hz) and reward-associated learning and memory has raised the hypothesis that this rhythm in hippocampal CA1 might be differently modulated by drug- and natural-conditioned place preference (CPP). Time-frequency analysis of recorded local field potentials (LFPs) from the CA1 of freely moving male rats previously exposed to a natural (in this case, food), drug (in this case, morphine), or saline (control) reward cue in the CPP paradigm showed that the hippocampal CA1 theta activity represents a different pattern for entrance to the rewarded compared to unrewarded compartment during the post-test session of morphine- and natural-CPP. Comparing LFP activity in the CA1 between the saline and morphine/natural groups showed that the maximum theta power occurred before entering the unrewarded compartment and after the entrance to the rewarded compartment in morphine and natural groups, respectively. In conclusion, our findings suggest that drug and natural rewards could differently affect the theta dynamic in the hippocampal CA1 region during reward-associated learning and contextual cueing in the CPP paradigm.

Contingent Amygdala Inputs Trigger Heterosynaptic LTP at Hippocampus-To-Accumbens Synapses

The nucleus accumbens shell (NAcSh) is a key brain region where environmental cues acquire incentive salience to reinforce motivated behaviors. Principal medium spiny neurons (MSNs) in the NAcSh receive extensive glutamatergic projections from limbic regions, among which, the ventral hippocampus (vH) transmits information enriched in contextual cues, and the basolateral amygdala (BLA) encodes real-time arousing states. The vH and BLA project convergently to NAcSh MSNs, both activated in a time-locked manner on a cue-conditioned motivational action. In brain slices prepared from male and female mice, we show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAcSh synapses without affecting BLA-to-NAcSh synapses, revealing a heterosynaptic mechanism through which BLA signals persistently increase the temporally contingent vH-to-NAcSh transmission. Furthermore, this LTP is more prominent in dopamine D1 receptor-expressing (D1) MSNs than D2 MSNs and can be prevented by inhibition of either D1 receptors or dopaminergic terminals in NAcSh. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.SIGNIFICANCE STATEMENT In motivated behaviors, environmental cues associated with arousing stimuli acquire increased incentive salience, processes mediated in part by the nucleus accumbens (NAc). NAc principal neurons receive glutamatergic projections from the ventral hippocampus (vH) and basolateral amygdala (BLA), which transmit information encoding contextual cues and affective states, respectively. Our results show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAc synapses without affecting BLA-to-NAc synapses, revealing a heterosynaptic mechanism through which BLA signals potentiate the temporally contingent vH-to-NAc transmission. Furthermore, this LTP is prevented by inhibition of either D1 receptors or dopaminergic axons. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.

TET1-induced DNA demethylation in dentate gyrus is important for reward conditioning and reinforcement

Neuroadaptations in neurocircuitry of reward memories govern the persistent and compulsive behaviors. The study of the role of hippocampus in processing of reward memory and its retrieval is critical to our understanding of addiction and relapse. The aim of this study is to probe the epigenetic mechanisms underlying reward memory in the frame of dentate gyrus (DG). To that end, the rats conditioned to the food baited arm of a Y-maze and subjected to memory probe trial. The hippocampus of conditioned rats displayed higher mRNA levels of Ten-eleven translocase 1 (Tet1) and brain-derived neurotrophic factor (Bdnf) after memory probe trial. The DNA hydroxymethylation and TET1 occupancy at the Bdnf promoters showed concomitant increase. Stereotactic administration of Tet1 siRNA in the DG before and after conditioning inhibited reward memory formation and recall, respectively. Administration of Tet1 siRNA impaired the reward memory recall that was reinstated following administration of exogenous BDNF peptide or after wash-off period of 8 days. Infusion of a MEK/ERK inhibitor, U0126 in the DG inhibited reward memory retrieval. The TET1-induced DNA demethylation at the Bdnf promoters raised BDNF levels in the hippocampus, thereby setting the stage for reward memory retrieval. The study underscores the causative role of TET1 in the DG for reward memory formation and recall.

Proximal CA1 20-40 Hz power dynamics reflect trial-specific information processing supporting nonspatial sequence memory

The hippocampus is known to play a critical role in processing information about temporal context. However, it remains unclear how hippocampal oscillations are involved, and how their functional organization is influenced by connectivity gradients. We examined local field potential activity in CA1 as rats performed a nonspatial odor sequence memory task. We found that odor sequence processing epochs were characterized by distinct spectral profiles and proximodistal CA1 gradients of theta and 20-40 Hz power than track running epochs. We also discovered that 20-40 Hz power was predictive of sequence memory performance, particularly in proximal CA1 and during the plateau of high power observed in trials in which animals had to maintain their decision until instructed to respond. Altogether, these results provide evidence that dynamics of 20-40 Hz power along the CA1 axis are linked to trial-specific processing of nonspatial information critical to order judgments and are consistent with a role for 20-40 Hz power in gating information processing.

Indicators and criteria of consciousness: ethical implications for the care of behaviourally unresponsive patients

BACKGROUND

Assessing consciousness in other subjects, particularly in non-verbal and behaviourally disabled subjects (e.g., patients with disorders of consciousness), is notoriously challenging but increasingly urgent. The high rate of misdiagnosis among disorders of consciousness raises the need for new perspectives in order to inspire new technical and clinical approaches.

MAIN BODY

We take as a starting point a recently introduced list of operational indicators of consciousness that facilitates its recognition in challenging cases like non-human animals and Artificial Intelligence to explore their relevance to disorders of consciousness and their potential ethical impact on the diagnosis and healthcare of relevant patients. Indicators of consciousness mean particular capacities that can be deduced from observing the behaviour or cognitive performance of the subject in question (or from neural correlates of such performance) and that do not define a hard threshold in deciding about the presence of consciousness, but can be used to infer a graded measure based on the consistency amongst the different indicators. The indicators of consciousness under consideration offer a potential useful strategy for identifying and assessing residual consciousness in patients with disorders of consciousness, setting the theoretical stage for an operationalization and quantification of relevant brain activity.

CONCLUSIONS

Our heuristic analysis supports the conclusion that the application of the identified indicators of consciousness to its disorders will likely inspire new strategies for assessing three very urgent issues: the misdiagnosis of disorders of consciousness; the need for a gold standard in detecting consciousness and diagnosing its disorders; and the need for a refined taxonomy of disorders of consciousness.

Effect of reward and punishment on no-risk decision-making in young men: an EEG study

Decision-making is a process that allows adapting behavior in response to feedback to achieve a goal. Previous studies have suggested that the cerebral cortex shows different activation patterns in response to feedback. However, the effects of reward and punishment on learning contexts and decision-making are not clear. Thus, this experiment compared the effects of reward and punishment on behavior and the electroencephalographic activity of cortical areas related to decision-making in a no-risk context. Twenty healthy males were asked to perform a decision-making task under two conditions in which the goal was to finish in the shortest time possible. In the reward condition, the more points the participant accumulated the sooner the task ended, while in the punishment condition, the more points accumulated the longer the task lasted. Lower reaction times were found in the reward condition, characterized by a higher absolute power of the slow bands in almost all the cortices recorded. Changes in the interhemispheric correlation were also obtained in the comparison of the two feedback conditions. Results suggest that changes in the type of feedback affect cortical functionality and behavioral execution during decision-making, with the reward being related to a quick emotional response strategy and punishment associated with slower and, likely, more reasoned responses.

Neural oscillations reflect meaning identification for novel words in context

During language processing, people make rapid use of contextual information to promote comprehension of upcoming words. When new words are learned implicitly, information contained in the surrounding context can provide constraints on their possible meaning. In the current study, EEG was recorded as participants listened to a series of three sentences, each containing an identical target pseudoword, with the aim of using contextual information in the surrounding language to identify a meaning representation for the novel word. In half of trials, sentences were semantically coherent so that participants could develop a single representation for the novel word that fit all contexts. Other trials contained unrelated sentence contexts so that meaning associations were not possible. We observed greater theta band enhancement over the left-hemisphere across central and posterior electrodes in response to pseudowords processed across semantically related compared to unrelated contexts. Additionally, relative alpha and beta band suppression was increased prior to pseudoword onset in trials where contextual information more readily promoted pseudoword-meaning associations. Under the hypothesis that theta enhancement indexes processing demands during lexical access, the current study provides evidence for selective online memory retrieval to novel words learned implicitly in a spoken context.

Volitional control of individual neurons in the human brain

Brain-machine interfaces allow neuroscientists to causally link specific neural activity patterns to a particular behaviour. Thus, in addition to their current clinical applications, brain-machine interfaces can also be used as a tool to investigate neural mechanisms of learning and plasticity in the brain. Decades of research using such brain-machine interfaces have shown that animals (non-human primates and rodents) can be operantly conditioned to self-regulate neural activity in various motor-related structures of the brain. Here, we ask whether the human brain, a complex interconnected structure of over 80 billion neurons, can learn to control itself at the most elemental scale-a single neuron. We used the unique opportunity to record single units in 11 individuals with epilepsy to explore whether the firing rate of a single (direct) neuron in limbic and other memory-related brain structures can be brought under volitional control. To do this, we developed a visual neurofeedback task in which participants were trained to move a block on a screen by modulating the activity of an arbitrarily selected neuron from their brain. Remarkably, participants were able to volitionally modulate the firing rate of the direct neuron in these previously uninvestigated structures. We found that a subset of participants (learners), were able to improve their performance within a single training session. Successful learning was characterized by (i) highly specific modulation of the direct neuron (demonstrated by significantly increased firing rates and burst frequency); (ii) a simultaneous decorrelation of the activity of the direct neuron from the neighbouring neurons; and (iii) robust phase-locking of the direct neuron to local alpha/beta-frequency oscillations, which may provide some insights in to the potential neural mechanisms that facilitate this type of learning. Volitional control of neuronal activity in mnemonic structures may provide new ways of probing the function and plasticity of human memory without exogenous stimulation. Furthermore, self-regulation of neural activity in these brain regions may provide an avenue for the development of novel neuroprosthetics for the treatment of neurological conditions that are commonly associated with pathological activity in these brain structures, such as medically refractory epilepsy.

Sleep Enhances Consolidation of Memory Traces for Complex Problem-Solving Skills

Sleep consolidates memory for procedural motor skills, reflected by sleep-dependent changes in the hippocampal-striatal-cortical network. Other forms of procedural skills require the acquisition of a novel strategy to solve a problem, which recruit overlapping brain regions and specialized areas including the caudate and prefrontal cortex. Sleep preferentially benefits strategy and problem-solving skills over the accompanying motor execution movements. However, it is unclear how acquiring new strategies benefit from sleep. Here, participants performed a task requiring the execution of a sequence of movements to learn a novel cognitive strategy. Participants performed this task while undergoing fMRI before and after an interval of either a full night sleep, a daytime nap, or wakefulness. Participants also performed a motor control task, which precluded the opportunity to learn the strategy. In this way, we subtracted motor execution-related brain activations from activations specific to the strategy. The sleep and nap groups experienced greater behavioral performance improvements compared to the wake group on the strategy-based task. Following sleep, we observed enhanced activation of the caudate in addition to other regions in the hippocampal-striatal-cortical network, compared to wakefulness. This study demonstrates that sleep is a privileged time to enhance newly acquired cognitive strategies needed to solve problems.

Navigating for reward

An organism's survival can depend on its ability to recall and navigate to spatial locations associated with rewards, such as food or a home. Accumulating research has revealed that computations of reward and its prediction occur on multiple levels across a complex set of interacting brain regions, including those that support memory and navigation. However, how the brain coordinates the encoding, recall and use of reward information to guide navigation remains incompletely understood. In this Review, we propose that the brain's classical navigation centres - the hippocampus and the entorhinal cortex - are ideally suited to coordinate this larger network by representing both physical and mental space as a series of states. These states may be linked to reward via neuromodulatory inputs to the hippocampus-entorhinal cortex system. Hippocampal outputs can then broadcast sequences of states to the rest of the brain to store reward associations or to facilitate decision-making, potentially engaging additional value signals downstream. This proposal is supported by recent advances in both experimental and theoretical neuroscience. By discussing the neural systems traditionally tied to navigation and reward at their intersection, we aim to offer an integrated framework for understanding navigation to reward as a fundamental feature of many cognitive processes.

Beta-band modulation in the human hippocampus during a conflict response task

Objective Identify the role of beta-band (13-30 Hz) power modulation in the human hippocampus during conflict processing. Approach We investigated changes in the spectral power of the beta band (13-30 Hz) as measured by depth electrode leads in the hippocampus during a modified Stroop task in six patients with medically-refractory epilepsy. Previous work done with direct electrophysiological recordings in humans has shown hippocampal theta-band (3-8 Hz) modulation during conflict processing. Local field potentials (LFP) sampled at 2k Hz were used for analysis and a non-parametric cluster-permutation t-test was used to identify the time period and frequency ranges of significant power change during cue processing (i.e. post-stimulus, pre-response). Main Results In five of the six patients, we observe a statistically significant increase in hippocampal beta-band power during successful conflict processing in the incongruent trial condition (cluster-based correction for multiple comparisons, p < 0.05). There was no significant beta-band power change observed during the cue processing period of the congruent condition in the hippocampus of these patients. Significance The beta-power changes during conflict processing represented here are consistent with previous studies suggesting that the hippocampus plays a role in conflict processing, but it is the first time that the beta band has been shown to be involved in humans with direct electrophysiological evidence. We propose that beta-band modulation plays a role in successful conflict detection and automatic response inhibition in the human hippocampus as studied during a conflict response task.

Alternating sequences of future and past behavior encoded within hippocampal theta oscillations

Neural networks display the ability to transform forward-ordered activity patterns into reverse-ordered, retrospective sequences. The mechanisms underlying this transformation remain unknown. We discovered that, during active navigation, rat hippocampal CA1 place cell ensembles are inherently organized to produce independent forward- and reverse-ordered sequences within individual theta oscillations. This finding may provide a circuit-level basis for retrospective evaluation and storage during ongoing behavior. Theta phase procession arose in a minority of place cells, many of which displayed two preferred firing phases in theta oscillations and preferentially participated in reverse replay during subsequent rest. These findings reveal an unexpected aspect of theta-based hippocampal encoding and provide a biological mechanism to support the expression of reverse-ordered sequences.

Enhancement of Hippocampal Spatial Decoding Using a Dynamic Q-Learning Method With a Relative Reward Using Theta Phase Precession

Hippocampal place cells and interneurons in mammals have stable place fields and theta phase precession profiles that encode spatial environmental information. Hippocampal CA1 neurons can represent the animal's location and prospective information about the goal location. Reinforcement learning (RL) algorithms such as Q-learning have been used to build the navigation models. However, the traditional Q-learning ([Formula: see text]Q-learning) limits the reward function once the animals arrive at the goal location, leading to unsatisfactory location accuracy and convergence rates. Therefore, we proposed a revised version of the Q-learning algorithm, dynamical Q-learning ([Formula: see text]Q-learning), which assigns the reward function adaptively to improve the decoding performance. Firing rate was the input of the neural network of [Formula: see text]Q-learning and was used to predict the movement direction. On the other hand, phase precession was the input of the reward function to update the weights of [Formula: see text]Q-learning. Trajectory predictions using [Formula: see text]Q- and [Formula: see text]Q-learning were compared by the root mean squared error (RMSE) between the actual and predicted rat trajectories. Using [Formula: see text]Q-learning, significantly higher prediction accuracy and faster convergence rate were obtained compared with [Formula: see text]Q-learning in all cell types. Moreover, combining place cells and interneurons with theta phase precession improved the convergence rate and prediction accuracy. The proposed [Formula: see text]Q-learning algorithm is a quick and more accurate method to perform trajectory reconstruction and prediction.

Beta-band power modulation in the human hippocampus during a reaching task

OBJECTIVE

Characterize the role of the beta-band (13-30 Hz) in the human hippocampus during the execution of voluntary movement.

APPROACH

We recorded electrophysiological activity in human hippocampus during a reach task using stereotactic electroencephalography (SEEG). SEEG has previously been utilized to study the theta band (3-8 Hz) in conflict processing and spatial navigation, but most studies of hippocampal activity during movement have used noninvasive measures such as fMRI. We analyzed modulation in the beta band (13-30 Hz), which is known to play a prominent role throughout the motor system including the cerebral cortex and basal ganglia. We conducted the classic 'center-out' direct-reach experiment with nine patients undergoing surgical treatment for medically refractory epilepsy.

MAIN RESULTS

In seven of the nine patients, power spectral analysis showed a statistically significant decrease in power within the beta band (13-30 Hz) during the response phase, compared to the fixation phase, of the center-out direct-reach task using the Wilcoxon signed-rank hypothesis test (p < 0.05).

SIGNIFICANCE

This finding is consistent with previous literature suggesting that the hippocampus may be involved in the execution of movement, and it is the first time that changes in beta-band power have been demonstrated in the hippocampus using human electrophysiology. Our findings suggest that beta-band modulation in the human hippocampus may play a role in the execution of voluntary movement.

The lateralization of left hippocampal CA3 during the retrieval of spatial working memory

The hippocampal CA3 contributes to spatial working memory (SWM), but which stage of SWM the CA3 neurons act on and whether the lateralization of CA3 function occurs in SWM is also unknown. Here, we reveal increased neural activity in both sample and choice phases of SWM. Left CA3 (LCA3) neurons show higher sensitivity in the choice phase during the correct versus error trials compared with right CA3 (RCA3) neurons. LCA3 initiates firing prior to RCA3 in the choice phase. Optogenetic suppression of pyramidal neurons in LCA3 disrupts SWM only in the choice phase. Furthermore, we discover that parvalbumin (PV) neurons, rather than cholinergic neurons in the medial septum (DB were cholinergic neurons), can project directly to unilateral CA3. Selective suppression of PV neurons in the MS projecting to LCA3 impairs SWM. The findings suggest that MS^PV-LCA3 projection plays a crucial role in manipulating the lateralization of LCA3 in the retrieval of SWM.

The CA3 region of the hippocampus is involved in spatial working memory. Here, the authors show that neurons in the left CA3 are more active in the choice phase of correct trials of spatial working memory than neurons in the right CA3, revealing lateralization of spatial working memory.

Dorsal and Ventral Hippocampal Sharp-Wave Ripples Activate Distinct Nucleus Accumbens Networks

Memories of positive experiences link places, events, and reward outcomes. These memories recruit interactions between the hippocampus and nucleus accumbens (NAc). Both dorsal and ventral hippocampus (dH and vH) project to the NAc, but it remains unknown whether dH and vH act in concert or separately to engage NAc representations related to space and reward. We recorded simultaneously from the dH, vH, and NAc of rats during an appetitive spatial task and focused on hippocampal sharp-wave ripples (SWRs) to identify times of memory reactivation across brain regions. Here, we show that dH and vH awake SWRs occur asynchronously and activate distinct and opposing patterns of NAc spiking. Only NAc neurons activated during dH SWRs were tuned to task- and reward-related information. These temporally and anatomically separable hippocampal-NAc interactions point to distinct channels of mnemonic processing in the NAc, with the dH-NAc channel specialized for spatial task and reward information. VIDEO ABSTRACT.

Multiplexing of Information about Self and Others in Hippocampal Ensembles

In addition to coding a subject's location in space, the hippocampus has been suggested to code social information, including the spatial position of conspecifics. "Social place cells" have been reported for tasks in which an observer mimics the behavior of a demonstrator. We examine whether rat hippocampal neurons may encode the behavior of a minirobot, but without requiring the animal to mimic it. Rather than finding social place cells, we observe that robot behavioral patterns modulate place fields coding animal position. This modulation may be confounded by correlations between robot movement and changes in the animal's position. Although rat position indeed significantly predicts robot behavior, we find that hippocampal ensembles code additional information about robot movement patterns. Fast-spiking interneurons are particularly informative about robot position and global behavior. In conclusion, when the animal's own behavior is conditional on external agents, the hippocampus multiplexes information about self and others.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.

Methodological Considerations on the Use of Different Spectral Decomposition Algorithms to Study Hippocampal Rhythms

Local field potential (LFP) oscillations are primarily shaped by the superposition of postsynaptic currents. Hippocampal LFP oscillations in the 25- to 50-Hz range (“slow γ”) are proposed to support memory retrieval independent of other frequencies. However, θ harmonics extend up to 48 Hz, necessitating a study to determine whether these oscillations are fundamentally the same. We compared the spectral analysis methods of wavelet, ensemble empirical-mode decomposition (EEMD), and Fourier transform. EEMD, as previously applied, failed to account for the θ harmonics. Depending on analytical parameters selected, wavelet may convolve over high-order θ harmonics due to the variable time-frequency atoms, creating the appearance of a broad 25- to 50-Hz rhythm. As an illustration of this issue, wavelet and EEMD depicted slow γ in a synthetic dataset that only contained θ and its harmonics. Oscillatory transience cannot explain the difference in approaches as Fourier decomposition identifies ripples triggered to epochs of high-power, 120- to 250-Hz events. When Fourier is applied to high power, 25- to 50-Hz events, only θ harmonics are resolved. This analysis challenges the identification of the slow γ rhythm as a unique fundamental hippocampal oscillation. While there may be instances in which slow γ is present in the rat hippocampus, the analysis presented here shows that unless care is exerted in the application of EEMD and wavelet techniques, the results may be misleading, in this case misrepresenting θ harmonics. Moreover, it is necessary to reconsider the characteristics that define a fundamental hippocampal oscillation as well as theories based on multiple independent γ bands.

Reward Expectation Modulates Local Field Potentials, Spiking Activity and Spike-Field Coherence in the Primary Motor Cortex

Reward modulation (M1) could be exploited in developing an autonomously updating brain-computer interface (BCI) based on a reinforcement learning (RL) architecture. For an autonomously updating RL-based BCI system, we would need a reward prediction error, or a state-value representation from the user's neural activity, which the RL-BCI agent could use to update its BCI decoder. In order to understand the multifaceted effects of reward on M1 activity, we investigated how neural spiking, oscillatory activities and their functional interactions are modulated by conditioned stimuli related reward expectation. To do so, local field potentials (LFPs) and single/multi-unit activities were recorded simultaneously and bilaterally from M1 cortices while four non-human primates (NHPs) performed cued center-out reaching or grip force tasks either manually using their right arm/hand or observed passively. We found that reward expectation influenced the strength of α (8-14 Hz) power, α-γ comodulation, α spike-field coherence (SFC), and firing rates (FRs) in general in M1. Furthermore, we found that an increase in α-band power was correlated with a decrease in neural spiking activity, that FRs were highest at the trough of the α-band cycle and lowest at the peak of its cycle. These findings imply that α oscillations modulated by reward expectation have an influence on spike FR and spike timing during both reaching and grasping tasks in M1. These LFP, spike, and spike-field interactions could be used to follow the M1 neural state in order to enhance BCI decoding (An et al., 2018; Zhao et al., 2018).

Formation of a morphine-conditioned place preference does not change the size of evoked potentials in the ventral hippocampus-nucleus accumbens projection

In opioid addiction, cues and contexts associated with drug reward can be powerful triggers for drug craving and relapse. The synapses linking ventral hippocampal outputs to medium spiny neurons of the accumbens may be key sites for the formation and storage of associations between place or context and reward, both drug-related and natural. To assess this, we implanted rats with electrodes in the accumbens shell to record synaptic potentials evoked by electrical stimulation of the ventral hippocampus, as well as continuous local-field-potential activity. Rats then underwent morphine-induced (10 mg/kg) conditioned-place-preference training, followed by extinction. Morphine caused an acute increase in the slope and amplitude of accumbens evoked responses, but no long-term changes were evident after conditioning or extinction of the place preference, suggesting that the formation of this type of memory does not lead to a net change in synaptic strength in the ventral hippocampal output to the accumbens. However, analysis of the local field potential revealed a marked sensitization of theta- and high-gamma-frequency activity with repeated morphine administration. This phenomenon may be linked to the behavioral changes—such as psychomotor sensitization and the development of drug craving—that are associated with chronic use of addictive drugs.

Persistent coding of outcome-predictive cue features in the rat nucleus accumbens

The nucleus accumbens (NAc) is important for learning from feedback, and for biasing and invigorating behaviour in response to cues that predict motivationally relevant outcomes. NAc encodes outcome-related cue features such as the magnitude and identity of reward. However, little is known about how features of cues themselves are encoded. We designed a decision making task where rats learned multiple sets of outcome-predictive cues, and recorded single-unit activity in the NAc during performance. We found that coding of cue identity and location occurred alongside coding of expected outcome. Furthermore, this coding persisted both during a delay period, after the rat made a decision and was waiting for an outcome, and after the outcome was revealed. Encoding of cue features in the NAc may enable contextual modulation of on-going behaviour, and provide an eligibility trace of outcome-predictive stimuli for updating stimulus-outcome associations to inform future behaviour.

Cannabinoid disruption of learning mechanisms involved in reward processing

The increasing use of cannabis, its derivatives, and synthetic cannabinoids for medicinal and recreational purposes has led to burgeoning interest in understanding the addictive potential of this class of molecules. It is estimated that ∼10% of marijuana users will eventually show signs of dependence on the drug, and the diagnosis of cannabis use disorder (CUD) is increasing in the United States. The molecule that sustains the use of cannabis is Δ⁹-tetrahydrocannabinol (Δ⁹-THC), and our knowledge of its effects, and those of other cannabinoids on brain function has expanded rapidly in the past two decades. Additionally, the identification of endogenous cannabinoid (endocannabinoid) systems in brain and their roles in physiology and behavior, demonstrate extensive involvement of these lipid signaling molecules in regulating CNS function. Here, we examine roles for endogenous cannabinoids in shaping synaptic activity in cortical and subcortical brain circuits, and we discuss mechanisms in which exogenous cannabinoids, such as Δ⁹-THC, interact with endocannabinoid systems to disrupt neuronal network oscillations. We then explore how perturbation of the interaction of this activity within brain reward circuits may lead to impaired learning. Finally, we propose that disruption of cellular plasticity mechanisms by exogenous cannabinoids in cortical and subcortical circuits may explain the difficulty in establishing viable cannabinoid self-administration models in animals.

Consciousness, Representation, Action: The Importance of Being Goal-Directed

Recent years have witnessed fierce debates on the dependence of consciousness on interactions between a subject and the environment. Reviewing neuroscientific, computational, and clinical evidence, I will address three questions. First, does conscious experience necessarily depend on acute interactions between a subject and the environment? Second, does it depend on specific perception-action loops in the longer run? Third, which types of action does consciousness cohere with, if not with all of them? I argue that conscious contents do not necessarily depend on acute or long-term brain-environment interactions. Instead, consciousness is proposed to be specifically associated with, and subserve, deliberate, goal-directed behavior (GDB). Brain systems implied in conscious representation are highly connected to, but distinct from, neural substrates mediating GDB and declarative memory.

The malleable brain: plasticity of neural circuits and behavior - a review from students to students

One of the most intriguing features of the brain is its ability to be malleable, allowing it to adapt continually to changes in the environment. Specific neuronal activity patterns drive long-lasting increases or decreases in the strength of synaptic connections, referred to as long-term potentiation and long-term depression, respectively. Such phenomena have been described in a variety of model organisms, which are used to study molecular, structural, and functional aspects of synaptic plasticity. This review originated from the first International Society for Neurochemistry (ISN) and Journal of Neurochemistry (JNC) Flagship School held in Alpbach, Austria (Sep 2016), and will use its curriculum and discussions as a framework to review some of the current knowledge in the field of synaptic plasticity. First, we describe the role of plasticity during development and the persistent changes of neural circuitry occurring when sensory input is altered during critical developmental stages. We then outline the signaling cascades resulting in the synthesis of new plasticity-related proteins, which ultimately enable sustained changes in synaptic strength. Going beyond the traditional understanding of synaptic plasticity conceptualized by long-term potentiation and long-term depression, we discuss system-wide modifications and recently unveiled homeostatic mechanisms, such as synaptic scaling. Finally, we describe the neural circuits and synaptic plasticity mechanisms driving associative memory and motor learning. Evidence summarized in this review provides a current view of synaptic plasticity in its various forms, offers new insights into the underlying mechanisms and behavioral relevance, and provides directions for future research in the field of synaptic plasticity. Read the Editorial Highlight for this article on page 788. Cover Image for this issue: doi: 10.1111/jnc.13815.

Internally generated hippocampal sequences as a vantage point to probe future-oriented cognition

Information processing in the rodent hippocampus is fundamentally shaped by internally generated sequences (IGSs), expressed during two different network states: theta sequences, which repeat and reset at the ∼8 Hz theta rhythm associated with active behavior, and punctate sharp wave-ripple (SWR) sequences associated with wakeful rest or slow-wave sleep. A potpourri of diverse functional roles has been proposed for these IGSs, resulting in a fragmented conceptual landscape. Here, we advance a unitary view of IGSs, proposing that they reflect an inferential process that samples a policy from the animal's generative model, supported by hippocampus-specific priors. The same inference affords different cognitive functions when the animal is in distinct dynamical modes, associated with specific functional networks. Theta sequences arise when inference is coupled to the animal's action-perception cycle, supporting online spatial decisions, predictive processing, and episode encoding. SWR sequences arise when the animal is decoupled from the action-perception cycle and may support offline cognitive processing, such as memory consolidation, the prospective simulation of spatial trajectories, and imagination. We discuss the empirical bases of this proposal in relation to rodent studies and highlight how the proposed computational principles can shed light on the mechanisms of future-oriented cognition in humans.

Medial Prefrontal Cortex Reduces Memory Interference by Modifying Hippocampal Encoding

The prefrontal cortex (PFC) is crucial for accurate memory performance when prior knowledge interferes with new learning, but the mechanisms that minimize proactive interference are unknown. To investigate these, we assessed the influence of medial PFC (mPFC) activity on spatial learning and hippocampal coding in a plus maze task that requires both structures. mPFC inactivation did not impair spatial learning or retrieval per se, but impaired the ability to follow changing spatial rules. mPFC and CA1 ensembles recorded simultaneously predicted goal choices and tracked changing rules; inactivating mPFC attenuated CA1 prospective coding. mPFC activity modified CA1 codes during learning, which in turn predicted how quickly rats adapted to subsequent rule changes. The results suggest that task rules signaled by the mPFC become incorporated into hippocampal representations and support prospective coding. By this mechanism, mPFC activity prevents interference by "teaching" the hippocampus to retrieve distinct representations of similar circumstances.