Selective excitotoxic lesions of the hippocampus and basolateral amygdala have dissociable effects on appetitive cue and place conditioning based on path integration in a novel Y-maze procedure

Drug memory reconsolidation: from molecular mechanisms to the clinical context

Since its rediscovery at the beginning of the 21st Century, memory reconsolidation has been proposed to be a therapeutic target for reducing the impact of emotional memories that can go awry in mental health disorders such as drug addiction (substance use disorder, SUD). Addiction can be conceptualised as a disorder of learning and memory, in which both pavlovian and instrumental learning systems become hijacked into supporting drug-seeking and drug-taking behaviours. The past two decades of research have characterised the details of the molecular pathways supporting the reconsolidation of pavlovian cue-drug memories, with more recent work indicating that the reconsolidation of instrumental drug-seeking memories also relies upon similar mechanisms. This narrative review considers what is known about the mechanisms underlying the reconsolidation of pavlovian and instrumental memories associated with drug use, how these approaches have translated to experimental medicine studies, and the challenges and opportunities for the clinical use of reconsolidation-based therapies.

Reevaluating the role of the hippocampus in memory: A meta-analysis of neurotoxic lesion studies in nonhuman primates

The hippocampus and perirhinal cortex are both broadly implicated in memory; nevertheless, their relative contributions to visual item recognition and location memory remain disputed. Neuropsychological studies in nonhuman primates that examine memory function after selective damage to medial temporal lobe structures report various levels of memory impairment-ranging from minor deficits to profound amnesia. The discrepancies in published findings have complicated efforts to determine the exact magnitude of visual item recognition and location memory impairments following damage to the hippocampus and/or perirhinal cortex. To provide the most accurate estimate to date of the overall effect size, we use meta-analytic techniques on data aggregated from 26 publications that assessed visual item recognition and/or location memory in nonhuman primates with and without selective neurotoxic lesions of the hippocampus or perirhinal cortex. We estimated the overall effect size, evaluated the relation between lesion extent and effect size, and investigated factors that may account for between-study variation. Grouping studies by lesion target and testing method, separate meta-analyses were conducted. One meta-analysis indicated that impairments on tests of visual item recognition were larger after lesions of perirhinal cortex than after lesions of the hippocampus. A separate meta-analysis showed that performance on tests of location memory was severely impaired by lesions of the hippocampus. For the most part, meta-regressions indicated that greater impairment corresponds with greater lesion extent; paradoxically, however, more extensive hippocampal lesions predicted smaller impairments on tests of visual item recognition. We conclude the perirhinal cortex makes a larger contribution than the hippocampus to visual item recognition, and the hippocampus predominately contributes to spatial navigation.

Neural circuit dynamics of drug-context associative learning in the mouse hippocampus

The environmental context associated with previous drug consumption is a potent trigger for drug relapse. However, the mechanism by which neural representations of context are modified to incorporate information associated with drugs of abuse remains unknown. Using longitudinal calcium imaging in freely behaving mice, we find that unlike the associative learning of natural reward, drug-context associations for psychostimulants and opioids are encoded in a specific subset of hippocampal neurons. After drug conditioning, these neurons weakened their spatial coding for the non-drug paired context, resulting in an orthogonal representation for the drug versus non-drug context that was predictive of drug-seeking behavior. Furthermore, these neurons were selected based on drug-spatial experience and were exclusively tuned to animals' allocentric position. Together, this work reveals how drugs of abuse alter the hippocampal circuit to encode drug-context associations and points to the possibility of targeting drug-associated memory in the hippocampus.

Trace classical conditioning impairment after lesion of the lateral part of the goldfish telencephalic pallium suggests a long ancestry of the episodic memory function of the vertebrate hippocampus

There is an ongoing debate on the evolutionary origin of the episodic memory function of the hippocampus. A widely accepted hypothesis claims that the hippocampus first evolved as a dedicated system for spatial navigation in ancestral vertebrates, being transformed later in phylogeny to support a broader role in episodic memory with the emergence of mammals. On the contrary, an alternative hypothesis holds that the hippocampus of ancestral vertebrates originally encoded both the spatial and temporal dimensions of relational memories since its evolutionary appearance, thus suggesting that the episodic-like memory function of the hippocampus could be the primitive condition in vertebrate forebrain evolution. The present experiment was aimed at scrutinizing these opposing hypotheses by investigating whether the hippocampal pallium of teleost fish, a vertebrate group that shares with mammals a common ancestor that lived about 400 Mya, is, like the hippocampus of mammals, essential to associate time-discontiguous events. Thus, goldfish with lesions in the ventral part of the dorsolateral pallium (Dlv), a telencephalic region considered homologous to the hippocampal pallium of land vertebrates, were trained in trace versus delay eyeblink-like classical conditioning, two learning procedures that differ only in the temporal relationships between the stimuli to be associated in memory. The results showed that hippocampal pallium lesion in goldfish severely impairs trace conditioning, but spares delay conditioning. This finding challenges the idea that navigation preceded relational memory in evolutionary appearance and suggests the possibility that a relational memory function that associates the experienced events in both the spatial and temporal dimensions could be a primitive feature of the hippocampus that pre-existed in the common ancestor of vertebrates.

Cortico-Hippocampal Computational Modeling Using Quantum Neural Networks to Simulate Classical Conditioning Paradigms

Most existing cortico-hippocampal computational models use different artificial neural network topologies. These conventional approaches, which simulate various biological paradigms, can get slow training and inadequate conditioned responses for two reasons: increases in the number of conditioned stimuli and in the complexity of the simulated biological paradigms in different phases. In this paper, a cortico-hippocampal computational quantum (CHCQ) model is proposed for modeling intact and lesioned systems. The CHCQ model is the first computational model that uses the quantum neural networks for simulating the biological paradigms. The model consists of two entangled quantum neural networks: an adaptive single-layer feedforward quantum neural network and an autoencoder quantum neural network. The CHCQ model adaptively updates all the weights of its quantum neural networks using quantum instar, outstar, and Widrow–Hoff learning algorithms. Our model successfully simulated several biological processes and maintained the output-conditioned responses quickly and efficiently. Moreover, the results were consistent with prior biological studies.

Green model to adapt classical conditioning learning in the hippocampus

Compared with the biological paradigms of classical conditioning, non-adaptive computational models are not capable of realistically simulating the biological behavioural functions of the hippocampal regions, because of their implausible requirement for a large number of learning trials, which can be on the order of hundreds. Additionally, these models did not attain a unified, final stable state even after hundreds of learning trials. Conversely, the output response has a different threshold for similar tasks in various models with prolonged transient response of unspecified status via the training or even testing phases. Accordingly, a green model is a combination of adaptive neuro-computational hippocampal and cortical models that is proposed by adaptively updating the whole weights in all layers for both intact networks and lesion networks using instar and outstar learning rules with adaptive resonance theory (ART). The green model sustains and expands the classical conditioning biological paradigms of the non-adaptive models. The model also overcomes the irregular output response behaviour by using the proposed feature of adaptivity. Further, the model successfully simulates the hippocampal regions without passing the final output response back to the whole network, which is considered to be biologically implausible. The results of the Green model showed a significant improvement confirmed by empirical studies of different tasks. In addition, the results indicated that the model outperforms the previously published models. All the obtained results successfully and quickly attained a stable, desired final state (with a unified concluding state of either "1" or "0") with a significantly shorter transient duration.

Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis

While the neurobiology of simple and habitual choices is relatively well known, our current understanding of goal-directed choices and planning in the brain is still limited. Theoretical work suggests that goal-directed computations can be productively associated to model-based (reinforcement learning) computations, yet a detailed mapping between computational processes and neuronal circuits remains to be fully established. Here we report a computational analysis that aligns Bayesian nonparametrics and model-based reinforcement learning (MB-RL) to the functioning of the hippocampus (HC) and the ventral striatum (vStr)-a neuronal circuit that increasingly recognized to be an appropriate model system to understand goal-directed (spatial) decisions and planning mechanisms in the brain. We test the MB-RL agent in a contextual conditioning task that depends on intact hippocampus and ventral striatal (shell) function and show that it solves the task while showing key behavioral and neuronal signatures of the HC-vStr circuit. Our simulations also explore the benefits of biological forms of look-ahead prediction (forward sweeps) during both learning and control. This article thus contributes to fill the gap between our current understanding of computational algorithms and biological realizations of (model-based) reinforcement learning.

Inter-individual differences in serotonin and glutamate co-transmission reflect differentiation in context-induced conditioned 50-kHz USVs response after morphine withdrawal

A growing body of research provides compelling evidence that in rats 50-kHz USVs are a form of expression of positive emotions. Context-induced 50-kHz USVs emission is variable among rats, indicating individual differences in contextual response bound up with pharmacological reward. The aims of this study were to: extract the most important neurotransmitters related to context-induced conditioned 50-kHz USVs response; find biological basis of existing inter-individual differences in context-induced conditioned 50-kHz USVs response; create a model of all-to-all neurotransmitters correlations. The data collected here confirms that re-exposure to the context of morphine administration after the withdrawal period increases the level of 50-kHz USVs and this contextual response is associated with elevated serotonin concentrations in amygdala, hippocampus and mPFC and with increased Glu/Gln ratio in nucleus accumbens. The concentration of serotonin increases simultaneously in amygdala, nucleus accumbens and hippocampus. Moreover, 5-HT concentration in amygdala is bound up with glutamate level in this structure as well as in hippocampus. Furthermore, Glu/Gln ratio in nucleus accumbens has strong associations with Glu/Gln ratio simultaneously in VTA, amygdala, striatum and hippocampus. All-to-all-analysis indicate that concentration of glutamate in hippocampus is proportional to glutamate in VTA and GABA concentration in the hippocampus. We have also demonstrated that Glu/GABA ratio in VTA and amygdala was elevated after post withdrawal re-exposure to the pharmacological reward paired context. Presented analysis indicates a strong correlation between serotonergic and glutamatergic systems in context-induced conditioned response. The strength of this co-transmission correlates with the number of 50-kHz USVs emitted in response to morphine-paired context.

The malleable brain: plasticity of neural circuits and behavior - a review from students to students

One of the most intriguing features of the brain is its ability to be malleable, allowing it to adapt continually to changes in the environment. Specific neuronal activity patterns drive long-lasting increases or decreases in the strength of synaptic connections, referred to as long-term potentiation and long-term depression, respectively. Such phenomena have been described in a variety of model organisms, which are used to study molecular, structural, and functional aspects of synaptic plasticity. This review originated from the first International Society for Neurochemistry (ISN) and Journal of Neurochemistry (JNC) Flagship School held in Alpbach, Austria (Sep 2016), and will use its curriculum and discussions as a framework to review some of the current knowledge in the field of synaptic plasticity. First, we describe the role of plasticity during development and the persistent changes of neural circuitry occurring when sensory input is altered during critical developmental stages. We then outline the signaling cascades resulting in the synthesis of new plasticity-related proteins, which ultimately enable sustained changes in synaptic strength. Going beyond the traditional understanding of synaptic plasticity conceptualized by long-term potentiation and long-term depression, we discuss system-wide modifications and recently unveiled homeostatic mechanisms, such as synaptic scaling. Finally, we describe the neural circuits and synaptic plasticity mechanisms driving associative memory and motor learning. Evidence summarized in this review provides a current view of synaptic plasticity in its various forms, offers new insights into the underlying mechanisms and behavioral relevance, and provides directions for future research in the field of synaptic plasticity. Read the Editorial Highlight for this article on page 788. Cover Image for this issue: doi: 10.1111/jnc.13815.

The anterior medial temporal lobes: Their role in food intake and body weight regulation

The anterior medial temporal lobes are one of the most studied parts of the brain. Classically, their two main structures - the amygdalae and the hippocampi - have been linked to key cognitive and affective functions, related in particular to learning and memory. Based on abundant evidence, we will argue for an alternative but complementary point of view: they may also play a major role in food intake and body weight regulation. First, an overview is given of early clinical evidence in this line of thought. Subsequently, empirical evidence is presented on how food intake, including in the extreme case of obesity, may relate to amygdalian and hippocampal functioning. The focus is on the amygdala's role in processing the relevance of food stimuli, cue-induced feeding, and stress-induced eating and on the hippocampus' involvement in the use of interoceptive signals of hunger and satiety, as well as memory and inhibitory processes related to food intake. Additionally, an elaboration takes place on possible reciprocal links between food intake, body weight, and amygdala and hippocampus functioning. Finally, issues that seemed particularly critical for future research in the field are discussed.

Involvement of metabotropic glutamate receptor 5 in the inhibition of methamphetamine-associated contextual memory after prolonged extinction training

Addiction is thought to be a memory process between perception and environmental cues and addicted patients often relapse when they come into contact with the drug-related context once again. Here, we used a conditioned place preference protocol to seek a more effective extinction methodology of methamphetamine (METH) memory and delineate its underlying mechanism. Conditioning METH for 3 days in mice markedly increased the time spent in the METH-paired compartment. Then the mice were conditioned with saline for 6 days, from day 6 to day 11, a procedure termed extinction training. However, METH memory returned after a priming injection of METH. We prolonged extinction duration from 6 to 10 days and found that this extensive extinction (EE) training prevented priming effect. At the molecular level, we discovered that prolonged extinction training reversed the METH-conditioned place preference-induced increase in surface expression of GluA2 and alpha-amino-3-hydroxy-5-methylisoxazole-4-propionate (AMPA)/NMDA ratio in the basolateral amygdala. In addition, we found that extinction with metabotropic glutamate receptor 5 (mGluR5) activation had similar results to EE: reduced relapse after extinction, decreased synaptic AMPA receptors AMPARs and the AMPA/NMDA ratio. On the contrary, EE with mGluR5 inhibition suppressed the results of EE. These data indicate that EE training-elicited inhibition of METH-primed reinstatement is mediated by the mGluR5. Conditioning mice with methamphetamine place preference (METH CPP) increases surface expression of AMPA receptors (AMPARs) in the basolateral amygdala. We found prolongation of extinction duration from 6 to 10 days prevented priming effect. At the molecular level, we discovered that extensive extinction (EE) reversed the METH CPP-induced increase in surface expression of GluA2 and AMPA/NMDA ratio. In addition, we found that extinction with the metabotropic glutamate receptor 5 (mGluR5) activation had similar results to EE: reduced relapse after extinction, decreased synaptic AMPARs and the AMPA/NMDA ratio. On the contrary, EE with mGluR5 inhibition suppressed the results of EE. These data indicate that EE training-elicited inhibition of METH-primed reinstatement is mediated by mGluR5 (PAM: positive allosteric modulator).

The hidden price of repeated traumatic exposure: different cognitive deficits in different first-responders

Studies on first responders who are repeatedly exposed to traumatic events report low levels of PTSD symptoms and diagnosis. However, neuroimaging and behavioral studies show that traumatic exposure is associated with brain and cognitive dysfunctions. Taking together it may suggest that traumatic exposure have a price, which is not sufficiently defined by the standard PTSD measures. In a recent study we revealed that similar to individuals with PTSD, non-PTSD highly exposed firefighters display a selective impairment in hippocampal related functions. In the current study we aimed to test whether different first responders display a similar impairment. We concentrated on unique populations of active duty firefighters and criminal scene-investigators (CSI) police, who are frequently exposed to similar levels and types of traumatic events, and compared them to civilian matched-controls with no history of trauma-exposure. We used a hippocampal dependent cue-context reversal paradigm, which separately evaluates reversal of negative and positive outcomes of cue and context related information. We predicted and found that all participants were equally able to acquire and retain stimulus-outcome associations. However, there were significant differences in reversal learning between the groups. Performance among firefighters replicated our prior findings; they struggled to learn that a previously negative context is later associated with a positive outcome. CSI police on the other hand showed a selective impairment in reversing the outcome of a negative cue. Hence after learning that a specific cue is associated with a negative outcome, they could not learn that later it is associated with a positive outcome. Performance in both groups did not correlate with levels of PTSD, anxiety, depression or behavioral inhibition symptoms. The results provide further evidence of the hidden price of traumatic exposure, suggesting that this price may differ as a function of occupation.

Timing and expectation of reward: a neuro-computational model of the afferents to the ventral tegmental area

Neural activity in dopaminergic areas such as the ventral tegmental area is influenced by timing processes, in particular by the temporal expectation of rewards during Pavlovian conditioning. Receipt of a reward at the expected time allows to compute reward-prediction errors which can drive learning in motor or cognitive structures. Reciprocally, dopamine plays an important role in the timing of external events. Several models of the dopaminergic system exist, but the substrate of temporal learning is rather unclear. In this article, we propose a neuro-computational model of the afferent network to the ventral tegmental area, including the lateral hypothalamus, the pedunculopontine nucleus, the amygdala, the ventromedial prefrontal cortex, the ventral basal ganglia (including the nucleus accumbens and the ventral pallidum), as well as the lateral habenula and the rostromedial tegmental nucleus. Based on a plausible connectivity and realistic learning rules, this neuro-computational model reproduces several experimental observations, such as the progressive cancelation of dopaminergic bursts at reward delivery, the appearance of bursts at the onset of reward-predicting cues or the influence of reward magnitude on activity in the amygdala and ventral tegmental area. While associative learning occurs primarily in the amygdala, learning of the temporal relationship between the cue and the associated reward is implemented as a dopamine-modulated coincidence detection mechanism in the nucleus accumbens.

Dopamine D4 receptors in psychostimulant addiction

Since the cloning of the D4 receptor in the 1990s, interest has been building in the role of this receptor in drug addiction, given the importance of dopamine in addiction. Like the D3 receptor, the D4 receptor has limited distribution within the brain, suggesting it may have a unique role in drug abuse. However, compared to the D3 receptor, few studies have evaluated the importance of the D4 receptor. This may be due, in part, to the relative lack of compounds selective for the D4 receptor; the early studies were mainly conducted in mice lacking the D4 receptor. In this review, we summarize the literature on the structure and localization of the D4 receptor before reviewing the data from D4 knockout mice that used behavioral models relevant to the understanding of stimulant use. We also present evidence from more recent pharmacological studies using selective D4 agonists and antagonists and animal models of drug-seeking and drug-taking. The data summarized here suggest a role for D4 receptors in relapse to stimulant use. Therefore, treatments based on antagonism of the D4 receptor may be useful treatments for relapse to nicotine, cocaine, and amphetamine use.

Multisensory control of multimodal behavior: do the legs know what the tongue is doing?

Understanding of adaptive behavior requires the precisely controlled presentation of multisensory stimuli combined with simultaneous measurement of multiple behavioral modalities. Hence, we developed a virtual reality apparatus that allows for simultaneous measurement of reward checking, a commonly used measure in associative learning paradigms, and navigational behavior, along with precisely controlled presentation of visual, auditory and reward stimuli. Rats performed a virtual spatial navigation task analogous to the Morris maze where only distal visual or auditory cues provided spatial information. Spatial navigation and reward checking maps showed experience-dependent learning and were in register for distal visual cues. However, they showed a dissociation, whereby distal auditory cues failed to support spatial navigation but did support spatially localized reward checking. These findings indicate that rats can navigate in virtual space with only distal visual cues, without significant vestibular or other sensory inputs. Furthermore, they reveal the simultaneous dissociation between two reward-driven behaviors.

Why trace and delay conditioning are sometimes (but not always) hippocampal dependent: a computational model

A recurrent-network model provides a unified account of the hippocampal region in mediating the representation of temporal information in classical eyeblink conditioning. Much empirical research is consistent with a general conclusion that delay conditioning (in which the conditioned stimulus CS and unconditioned stimulus US overlap and co-terminate) is independent of the hippocampal system, while trace conditioning (in which the CS terminates before US onset) depends on the hippocampus. However, recent studies show that, under some circumstances, delay conditioning can be hippocampal-dependent and trace conditioning can be spared following hippocampal lesion. Here, we present an extension of our prior trial-level models of hippocampal function and stimulus representation that can explain these findings within a unified framework. Specifically, the current model includes adaptive recurrent collateral connections that aid in the representation of intra-trial temporal information. With this model, as in our prior models, we argue that the hippocampus is not specialized for conditioned response timing, but rather is a general-purpose system that learns to predict the next state of all stimuli given the current state of variables encoded by activity in recurrent collaterals. As such, the model correctly predicts that hippocampal involvement in classical conditioning should be critical not only when there is an intervening trace interval, but also when there is a long delay between CS onset and US onset. Our model simulates empirical data from many variants of classical conditioning, including delay and trace paradigms in which the length of the CS, the inter-stimulus interval, or the trace interval is varied. Finally, we discuss model limitations, future directions, and several novel empirical predictions of this temporal processing model of hippocampal function and learning.

Reward cues in space: commonalities and differences in neural coding by hippocampal and ventral striatal ensembles

Forming place-reward associations critically depends on the integrity of the hippocampal-ventral striatal system. The ventral striatum (VS) receives a strong hippocampal input conveying spatial-contextual information, but it is unclear how this structure integrates this information to invigorate reward-directed behavior. Neuronal ensembles in rat hippocampus (HC) and VS were simultaneously recorded during a conditioning task in which navigation depended on path integration. In contrast to HC, ventral striatal neurons showed low spatial selectivity, but rather coded behavioral task phases toward reaching goal sites. Outcome-predicting cues induced a remapping of firing patterns in the HC, consistent with its role in episodic memory. VS remapped in conjunction with the HC, indicating that remapping can take place in multiple brain regions engaged in the same task. Subsets of ventral striatal neurons showed a "flip" from high activity when cue lights were illuminated to low activity in intertrial intervals, or vice versa. The cues induced an increase in spatial information transmission and sparsity in both structures. These effects were paralleled by an enhanced temporal specificity of ensemble coding and a more accurate reconstruction of the animal's position from population firing patterns. Altogether, the results reveal strong differences in spatial processing between hippocampal area CA1 and VS, but indicate similarities in how discrete cues impact on this processing.

Inhibition of opioid transmission at the μ-opioid receptor prevents both food seeking and binge-like eating

Endogenous opioids, and in particular μ-opioid receptors, have been linked to hedonic and rewarding mechanisms engaged during palatable food intake. The aim of this study was to investigate the effects of GSK1521498, a novel μ-opioid receptor antagonist, on food-seeking behavior and on binge-like eating of a highly preferred chocolate diet. Food seeking was measured in rats trained to respond for chocolate under a second-order schedule of reinforcement, in which prolonged periods of food-seeking behavior were maintained by contingent presentation of a reward-associated conditioned reinforcer. After reaching a stable baseline in both procedures, animals were treated with GSK1521498 (0.1, 1, and 3 mg/kg; IP) or naltrexone (NTX, 0.1, 1, and 3 mg/kg; SC). The binge eating model was characterized by four temporally contiguous phases: 1-h chow access, 2-h food deprivation, 10-min chow access, and 10-min access to either chocolate-flavoured food or standard chow. During training the rats developed binge-like hyperphagia of palatable food and anticipatory chow hypophagia (anticipatory negative contrast). Both compounds reduced binge-like palatable food hyperphagia. However, GSK1521498 reduced the impact of high hedonic value on ingestion more specifically than NTX, abolishing anticipatory chow hypophagia. GSK1521498 also dose-dependently reduced food seeking both before and after food ingestion, whereas NTX reduced food seeking only after food ingestion. Thus, while both drugs affected the hedonic value of the preferred food, GSK1521498 also directly decreased incentive motivation for chocolate. Selective μ-opioid receptor antagonism by GSK1521498 may have utility as a treatment for reducing maladaptive, palatability-driven eating behavior by reducing the motivational properties of stimuli that elicit the binge eating commonly associated with obesity.

Crossmodal object recognition in rats with and without multimodal object pre-exposure: no effect of hippocampal lesions

The neural mechanisms and brain circuitry involved in the formation, storage, and utilization of multisensory object representations are poorly understood. We have recently introduced a crossmodal object recognition (CMOR) task that enables the study of such questions in rats. Our previous research has indicated that the perirhinal and posterior parietal cortices functionally interact to mediate spontaneous (tactile-to-visual) CMOR performance in rats; however, it remains to be seen whether other brain regions, particularly those receiving polymodal sensory inputs, contribute to this cognitive function. In the current study, we assessed the potential contribution of one such polymodal region, the hippocampus (HPC), to crossmodal object recognition memory. Rats with bilateral excitotoxic HPC lesions were tested in two versions of crossmodal object recognition: (1) the original CMOR task, which requires rats to compare between a stored tactile object representation and visually-presented objects to discriminate the novel and familiar stimuli; and (2) a novel 'multimodal pre-exposure' version of the CMOR task (PE/CMOR), in which simultaneous exploration of the tactile and visual sensory features of an object 24 h prior to the sample phase enhances CMOR performance across longer retention delays. Hippocampus-lesioned rats performed normally on both crossmodal object recognition tasks, but were impaired on a radial arm maze test of spatial memory, demonstrating the functional effectiveness of the lesions. These results strongly suggest that the HPC, despite its polymodal anatomical connections, is not critically involved in tactile-to-visual crossmodal object recognition memory.

Retrieval of contextual memories increases activity-regulated cytoskeleton-associated protein in the amygdala and hippocampus

Activity-regulated cytoskeleton-associated protein (Arc) integrates information from multiple intracellular signaling cascades and, in turn, regulates cytoskeletal proteins involved in structural synaptic modifications. The purposes of the present study were: (1) to determine if the retrieval of contextual memories would induce Arc in hippocampal and amygdalar neurons; (2) use unbiased stereology at the ultrastructural level to quantify synapses contacting Arc-labeled (Arc+) and unlabeled (Arc-) postsynaptic structures in brain regions in which the amount of Arc integrated density (ID) correlated strongly with the degree of amphetamine conditioned place preference (AMPH CPP). The retrieval of contextual memories increased the Arc ID in the dentate gyrus, cornu ammonis (CA)1, and CA3 fields of the hippocampus and the basolateral, lateral, and central nuclei of the amygdala but not the primary auditory cortex, a control region. Stereological quantification of Arc+ and Arc- synapses in the basolateral nucleus of the amygdala (BLA) was undertaken because the strongest relationship between the amount of Arc ID and AMPH CPP was observed in the BLA. The retrieval of contextual memories increased the number and density of asymmetric (presumed excitatory) synapses contacting Arc+ spines and dendrites of BLA neurons, symmetric (presumed inhibitory or modulatory) synapses contacting Arc+ dendrites of BLA neurons, and multisynaptic boutons contacting Arc+ postsynaptic structures. Thus, the retrieval of contextual memories increases Arc in the amygdala and hippocampus, an effect that could be important for approach behavior to a drug-associated context.

Cues predicting drug or food reward restore morphine-induced place conditioning in mice lacking delta opioid receptors

RATIONALE

The exact role of delta opioid receptors in drug-induced conditioned place preference (CPP) remains debated. Under classical experimental conditions, morphine-induced CPP is decreased in mice lacking delta opioid receptors (Oprd1 (-/-)). Morphine self-administration, however, is maintained, suggesting that drug-context association rather than drug reward is deficient in these animals.

OBJECTIVES

This study further examined the role of delta opioid receptors in mediating drug-cue associations, which are necessary for the expression of morphine-induced CPP.

METHODS

We first identified experimental conditions under which Oprd1 (-/-) mice are able to express CPP to morphine (5, 10 or 20 mg/kg) in a drug-free state and observed that, in this paradigm, CPP was dependent on circadian time conditions. We then took advantage of this particularity to assess the ability of various cues (internal or discrete), predicting either drug or food reward, to restore CPP induced by morphine (10 mg/kg) in Oprd1 (-/-) mice in conditions under which they normally fail to express CPP.

RESULTS

We found that presentation of circadian, drug or auditory cues, predicting morphine or food reward, restored morphine CPP in Oprd1 (-/-) mice, which then performed as well as control mice.

CONCLUSIONS

This study reveals that, in contrast to spatial cues, internal or discrete morphine-predicting stimuli permit full expression of morphine CPP in Oprd1 (-/-) mice. Delta receptors, therefore, appear to play a crucial role in modulating spatial contextual cue-related responses. This activity may be critical when context gains control over behavior, as is the case for context-induced relapse in drug abuse.

Post-training unilateral amygdala lesions selectively impair contextual fear memories

The basolateral amygdala (BLA) and the dorsal hippocampus (dHPC) are both structures with key roles in contextual fear conditioning. During fear conditioning, it is postulated that contextual representations of the environment are formed in the hippocampus, which are then associated with foot shock in the amygdala. However, it is not known to what extent a functional connection between these two structures is required. This study investigated the effect on contextual and cued fear conditioning of disconnecting the BLA and dHPC, using asymmetrically placed, excitotoxic unilateral lesions. Post-training lesions selectively impaired contextual, but not cued, fear, while pretraining lesions resulted in a similar but nonsignificant pattern of results. This effect was unexpectedly observed in both the contralateral disconnection group and the anticipated ipsilateral control, which prompted further examination of individual unilateral lesions of BLA and dHPC. Post-training unilateral dHPC lesions had no effect on contextual fear memories while bilateral dHPC lesions and unilateral BLA lesions resulted in a near total abolition of contextual fear but not cued conditioned fear. Again, pretraining unilateral BLA lesions resulted in a strong but nonsignificant trend to the impairment of contextual fear. Furthermore, an analysis of context test-induced Fos protein expression in the BLA contralateral to the lesion site revealed no differences between post-training SHAM and unilateral BLA lesioned animals. Therefore, post-training unilateral lesions of the BLA are sufficient to severely impair contextual, but not cued, fear memories.

Hippocampal neuronal responses during signaled licking of gustatory stimuli in different contexts

Neuroanatomical studies suggest that hippocampal formation (HF) receives information from all sensory modalities including taste via the parahippocampal cortices. To date, however, no neurophysiological study has reported that HF neurons encode taste information. In the present study, we recorded CA1 HF neurons from freely behaving rats during performance of a visually-guided licking task in two different triangular chambers. When a cue lamp came on, the rats were required to press a bar to trigger a tube to protrude into the chambers for 3 s. During this period, the rats could lick one of six sapid solutions: [0.1M NaCl (salty), 0.3M sucrose (sweet), 0.01 M citric acid (sour), 0.0001 M quinine HCl (bitter), 0.01 M monosodium L-glutamate (MSG, umami), and a mixture of MSG and 0.001 M disodium-5'-inosinate (IMP) (MSG+IMP)], and distilled water. Of a total 285 pyramidal and interneurons, the activity of 173 was correlated with at least one of the events in the task-illumination of cue lamps, bar pressing, or licking the solution. Of these, 137 neurons responded during licking, and responses of 62 of these cells were greater to sapid solutions than to water (taste neurons). Multivariate analyses of the taste neurons suggested that, in the HF, taste quality might be encoded based on hedonic value. Furthermore, the activity of most taste neurons was chamber-specific. These results implicate the HF in guiding appetitive behaviors such as conditioned place preference.

Electroacupuncture suppresses discrete cue-evoked heroin-seeking and fos protein expression in the nucleus accumbens core in rats

Relapse to drug seeking was studied using a rodent model of reinstatement induced by exposure to drug-related cues. Here, we used intravenous drug self-administration procedures in rats to further investigate the beneficial effects of electroacupuncture (EA) on heroin-seeking behavior in a reinstatement model of relapse. We trained Sprague-Dawley rats to nose-poke for i.v. heroin either daily for 4 h or 25 infusions for 14 consecutive days. Then the rats were abstinent from heroin for two weeks. 2 Hz EA stimulation was conducted once daily for 14 days during heroin abstinence. We tested these animals for contextual and discrete cue-induced reinstatement of active responses. We also applied immunohistochemistry to detect Fos-positive nuclei in the nucleus accumbens (NACc) core and shell after reinstatement test. We found that active responses elicited by both contextual cues and discrete cues were high in the rats trained with heroin than in saline controls. EA treatment significantly reduced active responses elicited by discrete cues. EA stimulation attenuated Fos expression in the core but not the shell of the NACc. Altogether, these results highlight the therapeutic benefit of EA in preventing relapse to drug addiction.

The persistence of maladaptive memory: addiction, drug memories and anti-relapse treatments

Addiction is a chronic, relapsing disorder, characterised by the long-term propensity of addicted individuals to relapse. A major factor that obstructs the attainment of abstinence is the persistence of maladaptive drug-associated memories, which can maintain drug-seeking and taking behaviour and promote unconscious relapse of these habits. Thus, addiction can be conceptualised as a disorder of aberrant learning of the formation of strong instrumental memories linking actions to drug-seeking and taking outcomes that ultimately are expressed as persistent stimulus-response habits; of previously neutral environmental stimuli that become associated with drug highs (and/or withdrawal states) through pavlovian conditioning, and of the subsequent interactions between pavlovian and instrumental memories to influence relapse behaviour. Understanding the psychological, neurobiological and molecular basis of these drug memories may produce new methods of pro-abstinence, anti-relapse treatments for addiction.

Hippocampal lesions can enhance discrimination learning despite normal sensitivity to interference from incidental information

Spatial properties of stimuli are sometimes encoded even when incidental to the demands of a particular learning task. Incidental encoding of spatial information may interfere with learning by (i) causing a failure to generalize learning between trials in which a cue is presented in different spatial locations and (ii) adding common spatial features to stimuli that predict different outcomes. Hippocampal lesions have been found to facilitate acquisition of certain tasks. This facilitation may occur because hippocampal lesions impair incidental encoding of spatial information that interferes with learning. To test this prediction mice with lesions of the hippocampus were trained on appetitive simple simultaneous discrimination tasks using inserts in the goal arms of a T-maze. It was found that hippocampal lesioned mice were facilitated at learning the discriminations, but they were sensitive to changes in spatial information in a manner that was similar to control mice. In a second experiment it was found that both control and hippocampal lesioned mice showed equivalent incidental encoding of egocentric spatial properties of the inserts, but both groups did not encode the allocentric information. These results demonstrate that mice show incidental encoding of egocentric spatial information that decreases the ability to solve simultaneous discrimination tasks. The normal egocentric spatial encoding in hippocampal lesioned mice contradicts theories of hippocampal function that suggest that the hippocampus is necessary for incidental learning per se, or is required for modulating stimulus representations based on the relevancy of information. The facilitated learning suggests that the hippocampal lesions can enhance learning of the same qualitative information as acquired by control mice. © 2011 Wiley Periodicals, Inc.

Where is my reward and how do I get it? Interaction between the hippocampus and the basal ganglia during spatial learning

Spatial learning has been recognized over the years to be under the control of the hippocampus and related temporal lobe structures. Hippocampal damage often causes severe impairments in the ability to learn and remember a location in space defined by distal visual cues. Recent experimental evidence in rodents demonstrates, however, that other brain areas might also be involved in the acquisition of spatial information. Amongst these, the cortex--basal ganglia loop is known to be involved in reinforcement learning and has been identified as an important contributor to spatial learning. In particular, it has been shown that altered activity of the basal ganglia striatal complex can impair the ability to perform spatial learning tasks. Until recently, little was known about how the basal ganglia and the hippocampus interact and how their activities evolve during learning. The present review, focusing on rodent studies, provides a glimpse of the findings obtained over the past decade that support a dialog between these two structures during spatial learning. Based on these studies, we propose a new functional spatial decision network with three separate loops encompassing hippocampus and specific basal ganglia regions. Each of the three loops serves a different aspect of spatial decision making and all three are linked by their mutual connections and are under the control of the dopaminergic learning signal.

Task-dependent and independent synchronous activity of monkey hippocampal neurons in real and virtual translocation

Previous neurophysiological and behavioral studies relate hippocampal functions to place learning and memory, and encoding of task (or context)-specific information. Encoding of both task-specific information and own location is essential for episodic memory and for animals to navigate to reward-related places. It is suggested that different neural circuits with different assemblies of different hippocampal neurons are created in different environments or behavioral contexts for the hippocampal formation (HF) to encode and retrieve episodic memory. To investigate whether synchronous activity of hippocampal neurons, suggesting functional connectivity between those neurons, is task and position dependent, multiple single unit activities were recorded during performance of real and virtual translocation (VT) tasks. The monkey moved to one of four reward areas by driving a cab (real translocation) or by moving a pointer on a monitor. Of 163 neuron pairs, significant peaks in cross-correlograms (CCGs) were observed in 98 pairs. Most CCGs had positive peaks within 50 ms. Task-dependent cross-correlations (CCRs) were observed in 44% of the neuron pairs, and similarly observed in both the real and VT tasks. These CCRs were frequently observed in pyramidal vs. pyramidal neuron pairs with positive peak and peak shift. However, no consistent patterns of peak polarity, peak shift, and neuronal types were seen in task-independent CCRs. There was no significant difference in frequency of CCG peaks between real and VT tasks. These results suggest that the task-dependent information may be encoded by interaction among pyramidal neurons, and the common information across tasks may be encoded by interaction among pyramidal neurons and interneurons in the HF. These neuronal populations could provide a neural basis for episodic memory to disambiguously guide animals to places associated with reward in different situations.

Effects of systemic or nucleus accumbens-directed dopamine D1 receptor antagonism on sucrose seeking in rats

RATIONALE

Conditioned cues can elicit relapse to drug- and food-seeking behavior over prolonged periods of abstinence. If seeking behavior depends on mesolimbic dopamine D1 receptors, blocking these receptors should reduce seeking behavior.

OBJECTIVES

We examined the effects of either systemic or intra-nucleus accumbens administration of the D1 antagonist SCH 23390 on extinction responding (sucrose seeking) by rats either 1 or 30 days into forced abstinence.

MATERIALS AND METHODS

Rats self-administered 10% sucrose paired with a tone + light cue for 10 days. After either 1 or 30 days of forced abstinence, rats received systemic (0, 1, 5, or 25 μg/kg IP) or bilateral nucleus accumbens core or shell (0.3 or 0.6 μg/site) injections of SCH 23390 prior to extinction testing.

RESULTS

Saline-treated rats responded more during extinction following 30 vs. 1 day of forced abstinence ("incubation of craving"). Systemic SCH 23390 reduced sucrose seeking after 1 day of forced abstinence, significantly reducing responding following pretreatment with 1, 5, and 25 μg/kg SCH 23390, but only 25 μg/kg significantly reduced sucrose seeking after 30 days of forced abstinence. SCH 23390 (0.3 or 0.6 μg/site) in the core or shell of the nucleus accumbens reduced sucrose seeking in all groups.

CONCLUSION

Nucleus accumbens D1 receptors are involved in sucrose seeking, but it is not clear if they are involved in the incubation of craving. The fact that D1 antagonism reduced sucrose seeking across an extended period of abstinence may be of use for development of treatment strategies for relapse.

Opposing roles of nucleus accumbens core and shell dopamine in the modulation of limbic information processing

The dopaminergic innervation of the nucleus accumbens (NAc) is implicated in the selection and integration of motivationally relevant corticolimbic information that governs behavioral output. However, it is unknown whether the dopaminergic innervations of two anatomically distinct subregions of the NAc, core and shell, have differential roles in this gating process, and whether dopaminergic mechanisms are important in regulating the balance of limbic control over appetitive behavior at the point of learning. Having previously shown that repeated systemic pretreatment with amphetamine disrupts the regulation of competing limbic control over appetitive behavior in mice, we hereby examined the effects of repeated pretraining intra-NAc shell or core microinfusions of D-amphetamine, general dopamine (DA) receptor antagonist cis-flupenthixol, or vehicle solution (saline) upon a simultaneously acquired conditioned cue and place preference task in rats. Repeated infusions of amphetamine into the NAc shell and core had opposite effects on the acquisition of conditioned place preference by significantly enhancing and attenuating, respectively, hippocampal-dependent place conditioning. In contrast, direct infusions of flupenthixol into the NAc shell attenuated place conditioning, while NAc core flupenthixol infusions not only attenuated cue conditioning, but also enhanced conditioned place preference. These findings implicate the NAc shell DA as being necessary for enabling hippocampal-dependent spatial information to gain control over appetitive learning, and the NAc core DA as being important for allowing basolateral amygdala-dependent information to gain control over appetitive learning. It is further proposed that NAc core DA may be critical in regulating limbic information flow through the NAc shell.

The basolateral amygdala and nucleus accumbens core mediate dissociable aspects of drug memory reconsolidation

A distributed limbic-corticostriatal circuitry is implicated in cue-induced drug craving and relapse. Exposure to drug-paired cues not only precipitates relapse, but also triggers the reactivation and reconsolidation of the cue-drug memory. However, the limbic cortical-striatal circuitry underlying drug memory reconsolidation is unclear. The aim of this study was to investigate the involvement of the nucleus accumbens core and the basolateral amygdala in the reconsolidation of a cocaine-conditioned stimulus-evoked memory. Antisense oligodeoxynucleotides (ASO) were infused into each structure to knock down the expression of the immediate-early gene zif268, which is known to be required for memory reconsolidation. Control infusions used missense oligodeoxynucleotides (MSO). The effects of zif268 knockdown were measured in two complementary paradigms widely used to assess the impact of drug-paired CSs upon drug seeking: the acquisition of a new instrumental response with conditioned reinforcement and conditioned place preference. The results show that both intranucleus accumbens core and intrabasolateral amygdala zif268 ASO infusions at memory reactivation impaired the reconsolidation of the memory underlying a cocaine-conditioned place preference. However, knockdown of zif268 in the nucleus accumbens at memory reactivation had no effect on the memory underlying the conditioned reinforcing properties of the cocaine-paired CS measured subsequently, and this is in contrast to the marked impairment observed previously following intrabasolateral amygdala zif268 ASO infusions. These results suggest that both the basolateral amygdala and nucleus accumbens core are key structures within limbic cortical-striatal circuitry where reconsolidation of a cue-drug memory occurs. However reconsolidation of memory representations formed during Pavlovian conditioning are differentially localized in each site.

Amphetamine exposure selectively enhances hippocampus-dependent spatial learning and attenuates amygdala-dependent cue learning

Behaviorally sensitizing regimen of amphetamine (AMPH) exposure has diverse effects on learning, memory, and cognition that are likely to be a consequence of long-term neural adaptations occurring in the cortico-limbic-striatal circuitry. In particular, altered dopamine signaling in the nucleus accumbens and medial prefrontal cortex has been implicated to underlie AMPH-induced changes in behavior. This study sought to test the hypothesis that repeated AMPH exposure disrupts the regulation of limbic information processing and the balance of competing limbic control over appetitive behavior. Mice received seven intraperitoneal injections of D-AMPH (2.5 mg/kg or 5 mg/kg) or vehicle solution (saline) and were trained in (1) a simultaneous conditioned cue and place preference task using a six-arm radial maze, found to depend on the integrity of the hippocampus (HPC) and basolateral amygdala (BLA), respectively and (2) a conditional BLA-dependent cue, and HPC-dependent place learning task using an elevated T-maze. In both tasks, the vehicle pretreatment group initially acquired cue learning, followed by the emergence of significant place/spatial learning. In contrast, pretreatment with repeated AMPH caused marked deviations from normal acquisition patterns of place and cue conditioning, significantly facilitating HPC-dependent place conditioning in the first task while attenuating BLA-dependent cue conditioning in both tasks. These findings provide the first demonstration of an aberrant regulation of HPC- and BLA-dependent learning as a result of AMPH exposure, highlighting the importance of the meso-coticolimbic dopamine system in maintaining the balance of limbic control over appetitive behavior.

Hippocampal theta rhythm and drug-related reward-seeking behavior: an analysis of cocaine-induced conditioned place preference in rats

Drug cravings are elicited by environmental stimuli associated with the rewarding effects of drugs. As an animal model of such associative learning, conditioned place preference (CPP) is widely used. Since the hippocampus is closely related to reward memory and the hippocampal local field potential (LFP), and in particular the theta rhythm is known to be associated with bodily movements, the theta rhythm might be one of the key neural substrates. On the basis of this assumption, we recorded the behaviors and hippocampal LFP of eight rats during cocaine-induced acquisition and expression of CPP. The earliest appearance of phase-locked theta activity was observed before the rats entered the cocaine-paired environment after conditioning; after entrance, the theta disappeared. This phase-locked theta was stronger when the rats stayed for a long time in the cocaine-paired environment. Our observation suggested that the phase-locked hippocampal theta rhythm is related to the approaching behavior of the rat caused by reward memory. Thus, the role of the hippocampus in drug craving should be emphasized further.

A molecular dissociation between cued and contextual appetitive learning

In appetitive Pavlovian learning, animals learn to associate discrete cues or environmental contexts with rewarding outcomes, and these cues and/or contexts can potentiate an ongoing instrumental response for reward. Although anatomical substrates underlying cued and contextual learning have been proposed, it remains unknown whether specific molecular signaling pathways within the striatum underlie one form of learning or the other. Here, we show that while the striatum-enriched isoform of adenylyl cyclase (AC5) is required for cued appetitive Pavlovian learning, it is not required for contextual appetitive learning. Mice lacking AC5 (AC5KO) could not learn an appetitive Pavlovian learning task in which a discrete signal light predicted reward delivery, yet they could form associations between context and either natural or drug reward, which could in turn elicit Pavlovian approach behavior. However, unlike wild-type (WT) mice, AC5KO mice could not use these Pavlovian conditioned stimuli to potentiate ongoing instrumental behavior in a Pavlovian-to-instrumental transfer paradigm. These data suggest that AC5 is specifically required for learning associations between discrete cues and outcomes in which the temporal relationship between conditioned stimulus (CS) and unconditioned stimulus (US) is essential, while alternative signaling mechanisms may underlie the formation of associations between context and reward. In addition, loss of AC5 compromises the ability of both contextual and discrete cues to modulate instrumental behavior.

Corticostriatal Interactions during Learning, Memory Processing, and Decision Making

This mini-symposium aims to integrate recent insights from anatomy, behavior, and neurophysiology, highlighting the anatomical organization, behavioral significance, and information-processing mechanisms of corticostriatal interactions. In this summary of topics, which is not meant to provide a comprehensive survey, we will first review the anatomy of corticostriatal circuits, comparing different ways by which "loops" of cortical-basal ganglia circuits communicate. Next, we will address the causal importance and systems-neurophysiological mechanisms of corticostriatal interactions for memory, emphasizing the communication between hippocampus and ventral striatum during contextual conditioning. Furthermore, ensemble recording techniques have been applied to compare information processing in the dorsal and ventral striatum to predictions from reinforcement learning theory. We will next discuss how neural activity develops in corticostriatal areas when habits are learned. Finally, we will evaluate the role of GABAergic interneurons in dynamically transforming cortical inputs into striatal output during learning and decision making.

A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning

Some existing models of hippocampal function simulate performance in classical conditioning tasks using the error backpropagation algorithm to guide learning (Gluck, M.A., and Myers, C.E., (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus, 3(4), 491-516.). This algorithm is not biologically plausible because it requires information to be passed backward through layers of nodes and assumes that the environment provides information to the brain about what correct outputs should be. Here, we show that the same information-processing function proposed for the hippocampal region in the Gluck and Myers (1993) model can also be implemented in a network without using the backpropagation algorithm. Instead, our newer instantiation of the theory uses only (a) Hebbian learning methods which match more closely with synaptic and associative learning mechanisms ascribed to the hippocampal region and (b) a more plausible representation of input stimuli. We demonstrate here that this new more biologically plausible model is able to simulate various behavioral effects, including latent inhibition, acquired equivalence, sensory preconditioning, negative patterning, and context shift effects. In addition, the newer model is able to address some new phenomena including the effect of the number of training trials on blocking and overshadowing.

Blockade of the acquisition, but not expression, of associative learning by pre-session intra-amygdala R(+) 7-OH-DPAT

RATIONALE

Two issues were addressed regarding the effects of amygdala dopamine manipulations on associative learning: first, an apparent contradiction between the effects of post- vs. pre-session dopaminergic manipulations and second, the ability of dopaminergic infusions to affect association formation vs. its expression following extended training.

OBJECTIVES

The ability of pre-session infusions of a dopamine receptor agonist (R(+) 7-OH-DPAT) to inhibit acquisition of a conditioned approach response was examined and compared with the same manipulation following overtraining. Further experiments extended these findings.

MATERIALS AND METHODS

Experiment 1 infused pre-session intra-amygdala R(+) 7-OH-DPAT (0, 0.1, 1 nmol) during conditioned approach acquisition. Experiment 2 applied pre-session intra-amygdala R(+) 7-OH-DPAT (0, 0.01, 0.1, 1 nmol) during expression of the same response, once well learned. Experiment 3 required the inhibition of a conditioned approach response following unconditioned stimulus (US) removal. Experiment 4 examined the ability of animals with prior drug experience to acquire a conditioned response to a novel stimulus.

RESULTS

Experiments 1-3 showed that pre-session amygdala R(+) 7-OH-DPAT impaired acquisition of either excitatory or inhibitory conditioned responding, but was ineffective following overtraining. Drug-induced impairments in acquisition of a specific conditioned stimulus (CS)-US relationship continued well beyond the cessation of drug treatment, but were found not to transfer to an alternate CS in Experiment 4.

CONCLUSIONS

Pre-session dopamine receptor activation within the amygdala may impair the acquisition, but not expression, of CS-US associations. Enhanced learning reported earlier following post-session dopamine receptor activation may occur indirectly through reduced interference with the consolidation of recent learning.

Reinstated ethanol-seeking in rats is modulated by environmental context and requires the nucleus accumbens core

The reinstatement of ethanol (EtOH)-seeking induced by an EtOH-predictive light-tone stimulus is enhanced in an environment associated with prior EtOH self-administration (SA) compared with a context associated with EtOH unavailability (Tsiang & Janak, 2006). Here we hypothesized that EtOH-seeking would be elicited by the conditioned sensory stimulus properties of EtOH and that this reinstatement would be similarly modulated by context. We also determined whether pharmacologically inactivating the nucleus accumbens (NAc), a key structure in relapse circuitry, would attenuate reinstated EtOH-seeking. Rats lever-pressed for oral EtOH (10% v/v) in operant conditioning chambers distinguished by specific visual, olfactory and tactile stimuli. Responding was then extinguished by withholding EtOH in a different context. EtOH-seeking, expressed as elevated responding without EtOH delivery, was subsequently tested by presenting an oral EtOH prime (two aliquots of 0.1 mL EtOH) in either the extinction or the prior EtOH-SA context. Rats received a microinfusion (0.3 microL/hemisphere) of saline or GABA agonists (muscimol/baclofen) into the NAc core or shell immediately before the reinstatement test. Robust EtOH-seeking was observed in the prior EtOH-SA but not the extinction context in saline-pretreated rats. This effect was significantly attenuated by inactivating the NAc core but not shell. Conversely, NAc shell inactivation significantly elevated lever-pressing in the extinction context. These data suggest that the sensory stimulus properties of oral EtOH can reinstate EtOH-seeking when experienced in the appropriate context and that functional activity in the NAc core is required for this effect. In contrast, the shell may normally inhibit incorrect behavioral responses.

Ethanol seeking triggered by environmental context is attenuated by blocking dopamine D1 receptors in the nucleus accumbens core and shell in rats

RATIONALE

Conditioned behavioral responses to discrete drug-associated cues can be modulated by the environmental context in which those cues are experienced, a process that may facilitate relapse in humans. Rodent models of drug self-administration have been adapted to reveal the capacity of contexts to trigger drug seeking, thereby enabling neurobiological investigations of this effect.

OBJECTIVES

We tested the hypothesis that dopamine transmission in the nucleus accumbens, a neural structure that mediates reinforcement, is necessary for context-induced reinstatement of responding for ethanol-associated cues.

METHODS

Rats pressed one lever (active) for oral ethanol (0.1 ml; 10% v/v) in operant conditioning chambers distinguished by specific visual, olfactory, and tactile contextual stimuli. Ethanol delivery was paired with a discrete (4 s) light-noise stimulus. Responses on a second lever (inactive) were not reinforced. Behavior was then extinguished by withholding ethanol but not the discrete stimulus in a different context. Reinstatement, expressed as elevated responding for the discrete stimulus without ethanol delivery, was tested by placing rats into the prior self-administration context after administration of saline or the dopamine D1 receptor antagonist, SCH 23390 (0.006, 0.06, and 0.6 microg/side), into the nucleus accumbens core or shell.

RESULTS

Compared with extinction responding, active lever pressing in saline-pretreated rats was enhanced by placement into the prior ethanol self-administration context. SCH 23390 dose-dependently reduced reinstatement after infusion into the core or shell.

CONCLUSION

These findings suggest a critical role for dopamine acting via D1 receptors in the nucleus accumbens in the reinstatement of responding for ethanol cues triggered by placement into an ethanol-associated context.

Drug addiction and the memory systems of the brain

We review drug addiction from the perspective of the hypothesis that drugs of abuse interact with distinct brain memory systems. We focus on emotional and procedural forms of memory, encompassing Pavlovian and instrumental conditioning, both for action-outcome and for stimulus-response associations. Neural structures encompassed by these systems include the amygdala, hippocampus, nucleus accumbens, and dorsal striatum. Additional influences emanate from the anterior cingulate and prefrontal cortex, which are implicated in the encoding and retrieval of drug-related memories that lead to drug craving and drug use. Finally, we consider the ancillary point that chronic abuse of many drugs may impact directly on neural memory systems via neuroadaptive and neurotoxic effects that lead to cognitive impairments in which memory dysfunction is prominent.

Roles of hippocampal NMDA receptors and nucleus accumbens D1 receptors in the amphetamine-produced conditioned place preference in rats

There are glutamatergic projections from the hippocampus to the nucleus accumbens (NAc), which regulate DA transmission in this structure. To be precise, the ventral hippocampal (VH) glutamatergic neurons project to the nucleus accumbens shell region (NAcSh), whereas the dorsal hippocampus (DH) sends glutamatergic projections to the nucleus accumbens core region (NAcC). This study investigates the roles of hippocampal N-methyl-D-aspartate (NMDA) glutamate receptors and NAc type 1 dopamine receptor (D1) in amphetamine-produced conditioned place preference (AMPH-CPP) in rats. Our earlier reports showed that AMPH-CPP results in the enhancement of hippocampal CaMKII activity and it can be impaired by NMDA antagonist (AP5). In this study AMPH-CPP did not alter the NAc CaMKII activity, although AMPH-CPP was impaired by a blockade of D1 receptors (SCH23390) during conditioning. Moreover, inactivation of hippocampal area (dorsal hippocampus or ventral hippocampus) impaired AMPH-CPP, but its effect was diminished by the activation of D1 receptors in accumbal region (NAc core or NAc shell). By inactivating both DH and NAc core resulted in the disruption of rat's CPP expression. However, the impaired CPP expression was recovered during the next testing session, suggesting the disruption of CPP expression was a short term effect. Moreover, the disruption of CPP expression was not exhibited if NAc core was not inactivated. Interestingly, the rats that received activation in VH but an inactivation in NAc shell before testing show impaired CPP expression compared to those received inactivation in both VH and NAc shell. DH activation plus an inactivation in NAc core before testing show a significantly higher rate of the weakening of AMPH-CPP expression. Similarly, an activation of VH plus an inactivation of NAc shell before testing also show a statistically significant lower CPP score on tests 3 and 4. These results, taken together, indicate that NMDA receptor activation in DH and VH have different enhancing effects on the AMPH-CPP as their innervations onto the different NAc regions are essential for AMPH-CPP establishment. If the deterioration of AMPH-CPP expression (or extinction process) resembles the formation of new learning, then this active process might have been facilitated by the hippocampal NMDA receptor activations during testing.

Intra-amygdala and systemic antagonism of NMDA receptors prevents the reconsolidation of drug-associated memory and impairs subsequently both novel and previously acquired drug-seeking behaviors

The amygdala has long been considered a primary locus in mediating the effects of previously drug-associated stimuli on subsequent drug-seeking behavior, and the NMDA subtype of glutamate receptor within the amygdala is important for the consolidation of associations between environmental conditioned stimuli and the effects of addictive drugs. Here we demonstrate that amygdala NMDA receptors are also necessary for the reconsolidation of drug-associated memories. Using a behavioral task that specifically measures the conditioned reinforcing properties of a previously drug-paired stimulus, we show that infusion of the NMDA receptor antagonist D(-)-2-amino-5-phosphonopentanoic acid (D-APV) into the basolateral amygdala before a memory reactivation session disrupted the drug-associated memory and abolished subsequent instrumental responding for conditioned reinforcement. This effect was memory reactivation dependent, and the memory deficit persisted for at least 4 weeks. In contrast, infusion of d-APV immediately after the memory reactivation session had no effect on subsequent responding for conditioned reinforcement, indicating that NMDA receptors have a temporally limited role in the reconsolidation process. Furthermore, in molecular studies, we show that the reconsolidation-impairing effect of D-APV is correlated with downstream reductions in expression of the plasticity-related immediate early gene, zif268. We also demonstrate that systemic antagonism of NMDA receptors with MK-801 [(+)-5-methyl-10,11-dihydro-SH-dibenzo[a,d]cyclohepten-5,10-imine maleate] before memory reactivation subsequently reduced previously acquired instrumental drug-seeking behavior that depends on drug-associated cues acting as conditioned reinforcers. These data suggest that drugs modulating glutamatergic transmission at the NMDA receptor may be useful in the future treatment of relapse prevention in drug addiction through memory reconsolidation blockade.

Functional interaction between the hippocampus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context conditioning

The nucleus accumbens (NAc) has been implicated in a variety of associative processes that are dependent on the integrity of the amygdala and hippocampus (HPC). However, the extent to which the two subregions of the NAc, the core and shell, form differentiated circuits within the amygdala- and hippocampal-ventral striatal circuitry remains unclear. The present study investigated the effects of selective excitotoxic lesions of the nucleus accumbens shell or core subregion on appetitive elemental cue and context conditioning, shown previously to be dependent on the basolateral amygdala and hippocampus, respectively. Rats were trained sequentially to acquire discrete conditioned stimulus-sucrose conditioning, followed by spatial context-sucrose conditioning in a place preference apparatus characterized by three topographically identical chambers, the chambers being discriminable only on the basis of path integration. NAc shell lesions selectively impaired the acquisition of conditioned place preference and the use of spatial information to retrieve information about a discrete cue, whereas, as expected, NAc core lesions attenuated the acquisition of cue conditioning compared with sham rats. In a subsequent experiment, disconnection of the HPC from the NAc shell using unilateral asymmetric lesions of each structure resulted in a pattern of impairment in place conditioning and context-dependent cue retrieval similar to that produced by NAc shell lesions. These data not only suggest that the NAc core and shell subregions subserve distinct associative processes but also that the NAc shell and HPC are important functional components of a limbic corticostriatal network involved in spatial context conditioning.

Reconsolidation of appetitive memories for both natural and drug reinforcement is dependent on {beta}-adrenergic receptors

We have investigated the neurochemical mechanisms of memory reconsolidation and, in particular, the functional requirement for intracellular mechanisms initiated by beta-adrenergic signaling. We show that propranolol, given in conjunction with a memory reactivation session, can specifically disrupt the conditioned reinforcing properties of a previously appetitively reinforced conditioned stimulus (CS), whether the stimulus had been associated with self-administered cocaine or with sucrose. These data show that memories for both drug and nondrug CS-US associations are dependent on beta-adrenergic receptor-mediated signaling for their reconsolidation, with implications for the potential development of a novel treatment for drug addiction and some forms of obesity.