Role of the anterior cingulate cortex in the control over behavior by Pavlovian conditioned stimuli in rats

Contribution of Rat Insular Cortex to Stimulus-Guided Action

Anticipating rewards is fundamental for decision-making. Animals often use cues to assess reward availability and to make predictions about future outcomes. The gustatory region of the insular cortex (IC), the so-called gustatory cortex, has a well-established role in the representation of predictive cues, such that IC neurons encode both a general form of outcome expectation and anticipatory outcome-specific knowledge. Here, we used pavlovian-instrumental transfer (PIT) in male rats to assess if the IC is also required for predictive cues to exert both a general and specific influence over instrumental actions. Chemogenetic inhibition of IC impaired the ability of a reward-predictive stimulus to energize instrumental responding for reward. This deficit in general transfer was evident whether the same or different outcomes were used in the pavlovian and instrumental conditioning phases. We observed a similar deficit in specific PIT, such that rats with IC inhibition failed to use a reward-predictive stimulus to guide choice toward actions that deliver the same food reward. Finally, we show that rats with IC inhibition also fail to show outcome-selective reinstatement. Together, these data suggest a crucial role for IC in the representation of appetitive outcomes and particularly in using this representation to guide instrumental action.

Dopamine-Sensitive Anterior Cingulate Cortical Glucose-Monitoring Neurons as Potential Therapeutic Targets for Gustatory and Other Behavior Alterations

Background: The anterior cingulate cortex (ACC) is known for its involvement in various regulatory functions, including in the central control of feeding. Activation of local elements of the central glucose-monitoring (GM) neuronal network appears to be indispensable in these regulatory processes. Destruction of these type 2 glucose transporter protein (GLUT2)-equipped chemosensory cells results in multiple feeding-associated functional alterations. Methods: In order to examine this complex symptomatology, (1) dopamine sensitivity was studied in laboratory rats by means of the single-neuron-recording multibarreled microelectrophoretic technique, and (2) after local bilateral microinjection of the selective type 2 glucose transporter proteindemolishing streptozotocin (STZ), open-field, elevated plus maze, two-bottle and taste reactivity tests were performed. Results: A high proportion of the anterior cingulate cortical neurons changed their firing rate in response to microelectrophoretic administration of D-glucose, thus verifying them as local elements of the central glucose-monitoring network. Approximately 20% of the recorded cells displayed activity changes in response to microelectrophoretic application of dopamine, and almost 50% of the glucose-monitoring units here proved to be dopamine-sensitive. Moreover, taste stimulation experiments revealed even higher (80%) gustatory sensitivity dominance of these chemosensory cells. The anterior cingulate cortical STZ microinjections resulted in extensive behavioral and taste-associated functional deficits. Conclusions: The present findings provided evidence for the selective loss of glucose-monitoring neurons in the anterior cingulate cortex leading to motivated behavioral and gustatory alterations. This complex dataset also underlines the varied significance of the type 2 glucose transporter protein-equipped, dopamine-sensitive glucose-monitoring neurons as potential therapeutic targets. These units appear to be indispensable in adaptive control mechanisms of the homeostatic-motivational-emotional-cognitive balance for the overall well-being of the organism.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues

The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Event-based control of autonomic and emotional states by the anterior cingulate cortex

Despite being an intensive area of research, the function of the anterior cingulate cortex (ACC) remains somewhat of a mystery. Human imaging studies implicate the ACC in various cognitive functions, yet surgical ACC lesions used to treat emotional disorders have minimal lasting effects on cognition. An alternative view is that ACC regulates autonomic states, consistent with its interconnectivity with autonomic control regions and that stimulation evokes changes in autonomic/emotional states. At the cellular level, ACC neurons are highly multi-modal and promiscuous, and can represent a staggering array of task events. These neurons nevertheless combine to produce highly event-specific ensemble patterns that likely alter activity in downstream regions controlling emotional and autonomic tone. Since neuromodulators regulate the strength of the ensemble activity patterns, they would regulate the impact these patterns have on downstream targets. Through these mechanisms, the ACC may determine how strongly to react to the very events its ensembles represent. Pathologies arise when specific event-related representations gain excessive control over autonomic/emotional states.

Differential Effects of the Inactivation of Anterior and Posterior Orbitofrontal Cortex on Affective Responses to Proximal and Distal Threat, and Reward Anticipation in the Common Marmoset

Structural and functional abnormalities of the orbitofrontal cortex (OFC) have been implicated in affective disorders that manifest anxiety-related symptoms. However, research into the functions of primate OFC has predominantly focused on reward-oriented rather than threat-oriented responses. To redress this imbalance, the present study performed a comprehensive analysis of the independent role of 2 distinct subregions of the central OFC (anterior area 11; aOFC and posterior area 13; pOFC) in the processing of distal and proximal threat. Temporary inactivation of both aOFC and pOFC heightened responses to distal threat in the form of an unknown human, but not to proximal threat assessed in a discriminative Pavlovian conditioning task. Inactivation of the aOFC, however, did unexpectedly blunt conditioned threat responses, although the effect was not valence-specific, as conditioned appetitive responses were similarly blunted and appeared restricted to a discriminative version of the task (when both CS⁻ and CS⁺ are present within a session). Inactivation of the pOFC did not affect conditioned responses to either proximal threat or reward and basal cardiovascular activity was unaffected by manipulations of activity in either subregion. The results highlight the contribution of aOFC and pOFC to regulation of responses to more distal uncertain but not proximal, certain threat and reveal their opposing contribution to that of the immediately adjacent medial OFC, area 14.

Whole-brain mapping of monosynaptic inputs to midbrain cholinergic neurons

The cholinergic midbrain is involved in a wide range of motor and cognitive processes. Cholinergic neurons of the pedunculopontine (PPN) and laterodorsal tegmental nucleus (LDT) send long-ranging axonal projections that target sensorimotor and limbic areas in the thalamus, the dopaminergic midbrain and the striatal complex following a topographical gradient, where they influence a range of functions including attention, reinforcement learning and action-selection. Nevertheless, a comprehensive examination of the afferents to PPN and LDT cholinergic neurons is still lacking, partly due to the neurochemical heterogeneity of this region. Here we characterize the whole-brain input connectome to cholinergic neurons across distinct functional domains (i.e. PPN vs LDT) using conditional transsynaptic retrograde labeling in ChAT::Cre male and female rats. We reveal that input neurons are widely distributed throughout the brain but segregated into specific functional domains. Motor related areas innervate preferentially the PPN, whereas limbic related areas preferentially innervate the LDT. The quantification of input neurons revealed that both PPN and LDT receive similar substantial inputs from the superior colliculus and the output of the basal ganglia (i.e. substantia nigra pars reticulata). Notably, we found that PPN cholinergic neurons receive preferential inputs from basal ganglia structures, whereas LDT cholinergic neurons receive preferential inputs from limbic cortical areas. Our results provide the first characterization of inputs to PPN and LDT cholinergic neurons and highlight critical differences in the connectome among brain cholinergic systems thus supporting their differential roles in behavior.

Cocaine Triggers Astrocyte-Mediated Synaptogenesis

BACKGROUND

Synaptogenesis is essential in forming new neurocircuits during development, and this is mediated in part by astrocyte-released thrombospondins (TSPs) and activation of their neuronal receptor, α2δ-1. Here, we show that this developmental synaptogenic mechanism is utilized during cocaine experience to induce spinogenesis and the generation of AMPA receptor-silent glutamatergic synapses in the adult nucleus accumbens shell (NAcSh).

METHODS

Using multidisciplinary approaches including astrocyte Ca²⁺ imaging, genetic mouse lines, viral-mediated gene transfer, and operant behavioral procedures, we monitor the response of NAcSh astrocytes to cocaine administration and examine the role of astrocytic TSP-α2δ-1 signaling in cocaine-induced silent synapse generation as well as the behavioral impact of astrocyte-mediated synaptogenesis and silent synapse generation.

RESULTS

Cocaine administration acutely increases Ca²⁺ events in NAcSh astrocytes, while decreasing astrocytic Ca²⁺ blocks cocaine-induced generation of silent synapses. Furthermore, knockout of TSP2, or pharmacological inhibition or viral-mediated knockdown of α2δ-1, prevents cocaine-induced generation of silent synapses. Moreover, disrupting TSP2-α2δ-1-mediated spinogenesis and synapse generation in NAcSh decreases cue-induced cocaine seeking after withdrawal from cocaine self-administration and cue-induced reinstatement of cocaine seeking after drug extinction.

CONCLUSIONS

These results establish that silent synapses are generated by an astrocyte-mediated synaptogenic mechanism in response to cocaine experience and embed critical cue-associated memory traces that promote cocaine relapse.

Potential roles of the rodent medial prefrontal cortex in conflict resolution between multiple decision-making systems

Mammalian decision-making is mediated by the interaction of multiple, neurally and computationally separable decision systems. Having multiple systems requires a mechanism to manage conflict and converge onto the selection of singular actions. A long history of evidence has pointed to the prefrontal cortex as a central component in processing the interactions between distinct decision systems and resolving conflicts among them. In this chapter we review four theories of how that interaction might occur and identify how the medial prefrontal cortex in the rodent may be involved in each theory. We then present experimental predictions implied by the neurobiological data in the context of each theory as a starting point for future investigation of medial prefrontal cortex and decision-making.

Reward-predictive cues elicit excessive reward seeking in adolescent rats

Impulsive behavior during adolescence may stem from developmental imbalances between motivational and cognitive-control systems, producing greater urges to pursue reward and weakened capacities to inhibit such actions. Here, we developed a Pavlovian-instrumental transfer (PIT) protocol to assay rats' ability to suppress cue-motivated reward seeking based on changes in reward expectancy. Traditionally, PIT studies focus on how reward-predictive cues motivate instrumental reward-seeking behavior (lever pressing). However, cues signaling imminent reward delivery also elicit countervailing focal-search responses (food-port entry). We first examined how reward expectancy (cue-reward probability) influences expression of these competing behaviors. Adult male rats increased rates of lever pressing when presented with cues signaling lower probabilities of reward but focused their activity at the food cup on trials with cues that signaled higher probabilities of reward. We then compared adolescent and adult male rats in their responsivity to cues signaling different reward probabilities. In contrast to adults, adolescent rats did not flexibly adjust patterns of responding based on the expected likelihood of reward delivery but increased their rate of lever pressing for both weak and strong cues. These findings indicate that control over cue-motivated behavior is fundamentally dysregulated during adolescence, providing a model for studying neurobiological mechanisms of adolescent impulsivity.

Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats

Efficient foraging requires an ability to coordinate discrete reward-seeking and reward-retrieval behaviors. We used pathway-specific chemogenetic inhibition to investigate how rats’ mesolimbic and mesocortical dopamine circuits contribute to the expression and modulation of reward seeking and retrieval. Inhibiting ventral tegmental area dopamine neurons disrupted the tendency for reward-paired cues to motivate reward seeking, but spared their ability to increase attempts to retrieve reward. Similar effects were produced by inhibiting dopamine inputs to nucleus accumbens, but not medial prefrontal cortex. Inhibiting dopamine neurons spared the suppressive effect of reward devaluation on reward seeking, an assay of goal-directed behavior. Attempts to retrieve reward persisted after devaluation, indicating they were habitually performed as part of a fixed action sequence. Our findings show that complete bouts of reward seeking and retrieval are behaviorally and neurally dissociable from bouts of reward seeking without retrieval. This dichotomy may prove useful for uncovering mechanisms of maladaptive behavior.

Voluntary alcohol access during adolescence/early adulthood, but not during adulthood, causes faster omission contingency learning

In omission contingency training, rodents learn to suppress their natural tendency to approach or touch a reward-predictive cue (termed "autoshaping" or "sign-tracking" responses) if the approach/touching responses lead to the omission of the reward. Previous research has shown that high levels of alcohol exposure (through alcohol vapor exposure) or adolescent alcohol consumption (with some versions of the omission contingency task) can lead to faster omission contingency learning. However, the alcohol exposure procedures and/or omission contingency task parameters differed between these different demonstrations. It was unclear whether the same voluntary alcohol consumption procedures during adolescence/early adulthood and/or adulthood would lead to faster omission contingency learning in one or both age groups. Here, rats received 6 weeks of chronic intermittent access to 20% alcohol or water from PND 26-66 (adolescence/early adulthood in Exp. 1) or PND 68-108 (adulthood in Exp. 2) and began behavioral training (autoshaping training followed by omission contingency training) several days later. We found no evidence that alcohol access at either age altered the number of trials with a sign-tracking response on the levers during autoshaping training. However, alcohol access during adolescence/early adulthood, but not during adulthood, led to faster learning to withhold responding on the lever under omission contingencies during the subsequent phase. We also found no evidence that the level of alcohol consumption was correlated with sign-tracking behavior in the autoshaping phase or with the suppression of lever-pressing during the omission contingency phase. Our results suggest that adolescent/early adult rats have increased vulnerability, compared with adults, to some long-term behavioral effects of voluntary alcohol consumption.

Thalamic afferents to prefrontal cortices from ventral motor nuclei in decision-making

The focus of this literature review is on the three interacting brain areas that participate in decision‐making: basal ganglia, ventral motor thalamic nuclei, and medial prefrontal cortex, with an emphasis on the participation of the ventromedial and ventral anterior motor thalamic nuclei in prefrontal cortical function. Apart from a defining input from the mediodorsal thalamus, the prefrontal cortex receives inputs from ventral motor thalamic nuclei that combine to mediate typical prefrontal functions such as associative learning, action selection, and decision‐making. Motor, somatosensory and medial prefrontal cortices are mainly contacted in layer 1 by the ventral motor thalamic nuclei and in layer 3 by thalamocortical input from mediodorsal thalamus. We will review anatomical, electrophysiological, and behavioral evidence for the proposed participation of ventral motor thalamic nuclei and medial prefrontal cortex in rat and mouse motor decision‐making.

Effects of anterior cingulate cortex lesions on a continuous performance task for mice

Important tools in the study of prefrontal cortical-dependent executive functions are cross-species behavioural tasks with translational validity. A widely used test of executive function and attention in humans is the continuous performance task (CPT). Optimal performance in variations of this task is associated with activity along the medial wall of the prefrontal cortex, including the anterior cingulate cortex (ACC), for its essential components such as response control, target detection and processing of false alarm errors. We assess the validity of a recently developed rodent touchscreen continuous performance task (rCPT) that is analogous to typical human CPT procedures. Here we evaluate the performance of mice with quinolinic acid-induced lesions centred on the ACC in the rCPT following a range of task parameter manipulations designed to challenge attention and impulse control. Lesioned mice showed a disinhibited response profile expressed as a decreased response criterion and increased false alarm rates. ACC lesions also resulted in a milder increase in inter-trial interval responses ('ITI touches') and hit rate. Lesions did not affect discriminative sensitivity d'. The disinhibited behaviour of ACC lesioned animals was stable and not affected by the manipulation of variable task parameter manipulations designed to increase task difficulty. The results are in general agreement with human studies implicating the ACC in the processing of inappropriate responses. We conclude that the rCPT may be useful for studying prefrontal cortex function in mice and has the capability of providing meaningful links between animal and human cognitive tasks.

Altered reward learning and hippocampal connectivity following psychosocial stress

Acute stress has a profound influence on learning, as has been demonstrated in verbal learning or fear conditioning. However, its effect on appetitive conditioning is still unclear. Fear conditioning research suggests the possibility of overgeneralization of conditioning to the CS- under acute stress due to its effect on prefrontal and hippocampal processing. In this study, participants (N = 56 males) were subjected to the Trier Social Stress Test or a placebo version. After that, all participants underwent an appetitive conditioning paradigm in the fMRI, in which one neutral cue (CS+) was repeatedly paired with reward, while another (CS-) was not. Importantly, the stress-group revealed overgeneralization of conditioning to the CS- on the behavioral level. On the neural level, stressed participants showed increased connectivity between the hippocampus and amygdala, vACC, and OFC, which maintain specificity of conditioning and also showed reduced differential activation. The results indicate overgeneralization of appetitive conditioning promoted by maladaptive balancing of pattern separation and pattern completion in the hippocampus under acute stress and are discussed with respect to clinical implications.

Genesis and Maintenance of Attentional Biases: The Role of the Locus Coeruleus-Noradrenaline System

Emotionally arousing events are typically better remembered than mundane ones, in part because emotionally relevant aspects of our environment are prioritized in attention. Such biased attentional tuning is itself the result of associative processes through which we learn affective and motivational relevance of cues. We propose that the locus coeruleus-noradrenaline (LC-NA) system plays an important role in the genesis of attentional biases through associative learning processes as well as their maintenance. We further propose that individual differences in and disruptions of the LC-NA system underlie the development of maladaptive biases linked to psychopathology. We provide support for the proposed role of the LC-NA system by first reviewing work on attentional biases in development and its link to psychopathology in relation to alterations and individual differences in NA availability. We focus on pharmacological manipulations to demonstrate the effect of a disrupted system as well as the ADRA2b polymorphism as a tool to investigate naturally occurring differences in NA availability. We next review associative learning processes that-modulated by the LC-NA system-result in such implicit attentional biases. Further, we demonstrate how NA may influence aversive and appetitive conditioning linked to anxiety disorders as well as addiction and depression.

Multimodal connectivity-based parcellation reveals a shell-core dichotomy of the human nucleus accumbens

The subdifferentiation of the nucleus accumbens (NAc) has been extensively studied using neuroanatomy and histochemistry, yielding a well-accepted dichotomic shell/core architecture that reflects dissociable roles, such as in reward and aversion, respectively. However, in vivo parcellation of these structures in humans has been rare, potentially impairing future research into the structural and functional characteristics and alterations of putative NAc subregions. Here, we used three complementary parcellation schemes based on tractography, task-independent functional connectivity, and task-dependent co-activation to investigate the regional differentiation within the NAc. We found that a 2-cluster solution with shell-like and core-like subdivisions provided the best description of the data and was consistent with the earlier anatomical shell/core architecture. The consensus clusters from this optimal solution, which was based on the three schemes, were used as the final parcels for the subsequent connection analyses. The resulting connectivity patterns presented inter-hemispheric symmetry, convergence and divergence across the modalities, and, most importantly, clearly distinct patterns between the two subregions. This convergent connectivity patterns also confirmed the connections in animal models, supporting views that the two subregions could have antagonistic roles in some circumstances. Finally, the identified parcels should be helpful in further neuroimaging studies of the NAc. Hum Brain Mapp 38:3878-3898, 2017. © 2017 Wiley Periodicals, Inc.

Role of Anterior Cingulate Cortex in Instrumental Learning: Blockade of Dopamine D1 Receptors Suppresses Overt but Not Covert Learning

HIGHLIGHTS

Blockade of dopamine D1 receptors in ACC suppressed instrumental learning when overt responding was required.

Covert learning through observation was not impaired.

After treatment with a dopamine antagonist, instrumental learning recovered but not the rat's pretreatment level of effort tolerance.

ACC dopamine is not necessary for acquisition of task-relevant cues during learning, but regulates energy expenditure and effort based decision.

Dopamine activity in anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, including learning and effort based decision making. To dissociate learning from physical effort, we studied both observational (covert) learning, and trial-and-error (overt) learning. If ACC dopamine activity is required for task acquisition, its blockade should impair both overt and covert learning. If dopamine is not required for task acquisition, but solely for regulating the willingness to expend effort for reward, i.e., effort tolerance, blockade should impair overt learning but spare covert learning. Rats learned to push a lever for food rewards either with or without prior observation of an expert conspecific performing the same task. Before daily testing sessions, the rats received bilateral ACC microinfusions of SCH23390, a dopamine D1 receptor antagonist, or saline-control infusions. We found that dopamine blockade suppressed overt responding selectively, leaving covert task acquisition through observational learning intact. In subsequent testing sessions without dopamine blockade, rats recovered their overt-learning capacity but not their pre-treatment level of effort tolerance. These results suggest that ACC dopamine is not required for the acquisition of conditioned behaviors and that apparent learning impairments could instead reflect a reduced level of willingness to expend effort due to cortical dopamine blockade.

Transient inactivation of the anterior cingulate cortex in rats disrupts avoidance of a dynamic object

Although animals often learn and monitor the spatial properties of relevant moving objects such as conspecifics and predators to properly organize their own spatial behavior, the underlying brain substrate has received little attention and hence remains elusive. Because the anterior cingulate cortex (ACC) participates in conflict monitoring and effort-based decision making, and ACC neurons respond to objects in the environment, it may also play a role in the monitoring of moving cues and exerting the appropriate spatial response. We used a robot avoidance task in which a rat had to maintain at least a 25cm distance from a small programmable robot to avoid a foot shock. In successive sessions, we trained ten Long Evans male rats to avoid a fast-moving robot (4cm/s), a stationary robot, and a slow-moving robot (1cm/s). In each condition, the ACC was transiently inactivated by bilateral injections of muscimol in the penultimate session and a control saline injection was given in the last session. Compared to the corresponding saline session, ACC-inactivated rats received more shocks when tested in the fast-moving condition, but not in the stationary or slow robot conditions. Furthermore, ACC-inactivated rats less frequently responded to an approaching robot with appropriate escape responses although their response to shock stimuli remained preserved. Since we observed no effect on slow or stationary robot avoidance, we conclude that the ACC may exert cognitive efforts for monitoring dynamic updating of the position of an object, a role complementary to the dorsal hippocampus.

Are the emergence of affective disturbances in neuropathic pain states contingent on supraspinal neuroinflammation?

Neuro-immune interactions contribute to the pathogenesis of neuropathic pain due to peripheral nerve injury. A large body of preclinical evidence supports the idea that the immune system acts to modulate the sensory symptoms of neuropathy at both peripheral and central nervous system sites. The potential involvement of neuro-immune interactions in the highly debilitating affective disturbances of neuropathic pain, such as depression, anhedonia, impaired cognition and reduced motivation has received little attention. This is surprising given the widely accepted view that sickness behaviour, depression, cognitive impairment and other neuropsychiatric conditions can arise from inflammatory mechanisms. Moreover, there is a set of well-described immune-to-brain transmission mechanisms that explain how peripheral inflammation can lead to supraspinal neuroinflammation. In the last 5years increasing evidence has emerged that peripheral nerve injury induces supraspinal changes in cytokine or chemokine expression and alters glial cell activity. In this systematic review, based on strong preclinical evidence, we advance the argument that the emergence of affective disturbances in neuropathic pain states are contingent on pro-inflammatory mediators in the interconnected hippocampal-medial prefrontal circuitry that subserve affective behaviours. We explore how dysregulation of inflammatory mediators in these networks may result in affective disturbances through a wide variety of neuromodulatory mechanisms. There are also promising results from clinical trials showing that anti-inflammatory agents have efficacy in the treatment of a variety of neuropsychiatric conditions including depression and appear suited to sub-groups of patients with elevated pro-inflammatory profiles. Thus, although further research is required, aggressively targeting supraspinal pro-inflammatory mediators at critical time-points in appropriate clinical populations is likely to be a novel avenue to treat debilitating affective disturbances in neuropathic conditions.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Anterior cingulate cortex inactivation impairs rodent visual selective attention and prospective memory

Previous studies showed that the anterior cingulate cortex (ACC) plays a role in selective visual attention. The current study further examined the role of the ACC in attention using a visual cuing task with task-relevant and task-irrelevant stimuli. On every trial, 2 stimuli were presented on the touchscreen; 1 was task-relevant and the other was task-irrelevant. Rats were trained to attend to the task-relevant stimulus over the task-irrelevant stimulus to determine which side of the touchscreen should be selected for reward. After the rats were well-trained, cannulas targeting the ACC were implanted bilaterally for infusions of PBS or muscimol. When the ACC was functionally intact, high task performance was correlated with the anticipatory touches toward the reward; rats touched the stimulus proximal to the correct side more often, regardless of its task-relevancy. Analysis of the presurgery training data showed that rats developed anticipatory touches during training. Linear discriminant analyses of the touches also showed that the touches predict rats' choices in trials. With muscimol infusions, choice accuracy was impaired and the anticipatory touches toward the correct response location were less frequent. A control experiment, in which there were no irrelevant stimuli, showed no effects of ACC inactivation on choice accuracy or anticipatory touches. These results indicate that the rat ACC plays a critical role in reducing distraction from irrelevant stimuli as well as in guiding attention toward the goal locations.

The Origins and Organization of Vertebrate Pavlovian Conditioning

Pavlovian conditioning is the process by which we learn relationships between stimuli and thus constitutes a basic building block for how the brain constructs representations of the world. We first review the major concepts of Pavlovian conditioning and point out many of the pervasive misunderstandings about just what conditioning is. This brings us to a modern redefinition of conditioning as the process whereby experience with a conditional relationship between stimuli bestows these stimuli with the ability to promote adaptive behavior patterns that did not occur before the experience. Working from this framework, we provide an in-depth analysis of two examples, fear conditioning and food-based appetitive conditioning, which include a description of the only partially overlapping neural circuitry of each. We also describe how these circuits promote the basic characteristics that define Pavlovian conditioning, such as error-correction-driven regulation of learning.

Infralimbic prefrontal cortex interacts with nucleus accumbens shell to unmask expression of outcome-selective Pavlovian-to-instrumental transfer

Although several studies have examined the subcortical circuitry underlying Pavlovian-to-instrumental transfer (PIT), the role of medial prefrontal cortex in this behavior is largely unknown. Elucidating the cortical contributions to PIT will be key for understanding how reward-paired cues control behavior in both adaptive and maladaptive context (i.e., addiction). Here we use bilateral lesions in a rat model to show that infralimbic prefrontal cortex (ilPFC) is necessary for appropriate expression of PIT. Further, we show that ilPFC mediates this effect via functional connectivity with nucleus accumbens shell (NAcS). Together, these data provide the first demonstration that a specific cortico-striatal circuit is necessary for cue-invigorated reward seeking during specific PIT.

The touchscreen operant platform for testing learning and memory in rats and mice

An increasingly popular method of assessing cognitive functions in rodents is the automated touchscreen platform, on which a number of different cognitive tests can be run in a manner very similar to touchscreen methods currently used to test human subjects. This methodology is low stress (using appetitive rather than aversive reinforcement), has high translational potential and lends itself to a high degree of standardization and throughput. Applications include the study of cognition in rodent models of psychiatric and neurodegenerative diseases (e.g., Alzheimer's disease, schizophrenia, Huntington's disease, frontotemporal dementia), as well as the characterization of the role of select brain regions, neurotransmitter systems and genes in rodents. This protocol describes how to perform four touchscreen assays of learning and memory: visual discrimination, object-location paired-associates learning, visuomotor conditional learning and autoshaping. It is accompanied by two further protocols (also published in this issue) that use the touchscreen platform to assess executive function, working memory and pattern separation.

Time-dependent effects of corticosterone on reward-based decision-making in a rodent model of the Iowa Gambling Task

Corticosteroid hormones, released after stress, are known to change neuronal activity in two time-domains: within minutes via non-genomic pathways and with a delay of >1 h through pathways involving transcriptional regulation. Recent evidence in rodents and humans indicates that these two modes of corticosteroid action differently affect cognitive tasks. Here, we investigated whether reward-based decision-making, in a rat model of the Iowa Gambling Task (rIGT), is also differently altered by rapid versus delayed actions of corticosterone. We targeted the rapid and delayed time domain by injecting corticosterone (CORT, 1 mg/kg, s.c.) at 30 min (rapid) or 180 min (delayed) respectively prior to behavioural testing, during the final 3 days of the behavioural paradigm. In saline treated rats, the number of visits to the disadvantageous arm decreased over trial blocks, whilst this was attenuated when CORT was administered 30 min before testing. This attenuation was associated with a significantly increased c-Fos expression in the lateral orbitofrontal cortex and insular cortex, and a trend for an increase in the infralimbic cortex. The rapid corticosteroid effect contrasted with treatment 180 min before testing, where the number of visits to the disadvantageous arm as well as c-Fos labelling was not affected. These findings indicate that rapid corticosteroid actions impair reward-based decision-making.

Quantifying individual variation in the propensity to attribute incentive salience to reward cues

If reward-associated cues acquire the properties of incentive stimuli they can come to powerfully control behavior, and potentially promote maladaptive behavior. Pavlovian incentive stimuli are defined as stimuli that have three fundamental properties: they are attractive, they are themselves desired, and they can spur instrumental actions. We have found, however, that there is considerable individual variation in the extent to which animals attribute Pavlovian incentive motivational properties ("incentive salience") to reward cues. The purpose of this paper was to develop criteria for identifying and classifying individuals based on their propensity to attribute incentive salience to reward cues. To do this, we conducted a meta-analysis of a large sample of rats (N = 1,878) subjected to a classic Pavlovian conditioning procedure. We then used the propensity of animals to approach a cue predictive of reward (one index of the extent to which the cue was attributed with incentive salience), to characterize two behavioral phenotypes in this population: animals that approached the cue ("sign-trackers") vs. others that approached the location of reward delivery ("goal-trackers"). This variation in Pavlovian approach behavior predicted other behavioral indices of the propensity to attribute incentive salience to reward cues. Thus, the procedures reported here should be useful for making comparisons across studies and for assessing individual variation in incentive salience attribution in small samples of the population, or even for classifying single animals.

Impaired auditory discrimination learning following perinatal nicotine exposure or β2 nicotinic acetylcholine receptor subunit deletion

Maternal smoking during pregnancy can impair performance of the exposed offspring in tasks that require auditory stimulus processing and perception; however, the tobacco component(s) responsible for these effects and the underlying neurobiological mechanisms remain uncertain. In this study, we show that administration of nicotine during mouse perinatal development can impair performance in an auditory discrimination paradigm when the exposed animals are mature. This suggests that nicotine disrupts auditory pathways via nicotinic acetylcholine receptors (nAChRs) that are expressed at an early stage of development. We have also determined that mice which lack nAChRs containing the β2 subunit (β2* nAChRs) exhibit similarly compromised performance in this task, suggesting that β2* nAChRs are necessary for normal auditory discrimination or that β2* nAChRs play a critical role in development of the circuitry required for task performance. In contrast, no effect of perinatal nicotine exposure or β2 subunit knockout was found on the acquisition and performance of a differential reinforcement of low rate task. This suggests that the auditory discrimination impairments are not a consequence of a general deficit in learning and memory, but may be the result of compromised auditory stimulus processing in the nicotine-exposed and knockout animals.

New translational assays for preclinical modelling of cognition in schizophrenia: the touchscreen testing method for mice and rats

We describe a touchscreen method that satisfies a proposed 'wish-list' of desirables for a cognitive testing method for assessing rodent models of schizophrenia. A number of tests relevant to schizophrenia research are described which are currently being developed and validated using this method. These tests can be used to study reward learning, memory, perceptual discrimination, object-place associative learning, attention, impulsivity, compulsivity, extinction, simple Pavlovian conditioning, and other constructs. The tests can be deployed using a 'flexible battery' approach to establish a cognitive profile for a particular mouse or rat model. We have found these tests to be capable of detecting not just impairments in function, but enhancements as well, which is essential for testing putative cognitive therapies. New tests are being continuously developed, many of which may prove particularly valuable for schizophrenia research.

Cocaine-induced impulsive choices are accompanied by impaired delay-dependent anticipatory activity in basolateral amygdala

Addicts and drug-experienced animals have decision-making deficits in delayed reinforcement choice task, in which they prefer small immediate rewards over large delayed rewards. Here, we show evidence that this deficit is accompanied by changed coding of delay length in the basolateral amygdala (BLA). A subset of neurons in BLA demonstrated delay-dependent anticipatory activity (either increase or decrease as a function of delay to reward) in naive rats. After 30 days of withdrawal from chronic cocaine treatment (30 mg/kg/day for 10 days ip), the proportion of delay-dependent anticipatory neurons reduced, whereas delay-dependent activity in response to elapsed delay after reward delivery increased, both in the proportion of delay-dependent neurons and in the extent of delay dependence. Cocaine exposure increased, instead of decreased, BLA neuronal expectation for different reward magnitudes. These results indicate that BLA is critical for representing and maintaining the information of delayed reward before its delivery, and cocaine exposure may affect decision-making by impairing perception of delay instead of the ability to assess the differences in reward size.

Developmental trajectories during adolescence in males and females: a cross-species understanding of underlying brain changes

Adolescence is a transitional period between childhood and adulthood that encompasses vast changes within brain systems that parallel some, but not all, behavioral changes. Elevations in emotional reactivity and reward processing follow an inverted U shape in terms of onset and remission, with the peak occurring during adolescence. However, cognitive processing follows a more linear course of development. This review will focus on changes within key structures and will highlight the relationships between brain changes and behavior, with evidence spanning from functional magnetic resonance imaging (fMRI) in humans to molecular studies of receptor and signaling factors in animals. Adolescent changes in neuronal substrates will be used to understand how typical and atypical behaviors arise during adolescence. We draw upon clinical and preclinical studies to provide a neural framework for defining adolescence and its role in the transition to adulthood.

Blockade of opioid receptors in anterior cingulate cortex disrupts ethanol-seeking behavior in mice

The anterior cingulate cortex (ACC) and opioid receptors have been suggested to play a role in attributing incentive motivational properties to drug-related cues. We examined whether blockade of ACC opioid receptors would reduce cue-induced ethanol-seeking behavior in mice. We show that intra-ACC opioid receptor blockade disrupted expression of an ethanol-induced conditioned place preference, suggesting that endogenous opioid modulation in the ACC may be critical for maintaining the cue's conditioned rewarding effects.

Mediodorsal nucleus of the thalamus is critical for the expression of memory of methamphetamine-produced conditioned place preference in rats

Methamphetamine (MA) is a powerful and highly addictive psychostimulant. However, the neural substrate mediating MA-induced conditioned effects, an essential part of addiction, remain unclear. The present study investigated the involvement of the anterior cingulate cortex (ACC), the lateral nucleus of amygdala (LNA), and the mediodorsal nucleus of the thalamus (MD) in MA-conditioned place preference (CPP). Rats underwent bilateral radio-frequency lesions of the ACC, LNA, or MD followed by MA CPP training. Lesions of the MD, but not the ACC or LNA, disrupted MA CPP learning. To clarify the role of the MD on the different stages of the MA CPP memory process, bilateral microinfusions of lidocaine into the MD were performed 5 min prior to each conditioning trial, immediately after the conditioning trial, or 5 min before the testing phase. Pretesting, but not pre- or post-conditioning, infusions of lidocaine into the MD impaired MA CPP. Furthermore, a clear preference for the previously conditioned MA paired cues was expressed when the rats were tested again 24 h after infusions of lidocaine. These results are interpreted as indicating that the MD is specifically involved in the memory retrieval process of MA associated memory which suggests the MD could have an important role in relapse in individuals suffering from MA addiction.

The role of dopamine in the dorsomedial striatum in general and outcome-selective Pavlovian-instrumental transfer

Pavlovian stimuli predictive of appetitive outcomes can influence the selection and initiation of instrumental behaviour. For instance, Pavlovian stimuli can act to enhance those actions with which they share an outcome, but not others with which they do not share an outcome, a phenomenon termed outcome-selective Pavlovian-instrumental transfer (PIT). Furthermore, Pavlovian stimuli can invigorate an action by inducing a general appetitive arousal that elevates instrumental responding, a phenomenon termed general PIT. The dorsomedial striatum has been implicated in outcome-selective, but not general PIT. However, the role of dopamine (DA) signals in this subregion in mediating PIT is unknown. Here we examined in rats the effects of a 6-hydroxydopamine-induced DA depletion of the anterior (aDMS) or posterior (pDMS) subregion of the dorsomedial striatum on outcome-selective and general PIT as well as on instrumental performance on a FR-5 schedule (five lever presses earned one pellet). Results demonstrate that aDMS and pDMS DA depletions compromised the rate of responding on a FR-5 schedule, suggesting that DA signals in the dorsomedial striatum are necessary to maintain high rates of instrumental responding. By contrast, aDMS and pDMS DA depletions did not affect general PIT, suggesting that DA signals in the dorsomedial striatum do not mediate general activating effects of reward-predictive stimuli to invigorate instrumental responding. Furthermore, aDMS DA depletions did not impair outcome-selective PIT, while pDMS DA depletions had no or only minor effects. Thus, DA signals in the DMS may not be involved in mediating the specific cueing effects of reward-predictive stimuli.

A potential role for adiponectin receptor 2 (AdipoR2) in the regulation of alcohol intake

The anterior cingulate cortex (ACC) has been implicated in alcohol and drug addiction. We recently identified the small G protein K-ras as an alcohol-regulated gene in the ACC by gene expression analysis. We show here that the adiponectin receptor 2 (AdipoR2) was differentially regulated by alcohol in the ACC in a K-ras-dependent manner. Additionally, withdrawal-associated increased drinking was attenuated in AdipoR2 null mice. Intracellular recordings revealed that adiponectin increased the excitability of ACC neurons and that this effect was more pronounced during alcohol withdrawal, suggesting that AdipoR2 signaling may contribute to increased ACC activity. Altogether, the data implicate K-ras-regulated pathways involving AdipoR2 in the cellular and behavioral actions of alcohol that may contribute to overactivity of the ACC during withdrawal and excessive alcohol drinking.

Genome-wide gene expression analysis identifies K-ras as a regulator of alcohol intake

Adaptations in the anterior cingulate cortex (ACC) have been implicated in alcohol and drug addiction. To identify genes that may contribute to excessive drinking, here we performed microarray analyses in laser microdissected rat ACC after a single or repeated administration of an intoxicating dose of alcohol (3 g/kg). Expression of the small G protein K-ras was differentially regulated following both single and repeated alcohol administration. We also observed that voluntary alcohol intake in K-ras heterozygous null mice (K-ras(+/-)) did not increase after withdrawal from repeated cycles of intermittent ethanol vapor exposure, unlike in their wild-type littermates. To identify K-ras regulated pathways, we then profiled gene expression in the ACC of K-ras(+/-), heterozygous null mice for the K-ras negative regulator Nf1 (Nf1(+/-)) and wild-type mice following repeated administration of an intoxicating dose of alcohol. Pathway analysis showed that alcohol differentially affected various pathways in a K-ras dependent manner - some of which previously shown to be regulated by alcohol - including the insulin/PI3K pathway, the NF-kappaB, the phosphodiesterases (PDEs) pathway, the Jak/Stat and the adipokine signaling pathways. Altogether, the data implicate K-ras-regulated pathways in the regulation of excessive alcohol drinking after a history of dependence.

Pavlovian to instrumental transfer: a neurobehavioural perspective

Pavlovian-to-instrumental transfer (PIT) is a key concept in developing our understanding of cue-controlled behaviours. Here we have reviewed the literature on behavioural and neurobiological factors that influence PIT. Meta-analyses of the data for individual groups in PIT studies revealed that PIT is related to both the order and amounts of instrumental and Pavlovian training, and that it is critically determined by competition between instrumental and Pavlovian responses. We directly addressed the role of response competition in PIT in two experiments which showed that extensive Pavlovian conditioning produced more Pavlovian magazine visits and weaker PIT than moderate Pavlovian conditioning (Experiment 1); and that PIT lost after extensive Pavlovian conditioning was restored by Pavlovian extinction training (Experiment 2). These findings confirm that response competition is indeed an important determinant of PIT. This has significant implications for lesion and inactivation studies that assess the neurobiological substrates of PIT, as well as attempts to demonstrate PIT in the drug self-administration paradigm where the effect is yet to be reliably shown.

Interactions between orbital prefrontal cortex and amygdala: advanced cognition, learned responses and instinctive behaviors

Recent research indicates that the orbital prefrontal cortex (PFo) represents stimulus valuations and that the amygdala updates these valuations. An exploration of how PFo and the amygdala interact could improve the understanding of both. PFo and the amygdala function cooperatively when monkeys choose objects associated with recently revalued foods. In other tasks, they function in opposition. PFo uses positive feedback to promote learning in object-reward reversal tasks, and PFo also promotes extinction learning. Amygdala function interferes with both kinds of learning. The amygdala underlies fearful responses to a rubber snake from the first exposure on, but PFo is necessary only after the initial exposure. The amygdala mediates an arousal response in anticipation of rewards, whereas PFo sometimes suppresses such arousal. A role for PFo in advanced cognition, for the amygdala in instinctive behavior, and for cortex-subcortex interactions in prioritizing behaviors provides one account for these findings.

Methamphetamine acts on subpopulations of neurons regulating sexual behavior in male rats

Methamphetamine (Meth) is a highly addictive stimulant. Meth abuse is commonly associated with the practice of sexual risk behavior and increased prevalence of Human Immunodeficiency Virus and Meth users report heightened sexual desire, arousal, and sexual pleasure. The biological basis for this drug-sex nexus is unknown. The current study demonstrates that Meth administration in male rats activates neurons in brain regions of the mesolimbic system that are involved in the regulation of sexual behavior. Specifically, Meth and mating co-activate cells in the nucleus accumbens core and shell, basolateral amygdala, and anterior cingulate cortex. These findings illustrate that in contrast to current belief drugs of abuse can activate the same cells as a natural reinforcer, that is sexual behavior, and in turn may influence compulsive seeking of this natural reward.

The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning

Considerable evidence suggests that dopamine in the core subregion of the nucleus accumbens is not only involved in Pavlovian conditioning but also supports instrumental performance. However, it is largely unknown whether NAc dopamine is required for outcome encoding which plays an important role both in Pavlovian stimulus-outcome learning and instrumental action-outcome learning. Therefore, we tested rats with 6-hydroxydopamine (6-OHDA) induced dopamine depletion of the NAc core for their sensitivity to outcome devaluation in a Pavlovian and an instrumental task. Results indicate that 6-OHDA-lesioned animals were sensitive to outcome devaluation in an instrumental task. This finding provides support to the notion that NAc core dopamine may not be crucial in encoding action-outcome associations. However, during instrumental conditioning lever pressing rates in 6-OHDA-lesioned animals were markedly lower which could reflect an impaired behavioral activation. By contrast, after outcome-specific devaluation in a Pavlovian task, performance in 6-OHDA-lesioned animals was impaired, i.e. their magazine-directed responding was non-selectively reduced. One possibility to explain non-selective responding is that NAc core DA depletion impaired the ability of conditioned stimuli to activate the memory of the current value of the reinforcer.

Post-learning infusion of anisomycin into the anterior cingulate cortex impairs instrumental acquisition through an effect on reinforcer valuation

The integrity of the rodent anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, but it is not clear if the ACC is important for the acquisition of a simple instrumental response. Here, it was demonstrated that post-session infusions of anisomycin into the rat ACC completely prevented the acquisition of instrumental responding. The experimental use of post-session intracranial infusions of plasticity inhibitors is assumed to affect local consolidation of plasticity, but not behavioral task performance. However, in associative appetitive conditioning, post-session intracranial infusion of pharmaco-active compounds could actually interfere with subsequent task performance indirectly through retrospective effects on the valuation of ingested rewards. Thus, it was subsequently demonstrated that the intracranial infusion of anisomycin into the ACC after sucrose pellet consumption significantly reduced subsequent pellet consumption, suggesting that the infusion of anisomycin into the ACC produced conditioned taste avoidance. In the third experiment, an innovative procedure was introduced that dissociated the effects of intracranial infusions after conditioning sessions on task-learning and unconditioned stimulus valuation. With this procedure, the infusion of anisomycin into the ACC after instrumental sessions did not affect instrumental reinforcer valuation or the acquisition of instrumental responding, suggesting that plasticity in the ACC is not necessary for the acquisition of instrumental behavior.

Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction

In this review we discuss the evidence that drug addiction, defined as a maladaptive compulsive habit, results from the progressive subversion by addictive drugs of striatum-dependent operant and Pavlovian learning mechanisms that are usually involved in the control over behaviour by stimuli associated with natural reinforcement. Although mainly organized through segregated parallel cortico-striato-pallido-thalamo-cortical loops involved in motor or emotional functions, the basal ganglia, and especially the striatum, are key mediators of the modulation of behavioural responses, under the control of both action-outcome and stimulus-response mechanisms, by incentive motivational processes and Pavlovian associations. Here we suggest that protracted exposure to addictive drugs recruits serial and dopamine-dependent, striato-nigro-striatal ascending spirals from the nucleus accumbens to more dorsal regions of the striatum that underlie a shift from action-outcome to stimulus-response mechanisms in the control over drug seeking. When this progressive ventral to dorsal striatum shift is combined with drug-associated Pavlovian influences from limbic structures such as the amygdala and the orbitofrontal cortex, drug seeking behaviour becomes established as an incentive habit. This instantiation of implicit sub-cortical processing of drug-associated stimuli and instrumental responding might be a key mechanism underlying the development of compulsive drug seeking and the high vulnerability to relapse which are hallmarks of drug addiction.

Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making

Research on the neural basis that underlies decision making in humans has revealed that these processes are mediated by distributed neural networks that incorporate different regions of the frontal lobes, the amygdala, the ventral striatum, and the dopamine system. In the present article, we review recent studies in rodents investigating the contribution of these systems to different forms of cost-benefit decision making and focus on evaluations related to delays, effort, or risks associated with certain rewards. Anatomically distinct regions of the medial and orbital prefrontal cortex make dissociable contributions to different forms of decision making, although lesions of these regions can induce variable effects, depending on the type of tasks used to assess these functions. The basolateral amygdala and the nucleus accumbens play a more fundamental role in these evaluations, helping an organism overcome different costs to obtain better rewards. Dopamine activity biases behavior toward more costly yet larger rewards, although abnormal increases in dopamine transmission can exert opposing actions on different types of decision making. The fact that similar neural circuits are recruited to solve these types of problems in both humans and animals suggests that animal models of decision making will prove useful in elucidating the mechanisms mediating these processes.