Reward-quality dependent anticipation in rat nucleus accumbens

Representation of rewards differing in their hedonic valence in the caudate nucleus correlates with the performance in a problem-solving task in dogs (Canis familiaris)

We have investigated dogs' (Canis familiaris) abilities in associating different sounds with appetitive stimuli of different incentive values. The association's establishment was first tested on family dogs (n = 20) in a problem-solving behavioural paradigm (experiment 1), then in a problem-solving behavioural paradigm as well as an fMRI study on specially trained family dogs (n = 20) (experiment 2). The aim was to show behavioural and parallel neural effects of the association formed between the two sounds and two different associated appetitive stimuli. The latency of solving the problem was considered an indicator of the motivational state. In our first experiment, where only behaviour was studied, we found that dogs were quicker in solving a problem upon hearing the sound associated with food higher in reward value, suggesting that they have successfully associated the sounds with the corresponding food value. In our second experiment, this behaviour difference was not significant. In the fMRI study, the cerebral response to the two sounds was compared both before and after the associative training. Two bilateral regions of interest were explored: the caudate nucleus and the amygdala. After the associative training, the response in the caudate nucleus was higher to the sound related to a higher reward value food than to the sound related to a lower reward value food, which difference was not present before the associative training. We found an increase in the amygdala response to both sounds after the training. In a whole-brain representational similarity analysis, we found that cerebral patterns in the caudate nucleus to the two sounds were different only after the training. Moreover, we found a positive correlation between the dissimilarity index in the caudate nucleus for activation responses to the two sounds and the difference in latencies (i.e. high reward value associated sound condition latency-low reward value associated sound condition latency) to solve the behavioural task: the bigger the difference between the conditions in latency to solve the task, the greater the difference in the neural representation of the two sounds was. In summary, family dogs' brain activation patterns reflected their expectations based on what they learned about the relationship between two sounds and their associated appetitive stimuli.

Anhedonia as a central factor in depression: Neural mechanisms revealed from preclinical to clinical evidence

Anhedonia is one of the core symptoms of major depressive disorder (MDD), which is often inadequately treated by traditional antidepressants. The modern framework of anhedonia extends the definition from impaired consummatory pleasure or interest in rewards to a broad spectrum of deficits that impact functions such as reward anticipation, approach motivation, effort expenditure, reward valuation, expectation, and reward-cue association learning. Substantial preclinical and clinical research has explored the neural basis of reward deficits in the context of depression, and has implicated mesocorticolimbic reward circuitry comprising the nucleus accumbens, ventral pallidum, ventral tegmental area, amygdala, hippocampus, anterior cingulate, insula, orbitofrontal cortex, and other prefrontal cortex regions. Dopamine modulates several reward facets including anticipation, motivation, effort, and learning. As well, serotonin, norepinephrine, opioids, glutamate, Gamma aminobutyric acid (GABA), and acetylcholine are also involved in anhedonia, and medications targeting these systems may also potentially normalize reward processing in depression. Unfortunately, whereas reward anticipation and reward outcome are extensively explored by both preclinical and clinical studies, translational gaps remain in reward motivation, effort, valuation, and learning, where clinical neuroimaging studies are in the early stages. This review aims to synthesize the neurobiological mechanisms underlying anhedonia in MDD uncovered by preclinical and clinical research. The translational difficulties in studying the neural basis of reward are also discussed.

d-Fenfluramine and lorcaserin inhibit the binge-like feeding induced by μ-opioid receptor stimulation of the nucleus accumbens in the rat

Multiple laboratories have shown that the stimulation of μ-opioid receptors in the nucleus accumbens (NAcc) powerfully increases intake of palatable and high-fat diets. Separate studies have demonstrated that serotonin agonists advance satiety processes, and several serotonin-targeting agents have been prescribed to promote weight loss. However, it is unknown if serotonin signaling can modulate the increased feeding elicited by activation of NAcc μ-opioid receptors. These experiments assessed the effects of systemic treatments with the serotonin agonists d-fenfluramine and lorcaserin on the binge-like feeding induced by μ-opioid receptor stimulation of the NAcc in Sprague-Dawley rats. Consistent with previous reports, stimulation of NAcc μ-opioid receptors (with 0.025 μg/0.5 μl/side DAMGO) significantly increased consumption of high-fat vegetable shortening, and systemic treatment with d-fenfluramine and lorcaserin dose-dependently decreased intake. Interestingly, d-fenfluramine and lorcaserin reversed the binge-like feeding observed following stimulation of NAcc μ-opioid receptors. Both serotonergic drugs also attenuated the increases of ambulation observed following administration of DAMGO in the NAcc. These data demonstrate that serotonergic anorectics, in addition to their known role in advancing satiety processes during normal feeding, can also inhibit the binge-like feeding that is elicited by activation of μ-opioid receptors within the ventral striatum.

Cocaine Place Conditioning Strengthens Location-Specific Hippocampal Coupling to the Nucleus Accumbens

Conditioned place preference (CPP) is a widely used model of addiction-related behavior whose underlying mechanisms are not understood. In this study, we used dual site silicon probe recordings in freely moving mice to examine interactions between the hippocampus and nucleus accumbens in cocaine CPP. We found that CPP was associated with recruitment of D2-positive nucleus accumbens medium spiny neurons to fire in the cocaine-paired location, and this recruitment was driven predominantly by selective strengthening of coupling with hippocampal place cells that encode the cocaine-paired location. These findings provide in vivo evidence suggesting that the synaptic potentiation in the accumbens caused by repeated cocaine administration preferentially affects inputs that were active at the time of drug exposure. This provides a potential physiological mechanism by which drug use becomes associated with specific environmental contexts.

Roux-en-Y Gastric Bypass Alters Brain Activity in Regions that Underlie Reward and Taste Perception

BACKGROUND

Roux-en-Y gastric bypass (RYGB) surgery is a very effective bariatric procedure to achieve significant and sustained weight loss, yet little is known about the procedure's impact on the brain. This study examined the effects of RYGB on the brain's response to the anticipation of highly palatable versus regular food.

METHODS

High fat diet-induced obese rats underwent RYGB or sham operation and were then tested for conditioned place preference (CPP) for the bacon-paired chamber, relative to the chow-paired chamber. After CPP, animals were placed in either chamber without the food stimulus, and brain-glucose metabolism (BGluM) was measured using positron emission tomography (μPET).

RESULTS

Bacon CPP was only observed in RYGB rats that had stable weight loss following surgery. BGluM assessment revealed that RYGB selectively activated regions of the right and midline cerebellum (Lob 8) involved in subjective processes related to reward or expectation. Also, bacon anticipation led to significant activation in the medial parabrachial nuclei (important in gustatory processing) and dorsomedial tegmental area (key to reward, motivation, cognition and addiction) in RYGB rats; and activation in the retrosplenial cortex (default mode network), and the primary visual cortex in control rats.

CONCLUSIONS

RYGB alters brain activity in areas involved in reward expectation and sensory (taste) processing when anticipating a palatable fatty food. Thus, RYGB may lead to changes in brain activity in regions that process reward and taste-related behaviors. Specific cerebellar regions with altered metabolism following RYGB may help identify novel therapeutic targets for treatment of obesity.

Ramping single unit activity in the medial prefrontal cortex and ventral striatum reflects the onset of waiting but not imminent impulsive actions

The medial prefrontal cortex (mPFC) and ventral striatum (VS), including the nucleus accumbens, are key forebrain regions involved in regulating behaviour for future rewards. Dysfunction of these regions can result in impulsivity, characterized by actions that are mistimed and executed without due consideration of their consequences. Here we recorded the activity of single neurons in the mPFC and VS of 16 rats during performance on a five-choice serial reaction time task of sustained visual attention and impulsivity. Impulsive responses were assessed by the number of premature responses made before target stimuli were presented. We found that the majority of cells signalled trial outcome after an action was made (both rewarded and unrewarded). Positive and negative ramping activity was a feature of population activity in the mPFC and VS (49.5 and 50.4% of cells, respectively). This delay-related activity increased at the same rate and reached the same maximum (or minimum) for trials terminated by either correct or premature responses. However, on premature trials, the ramping activity started earlier and coincided with shorter latencies to begin waiting. For all trial types the pattern of ramping activity was unchanged when the pre-stimulus delay period was made variable. Thus, premature responses may result from a failure in the timing of the initiation of a waiting process, combined with a reduced reliance on external sensory cues, rather than a primary failure in delay activity. Our findings further show that the neural locus of this aberrant timing signal may emanate from structures outside the mPFC and VS.

Competitor suppresses neuronal representation of food reward in the nucleus accumbens/medial striatum of domestic chicks

To investigate the role of social contexts in controlling the neuronal representation of food reward, we recorded single neuron activity in the medial striatum/nucleus accumbens of domestic chicks and examined whether activities differed between two blocks with different contexts. Chicks were trained in an operant task to associate light-emitting diode color cues with three trial types that differed in the type of food reward: no reward (S-), a small reward/short-delay option (SS), and a large reward/long-delay alternative (LL). Amount and duration of reward were set such that both of SS and LL were chosen roughly equally. Neurons showing distinct cue-period activity in rewarding trials (SS and LL) were identified during an isolation block, and activity patterns were compared with those recorded from the same neuron during a subsequent pseudo-competition block in which another chick was allowed to forage in the same area, but was separated by a transparent window. In some neurons, cue-period activity was lower in the pseudo-competition block, and the difference was not ascribed to the number of repeated trials. Comparison at neuronal population level revealed statistically significant suppression in the pseudo-competition block in both SS and LL trials, suggesting that perceived competition generally suppressed the representation of cue-associated food reward. The delay- and reward-period activities, however, did not significantly different between blocks. These results demonstrate that visual perception of a competitive forager per se weakens the neuronal representation of predicted food reward. Possible functional links to impulse control are discussed.

The role of serotonin in the regulation of patience and impulsivity

Classic theories suggest that central serotonergic neurons are involved in the behavioral inhibition that is associated with the prediction of negative rewards or punishment. Failed behavioral inhibition can cause impulsive behaviors. However, the behavioral inhibition that results from predicting punishment is not sufficient to explain some forms of impulsive behavior. In this article, we propose that the forebrain serotonergic system is involved in “waiting to avoid punishment” for future punishments and “waiting to obtain reward” for future rewards. Recently, we have found that serotonergic neurons increase their tonic firing rate when rats await food and water rewards and conditioned reinforcer tones. The rate of tonic firing during the delay period was significantly higher when rats were waiting for rewards than for tones, and rats were unable to wait as long for tones as for rewards. These results suggest that increased serotonergic neuronal firing facilitates waiting behavior when there is the prospect of a forthcoming reward and that serotonergic activation contributes to the patience that allows rats to wait longer. We propose a working hypothesis to explain how the serotonergic system regulates patience while waiting for future rewards.

Theta phase precession in rat ventral striatum links place and reward information

A functional interaction between the hippocampal formation and the ventral striatum is thought to contribute to the learning and expression of associations between places and rewards. However, the mechanism of how such associations may be learned and used is currently unknown. We recorded neural ensembles and local field potentials from the ventral striatum and CA1 simultaneously as rats ran a modified T-maze. Theta-modulated cells in ventral striatum almost invariably showed firing phase precession relative to the hippocampal theta rhythm. Across the population of ventral striatal cells, phase precession was preferentially associated with an anticipatory ramping of activity up to the reward sites. In contrast, CA1 population activity and phase precession were distributed more uniformly. Ventral striatal phase precession was stronger to hippocampal than ventral striatal theta and was accompanied by increased theta coherence with hippocampus, suggesting that this effect is hippocampally derived. These results suggest that the firing phase of ventral striatal neurons contains motivationally relevant information and that phase precession serves to bind hippocampal place representations to ventral striatal representations of reward.

Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards

The serotonergic system plays a key role in the control of impulsive behaviors. Forebrain serotonin depletion leads to premature actions and steepens discounting of delayed rewards. However, there has been no direct evidence for serotonin neuron activity in relation to actions for delayed rewards. Here we show that serotonin neurons increase their tonic firing while rats wait for food and water rewards and conditioned reinforcement tones. The rate of tonic firing during the delay period was significantly higher for rewards than for tones, for which rats could not wait as long. When the delay was extended, tonic firing persisted until reward or tone delivery. When rats gave up waiting because of extended delay or reward omission, serotonin neuron firing dropped preceding the exit from reward sites. Serotonin neurons did not show significant response when an expected reward was omitted, which was predicted by the theory that serotonin signals negative reward prediction errors. These results suggest that increased serotonin neuron firing facilitates a rat's waiting behavior in prospect of forthcoming rewards and that higher serotonin activation enables longer waiting.

Integrating early results on ventral striatal gamma oscillations in the rat

A vast literature implicates the ventral striatum in the processing of reward-related information and in mediating the impact of such information on behavior. It is characterized by heterogeneity at the local circuit, connectivity, and functional levels. A tool for dissecting this complex structure that has received relatively little attention until recently is the analysis of ventral striatal local field potential oscillations, which are more prominent in the gamma band compared to the dorsal striatum. Here we review recent results on gamma oscillations recorded from freely moving rats. Ventral striatal gamma separates into distinct frequency bands (gamma-50 and gamma-80) with distinct behavioral correlates, relationships to different inputs, and separate populations of phase-locked putative fast-spiking interneurons. Fast switching between gamma-50 and gamma-80 occurs spontaneously but is influenced by reward delivery as well as the application of dopaminergic drugs. These results provide novel insights into ventral striatal processing and highlight the importance of considering fast-timescale dynamics of ventral striatal activity.

Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task

Decision-making studies across different domains suggest that decisions can arise from multiple, parallel systems in the brain: a flexible system utilizing action-outcome expectancies and a more rigid system based on situation-action associations. The hippocampus, ventral striatum, and dorsal striatum make unique contributions to each system, but how information processing in each of these structures supports these systems is unknown. Recent work has shown covert representations of future paths in hippocampus and of future rewards in ventral striatum. We developed analyses in order to use a comparative methodology and apply the same analyses to all three structures. Covert representations of future paths and reward were both absent from the dorsal striatum. In contrast, dorsal striatum slowly developed situation representations that selectively represented action-rich parts of the task. This triple dissociation suggests that the different roles these structures play are due to differences in information-processing mechanisms.

Expectancies in decision making, reinforcement learning, and ventral striatum

Decisions can arise in different ways, such as from a gut feeling, doing what worked last time, or planful deliberation. Different decision-making systems are dissociable behaviorally, map onto distinct brain systems, and have different computational demands. For instance, “model-free” decision strategies use prediction errors to estimate scalar action values from previous experience, while “model-based” strategies leverage internal forward models to generate and evaluate potentially rich outcome expectancies. Animal learning studies indicate that expectancies may arise from different sources, including not only forward models but also Pavlovian associations, and the flexibility with which such representations impact behavior may depend on how they are generated. In the light of these considerations, we review the results of van der Meer and Redish (2009a), who found that ventral striatal neurons that respond to reward delivery can also be activated at other points, notably at a decision point where hippocampal forward representations were also observed. These data suggest the possibility that ventral striatal reward representations contribute to model-based expectancies used in deliberative decision making.

Low and High Gamma Oscillations in Rat Ventral Striatum have Distinct Relationships to Behavior, Reward, and Spiking Activity on a Learned Spatial Decision Task

Local field potential (LFP) oscillations in the brain reflect organization thought to be important for perception, attention, movement, and memory. In the basal ganglia, including dorsal striatum, dysfunctional LFP states are associated with Parkinson's disease, while in healthy subjects, dorsal striatal LFPs have been linked to decision-making processes. However, LFPs in ventral striatum have been less studied. We report that in rats running a spatial decision task, prominent gamma-50 (45–55 Hz) and gamma-80 (70–85 Hz) oscillations in ventral striatum had distinct relationships to behavior, task events, and spiking activity. Gamma-50 power increased sharply following reward delivery and before movement initiation, while in contrast, gamma-80 power ramped up gradually to reward locations. Gamma-50 power was low and contained little structure during early learning, but rapidly developed a stable pattern, while gamma-80 power was initially high before returning to a stable level within a similar timeframe. Putative fast-spiking interneurons (FSIs) showed phase, firing rate, and coherence relationships with gamma-50 and gamma-80, indicating that the observed LFP patterns are locally relevant. Furthermore, in a number of FSIs such relationships were specific to gamma-50 or gamma-80, suggesting that partially distinct FSI populations mediate the effects of gamma-50 and gamma-80.

Covert Expectation-of-Reward in Rat Ventral Striatum at Decision Points

Flexible decision-making strategies (such as planning) are a key component of adaptive behavior, yet their neural mechanisms have remained resistant to experimental analysis. Theories of planning require prediction and evaluation of potential future rewards, suggesting that reward signals may covertly appear at decision points. To test this idea, we recorded ensembles of ventral striatal neurons on a spatial decision task, in which hippocampal ensembles are known to represent future possibilities at decision points. We found representations of reward which were not only activated at actual reward delivery sites, but also at a high-cost choice point and before error correction. This expectation-of-reward signal at decision points was apparent at both the single cell and the ensemble level, and vanished with behavioral automation. We conclude that ventral striatal representations of reward are more dynamic than suggested by previous reports of reward- and cue-responsive cells, and may provide the necessary signal for evaluation of internally generated possibilities considered during flexible decision-making.

Distinct subsets of nucleus accumbens neurons encode operant responding for ethanol versus water

Subsets of nucleus accumbens (NAc) neurons process information about operant responses for drugs as well as natural rewards (food and water) by excitations and inhibitions in firing rate time-locked to the operant response. The degree to which ensembles of neurons exhibit similar firing patterns when encoding cues and operant responses across different reinforcer conditions will provide critical information regarding the functional organization of this nucleus. The present experiment evaluated the relative contribution of subsets of accumbens neurons that encode distinct features of lever press responding for ethanol vs. water. Electrophysiological recordings (n = 153 neurons) were made in the accumbens of rats trained on concurrent reinforcement schedules for ethanol and water throughout a self-administration session. During operant responding, 52% of neurons exhibited patterned discharges characterized by significant increases or decreases in firing rate of +/- 1 s relative to lever presses for ethanol and/or water. Of these phasic cells, 85% discriminated between presses for ethanol and water (i.e. exhibited firing patterns unique to one reinforcer type), while 15% exhibited identical firing patterns relative to lever presses for both reinforcers. Notably, the data revealed that both high ethanol preference and spatially distinct lever positions contributed to the reinforcer specificity. Together, these data demonstrate that subsets of NAc neurons encode conditioned and instrumental aspects of ethanol vs. water reinforcement in well-trained rats, and that reinforcer preference and spatial cues are important components of this differential information processing.

Anticipatory reward signals in ventral striatal neurons of behaving rats

It has been proposed that the striatum plays a crucial role in learning to select appropriate actions, optimizing rewards according to the principles of 'Actor-Critic' models of trial-and-error learning. The ventral striatum (VS), as Critic, would employ a temporal difference (TD) learning algorithm to predict rewards and drive dopaminergic neurons. This study examined this model's adequacy for VS responses to multiple rewards in rats. The respective arms of a plus-maze provided rewards of varying magnitudes; multiple rewards were provided at 1-s intervals while the rat stood still. Neurons discharged phasically prior to each reward, during both initial approach and immobile waiting, demonstrating that this signal is predictive and not simply motor-related. In different neurons, responses could be greater for early, middle or late droplets in the sequence. Strikingly, this activity often reappeared after the final reward, as if in anticipation of yet another. In contrast, previous TD learning models show decremental reward-prediction profiles during reward consumption due to a temporal-order signal introduced to reproduce accurate timing in dopaminergic reward-prediction error signals. To resolve this inconsistency in a biologically plausible manner, we adapted the TD learning model such that input information is nonhomogeneously distributed among different neurons. By suppressing reward temporal-order signals and varying richness of spatial and visual input information, the model reproduced the experimental data. This validates the feasibility of a TD-learning architecture where different groups of neurons participate in solving the task based on varied input information.

Integrating hippocampus and striatum in decision-making

Learning and memory and navigation literatures emphasize interactions between multiple memory systems: a flexible, planning-based system and a rigid, cached-value system. This has profound implications for decision-making. Recent conceptualizations of flexible decision-making employ prospection and projection arising from a network involving the hippocampus. Recent recordings from rodent hippocampus in decision-making situations have found transient forward-shifted representations. Evaluation of that prediction and subsequent action-selection probably occurs downstream (e.g. in orbitofrontal cortex, in ventral and dorsomedial striatum). Classically, striatum has been identified as a crucial component of the less-flexible, incremental system. Current evidence, however, suggests that striatum is involved in both flexible and stimulus-response decision-making, with dorsolateral striatum involved in stimulus-response strategies and ventral and dorsomedial striatum involved in goal-directed strategies.

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point

Neural ensembles were recorded from the CA3 region of rats running on T-based decision tasks. Examination of neural representations of space at fast time scales revealed a transient but repeatable phenomenon as rats made a decision: the location reconstructed from the neural ensemble swept forward, first down one path and then the other. Estimated representations were coherent and preferentially swept ahead of the animal rather than behind the animal, implying it represented future possibilities rather than recently traveled paths. Similar phenomena occurred at other important decisions (such as in recovery from an error). Local field potentials from these sites contained pronounced theta and gamma frequencies, but no sharp wave frequencies. Forward-shifted spatial representations were influenced by task demands and experience. These data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms.

A computational model of craving and obsession

If addictions and problematic behaviors arise from interactions between drugs, reward sequences, and natural learning sytems, then an explanation of clinically problematic conditions (such as the self-administration of drugs or problem gambling) requires an understanding of the neural systems that have evolved to allow an agent to make decisions. We hypothesize a unified decision-making system consisting of three components-a situation recognition system, a flexible, planning-capable system, and an inflexible, habit-like system. In this article, we present a model of the planning-capable system based on a planning process arising from experimentally observed look-ahead dynamics in the hippocampus enabling a forward search of possibilities and an evaluation process in the nucleus accumbens. Based on evidence that opioid signaling can provide hedonic evalutation of an achieved outcome, we hypothesize that similar opioid-signaling processes evaluate the value of expected outcomes. This leads to a model of craving, based on the recognition of a path to a high-value outcome, and obsession, based on a value-induced limitation of the search process. This theory can explain why opioid antagonists reduce both hedonic responses and craving.

Neural systems implicated in delayed and probabilistic reinforcement

This review considers the theoretical problems facing agents that must learn and choose on the basis of reward or reinforcement that is uncertain or delayed, in implicit or procedural (stimulus-response) representational systems and in explicit or declarative (action-outcome-value) representational systems. Individual differences in sensitivity to delays and uncertainty may contribute to impulsivity and risk taking. Learning and choice with delayed and uncertain reinforcement are related but in some cases dissociable processes. The contributions to delay and uncertainty discounting of neuromodulators including serotonin, dopamine, and noradrenaline, and of specific neural structures including the nucleus accumbens core, nucleus accumbens shell, orbitofrontal cortex, basolateral amygdala, anterior cingulate cortex, medial prefrontal (prelimbic/infralimbic) cortex, insula, subthalamic nucleus, and hippocampus are examined.

Basal ganglia orient eyes to reward

Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.

Sex differences in brain activation elicited by humor

With recent investigation beginning to reveal the cortical and subcortical neuroanatomical correlates of humor appreciation, the present event-related functional MRI (fMRI) study was designed to elucidate sex-specific recruitment of these humor related networks. Twenty healthy subjects (10 females) underwent fMRI scanning while subjectively rating 70 verbal and nonverbal achromatic cartoons as funny or unfunny. Data were analyzed by comparing blood oxygenation-level-dependent signal activation during funny and unfunny stimuli. Males and females share an extensive humor-response strategy as indicated by recruitment of similar brain regions: both activate the temporal-occipital junction and temporal pole, structures implicated in semantic knowledge and juxtaposition, and the inferior frontal gyrus, likely to be involved in language processing. Females, however, activate the left prefrontal cortex more than males, suggesting a greater degree of executive processing and language-based decoding. Females also exhibit greater activation of mesolimbic regions, including the nucleus accumbens, implying greater reward network response and possibly less reward expectation. These results indicate sex-specific differences in neural response to humor with implications for sex-based disparities in the integration of cognition and emotion.

Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats

Background

Animals must frequently make choices between alternative courses of action, seeking to maximize the benefit obtained. They must therefore evaluate the magnitude and the likelihood of the available outcomes. Little is known of the neural basis of this process, or what might predispose individuals to be overly conservative or to take risks excessively (avoiding or preferring uncertainty, respectively). The nucleus accumbens core (AcbC) is known to contribute to rats' ability to choose large, delayed rewards over small, immediate rewards; AcbC lesions cause impulsive choice and an impairment in learning with delayed reinforcement. However, it is not known how the AcbC contributes to choice involving probabilistic reinforcement, such as between a large, uncertain reward and a small, certain reward. We examined the effects of excitotoxic lesions of the AcbC on probabilistic choice in rats.

Results

Rats chose between a single food pellet delivered with certainty (p = 1) and four food pellets delivered with varying degrees of uncertainty (p = 1, 0.5, 0.25, 0.125, and 0.0625) in a discrete-trial task, with the large-reinforcer probability decreasing or increasing across the session. Subjects were trained on this task and then received excitotoxic or sham lesions of the AcbC before being retested. After a transient period during which AcbC-lesioned rats exhibited relative indifference between the two alternatives compared to controls, AcbC-lesioned rats came to exhibit risk-averse choice, choosing the large reinforcer less often than controls when it was uncertain, to the extent that they obtained less food as a result. Rats behaved as if indifferent between a single certain pellet and four pellets at p = 0.32 (sham-operated) or at p = 0.70 (AcbC-lesioned) by the end of testing. When the probabilities did not vary across the session, AcbC-lesioned rats and controls strongly preferred the large reinforcer when it was certain, and strongly preferred the small reinforcer when the large reinforcer was very unlikely (p = 0.0625), with no differences between AcbC-lesioned and sham-operated groups.

Conclusion

These results support the view that the AcbC contributes to action selection by promoting the choice of uncertain, as well as delayed, reinforcement.

Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat

Background

Delays between actions and their outcomes severely hinder reinforcement learning systems, but little is known of the neural mechanism by which animals overcome this problem and bridge such delays. The nucleus accumbens core (AcbC), part of the ventral striatum, is required for normal preference for a large, delayed reward over a small, immediate reward (self-controlled choice) in rats, but the reason for this is unclear. We investigated the role of the AcbC in learning a free-operant instrumental response using delayed reinforcement, performance of a previously-learned response for delayed reinforcement, and assessment of the relative magnitudes of two different rewards.

Results

Groups of rats with excitotoxic or sham lesions of the AcbC acquired an instrumental response with different delays (0, 10, or 20 s) between the lever-press response and reinforcer delivery. A second (inactive) lever was also present, but responding on it was never reinforced. As expected, the delays retarded learning in normal rats. AcbC lesions did not hinder learning in the absence of delays, but AcbC-lesioned rats were impaired in learning when there was a delay, relative to sham-operated controls. All groups eventually acquired the response and discriminated the active lever from the inactive lever to some degree. Rats were subsequently trained to discriminate reinforcers of different magnitudes. AcbC-lesioned rats were more sensitive to differences in reinforcer magnitude than sham-operated controls, suggesting that the deficit in self-controlled choice previously observed in such rats was a consequence of reduced preference for delayed rewards relative to immediate rewards, not of reduced preference for large rewards relative to small rewards. AcbC lesions also impaired the performance of a previously-learned instrumental response in a delay-dependent fashion.

Conclusions

These results demonstrate that the AcbC contributes to instrumental learning and performance by bridging delays between subjects' actions and the ensuing outcomes that reinforce behaviour.

The brain-computer: origin of the idea and progress in its realization

The Brain-Computer is a physical analogue of a real organism which uses both a brain-inspired memory-based architecture and an output-driven learning algorithm. This system can be realized by creating a scaled-down model car that learns how to drive by heuristically connecting image processing with behavior control. This study proves that learning efficiency progresses rapidly when the acquired behaviors are prioritized. We develop a small real-world device that moves about purposefully in an artificial environment. The robot uses imaging information acquired through its random actions to make a mental map. This map, then, provides the cognitive structure for acquiring necessary information for autonomous behavior.

Different representation of forthcoming reward in nucleus accumbens and medial prefrontal cortex

We recorded single units in the rat nucleus accumbens (NAcc) and medial prefrontal cortex (mPFC) to investigate activity related to reward mediation and anticipation during execution of an alternating reward task. NAcc and mPFC neurons showed increased activity differently during an interposed delay preceding reward delivery. Some NAcc neurons increased their activity specifically during the delay period before reward presentation, discriminating forthcoming food or water presentation. A subset of neurons in the mPFC similarly discriminated between food and water reward during the delay; however, about half did not discriminate reward qualities. These results show that the NAcc and the mPFC contribute differently to the organization and execution of goal-directed behavior.

Blockade by the cannabinoid CB1 receptor antagonist, rimonabant (SR141716), of the potentiation by quinelorane of food-primed reinstatement of food-seeking behavior

It has been shown previously that the selective cannabinoid CB1 receptor antagonist, rimonabant (SR141716), reduced the intake of palatable food as well as the self-administration of several drugs of abuse, suggesting that endocannabinoid systems play a role in brain reward function. The present study investigated whether a cannabinoid step was involved in food-seeking behavior induced by explicit stimuli, using an operant reinstatement procedure in rats. Experimental sessions consisted of a 15-min food rewarded period, followed by a 45-min extinction period. Rimonabant did not affect the response reinstatement induced by noncontingent delivery of food pellets, but prevented (0.03-0.3 mg/kg) the potentiation by quinelorane, a dopamine D3 receptor-preferring agonist, of food-seeking behavior. A possible link between cannabinoid processes and D3- and/or D2-mediated dopaminergic transmission was further investigated by studying Fos protein expression in cortico-limbic structures in D3 (D3-/-) and D2 (D2-/-) knockout mice. Rimonabant (10 mg/kg) increased Fos immunoreactivity in the prefrontal cortex (pFCortex) and in the shell but not the core of the nucleus accumbens (NAcc). Fos induction by this dose of rimonabant was not seen in mice lacking CB1 receptors, providing clear evidence for the involvement of CB1 receptors. In the NAcc shell, the effect of rimonabant was suppressed in D3-/-, but remained unchanged in D2-/- mice. In contrast, Fos expression by rimonabant in the pFCortex was impervious to D2 or D3 receptor deletion. In conclusion, these data indicate first that rimonabant prevented the enhancement by quinelorane of the appetitive value of food pellets unexpectedly delivered during extinction and second that rimonabant effects might involve D3 receptor-mediated processes. Overall, these results are consistent with the notion that endocannabinoid functions control brain reward processes and in particular the capacity of explicit stimuli to precipitate food-seeking behavior.

Neurons in hippocampal afferent zones of rat striatum parse routes into multi-pace segments during maze navigation

Hippocampal 'place' neurons discharge when rats occupy specific regions within an environment. This finding is a cornerstone of the theory of the hippocampus as a cognitive map of space. But for navigation, representations of current position must be implemented by signals concerning where to go next, and how to get there. In recordings in hippocampal output structures associated with the motor system (nucleus accumbens and ventromedial caudate nucleus) in rats solving a plus-maze, neurons fired continuously from the moment the rat left one location until it arrived at the next goal site, or at an intermediate place, such as the maze centre. While other studies have shown discharges during reward approach behaviours, this is the first demonstration of activity corresponding to the parsing of complex routes into sequences of movements between landmarks, similar to the lists of instructions we often employ to communicate directions to follow between points on a map. As these cells fired during a series of several paces or re-orientation movements, perhaps this is homologous to 'chunking'. The temporal overlaps in the activity profiles of the individual neurons provide a possible substrate to successively trigger movements required to arrive at the goal. These hippocampally informed, and in some cases, spatially selective responses support the view of the ventral striatum as an interface between limbic and motor systems, permitting contextual representations to have an impact on fundamental action sequences for goal-directed behaviour.

Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues

The nucleus accumbens (NAc) plays an important role in both appetitive and consummatory behavior. To examine how NAc neurons encode information during reward consumption, we recorded the firing activity of rat NAc neurons during the performance of a discriminative stimulus task. In this task, the animal must make an operant response to an intermittently presented cue to obtain a sucrose reward delivered in a reward receptacle. Uncued entries to the receptacle were not rewarded. Both excitations and inhibitions during reward consumption were observed, but substantially more neurons were inhibited than excited. These excitations and inhibitions began when the animal entered the reward receptacle and ended when the animal exited the receptacle. Both excitations and inhibitions were much smaller or nonexistent when the animal made uncued entries into the reward receptacle. In one set of experiments, we randomly withheld the reward in some cued trials that would otherwise have been rewarded. Excitations and inhibitions were of similar magnitude whether or not the reward was delivered. This indicates that the sensory stimulus of reward does not drive these phasic responses; instead, the reward-associated responses may be driven by the conditioned stimuli associated with reward, or they may encode information about consummatory motor activity. Another population of NAc neurons was excited on exit from the reward receptacle. Many of these excitations persisted for tens of seconds after the receptacle exit and showed a significant inverse correlation with the rate of uncued operant responding. These findings are consistent with a contribution of NAc neurons to both reward consummatory and reward seeking behavior.

Effects of a dopamine D3 receptor ligand, BP 897, on acquisition and expression of food-, morphine-, and cocaine-induced conditioned place preference, and food-seeking behavior in rats

The present study addressed the role of dopaminergic D(3) receptors (D(3)R) in motivational processes in rats. The effects of the selective D(3)R partial agonist, BP 897 (0.25-1 mg/kg, i.p.), on the establishment and the expression of conditioned place preference (CPP) supported by food, morphine (4 mg/kg, s.c.), or cocaine (2 mg/kg, s.c.) were investigated using an unbiased, one-compartment, place-conditioning procedure. When administered alone, BP 897 (0.05-2 mg/kg, i.p.) did not support CPP; on the contrary, conditioned place avoidance (CPA) was observed at 1 mg/kg, suggesting that this dose of BP 897 could be perceived as aversive. When given before each cocaine injection during the conditioning phase, BP 897 (1 mg/kg) prevented the establishment of CPP, and a single administration of BP 897 (0.5 and 1 mg/kg) before the test session impaired the expression of cocaine CPP. In contrast, neither the establishment nor the expression of food- and morphine-CPP were significantly altered by BP 897 (up to 1 mg/kg), whereas the full but less selective D(3)/D(2)R agonists, 7-OH-DPAT (0.5-2 mug/kg, s.c.) and quinelorane (1 mug/kg, s.c.), prevented the acquisition of food CPP. In a within-session extinction schedule of lever pressing for food, BP 897 (0.06-2 mg/kg) was ineffective in potentiating response reinstatement induced by the noncontingent delivery of two food pellets, in contrast with quinelorane and 7-OH-DPAT where previous studies showed to be efficient in this respect (Duarte et al, 2003). These results indicate that BP 897 has no positive appetitive value on its own, and that a moderate degree of stimulation of D(3)R is not sufficient to modulate food-primed food-seeking behavior or alter incentive motivation for food, morphine, and/or their associated cues. However, D(3)R are likely involved in the perception of the rewarding value of cocaine and cocaine-paired cues. This suggests that the appetitive effects of cocaine are subserved by mechanisms different, at least in part, from those of morphine and food, and that D(3)R play a role only in the former.

The nucleus accumbens unit activities related to the emotional significance of complex environmental stimuli in freely moving cats

To establish the functional role of the nucleus accumbens (ACC) in emotionally motivated behaviors, extracellular single or multiple units were recorded from the ACC under an unanesthetized, freely moving non-operant condition in 43 cats. Then neuronal and behavioral responses to stimuli such as tones, live small animals, a human, air puffs and so on were analyzed using a videotape monitoring method. A total of 98 units were recorded from the ACC, and 34 (34.7%) of them responded to some of the stimuli. Of the 34 responded units, 5 (15%) units responded to quiet approach-provoking stimuli (appetitive stimuli), and 29 (85%) units responded to escape- or defensive attack-provoking stimuli (aversive stimuli). Although most of the units responded in an individual item-specific manner, there was no unit reacted to both the appetitive and aversive stimuli. The neuronal responses were not related to any movement or locomotion. The results were compared with those with the amygdala, and their neuronal responsiveness were shown to be quite different from each other. Although the ACC appears to be involved in the central processing of emotional behavior in some way, the role was suggested to be entirely different from that of the amygdala.

Neural encoding in ventral striatum during olfactory discrimination learning

A growing body of evidence implicates the ventral striatum in using information acquired through associative learning. The present study examined the activity of ventral striatal neurons in awake, behaving rats during go/no-go odor discrimination learning and reversal. Many neurons fired selectively to odor cues predictive of either appetitive (sucrose) or aversive (quinine) outcomes. Few neurons were selective when first exposed to the odors, but many acquired this differential activity as rats learned the significance of the cues. A substantial proportion of these neurons encoded the cues' learned motivational significance, and these neurons tended to reverse their firing selectivity after reversal of odor-outcome contingencies. Other neurons that became selectively activated during learning did not reverse, but instead appeared to encode specific combinations of cues and associated motor responses. The results support a role for ventral striatum in using the learned significance, both appetitive and aversive, of predictive cues to guide behavior.

Reward value invariant place responses and reward site associated activity in hippocampal neurons of behaving rats

To investigate the involvement of the hippocampal-accumbens system in goal-oriented displacement behaviors, hippocampal neuronal activity was recorded in rats learning and recalling new distributions of different volumes of liquid reward among the arms of a plus maze. Each arm had a reward box containing a water trough and identical visual cues that could be illuminated independently. As the water-restricted rat successively visited the respective boxes, it received 7, 5, and 3 drops of water, and then 1 drop, provided at 1-s intervals. (Reward distributions were reassigned daily and mid-session.) In the training phase, reward boxes were lit individually. In the recall phase, the lamps on all arms were lit and then turned off as the rat visited the boxes in order of descending value. Neuronal firing rates were analyzed for changes related to reward value or to shifts between learning and recall phases. The principal finding is that place responses remained unchanged after these manipulations and that these neurons showed no evidence of explicit coding of reward value. In addition, two other types of responses appeared while the rat was stationary at the reward boxes awaiting multiple rewards. These were observed primarily in neurons within the dentate gyrus, but also in CA1. Position-selective reward site responses were regular at 20-60 impulses per second, while position-independent discharges bursted irregularly at about 5 impulses per second. Such responses could explain controversial reports of reward dependence in hippocampal neurons. The higher incidence of the latter responses in the temporal ("ventral") hippocampus is consistent with the distinctive anatomical and functional properties of this subregion.

Behavioural learning-induced increase in spontaneous GABAA-dependent synaptic activity in rat striatal cholinergic interneurons

Cholinergic striatal interneurons play a crucial role in cognitive aspects of context-dependent motor behaviours. They are considered to correspond to the tonically active neurons (TANs) of the primate striatum, which phasically decrease their discharge at the presentation of reward-related sensory stimuli. The origin of this response is still poorly understood. Therefore, in the present paper, we have investigated whether synaptic changes establish in cholinergic interneurons from young rats that have learned a rewarded, externally cued sensorimotor task. Corticostriatal slices were prepared from both control and trained rats. No significant change in intrinsic membrane properties and evoked synaptic activity was observed in cholinergic interneurons, nor the responsiveness to exogenously applied dopaminergic and glutamatergic agonists was modified. Conversely, an increased occurrence of spontaneous bicuculline-sensitive depolarizing postsynaptic potentials (sDPSP) was recorded. The frequency of the GABAA-mediated sDPSP was increased in comparison to not-conditioned rats. Overall, these results suggest that after learning a rewarded sensorimotor paradigm an increased GABA influence develops on cholinergic interneurons. The origin of this effect might be searched in collaterals of GABAergic output spiny neurons as well as in GABAergic striatal interneurons impinging onto cholinergic interneurons. This intrastriatal mechanism might be involved in the phasic suppression of discharge of TANs at the presentation of reward-related sensory stimuli.

Feeding-induced decrease in extracellular glutamate level in the rat nucleus accumbens: dependence on glutamate uptake

In vivo microdialysis combined with high-performance liquid chromatography and electrochemical detection was used to monitor extracellular glutamate levels in the medial nucleus accumbens of Sprague-Dawley rats during their feeding behaviour. Consumption of a palatable new diet or a diet to which rats were previously exposed caused a decrease in extracellular level of glutamate in the nucleus accumbens during and after feeding. The presentation of an inedible object (a piece of rubber) instead of the expected food caused a marked increase in extracellular glutamate levels. In contrast, if the piece of rubber was presented to rats that did not expect food delivery, the extracellular level of glutamate remained unchanged during the rubber presentation. The feeding-induced decrease in the extracellular glutamate level did not depend on food deprivation and was completely prevented by intraaccumbal infusions through the dialysis probe of 10 mM D,L-threo-beta-hydroxyaspartate (a glutamate uptake inhibitor). Intraaccumbal infusions of 10 microM S-(-)-raclopride L-tartrate (a D2/D3 dopamine receptor antagonist) or 1 microM tetrodotoxin (a voltage-dependent Na(+) channel blocker) also completely reversed the decrease in extracellular glutamate level in response to food intake. The D1/D5 dopamine receptor antagonist SCH-23390 (10 microM) administered into the nucleus accumbens had no significant effect on the feeding-induced decrease in extracellular glutamate level. From the data obtained we suggest that the decrease in the extracellular level of glutamate in the medial nucleus accumbens in response to feeding appears to arise from a temporal increase in glutamate uptake that is probably operated by dopamine inputs to the nucleus accumbens via D2/D3 receptors. Our findings also suggest that the dissociation between the expected biological value of a presented object and the reality might be an important determinant for regulation of glutamate release in this brain area during feeding behaviour.

Position sensitivity in phasically discharging nucleus accumbens neurons of rats alternating between tasks requiring complementary types of spatial cues

To determine how hippocampal location-selective discharges might influence downstream structures for navigation, nucleus accumbens neurons were recorded in rats alternating between two tasks guided respectively by lit cues in the maze or by extramaze room cues. Of 144 phasically active neurons, 80 showed significant behavioral correlates including displacements, immobility prior to, or after reward delivery, as well as turning, similar to previous reports. Nine neurons were position-selective, 22 were sensitive to task and platform changes and 40 others were both. Although the accumbens neurons showed the same behavioral correlate in two or four functionally equivalent locations, these responses were stronger at some of these places, evidence for position sensitivity. To test whether position responses were selective for room versus platform cues, the experimental platform was rotated while the rat performed each of the two tasks. This revealed responses to changes in position relative to both platform and room cues, despite the fact that previous studies had shown that place responses of hippocampal neurons recorded in the same task are anchored to room cues only. After these manipulations and shifts between the two tasks, the responses varied among simultaneously recorded neurons, and even in single neurons in alternating visits to reward sites. Again this contrasts with the uniformity of place responses of hippocampal neurons recorded in this same task. Thus accumbens position responses may derive from hippocampal inputs, while responses to context changes are more likely to derive from other signals or intrinsic processing. Considering the accumbens as a limbic-motor interface, we conclude that position-modulated behavioral responses in the accumbens may be intermediate between the allocentric reference frame of position-selective discharges in the hippocampus and the egocentric coding required to organize movement control. The conflicting responses among simultaneously recorded neurons could reflect competition processes serving as substrates for action selection and learning.

Cocaine dependence: a disease of the brain's reward centers

Cocaine addiction affects brain reward centers that have evolved to ensure survival. Cocaine euphoria is intensely pleasurable and results from mesolimbic dopamine (DA) neurotransmission. DA signal-receiving neurons in the nucleus accumbens synthesize endogenous opioids and project to numerous reward regions. Cocaine-induced neuroadaptations, including DA depletion, may underlie craving and hedonic dysregulation. Cue-induced craving is vigorously triggered by conditioned elements of the drug environment and associated with measurable limbic activation. Reduced frontal lobe metabolism in cocaine-addicted individuals could explain important clinical phenomena such as denial and the loss of control over limbic impulses. Cocaine addiction is rapidly progressive and associated with severe medical, psychiatric, and psychosocial consequences. Denial shields addicted individuals from their predicament and must be addressed in treatment. Lacking pharmacological options, clinicians must rely entirely on psychosocial approaches. Treatment principles, including engagement, motivational enhancement, abstinence strategies, and craving reduction are discussed in terms of biological rationales.

Reward-related neuronal activities in basal ganglia of domestic chicks

We aimed to reveal what is coded in the basal ganglia of domestic chicks. In the water-reinforced 'go' task, chicks learned to peck selectively at a colored bead in order to obtain a drop of water. Out of 38 units obtained, seven showed excitatory activities specifically during the reward period. In the food-reinforced go/no-go task, chicks learned to discriminate two colors to obtain mash food after a delay period. They also learned to ignore another color, which was not associated with a reward. Out of 27 units obtained, four showed excitatory activities during the cue period, specifically when a food reward was anticipated. LPO neurons may code qualities of the obtained rewards, and also chick's anticipation of the forthcoming rewards.

Position and behavioral modulation of synchronization of hippocampal and accumbens neuronal discharges in freely moving rats

To understand how hippocampal signals are processed by downstream neurons, we analyzed the relative timing between neuronal discharges in simultaneous recordings in the hippocampus and nucleus accumbens of rats performing in a plus maze. In all, 154 pairs of cells (composed of 65 hippocampal and 56 accumbens neurons) were examined during the 1 s period prior to reward delivery. Cross-correlation analyses over a +/- 300-ms window with 10-ms bins revealed that 108 pairs had at least one significant histogram bin (P < 0.01). The most frequently occurring peaks of hippocampal firing prior to accumbens discharges appeared at latencies from -30-0 ms, corresponding to published values of the latency of the hippocampal pathway to the nucleus accumbens. Other peaks appeared most often at latencies multiples of about 110 ms prior to and after this, corresponding to theta rhythmicity. Since firing synchronization can result from several types of connectivity patterns (such as common inputs), a group of 18 hippocampus-accumbens pairs was selected as those most likely to have monosynaptic connections. The criterion was the presence of at least one highly significant peak (P < 0.001) at latencies corresponding to field potentials evoked in the accumbens by hippocampal stimulation. A significant peak occurred on all four maze arms for only one of these cell pairs, indicating positional modulation for the others. In addition, behavior dependence of the synchrony between these nucleus accumbens and hippocampus neurons was examined by studying data in relation to three different synchronization points: reward box arrival, box departure, and arrival at the center of the maze. This indicates that the functional connectivity between hippocampal and accumbens neurons was stronger when the rat was near reward areas. Ten of the hippocampal neurons in these 18 cell pairs showed 9-Hz (theta) rhythmic activity in autocorrelation analyses. Of these 10 cells, cross-correlograms from eight hippocampal-accumbens pairs also showed theta rhythmicity. Overall, these results indicate that the synchrony between hippocampus and nucleus accumbens neurons is modulated by spatial position and behavior, and theta rhythm may play an important role for this synchronization.

Role of tonically-active neurons in the control of striatal function: cellular mechanisms and behavioral correlates

1. The striatum is primarily involved in motor planning and motor learning. Human diseases involving its complex circuitry lead to movement disorders such as Parkinson's disease (PD) and Huntington's disease (HD). Moreover the striatum has been involved in processes linked to reward, cognition and drug addiction. 2. The high content of acetylcholine (ACh) found in the striatum is due to the presence of cholinergic interneurons. The intrinsic electrical and synaptic properties of these interneurons have been recently characterized. However, their functional significance is far from being fully elucidated. 3. In vivo electrophysiological experiments from behaving monkeys have identified these cholinergic interneurons as "Tonically Active Neurons" (TANs). They are activated by presentation of sensory stimuli of behavioral significance or linked to reward. 4. Experimental evidence showed that integrity of the nigrostriatal dopaminergic system is essential for TANs to express learned activity. 5. PD is known to be due to the loss of the nigrostriatal dopaminergic pathway and the ensuing imbalance between the content of dopamine and acetylcholine in the striatum. This evidence supports the hypothesis that cholinergic interneurons, or TANs, play a key role in the modulation of striatal function.