Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation

Wireless, Battery-Free Implants for Electrochemical Catecholamine Sensing and Optogenetic Stimulation

Neurotransmitters and neuromodulators mediate communication between neurons and other cell types; knowledge of release dynamics is critical to understanding their physiological role in normal and pathological brain function. Investigation into transient neurotransmitter dynamics has largely been hindered due to electrical and material requirements for electrochemical stimulation and recording. Current systems require complex electronics for biasing and amplification and rely on materials that offer limited sensor selectivity and sensitivity. These restrictions result in bulky, tethered, or battery-powered systems impacting behavior and that require constant care of subjects. To overcome these challenges, we demonstrate a fully implantable, wireless, and battery-free platform that enables optogenetic stimulation and electrochemical recording of catecholamine dynamics in real time. The device is nearly 1/10th the size of previously reported examples and includes a probe that relies on a multilayer electrode architecture featuring a microscale light emitting diode (μ-LED) and a carbon nanotube (CNT)-based sensor with sensitivities among the highest recorded in the literature (1264.1 nA μM-1 cm-2). High sensitivity of the probe combined with a center tapped antenna design enables the realization of miniaturized, low power circuits suitable for subdermal implantation even in small animal models such as mice. A series of in vitro and in vivo experiments highlight the sensitivity and selectivity of the platform and demonstrate its capabilities in freely moving, untethered subjects. Specifically, a demonstration of changes in dopamine concentration after optogenetic stimulation of the nucleus accumbens and real-time readout of dopamine levels after opioid and naloxone exposure in freely behaving subjects highlight the experimental paradigms enabled by the platform.

Enhanced perceptual task performance without deprivation in mice using medial forebrain bundle stimulation

Perceptual decision-making tasks are essential to many fields of neuroscience. Current protocols generally reward deprived animals with water. However, balancing animals' deprivation level with their well-being is challenging, and trial number is limited by satiation. Here, we present electrical stimulation of the medial forebrain bundle (MFB) as an alternative that avoids deprivation while yielding stable motivation for thousands of trials. Using licking or lever press as a report, MFB animals learnt auditory discrimination tasks at similar speed to water-deprived mice. Moreover, they more reliably reached higher accuracy in harder tasks, performing up to 4,500 trials per session without loss of motivation. MFB stimulation did not impact the underlying sensory behavior since psychometric parameters and response times are preserved. MFB mice lacked signs of metabolic or behavioral stress compared with water-deprived mice. Overall, MFB stimulation is a highly promising tool for task learning because it enhances task performance while avoiding deprivation.

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors

Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.^1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,^1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.

Accumbal Dopamine Release Tracks the Expectation of Dopamine Neuron-Mediated Reinforcement

Dopamine (DA) transmission in the nucleus accumbens (NAc) facilitates cue-reward associations and appetitive action. Reward-related accumbal DA release dynamics are traditionally ascribed to ventral tegmental area (VTA) DA neurons. Activation of VTA to NAc DA signaling is thought to reinforce action and transfer reward-related information to predictive cues, allowing cues to guide behavior and elicit dopaminergic activity. Here, we use optogenetics to control DA neuron activity and voltammetry to simultaneously record accumbal DA release in order to quantify how reinforcer-evoked dopaminergic activity shapes conditioned mesolimbic DA transmission. We find that cues predicting access to DA neuron self-stimulation elicit conditioned responding and NAc DA release. However, cue-evoked DA release does not reflect the cost or magnitude of DA neuron activation. Accordingly, conditioned accumbal DA release selectively tracks the expected availability of DA-neuron-mediated reinforcement. This work provides insight into how mesolimbic DA transmission drives and encodes appetitive action.

Deep brain stimulation of the medial forebrain bundle elevates striatal dopamine concentration without affecting spontaneous or reward-induced phasic release

Deep brain stimulation (DBS) of the medial forebrain bundle (MFB) induces rapid improvement of depressive symptoms in patients suffering from treatment-refractory major depressive disorder (MDD). It has been hypothesized that activation of the dopamine (DA) system contributes to this effect. To investigate whether DBS in the MFB affects DA release in the striatum, we combined DBS with fast-scan cyclic voltammetry (FSCV) in freely moving rats. Animals were implanted with a stimulating electrode at the border of the MFB and the ventral tegmental area, and a FSCV microelectrode in the ventromedial striatum to monitor extracellular DA during the acute onset of DBS and subsequent continued stimulation. DBS onset induced a significant increase in extracellular DA concentration in the ventromedial striatum that was sustained for at least 40s. However, continued DBS did not affect amplitude or frequency of so-called spontaneous phasic DA transients, nor phasic DA release in response to the delivery of unexpected food pellets. These findings suggest that effects of DBS in the MFB are mediated by an acute change in extracellular DA concentration, but more research is needed to further explore the potentially sustained duration of this effect. Together, our results provide both support and refinement of the hypothesis that MFB DBS activates the DA system: DBS induces an increase in overall ambient concentration of DA, but spontaneous or reward-associated more rapid, phasic DA dynamics are not enhanced. This knowledge improves our understanding of how DBS affects brain function and may help improve future therapies for depressive symptoms.

Dopamine Dynamics during Continuous Intracranial Self-Stimulation: Effect of Waveform on Fast-Scan Cyclic Voltammetry Data

The neurotransmitter dopamine is heavily implicated in intracranial self-stimulation (ICSS). Many drugs of abuse that affect ICSS behavior target the dopaminergic system, and optogenetic activation of dopamine neurons is sufficient to support self-stimulation. However, the patterns of phasic dopamine release during ICSS remain unclear. Early ICSS studies using fast-scan cyclic voltammetry (FSCV) rarely observed phasic dopamine release, which led to the surprising conclusion that it is dissociated from ICSS. However, several advances in the sensitivity (i.e., the use of waveforms with extended anodic limits) and analysis (i.e., principal component regression) of FSCV measurements have made it possible to detect smaller, yet physiologically relevant, dopamine release events. Therefore, this study revisits phasic dopamine release during ICSS using these tools. It was found that the anodic limit of the voltammetric waveform has a substantial effect on the patterns of dopamine release observed during continuous ICSS. While data collected with low anodic limits (i.e., +1.0 V) support the disappearance of phasic dopamine release observed in previous investigation, the use of high anodic limits (+1.3 V, +1.4 V) allows for continual detection of dopamine release throughout ICSS. However, the +1.4 V waveform lacks the ability to resolve narrowly spaced events, with the best balance of temporal resolution and sensitivity provided by the +1.3 V waveform. Ultimately, it is revealed that the amplitude of phasic dopamine release decays but does not fully disappear during continuous ICSS.

Reward magnitude tracking by neural populations in ventral striatum

Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals' responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes.

The Effects of Electrical and Optical Stimulation of Midbrain Dopaminergic Neurons on Rat 50-kHz Ultrasonic Vocalizations

Rationale: Adult rats emit ultrasonic vocalizations (USVs) at around 50-kHz; these commonly occur in contexts that putatively engender positive affect. While several reports indicate that dopaminergic (DAergic) transmission plays a role in the emission of 50-kHz calls, the pharmacological evidence is mixed. Different modes of dopamine (DA) release (i.e., tonic and phasic) could potentially explain this discrepancy.

Objective: To investigate the potential role of phasic DA release in 50-kHz call emission.

Methods: In Experiment 1, USVs were recorded in adult male rats following unexpected electrical stimulation of the medial forebrain bundle (MFB). In parallel, phasic DA release in the nucleus accumbens (NAcc) was recorded using fast-scan cyclic voltammetry. In Experiment 2, USVs were recorded following response-contingent or non-contingent optogenetic stimulation of midbrain DAergic neurons. Four 20-s schedules of optogenetic stimulation were used: fixed-interval, fixed-time, variable-interval, and variable-time.

Results: Brief electrical stimulation of the MFB increased both 50-kHz call rate and phasic DA release in the NAcc. During optogenetic stimulation sessions, rats initially called at a high rate comparable to that observed following reinforcers such as psychostimulants. Although optogenetic stimulation maintained reinforced responding throughout the 2-h session, the call rate declined to near zero within the first 30 min. The trill call subtype predominated following both electrical and optical stimulation.

Conclusion: The occurrence of electrically-evoked 50-kHz calls, time-locked to phasic DA (Experiment 1), provides correlational evidence supporting a role for phasic DA in USV production. However, in Experiment 2, the temporal dissociation between calling and optogenetic stimulation of midbrain DAergic neurons suggests that phasic mesolimbic DA release is not sufficient to produce 50-kHz calls. The emission of the trill subtype of 50-kHz calls potentially provides a marker distinguishing positive affect from positive reinforcement.

The neural substrates for the rewarding and dopamine-releasing effects of medial forebrain bundle stimulation have partially discrepant frequency responses

Midbrain dopamine neurons have long been implicated in the rewarding effect produced by electrical brain stimulation of the medial forebrain bundle (MFB). These neurons are excited trans-synaptically, but their precise role in intracranial self-stimulation (ICSS) has yet to be determined. This study assessed the hypothesis that midbrain dopamine neurons are in series with the directly stimulated substrate for self-stimulation of the MFB and either perform spatio-temporal integration of synaptic input from directly activated MFB fibers or relay the results of such integration to efferent stages of the reward circuitry. Psychometric current-frequency trade-off functions were derived from ICSS performance, and chemometric trade-off functions were derived from stimulation-induced dopamine transients in the nucleus accumbens (NAc) shell, measured by means of fast-scan cyclic voltammetry. Whereas the psychometric functions decline monotonically over a broad range of pulse frequencies and level off only at high frequencies, the chemometric functions obtained with the same rats and electrodes are either U-shaped or level off at lower pulse frequencies. This discrepancy was observed when the dopamine transients were recorded in either anesthetized or awake subjects. The lack of correspondence between the psychometric and chemometric functions is inconsistent with the hypothesis that dopamine neurons projecting to the NAc shell constitute an entire series stage of the neural circuit subserving self-stimulation of the MFB.

Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks

Successful decision making often requires weighing a given option's costs against its associated benefits, an ability that appears perturbed in virtually every severe mental illness. Animal models of such cost/benefit decision making overwhelmingly implicate mesolimbic dopamine in our willingness to exert effort for a larger reward. Until recently, however, animal models have invariably manipulated the degree of physical effort, whereas human studies of effort have primarily relied on cognitive costs. Dopamine's relationship to cognitive effort has not been directly examined, nor has the relationship between individuals' willingness to expend mental versus physical effort. It is therefore unclear whether willingness to work hard in one domain corresponds to willingness in the other. Here we utilize a rat cognitive effort task (rCET), wherein animals can choose to allocate greater visuospatial attention for a greater reward, and a previously established physical effort-discounting task (EDT) to examine dopaminergic and noradrenergic contributions to effort. The dopamine antagonists eticlopride and SCH23390 each decreased willingness to exert physical effort on the EDT; these drugs had no effect on willingness to exert mental effort for the rCET. Preference for the high effort option correlated across the two tasks, although this effect was transient. These results suggest that dopamine is only minimally involved in cost/benefit decision making with cognitive effort costs. The constructs of mental and physical effort may therefore comprise overlapping, but distinct, circuitry, and therapeutic interventions that prove efficacious in one effort domain may not be beneficial in another.

Individual differences in response to positive and negative stimuli: endocannabinoid-based insight on approach and avoidance behaviors

Approach and avoidance behaviors-the primary responses to the environmental stimuli of danger, novelty and reward-are associated with the brain structures that mediate cognitive functionality, reward sensitivity and emotional expression. Individual differences in approach and avoidance behaviors are modulated by the functioning of amygdaloid-hypothalamic-striatal and striatal-cerebellar networks implicated in action and reaction to salient stimuli. The nodes of these networks are strongly interconnected and by acting on them the endocannabinoid and dopaminergic systems increase the intensity of appetitive or defensive motivation. This review analyzes the approach and avoidance behaviors in humans and rodents, addresses neurobiological and neurochemical aspects of these behaviors, and proposes a possible synaptic plasticity mechanism, related to endocannabinoid-dependent long-term potentiation (LTP) and depression that allows responding to salient positive and negative stimuli.

Striatal mechanisms underlying movement, reinforcement, and punishment

Direct and indirect pathway striatal neurons are known to exert opposing control over motor output. In this review, we discuss a hypothetical extension of this framework, in which direct pathway striatal neurons also mediate reinforcement and reward, and indirect pathway neurons mediate punishment and aversion.

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success.

A neuroscientific perspective on music therapy

During the last years, a number of studies demonstrated that music listening (and even more so music production) activates a multitude of brain structures involved in cognitive, sensorimotor, and emotional processing. For example, music engages sensory processes, attention, memory-related processes, perception-action mediation ("mirror neuron system" activity), multisensory integration, activity changes in core areas of emotional processing, processing of musical syntax and musical meaning, and social cognition. It is likely that the engagement of these processes by music can have beneficial effects on the psychological and physiological health of individuals, although the mechanisms underlying such effects are currently not well understood. This article gives a brief overview of factors contributing to the effects of music-therapeutic work. Then, neuroscientific studies using music to investigate emotion, perception-action mediation ("mirror function"), and social cognition are reviewed, including illustrations of the relevance of these domains for music therapy.

Evolution of Deep Brain Stimulation: Human Electrometer and Smart Devices Supporting the Next Generation of Therapy

Deep Brain Stimulation (DBS) provides therapeutic benefit for several neuropathologies including Parkinson's disease (PD), epilepsy, chronic pain, and depression. Despite well established clinical efficacy, the mechanism(s) of DBS remains poorly understood. In this review we begin by summarizing the current understanding of the DBS mechanism. Using this knowledge as a framework, we then explore a specific hypothesis regarding DBS of the subthalamic nucleus (STN) for the treatment of PD. This hypothesis states that therapeutic benefit is provided, at least in part, by activation of surviving nigrostriatal dopaminergic neurons, subsequent striatal dopamine release, and resumption of striatal target cell control by dopamine. While highly controversial, we present preliminary data that are consistent with specific predications testing this hypothesis. We additionally propose that developing new technologies, e.g., human electrometer and closed-loop smart devices, for monitoring dopaminergic neurotransmission during STN DBS will further advance this treatment approach.

Dynamic changes in dopamine tone during self-stimulation of the ventral tegmental area in rats

In a prior study, phasic release of dopamine (DA) in the nucleus accumbens (NAc) was only transiently and rarely detected by means of fast-scan cyclic voltammetry (FCSV) in rats already trained to work for electrical stimulation of the ventral tegmental area (VTA) on a continuous reinforcement schedule. However, in rats receiving rewarding electrical stimulation via lateral hypothalamic (LH) electrodes, elevated DA tone in the NAc terminal field was detected via microdialysis for up to 2h, even when short (1.5s) inter-train intervals were employed. To better characterize the similarities and differences between the FSCV and microdialysis measurements, we trained rats to self-administer VTA stimulation under conditions similar to those employed in the initial FSCV study. The results resemble those obtained by means of microdialysis in rats receiving LH stimulation but differed from the prior FSCV data. Although the concentration of DA in dialysate obtained from NAc probes did fall after having peaked at the 30 min mark, this decline set in much later than in the FSCV studies, and elevated DA tone could still be detected after 110 min of self-stimulation. The stimulation-induced peak in DA tone could be restored by a 30 min rest period, a manipulation that was ineffective previously in restoring the FSCV measure of phasic release. These findings are discussed in terms of the differential sensitivity of the FSCV and microdialysis methods to phasic and tonic signaling by DA neurons and to different transitions between their activity states.

Understanding Parkinsonian Handwriting Through a Computational Model of Basal Ganglia

Handwriting in Parkinson's disease (PD) is typically characterized by micrographia, jagged line contour, and unusual fluctuations in pen tip velocity. Although PD handwriting features have been used for diagnostics, they are not based on a signaling model of basal ganglia (BG). In this letter, we present a computational model of handwriting generation that highlights the role of BG. When PD conditions like reduced dopamine and altered dynamics of the subthalamic nucleus and globus pallidus externa subsystems are simulated, the handwriting produced by the model manifested characteristic PD handwriting distortions like micrographia and velocity fluctuations. Our approach to PD modeling is in tune with the perspective that PD is a dynamic disease.

Dopamine tone increases similarly during predictable and unpredictable administration of rewarding brain stimulation at short inter-train intervals

Unpredicted rewards, but not predicted ones, trigger strong phasic changes in the firing rates of midbrain dopamine (DA). In contrast, neurochemical measurements of DA tone have failed to reveal an influence of reward predictability. However, the subjects of the neurochemical experiments were asked to predict reward onset over longer intervals (12s, on average) than the subjects of the electrophysiological studies (typically, 2s). Thus, the contrasting effects of reward predictability could reflect the difference in the duration of the interval separating the predictor from the reward rather than a difference in the influence of reward predictability on phasic and tonic DA signaling. This hypothesis was tested in rats receiving trains of rewarding electrical brain stimulation with either a predictable or unpredictable onset. The mean inter-train interval was 1.5s, a value close to the 2-s CS-US interval that has been used in electrophysiological studies demonstrating the dependence of phasic DA responses on reward predictability. Despite the shortened inter-train interval, the time courses of the observed stimulation-induced elevations in DA levels were very similar, regardless of whether train onset was predictable. This finding is consistent with the idea that tonic DA signaling is insensitive to the predictability of rewards.

Prominent burst firing of dopaminergic neurons in the ventral tegmental area during paradoxical sleep

Dopamine is involved in motivation, memory, and reward processing. However, it is not clear whether the activity of dopamine neurons is related or not to vigilance states. Using unit recordings in unanesthetized head restrained rats we measured the firing pattern of dopamine neurons of the ventral tegmental area across the sleep-wake cycle. We found these cells were activated during paradoxical sleep (PS) via a clear switch to a prominent bursting pattern, which is known to induce large synaptic dopamine release. This activation during PS was similar to the activity measured during the consumption of palatable food. Thus, as it does during waking in response to novelty and reward, dopamine could modulate brain plasticity and thus participate in memory consolidation during PS. By challenging the traditional view that dopamine is the only aminergic group not involved in sleep physiology, this study provides an alternative perspective that may be crucial for understanding the physiological function of PS and dream mentation.

Extracting the basal extracellular dopamine concentrations from the evoked responses: re-analysis of the dopamine kinetics

Fast-scan cyclic voltammetry in conjunction with carbon fiber microelectrode has been used to study dopamine (DA) release and uptake mechanisms in rat brains because of the smaller size of the electrode and the subsecond resolution. Current voltammetry data were analyzed by a DA kinetic model assuming a zero baseline, which is in conflict with existing microdialysis findings and a recent claim of the striatal extracellular DA concentration at micromolar levels. This work applied a new analysis approach based on a modified DA kinetic model to analyze the kinetics of electrically evoked DA overflow in the caudate-putamen of anesthetized rats. The DA uptake parameters were fitted from the electrical stimulation phase, and subsequently used to calculate theoretical DA uptake rates. Comparison of the theoretical uptake rates with experimental clearance rates allows for the study of the tonic DA release process following electrical stimulations. Analyses of DA voltammetry data suggest that the locally averaged basal level of extracellular DA in the rat striatum might be confined between 95 and 220 nM. The disparate time scales in the clearance kinetics of endogenous and exogenous DA were investigated. Long-distance diffusion could only partially explain the slow clearance time course of exogenous DA. Model simulations and parameter analyses on evoked DA responses indicate that suppression of the nonevoked DA release process immediately following electrical stimulation cannot completely account for the rapid clearance of the electrically evoked DA. Inconsistency in the measured uptake strengths in the literature studying endogenous and exogenous DA remains to be investigated in the future.

Prolonged rewarding stimulation of the rat medial forebrain bundle: neurochemical and behavioral consequences

Extracellular dopamine levels were measured in the rat nucleus accumbens by means of in vivo microdialysis. Delivery of rewarding medial forebrain bundle stimulation at a low rate (5 trains/min) produced a sustained elevation of dopamine levels, regardless of whether train onset was predictable. When the rate of train delivery was increased to 40 trains/min, dopamine levels rose rapidly during the first 40 min but then declined toward the baseline range. The rewarding impact of the stimulation was reduced following prior delivery of stimulation at the high, but not the low, rate. These results support the idea that dopamine tone plays an enabling role in brain stimulation reward and is elevated similarly by predictable and unpredictable stimulation.

Cannabinoid modulation of electrically evoked pH and oxygen transients in the nucleus accumbens of awake rats

Cannabinoid receptors have been implicated in the regulation of blood flow in the cerebral vasculature. Because the nucleus accumbens (NAc) shows high levels of central cannabinoid receptor 1 (CB1) expression we examined the effects of cannabinoids on the local transient alkaline shifts and increases in extracellular oxygen induced by electrical stimulation of the medial forebrain bundle (MFB) in conscious animals. These changes result from increases in cerebral blood flow (CBF) and metabolism in the NAc that are evoked by the stimulation. Oxygen and pH changes were monitored using fast-scan cyclic voltammetry at carbon-fiber microelectrodes in the NAc of freely moving rats. Administration of the cannabinoid receptor agonist WIN55,212-2 potently inhibited extracellular oxygen and pH changes, an effect that was reversed and prevented by pre-treatment with the CB1 receptor antagonists SR141716A and AM251. The effects on pH following WIN55,212-2 were similar to those following nimodipine, a recognized vasodilator. When AM251 was injected alone, the amplitude of electrically evoked pH shifts was unaffected. Administration of AM404 and VDM11, endocannabinoid transport inhibitors, partially inhibited pH transients in a CB1 receptor-dependent manner. The present findings suggest that CB1 receptor activation modulates changes in two well-established indices of local blood flow and metabolism resulting from electrically evoked activation of ascending fibers. Although endogenous cannabinoid tone alone is not sufficient to modify these responses, uptake blockade demonstrates that the system has the potential to exert CB1-specific effects similar to those of full agonists.

Dopamine, prediction error and associative learning: a model-based account

The notion of prediction error has established itself at the heart of formal models of animal learning and current hypotheses of dopamine function. Several interpretations of prediction error have been offered, including the model-free reinforcement learning method known as temporal difference learning (TD), and the important Rescorla-Wagner (RW) learning rule. Here, we present a model-based adaptation of these ideas that provides a good account of empirical data pertaining to dopamine neuron firing patterns and associative learning paradigms such as latent inhibition, Kamin blocking and overshadowing. Our departure from model-free reinforcement learning also offers: 1) a parsimonious distinction between tonic and phasic dopamine functions; 2) a potential generalization of the role of phasic dopamine from valence-dependent "reward" processing to valence-independent "salience" processing; 3) an explanation for the selectivity of certain dopamine manipulations on motivation for distal rewards; and 4) a plausible link between formal notions of prediction error and accounts of disturbances of thought in schizophrenia (in which dopamine dysfunction is strongly implicated). The model distinguishes itself from existing accounts by offering novel predictions pertaining to the firing of dopamine neurons in various untested behavioral scenarios.

Simultaneous dopamine and single-unit recordings reveal accumbens GABAergic responses: implications for intracranial self-stimulation

Intracranial self-stimulation (ICS) is a motivated behavior that results from contingent activation of the brain reward system. ICS with stimulating electrodes placed in the medial forebrain bundle (MFB) is particularly robust. However, the neurons that course through this pathway use a variety of neurotransmitters including dopamine and GABA. For this reason, the neurotransmitters that are central to this behavior, and the specific roles that they subserve, remain unclear. Here, we used extracellular electrophysiology and cyclic voltammetry at the same electrode in awake rats to simultaneously examine cell firing and dopamine release in the nucleus accumbens (NAc) during ICS and noncontingent stimulation of the MFB. ICS elicited dopamine release in the NAc and produced coincident time-locked changes (predominantly inhibitions) in the activity of a subset of NAc neurons. Similar responses were elicited with noncontingent stimulations. The changes in firing rate induced by noncontingent stimulations were reversed by the GABA(A) receptor antagonist bicuculline. Most time-locked unit activity was unaffected by D1 or D2-like dopamine-receptor antagonists, or by inhibition of evoked dopamine release, although, for a minority of units, the D1 dopamine-receptor antagonist SCH23390 attenuated neural activity. Thus, neurons in the NAc are preferentially inhibited by GABA(A) receptors after MFB stimulation, a mechanism that may also be important in ICS.

In vivo neurochemical monitoring and the study of behaviour

In vivo neurochemical monitoring techniques measure changes in the extracellular compartment of selected brain regions. These changes reflect the release of chemical messengers and intermediates of brain energy metabolism resulting from the activity of neuronal assemblies. The two principal techniques used in neurochemical monitoring are microdialysis and voltammetry. The presence of glutamate in the extracellular compartment and its pharmacological characteristics suggest that it is released from astrocytes and acts as neuromodulator rather than a neurotransmitter. The changes in extracellular noradrenaline and dopamine reflect their role in the control of behaviour. Changes in glucose and oxygen, the latter a measure of local cerebral blood flow, reflect synaptic processing in the underlying neuronal networks rather than a measure of efferent output from the brain region. In vivo neurochemical monitoring provides information about the intermediate processing that intervenes between the application of the stimulus and the resulting behaviour but does not reflect the final efferent output that leads to behaviour.

The hippocampal-VTA loop: controlling the entry of information into long-term memory

In this article we develop the concept that the hippocampus and the midbrain dopaminergic neurons of the ventral tegmental area (VTA) form a functional loop. Activation of the loop begins when the hippocampus detects newly arrived information that is not already stored in its long-term memory. The resulting novelty signal is conveyed through the subiculum, accumbens, and ventral pallidum to the VTA where it contributes (along with salience and goal information) to the novelty-dependent firing of these cells. In the upward arm of the loop, dopamine (DA) is released within the hippocampus; this produces an enhancement of LTP and learning. These findings support a model whereby the hippocampal-VTA loop regulates the entry of information into long-term memory.

Locomotion induced by non-contingent intracranial electrical stimulation: Dopamine dependence and general characteristics

Intracranial self-stimulation (ICSS) is induced by delivery of electrical stimulation contingent upon a response such as bar pressing. This procedure has been widely used to investigate the brain reward system. Recent investigations, however, have noted that non-contingent electrical stimulation, also called experimenter applied stimulation (EAS), produces a unique set of locomotion behaviors that appear to be related to ICSS, and that these behaviors resemble locomotion similar to those elicited by dopamine enhancing drugs. However, little is known about the general characteristics of EAS-induced locomotion. While ICSS appears to be robust, long lasting, and highly rewarding in that the rat will invest vast amounts of time or energy to obtain the electrical stimulation, these parameters have not been explored for EAS. Moreover, the dopamine dependence of EAS-evoked locomotion is also not firmly established. Thus, the present study investigated dopamine dependence and general characteristics of the EAS-induced locomotion to determine its similarity to ICSS. Results suggested that motor and limbic systems were strongly activated by non-contingent EAS, and that the resulting locomotion was dopamine dependent, robust, continued across long time horizons, and was greater than that evoked by contingent electrical stimulation.

Ultrastructure at carbon fiber microelectrode implantation sites after acute voltammetric measurements in the striatum of anesthetized rats

This work seeks to establish the feasibility of characterizing the ultrastructure of brain tissue disruption associated with the implantation of carbon fiber voltammetric microelectrodes. In vivo recording was performed by fast scan cyclic voltammetry in conjunction with carbon fiber microelectrodes (3.5 microm radius) in the striatum of rats anesthetized with chloral hydrate. After 4 h of in vivo recording, the microelectrodes were removed from the brain and the animals underwent intracardial perfusion. Brain tissue was collected and sectioned in the horizontal plane perpendicular to the axis of the microelectrodes. With microelectrodes of a conventional single barreled design, the tissue tracks were often too small to be followed by light microscopy to the point of deepest penetration, which would correspond to the implantation site of the carbon fiber itself. The enlarged tissue tracks formed by the implantation of double barreled electrodes, however, could be followed to their termination by light microscopy. Anatomical mapping was used to identify the fields laying 100 microm deeper than the deepest trace of such tracks. Electron microscopy of these fields revealed a spot of tissue damage presumed to be associated with the implantation site of the carbon fiber microelectrode. The spot of maximal tissue damage had a radius of 2.5 microm and was surrounded by an annular region with a width of 4 microm that contained a mix of healthy and damaged elements. Beyond this annular region, i.e. beyond 6.5 microm from the center of the spot of maximal damage, signs of microelectrode-associated damage were rare and consisted primarily of neurons with darkened cytoplasm.

Locomotion induced by non-contingent intracranial stimulation: comparison to psychomotor stimulant

Non-contingent experimenter-applied stimulation (nEAS) to the ventral mesencephalon, unlike contingent intracranial self-stimulation (ICSS), elicits high rates of general locomotion. This locomotion may be due to the nature of the presentation of stimulation, in that nEAS is non-contingent, while ICSS depends on a specific and focused response (e.g., bar pressing). Psychomotor stimulants also elicit high amounts of general locomotion, with the locomotion attributed to increased dopamine release. Interestingly, dopamine release decreases or is absent with repeated ICSS, but not nEAS. This suggests that the locomotion elicited by nEAS may be the result of DA release similar to that observed with psychomotor stimulants. To determine the relationship between locomotion induced by nEAS and psychomotor stimulants, locomotion elicited by nEAS was directly compared to that produced by cocaine, a psychomotor stimulant and indirect DA agonist. Six groups of rats were examined: (1) DA+ group: rats were implanted with a stimulating electrode in the ventral mesencephalon and activation of DA neurons was verified during surgery by monitoring DA release in the striatum; (2) DA- group: rats were also implanted with stimulating electrodes, but the location in the ventral mesencephalon did not elicit DA release; (3) 10-mg/kg cocaine group: rats were exposed to a low dose (10 mg/kg) of cocaine; (4) 40-mg/kg cocaine group: rats were exposed to a high dose (40 mg/kg) of cocaine; (5) saline group: rats were injected with saline; and (6) naive group: rats received no treatment. The topography of behavior was assessed in all rats during four periods: a pre-treatment baseline, treatment, early post-treatment, and a late post-treatment end point. The results suggest that locomotion elicited by nEAS was stereotypic, dependent upon DA release and similar, but not identical, to psychomotor stimulant-induced locomotion.

Dynamic gain control of dopamine delivery in freely moving animals

Activity changes in a large subset of midbrain dopamine neurons fulfill numerous assumptions of learning theory by encoding a prediction error between actual and predicted reward. This computational interpretation of dopaminergic spike activity invites the important question of how changes in spike rate are translated into changes in dopamine delivery at target neural structures. Using electrochemical detection of rapid dopamine release in the striatum of freely moving rats, we established that a single dynamic model can capture all the measured fluctuations in dopamine delivery. This model revealed three independent short-term adaptive processes acting to control dopamine release. These short-term components generalized well across animals and stimulation patterns and were preserved under anesthesia. The model has implications for the dynamic filtering interposed between changes in spike production and forebrain dopamine release.

Neural mechanisms of reward-related motor learning

The analysis of the neural mechanisms responsible for reward-related learning has benefited from recent studies of the effects of dopamine on synaptic plasticity. Dopamine-dependent synaptic plasticity may lead to strengthening of selected inputs on the basis of an activity-dependent conjunction of sensory afferent activity, motor output activity, and temporally related firing of dopamine cells. Such plasticity may provide a link between the reward-related firing of dopamine cells and the acquisition of changes in striatal cell activity during learning. This learning mechanism may play a special role in the translation of reward signals into context-dependent response probability or directional bias in movement responses.

Detecting subsecond dopamine release with fast-scan cyclic voltammetry in vivo

BACKGROUND

Dopamine is a potent neuromodulator in the brain, influencing a variety of motivated behaviors and involved in several neurologic diseases. Measurements of extracellular dopamine in the brains of experimental animals have traditionally focused on a tonic timescale (minutes to hours). However, dopamine concentrations are now known to fluctuate on a phasic timescale (subseconds to seconds).

APPROACH

Fast-scan cyclic voltammetry provides analytical chemical measurements of phasic dopamine signals in the rat brain.

CONTENT

Procedural aspects of the technique are discussed, with regard to appropriate use and in comparison with other methods. Finally, examples of data collected using fast-scan cyclic voltammetry are summarized, including naturally occurring dopamine transients and signals arising from electrical stimulation of dopamine neurons.

SUMMARY

Fast-scan cyclic voltammetry offers real-time measurements of changes in extracellular dopamine concentrations in vivo. With its subsecond time resolution, micrometer-dimension spatial resolution, and chemical selectivity, it is the most suitable technique currently available to measure transient concentration changes of dopamine.

A role for presynaptic mechanisms in the actions of nomifensine and haloperidol

Psychomotor stimulants and neuroleptics exert multiple effects on dopaminergic signaling and produce the dopamine (DA)-related behaviors of motor activation and catalepsy, respectively. However, a clear relationship between dopaminergic activity and behavior has been very difficult to demonstrate in the awake animal, thus challenging existing notions about the mechanism of these drugs. The present study examined whether the drug-induced behaviors are linked to a presynaptic site of action, the DA transporter (DAT) for psychomotor stimulants and the DA autoreceptor for neuroleptics. Doses of nomifensine (7 mg/kg i.p.), a DA uptake inhibitor, and haloperidol (0.5 mg/kg i.p.), a dopaminergic antagonist, were selected to examine characteristic behavioral patterns for each drug: stimulant-induced motor activation in the case of nomifensine and neuroleptic-induced catalepsy in the case of haloperidol. Presynaptic mechanisms were quantified in situ from extracellular DA dynamics evoked by electrical stimulation and recorded by voltammetry in the freely moving animal. In the first experiment, the maximal concentration of electrically evoked DA ([DA](max)) measured in the caudate-putamen was found to reflect the local, instantaneous change in presynaptic DAT or DA autoreceptor activity according to the ascribed action of the drug injected. A positive temporal association was found between [DA](max) and motor activation following nomifensine (r=0.99) and a negative correlation was found between [DA](max) and catalepsy following haloperidol (r=-0.96) in the second experiment. Taken together, the results suggest that a dopaminergic presynaptic site is a target of systemically applied psychomotor stimulants and regulates the postsynaptic action of neuroleptics during behavior. This finding was made possible by a voltammetric microprobe with millisecond temporal resolution and its use in the awake animal to assess release and uptake, two key mechanisms of dopaminergic neurotransmission. Moreover, the results indicate that presynaptic mechanisms may play a more important role in DA-behavior relationships than is currently thought.

A computational substrate for incentive salience

Theories of dopamine function are at a crossroads. Computational models derived from single-unit recordings capture changes in dopaminergic neuron firing rate as a prediction error signal. These models employ the prediction error signal in two roles: learning to predict future rewarding events and biasing action choice. Conversely, pharmacological inhibition or lesion of dopaminergic neuron function diminishes the ability of an animal to motivate behaviors directed at acquiring rewards. These lesion experiments have raised the possibility that dopamine release encodes a measure of the incentive value of a contemplated behavioral act. The most complete psychological idea that captures this notion frames the dopamine signal as carrying 'incentive salience'. On the surface, these two competing accounts of dopamine function seem incommensurate. To the contrary, we demonstrate that both of these functions can be captured in a single computational model of the involvement of dopamine in reward prediction for the purpose of reward seeking.

Correlation of local changes in extracellular oxygen and pH that accompany dopaminergic terminal activity in the rat caudate-putamen

Terminal activity causes an increase in local cerebral blood flow that can be quantified by measuring the accompanying increase in tissue oxygen. Alkaline pH changes can also follow neuronal activation. The purpose of these studies was to determine whether these changes in extracellular oxygen and pH correlate. Fast-scan cyclic voltammetry was used to detect changes in dopamine, pH and oxygen levels simultaneously in the caudate-putamen after electrical stimulation of the substantia nigra in anesthetized rats. The biphasic increases in oxygen and pH followed similar time courses, and were delayed a few seconds from the immediate release and uptake of dopamine. The changes following administration of neurotransmitter receptor antagonists as well as agents that modulate blood flow were identical for oxygen and pH. Two distinct mechanisms were identified that give rise to the oxygen and pH changes: blood vessel dilatation caused by nitric oxide synthesis after muscarinic receptor activation and adenosine receptor activation. We conclude that changes in blood flow accompanying terminal activity cause alkaline pH shifts by the rapid removal of carbon dioxide, a component of the extracellular brain buffering system.

Increase in accumbal dopaminergic transmission correlates with response cost not reward of hypothalamic stimulation

Rats were trained to lever-press for intracranial self-stimulation (ICSS) of the lateral hypothalamus on either a fixed ratio (FR) 1 or 10 schedule. Their brains were removed after a 20 min session and tissue punches taken from the nucleus accumbens, olfactory tubercle, anterior striatum, or central striatum. These punches were assayed for content of dopamine (DA) and the major DA metabolite DOPAC. Compared with implanted controls, only the FR10 group showed significantly elevated DOPAC/DA ratios. These elevations were statistically significant in nucleus accumbens and central striatum and near significance in anterior striatum. They occurred to similar degrees in each hemisphere. In contrast, we found that stimulation of the ventral tegmental area of anesthetized rats asymmetrically increased the DOPAC/DA ratio, being most prominent in the ipsilateral accumbens. Because the FR10 group made only 58% of the responses of the FR1 group and received only 6% of the stimulations of the FR1 group, yet unlike the FR1 group showed a significant increase in the DOPAC/DA ratio, we suggest that the DA release was primarily influenced by the schedule, not the stimulation or the reward of the stimulation. These results were interpreted in terms of a model in which hypothalamic ICSS reward is largely dependent on non-dopaminergic mechanisms, with accumbal DA transmission being strongly dependent on the costs versus benefits of ongoing behavior.

Modeling fast dopamine neurotransmission in the nucleus accumbens during behavior

Recent advances in electrophysiology and voltammetry permit monitoring of dopamine (DA) neuronal activity in real time in the brain of awake animals. Studies using these approaches demonstrate that behaviorally relevant events elicit characteristic patterns of electrical activity in midbrain DA neurons as well as large, transient changes in extracellular DA in the nucleus accumbens (NAc). In addition to providing insight into the role of the DA system in the processing of motor, motivational, and sensory information, the new findings also shed light on fast DA neurotransmission in a behavioral context. This report, (1). summarizes the information obtained by electrophysiological and real-time voltammetric approaches and (2). describes a general model of phasic DA signaling in the NAc that links the observed changes in DA electrical activity and extracellular dynamics. The analysis demonstrates that the behaviorally evoked DA transients are governed by similar mechanisms as those produced by short trains of electrical stimulation. Thus, action potential-dependent release and presynaptic uptake are primary determinants of functional DA levels in the brain during behavior. Interestingly, the model predicts that the same burst of electrical activity generated at DA cell bodies produces markedly different DA dynamics in forebrain projection fields. The distinct changes result from heterogeneous release and uptake rates and may underlie region-specific effects of DA. Auto- and heteroreceptors, as well as other sites of presynaptic control, could further modulate the DA transients.

Long-term reward prediction in TD models of the dopamine system

This article addresses the relationship between long-term reward predictions and slow-timescale neural activity in temporal difference (TD) models of the dopamine system. Such models attempt to explain how the activity of dopamine (DA) neurons relates to errors in the prediction of future rewards. Previous models have been mostly restricted to short-term predictions of rewards expected during a single, somewhat artificially defined trial. Also, the models focused exclusively on the phasic pause-and-burst activity of primate DA neurons; the neurons' slower, tonic background activity was assumed to be constant. This has led to difficulty in explaining the results of neurochemical experiments that measure indications of DA release on a slow timescale, results that seem at first glance inconsistent with a reward prediction model. In this article, we investigate a TD model of DA activity modified so as to enable it to make longer-term predictions about rewards expected far in the future. We show that these predictions manifest themselves as slow changes in the baseline error signal, which we associate with tonic DA activity. Using this model, we make new predictions about the behavior of the DA system in a number of experimental situations. Some of these predictions suggest new computational explanations for previously puzzling data, such as indications from microdialysis studies of elevated DA activity triggered by aversive events.

Neural economics and the biological substrates of valuation

A recent flurry of neuroimaging and decision-making experiments in humans, when combined with single-unit data from orbitofrontal cortex, suggests major additions to current models of reward processing. We review these data and models and use them to develop a specific computational relationship between the value of a predictor and the future rewards or punishments that it promises. The resulting computational model, the predictor-valuation model (PVM), is shown to anticipate a class of single-unit neural responses in orbitofrontal and striatal neurons. The model also suggests how neural responses in the orbitofrontal-striatal circuit may support the conversion of disparate types of future rewards into a kind of internal currency, that is, a common scale used to compare the valuation of future behavioral acts or stimuli.

Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue

Compulsive drug use is characterized by a pattern of drug seeking and consumption that becomes progressively habitual and less and less modifiable by external and internal factors. Although traditional views would posit that nigrostriatal dopamine (DA) neurons originating in the substantia nigra and innervating the dorsal striatum are primarily concerned with motor functions, recent studies have implicated the dorsal striatum in mediating stimulus-response (habit) learning. In this study, in vivo microdialysis in combination with a second-order schedule of cocaine reinforcement was used to investigate the role of the dorsal striatal dopamine innervation in well established drug-seeking behavior under the control of a drug-associated cue [light conditioned stimulus (CS+)]. Rats were initially trained to self-administer cocaine under a continuous reinforcement schedule where a response on one of two identical levers led to a 20 sec presentation of a light CS+ and an intravenous cocaine infusion (0.75 mg/kg). The response requirement for the CS+ and cocaine was then progressively increased until stable responding was established under a second-order schedule of reinforcement. During microdialysis, rats were presented with the cocaine-associated CS+ either noncontingently or contingent on responding during a session of cocaine-seeking behavior. The results showed a marked increase in DA release in the dorsal striatum during drug-seeking, when cocaine cues were presented contingently, but not when the same cue was presented noncontingently. These data indicate a possible involvement of the dopaminergic innervation of the dorsal striatum in well established, or habitual, cocaine-seeking behavior.

Transient changes in mesolimbic dopamine and their association with 'reward'

Mesolimbic dopaminergic neurons modulate complex circuitry in the ventral forebrain involved in reward processing, although the precise function of the dopaminergic input is debated. Electrophysiological measurements have revealed that mesolimbic dopaminergic neurons can fire in either tonic or phasic modes, and that phasic firing accompanies the alerting or anticipatory phases of reward. However, the neurochemical relevance of this rapid neuronal discharge within the reward processing circuitry is not yet clear, in part because of difficulty in interpretation of extracellular dopamine measurements. Herein, the nature of the information provided by different neurochemical techniques is critically discussed. Classical methods of monitoring dopamine reveal changes in extracellular dopamine resulting from tonic neuronal activity, but do not have the temporal resolution to distinguish concentration transients. However, recent advances in dopamine sensors now enable transient dopamine concentrations resulting from phasic firing to be positively identified and followed on a physiologically relevant timescale. This has enabled demonstrations of discrete, phasic dopamine signals accompanying rewarding or alerting stimuli. Thus, enhanced dopamine release at terminals appears to be coincident with phasic electrical activity at cell bodies. These accumulating data promise to help unravel the precise role of phasic dopamine transmission in reward processing.

Contrasting effects of dopamine antagonists and frequency reduction on Fos expression induced by lateral hypothalamic stimulation

To help further identify the reward-relevant regions activated by electrical stimulation of the lateral hypothalamus, Fos expression was quantified in 23 brain regions in naïve, awake rats following non-contingent stimulation with a frequency that supports self-stimulation (100 Hz), a frequency that supports only minimal responding (50 Hz) and a frequency that does not support self-stimulation (25 Hz). Fos expression was also examined in stimulated and unstimulated rats pretreated with SCH 23390 (a dopamine D1 antagonist) or spiperone (a D2-like antagonist), at doses known to greatly inhibit responding for self-stimulation. Lowering the stimulation frequency from 100 to 50 Hz reduced Fos labelling in all areas, except for a few cells immediately surrounding the electrode tip. No differences were observed between unstimulated rats and those receiving 25 Hz stimulation. This suggests that a critical threshold of stimulation is required before other reward-relevant regions in the midbrain and forebrain are recruited with higher frequency stimulation. Pretreatment with SCH 23390 (0.1 mg/kg) inhibited stimulation-induced Fos expression in some key dopamine terminal areas, such as the nucleus accumbens (core and shell) and medial caudate-putamen, but not in directly driven neurons near the stimulation site. In contrast, spiperone (0.1 mg/kg) did not affect the pattern of stimulation-induced Fos expression, but induced immunolabelling in the dorsolateral caudate-putamen, an area associated with the extrapyramidal side-effects of antipsychotic drugs. These results reveal the utility of Fos immunohistochemistry to show how different treatments that alter the rewarding impact of electrical brain stimulation achieve their effects at the neural level.

Sub-second changes in accumbal dopamine during sexual behavior in male rats

Transient (200--900 ms), high concentrations (200--500 nM) of dopamine, measured using fast-scan cyclic voltammetry, occurred in the nucleus accumbens core of male rats at the presentation of a receptive female. Additional dopamine signals were observed during subsequent approach behavior. Background-subtracted cyclic voltammograms of the naturally-evoked signals matched those of electrically-evoked dopamine measured at the same recording sites. Administration of nomifensine amplified natural and evoked dopamine release, and increased the frequency of detectable signals. While gradual changes in dopamine concentration during sexual behavior have been well established, these findings dramatically improve the time resolution. The observed dopamine transients, probably resulting from neuronal burst firing, represent the first direct correlation of dopamine with sexual behavior on a sub-second time scale.

Immunohistochemical characterisation of Fos-positive cells in brainstem monoaminergic nuclei following intracranial self-stimulation of the medial forebrain bundle in the rat

Fos immunostaining was used as a marker of neuronal activity following intracranial self-stimulation (ICSS) of the medial forebrain bundle (MFB) in the rat, and was combined with immunostaining for tyrosine hydroxylase (TH), serotonin (5-HT), gamma-aminobutyric acid (GABA), or NR1 (one of the glutamate N-methyl- D-aspartate receptor subunits) for purposes of neurochemical identification. ICSS induced a significant but different degree of increase in the number of Fos-immunopositive (Fos+) cells in the six brainstem monoaminergic nuclei examined, which included the ventral tegmental area (VTA), substantia nigra pars compacta (SNc), dorsal raphe nucleus (DR), median raphe nucleus (MR), locus coeruleus (LC), and A7 noradrenaline cells. Densely labelled Fos+ cells were observed in the LC following ICSS, and many of these Fos+ cells were colocalized with TH. Similarly, many of Fos+ cells in the A7 and DR/MR were colocalized with TH and 5-HT, respectively. By contrast, a smaller number of Fos+ cells was detected in the VTA and SNc following the ICSS, and in these regions the majority of Fos+ cells were not colocalized with TH. Although results among regions quantitatively differed, the ICSS induced a significant increase in the number of double-labelled cells (GABA+/Fos+ or NR1+/Fos+) in all of the VTA, DR, and LC, in which the ICSS produced an ipsilaterally weighted increase in Fos-like immunoreactivity. These results suggest that ICSS of the MFB induces differential Fos expression within monoaminergic and GABAergic neurons in brainstem monoaminergic nuclei under modulation by glutamatergic afferents.