Excitability properties of medial forebrain bundle axons of A9 and A10 dopamine cells

The priming effect of rewarding brain stimulation in rats depends on both the cost and strength of reward but survives blockade of D2-like dopamine receptors

Receipt of an intense reward boosts motivation to work for more of that reward. This phenomenon is called the priming effect of rewards. Using a novel measurement method, we show that the priming effect of rewarding electrical brain stimulation depends on the cost, as well as on the strength, of the anticipated reward. Previous research on the priming effect of electrical brain stimulation utilized a runway paradigm in which running speed serves as the measure of motivation. In the present study, the measure of motivation was the vigour with which rats executed a two-lever response chain, in a standard operant-conditioning chamber, to earn rewarding electrical stimulation of the lateral hypothalamus. In a second experiment, we introduced a modification that entails self-administered priming stimulation and alternating blocks of primed and unprimed trials. Reliable, consistent priming effects of substantial magnitude were obtained in the modified paradigm, which is closely analogous to the runway paradigm. In a third experiment, the modified paradigm served to assess the dependence of the priming effect on dopamine D2-like receptors. The priming effect proved resilient to the effect of eticlopride, a selective D2-like receptor antagonist. These results are discussed within the framework of a new model of brain reward circuitry in which non-dopaminergic medial forebrain bundle fibers and dopamine axons provide parallel inputs to the final common paths for reward and incentive motivation.

The Convergence Model of Brain Reward Circuitry: Implications for Relief of Treatment-Resistant Depression by Deep-Brain Stimulation of the Medial Forebrain Bundle

Deep-brain stimulation of the medial forebrain bundle (MFB) can provide effective, enduring relief of treatment-resistant depression. Panksepp provided an explanatory framework: the MFB constitutes the core of the neural circuitry subserving the anticipation and pursuit of rewards: the “SEEKING” system. On that view, the SEEKING system is hypoactive in depressed individuals; background electrical stimulation of the MFB alleviates symptoms by normalizing activity. Panksepp attributed intracranial self-stimulation to excitation of the SEEKING system in which the ascending projections of midbrain dopamine neurons are an essential component. In parallel with Panksepp’s qualitative work, intracranial self-stimulation has long been studied quantitatively by psychophysical means. That work argues that the predominant directly stimulated substrate for MFB self-stimulation are myelinated, non-dopaminergic fibers, more readily excited by brief electrical current pulses than the thin, unmyelinated axons of the midbrain dopamine neurons. The series-circuit hypothesis reconciles this view with the evidence implicating dopamine in MFB self-stimulation as follows: direct activation of myelinated MFB fibers is rewarding due to their trans-synaptic activation of midbrain dopamine neurons. A recent study in which rats worked for optogenetic stimulation of midbrain dopamine neurons challenges the series-circuit hypothesis and provides a new model of intracranial self-stimulation in which the myelinated non-dopaminergic neurons and the midbrain dopamine projections access the behavioral final common path for reward seeking via separate, converging routes. We explore the potential implications of this convergence model for the interpretation of the antidepressant effect of MFB stimulation. We also discuss the consistent finding that psychomotor stimulants, which boost dopaminergic neurotransmission, fail to provide a monotherapy for depression. We propose that non-dopaminergic MFB components may contribute to the therapeutic effect in parallel to, in synergy with, or even instead of, a dopaminergic component.

Accumbal Dopamine Release Tracks the Expectation of Dopamine Neuron-Mediated Reinforcement

Dopamine (DA) transmission in the nucleus accumbens (NAc) facilitates cue-reward associations and appetitive action. Reward-related accumbal DA release dynamics are traditionally ascribed to ventral tegmental area (VTA) DA neurons. Activation of VTA to NAc DA signaling is thought to reinforce action and transfer reward-related information to predictive cues, allowing cues to guide behavior and elicit dopaminergic activity. Here, we use optogenetics to control DA neuron activity and voltammetry to simultaneously record accumbal DA release in order to quantify how reinforcer-evoked dopaminergic activity shapes conditioned mesolimbic DA transmission. We find that cues predicting access to DA neuron self-stimulation elicit conditioned responding and NAc DA release. However, cue-evoked DA release does not reflect the cost or magnitude of DA neuron activation. Accordingly, conditioned accumbal DA release selectively tracks the expected availability of DA-neuron-mediated reinforcement. This work provides insight into how mesolimbic DA transmission drives and encodes appetitive action.

Drive and Reinforcement Circuitry in the Brain: Origins, Neurotransmitters, and Projection Fields

Brain stimulation has identified two central subsets of stimulation sites with motivational relevance. First, there is a large and disperse set of sites where stimulation is reinforcing, increasing the frequency of the responses it follows, and second, a much more restricted set of sites where-along with reinforcement-stimulation also has drive-like effects, instigating feeding, copulation, predation, and other motivated acts in otherwise sated or peaceful animals. From this work a dispersed but synaptically interconnected network of reinforcement circuitry is emerging: it includes afferents to the ventral tegmental area and substantia nigra; the dopamine systems themselves; glutamatergic afferents to the striatum; and one of two dopamine-receptor-expressing efferent pathways of the striatum. Stimulation of a limited subset of these sites, including descending inhibitory medial forebrain bundle fibers, induces both feeding and reinforcement, and suggests the possibility of a subset of fibers where stimulation has both drive-like and reinforcing effects. This review stresses the common findings of sites and connectivity between electrical and optogenetic studies of core drive and reinforcement sites. By doing so, it suggests the biological importance of optogenetic follow-up of less-publicized electrical stimulation findings. Such studies promise not only information about origins, neurotransmitters, and connectivity of related networks, by covering more sensory and at least one putative motor component they also promote a much deeper understanding of the breadth of motivational function.

Deep brain stimulation of the medial forebrain bundle elevates striatal dopamine concentration without affecting spontaneous or reward-induced phasic release

Deep brain stimulation (DBS) of the medial forebrain bundle (MFB) induces rapid improvement of depressive symptoms in patients suffering from treatment-refractory major depressive disorder (MDD). It has been hypothesized that activation of the dopamine (DA) system contributes to this effect. To investigate whether DBS in the MFB affects DA release in the striatum, we combined DBS with fast-scan cyclic voltammetry (FSCV) in freely moving rats. Animals were implanted with a stimulating electrode at the border of the MFB and the ventral tegmental area, and a FSCV microelectrode in the ventromedial striatum to monitor extracellular DA during the acute onset of DBS and subsequent continued stimulation. DBS onset induced a significant increase in extracellular DA concentration in the ventromedial striatum that was sustained for at least 40s. However, continued DBS did not affect amplitude or frequency of so-called spontaneous phasic DA transients, nor phasic DA release in response to the delivery of unexpected food pellets. These findings suggest that effects of DBS in the MFB are mediated by an acute change in extracellular DA concentration, but more research is needed to further explore the potentially sustained duration of this effect. Together, our results provide both support and refinement of the hypothesis that MFB DBS activates the DA system: DBS induces an increase in overall ambient concentration of DA, but spontaneous or reward-associated more rapid, phasic DA dynamics are not enhanced. This knowledge improves our understanding of how DBS affects brain function and may help improve future therapies for depressive symptoms.

Mechanism for optimization of signal-to-noise ratio of dopamine release based on short-term bidirectional plasticity

Repeated electrical stimulation of dopamine (dopamine) fibers can cause variable effects on further dopamine release; sometimes there are short-term decreases while in other cases short-term increases have been reported. Previous studies have failed to discover what factors determine in which way dopamine neurons will respond to repeated stimulation. The aim of the present study was therefore to investigate what determines the direction and magnitude of this particular form of short-term plasticity. Fixed potential amperometry was used to measure dopamine release in the nucleus accumbens in response to two trains of electrical pulses administered to the ventral tegmental area of anesthetized mice. When the pulse trains were of equal magnitude we found that low magnitude stimulation was associated with short-term suppression and high magnitude stimulation with short-term facilitation of dopamine release. Secondly, we found that the magnitude of the second pulse train was critical for determining the sign of the plasticity (suppression or facilitation), while the magnitude of the first pulse train determined the extent to which the response to the second train was suppressed or facilitated. This form of bidirectional plasticity might provide a mechanism to enhance signal-to-noise ratio of dopamine neurotransmission.

Dopamine Dynamics during Continuous Intracranial Self-Stimulation: Effect of Waveform on Fast-Scan Cyclic Voltammetry Data

The neurotransmitter dopamine is heavily implicated in intracranial self-stimulation (ICSS). Many drugs of abuse that affect ICSS behavior target the dopaminergic system, and optogenetic activation of dopamine neurons is sufficient to support self-stimulation. However, the patterns of phasic dopamine release during ICSS remain unclear. Early ICSS studies using fast-scan cyclic voltammetry (FSCV) rarely observed phasic dopamine release, which led to the surprising conclusion that it is dissociated from ICSS. However, several advances in the sensitivity (i.e., the use of waveforms with extended anodic limits) and analysis (i.e., principal component regression) of FSCV measurements have made it possible to detect smaller, yet physiologically relevant, dopamine release events. Therefore, this study revisits phasic dopamine release during ICSS using these tools. It was found that the anodic limit of the voltammetric waveform has a substantial effect on the patterns of dopamine release observed during continuous ICSS. While data collected with low anodic limits (i.e., +1.0 V) support the disappearance of phasic dopamine release observed in previous investigation, the use of high anodic limits (+1.3 V, +1.4 V) allows for continual detection of dopamine release throughout ICSS. However, the +1.4 V waveform lacks the ability to resolve narrowly spaced events, with the best balance of temporal resolution and sensitivity provided by the +1.3 V waveform. Ultimately, it is revealed that the amplitude of phasic dopamine release decays but does not fully disappear during continuous ICSS.

Optogenetic Activation of a Lateral Hypothalamic-Ventral Tegmental Drive-Reward Pathway

Electrical stimulation of the lateral hypothalamus can motivate feeding or can serve as a reward in its own right. It remains unclear whether the same or independent but anatomically overlapping circuitries mediate the two effects. Electrical stimulation findings implicate medial forebrain bundle (MFB) fibers of passage in both effects, and optogenetic studies confirm a contribution from fibers originating in the lateral hypothalamic area and projecting to or through the ventral tegmental area. Here we report that optogenetic activation of ventral tegmental fibers from cells of origin in more anterior or posterior portions of the MFB failed to induce either reward or feeding. The feeding and reward induced by optogenetic activation of fibers from the lateral hypothalamic cells of origin were influenced similarly by variations in stimulation pulse width and pulse frequency, consistent with the hypothesis of a common substrate for the two effects. There were, however, several cases where feeding but not self-stimulation or self-stimulation but not feeding were induced, consistent with the hypothesis that distinct but anatomically overlapping systems mediate the two effects. Thus while optogenetic stimulation provides a more selective tool for characterizing the mechanisms of stimulation-induced feeding and reward, it does not yet resolve the question of common or independent substrates.

Glutamate dysfunction associated with developmental cerebellar damage: relevance to autism spectrum disorders

Neural abnormalities commonly associated with autism spectrum disorders include prefrontal cortex (PFC) dysfunction and cerebellar pathology in the form of Purkinje cell loss and cerebellar hypoplasia. It has been reported that loss of cerebellar Purkinje cells results in aberrant dopamine neurotransmission in the PFC which occurs via dysregulation of multisynaptic efferents from the cerebellum to the PFC. Using a mouse model, we investigated the possibility that developmental cerebellar Purkinje cell loss could disrupt glutamatergic cerebellar projections to the PFC that ultimately modulate DA release. We measured glutamate release evoked by local electrical stimulation using fixed-potential amperometry in combination with glutamate selective enzyme-based recording probes in urethane-anesthetized Lurcher mutant and wildtype mice. Target sites included the mediodorsal and ventrolateral thalamic nuclei, reticulotegmental nuclei, pedunculopontine nuclei, and ventral tegmental area. With the exception of the ventral tegmental area, the results indicated that in comparison to wildtype mice, evoked glutamate release was reduced in Lurcher mutants by between 9 and 72% at all stimulated sites. These results are consistent with the notion that developmental loss of cerebellar Purkinje cells drives reductions in evoked glutamate release in cerebellar efferent pathways that ultimately influence PFC dopamine release. Possible mechanisms whereby reductions in glutamate release could occur are discussed.

A new view of the effect of dopamine receptor antagonism on operant performance for rewarding brain stimulation in the rat

RATIONALE

Previous studies of neuroleptic challenges to intracranial self-stimulation (ICSS) employed two-dimensional (2D) measurements (curve shifts). Results so obtained are ambiguous with regard to the stage of neural processing at which the drug produces its performance-altering effect. We substituted a three-dimensional (3D) method that measures reward-seeking as a function of both the strength and cost of reward. This method reveals whether changes in reward seeking are due to drug action prior to the output of the circuitry that performs spatiotemporal integration of the stimulation-induced neural activity.

OBJECTIVES

The aim of this study was to obtain new information about the stage of neural processing at which pimozide acts to alter pursuit of brain stimulation reward (BSR).

METHODS

Following treatment with pimozide (0.1 mg/kg) or its vehicle, the proportion of trial time allocated to working for BSR was measured as a function of pulse frequency and opportunity cost. A surface defined by Shizgal's reward-mountain model was fitted to the drug and vehicle data.

RESULTS

Pimozide lowered the cost required to decrease performance for a maximal BSR to half its maximal level but did not alter the pulse-frequency required to produce a reward of half-maximal intensity.

CONCLUSIONS

Like indirect dopamine agonists, pimozide does not alter the sensitivity of brain reward circuity but changes reward-system gain, subjective effort costs, and/or the value of activities that compete with ICSS. The 3D method is more sensitive and informative than the 2D methods employed previously.

High γ power in ECoG reflects cortical electrical stimulation effects on unit activity in layers V/VI

OBJECTIVE

Cortical electrical stimulation (CES) has been used extensively in experimental neuroscience to modulate neuronal or behavioral activity, which has led this technique to be considered in neurorehabilitation. Because the cortex and the surrounding anatomy have irregular geometries as well as inhomogeneous and anisotropic electrical properties, the mechanism by which CES has therapeutic effects is poorly understood. Therapeutic effects of CES can be improved by optimizing the stimulation parameters based on the effects of various stimulation parameters on target brain regions.

APPROACH

In this study we have compared the effects of CES pulse polarity, frequency, and amplitude on unit activity recorded from rat primary motor cortex with the effects on the corresponding local field potentials (LFP), and electrocorticograms (ECoG). CES was applied at the surface of the cortex and the unit activity and LFPs were recorded using a penetrating electrode array, which was implanted below the stimulation site. ECoGs were recorded from the vicinity of the stimulation site.

MAIN RESULTS

Time-frequency analysis of LFPs following CES showed correlation of gamma frequencies with unit activity response in all layers. More importantly, high gamma power of ECoG signals only correlated with the unit activity in lower layers (V-VI) following CES. Time-frequency correlations, which were found between LFPs, ECoGs and unit activity, were frequency- and amplitude-dependent.

SIGNIFICANCE

The signature of the neural activity observed in LFP and ECoG signals provides a better understanding of the effects of stimulation on network activity, representative of large numbers of neurons responding to stimulation. These results demonstrate that the neurorehabilitation and neuroprosthetic applications of CES targeting layered cortex can be further improved by using field potential recordings as surrogates to unit activity aimed at optimizing stimulation efficacy. Likewise, the signatures of unit activity observed as changes in high gamma power in ECoGs suggest that future cortical stimulation studies could rely on less invasive feedback schemes that incorporate surface stimulation with ECoG reporting of stimulation efficacy.

Advances in studying phasic dopamine signaling in brain reward mechanisms

The last sixty years of research has provided extraordinary advances of our knowledge of the reward system. Since its discovery as a neurotransmitter by Carlsson and colleagues (1), dopamine (DA) has emerged as an important mediator of reward processing. As a result, a number of electrochemical techniques have been developed to measure DA in the brain. Together, these techniques have begun to elucidate the complex roles of tonic and phasic DA signaling in reward processing and addiction. In this review, we will first provide a guide for the most commonly used electrochemical methods for DA detection and describe their utility in furthering our knowledge about DA's role in reward and addiction. Second, we will review the value of common in vitro and in vivo preparations and describe their ability to address different types of questions. Last, we will review recent data that has provided new mechanistic insight of in vivo phasic DA signaling and its role in reward processing and reward-mediated behavior.

Role of dopamine tone in the pursuit of brain stimulation reward

Dopaminergic neurons contribute to intracranial self-stimulation (ICSS) and other reward-seeking behaviors, but it is not yet known where dopaminergic neurons intervene in the neural circuitry underlying reward pursuit or which psychological processes are involved. In rats working for electrical stimulation of the medial forebrain bundle, we assessed the effect of GBR-12909 (1-[2-[bis(4-fluorophenyl)-methoxy]ethyl]-4-[3- phenylpropyl]piperazine), a specific blocker of the dopamine transporter. Operant performance was measured as a function of the strength and cost of electrical stimulation. GBR-12909 increased the opportunity cost most subjects were willing to pay for a reward of a given intensity. However, this effect was smaller than that produced by a regimen of cocaine administration that drove similar increases in nucleus accumbens (NAc) dopamine levels in unstimulated rats. Delivery of rewarding stimulation to drug-treated rats caused an additional increase in dopamine concentration in the NAc shell in cocaine-treated, but not GBR-12909-treated, rats. These behavioral and neurochemical differences may reflect blockade of the norepinephrine transporter by cocaine but not by GBR-12909. Whereas the effect of psychomotor stimulants on ICSS has long been attributed to dopaminergic action at early stages of the reward pathway, the results reported here imply that increased dopamine tone boosts reward pursuit by acting at or beyond the output of the circuitry that temporally and spatially summates the output of the directly stimulated neurons underlying ICSS. The observed enhancement of reward seeking could be attributable to a decrease in the value of competing behaviors, a decrease in subjective effort costs, or an increase in reward-system gain.

Scarce means with alternative uses: robbins' definition of economics and its extension to the behavioral and neurobiological study of animal decision making

Almost 80 years ago, Lionel Robbins proposed a highly influential definition of the subject matter of economics: the allocation of scarce means that have alternative ends. Robbins confined his definition to human behavior, and he strove to separate economics from the natural sciences in general and from psychology in particular. Nonetheless, I extend his definition to the behavior of non-human animals, rooting my account in psychological processes and their neural underpinnings. Some historical developments are reviewed that render such a view more plausible today than would have been the case in Robbins’ time. To illustrate a neuroeconomic perspective on decision making in non-human animals, I discuss research on the rewarding effect of electrical brain stimulation. Central to this discussion is an empirically based, functional/computational model of how the subjective intensity of the electrical reward is computed and combined with subjective costs so as to determine the allocation of time to the pursuit of reward. Some successes achieved by applying the model are discussed, along with limitations, and evidence is presented regarding the roles played by several different neural populations in processes posited by the model. I present a rationale for marshaling convergent experimental methods to ground psychological and computational processes in the activity of identified neural populations, and I discuss the strengths, weaknesses, and complementarity of the individual approaches. I then sketch some recent developments that hold great promise for advancing our understanding of structure–function relationships in neuroscience in general and in the neuroeconomic study of decision making in particular.

M₅ muscarinic receptors mediate striatal dopamine activation by ventral tegmental morphine and pedunculopontine stimulation in mice

Opiates, like other addictive drugs, elevate forebrain dopamine levels and are thought to do so mainly by inhibiting GABA neurons near the ventral tegmental area (VTA), in turn leading to a disinhibition of dopamine neurons. However, cholinergic inputs from the laterodorsal (LDT) and pedunculopontine (PPT) tegmental nucleus to the VTA and substantia nigra (SN) importantly contribute, as either LDT or PPT lesions strongly attenuate morphine-induced forebrain dopamine elevations. Pharmacological blockade of muscarinic acetylcholine receptors in the VTA or SN has similar effects. M₅ muscarinic receptors are the only muscarinic receptor subtype associated with VTA and SN dopamine neurons. Here we tested the contribution of M₅ muscarinic receptors to morphine-induced dopamine elevations by measuring nucleus accumbens dopamine efflux in response to intra-VTA morphine infusion using in vivo chronoamperometry. Intra-VTA morphine increased nucleus accumbens dopamine efflux in urethane-anesthetized wildtype mice starting at 10 min after infusion. These increases were absent in M₅ knockout mice and were similarly blocked by pre-treatment with VTA scopolamine in wildtype mice. Furthermore, in wildtype mice electrical stimulation of the PPT evoked an initial, short-lasting increase in striatal dopamine efflux, followed 5 min later by a second prolonged increase in dopamine efflux. In M₅ knockout mice, or following systemic pre-treatment with scopolamine in wildtype mice, the prolonged increase in striatal dopamine efflux was absent. The time course of increased accumbal dopamine efflux in wildtype mice following VTA morphine was consistent with both the prolonged M₅-mediated excitation of striatal dopamine efflux following PPT electrical stimulation and accumbal dopamine efflux following LDT electrical stimulation. Therefore, M₅ receptors appear critical for prolonged PPT excitation of dopamine efflux and for dopamine efflux induced by intra-VTA morphine.

Estimation of electrode location in a rat motor cortex by laminar analysis of electrophysiology and intracortical electrical stimulation

While the development of microelectrode arrays has enabled access to disparate regions of a cortex for neurorehabilitation, neuroprosthetic and basic neuroscience research, accurate interpretation of the signals and manipulation of the cortical neurons depend upon the anatomical placement of the electrode arrays in a layered cortex. Toward this end, this report compares two in vivo methods for identifying the placement of electrodes in a linear array spaced 100 µm apart based on in situ laminar analysis of (1) ketamine-xylazine-induced field potential oscillations in a rat motor cortex and (2) an intracortical electrical stimulation-induced movement threshold. The first method is based on finding the polarity reversal in laminar oscillations which is reported to appear at the transition between layers IV and V in laminar 'high voltage spindles' of the rat cortical column. Analysis of histological images in our dataset indicates that polarity reversal is detected 150.1 ± 104.2 µm below the start of layer V. The second method compares the intracortical microstimulation currents that elicit a physical movement for anodic versus cathodic stimulation. It is based on the hypothesis that neural elements perpendicular to the electrode surface are preferentially excited by anodic stimulation while cathodic stimulation excites those with a direction component parallel to its surface. With this method, we expect to see a change in the stimulation currents that elicits a movement at the beginning of layer V when comparing anodic versus cathodic stimulation as the upper cortical layers contain neuronal structures that are primarily parallel to the cortical surface and lower layers contain structures that are primarily perpendicular. Using this method, there was a 78.7 ± 68 µm offset in the estimate of the depth of the start of layer V. The polarity reversal method estimates the beginning of layer V within ±90 µm with 95% confidence and the intracortical stimulation method estimates it within ±69.3 µm. We propose that these methods can be used to estimate the in situ location of laminar electrodes implanted in the rat motor cortex.

At what stage of neural processing does cocaine act to boost pursuit of rewards?

Dopamine-containing neurons have been implicated in reward and decision making. One element of the supporting evidence is that cocaine, like other drugs that increase dopaminergic neurotransmission, powerfully potentiates reward seeking. We analyze this phenomenon from a novel perspective, introducing a new conceptual framework and new methodology for determining the stage(s) of neural processing at which drugs, lesions and physiological manipulations act to influence reward-seeking behavior. Cocaine strongly boosts the proclivity of rats to work for rewarding electrical brain stimulation. We show that the conventional conceptual framework and methods do not distinguish between three conflicting accounts of how the drug produces this effect: increased sensitivity of brain reward circuitry, increased gain, or decreased subjective reward costs. Sensitivity determines the stimulation strength required to produce a reward of a given intensity (a measure analogous to the K_M of an enzyme) whereas gain determines the maximum intensity attainable (a measure analogous to the v_max of an enzyme-catalyzed reaction). To distinguish sensitivity changes from the other determinants, we measured and modeled reward seeking as a function of both stimulation strength and opportunity cost. The principal effect of cocaine was a two-fourfold increase in willingness to pay for the electrical reward, an effect consistent with increased gain or decreased subjective cost. This finding challenges the long-standing view that cocaine increases the sensitivity of brain reward circuitry. We discuss the implications of the results and the analytic approach for theories of how dopaminergic neurons and other diffuse modulatory brain systems contribute to reward pursuit, and we explore the implications of the conceptual framework for the study of natural rewards, drug reward, and mood.

Strength-duration relationship for extracellular neural stimulation: numerical and analytical models

The strength-duration relationship for extracellular stimulation is often assumed to be similar to the classical intracellular stimulation model, with a slope asymptotically approaching 1/τ at pulse durations shorter than chronaxy. We modeled extracellular neural stimulation numerically and analytically for several cell shapes and types of active membrane properties. The strength-duration relationship was found to differ significantly from classical intracellular models. At pulse durations between 4 μs and 5 ms stimulation is dominated by sodium channels, with a slope of -0.72 in log-log coordinates for the Hodgkin-Huxley ion channel model. At shorter durations potassium channels dominate and slope decreases to -0.13. Therefore the charge per phase is decreasing with decreasing stimulus duration. With pulses shorter than cell polarization time (∼0.1-1 μs), stimulation is dominated by polarization dynamics with a classical -1 slope and the charge per phase becomes constant. It is demonstrated that extracellular stimulation can have not only lower but also upper thresholds and may be impossible below certain pulse durations. In some regimes the extracellular current can hyperpolarize cells, suppressing rather than stimulating spiking behavior. Thresholds for burst stimuli can be either higher or lower than that of a single pulse, depending on pulse duration. The modeled thresholds were found to be comparable to published experimental data. Electroporation thresholds, which limit the range of safe stimulation, were found to exceed stimulation thresholds by about two orders of magnitude. These results provide a biophysical basis for understanding stimulation dynamics and guidance for optimizing the neural stimulation efficacy and safety.

Appetite and reward

The tendency to engage in or maintain feeding behaviour is potently influenced by the rewarding properties of food. Affective and goal-directed behavioural responses for food have been assessed in response to various physiological, pharmacological and genetic manipulations to provide much insight into the neural mechanisms regulating motivation for food. In addition, several lines of evidence tie the actions of metabolic signals, neuropeptides and neurotransmitters to the modulation of the reward-relevant circuitry including midbrain dopamine neurons and corticolimbic nuclei that encode emotional and cognitive aspects of feeding. Along these lines, this review pulls together research describing the peripheral and central signalling molecules that modulate the rewarding effects of food and the underlying neural pathways.

Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area

Dopamine concentrations fluctuate on a subsecond time scale in the nucleus accumbens (NAc) of awake rats. These transients occur in resting animals, are more frequent following administration of drugs of abuse, and become time-locked to cues predicting reward. Despite their importance in various behaviors, the origin of these signals has not been demonstrated. Here we show that dopamine transients are evoked by neural activity in the ventral tegmental area (VTA), a brain region containing dopaminergic cell bodies. The frequency of naturally occurring dopamine transients in a resting, awake animal was reduced by a local VTA microinfusion of either lidocaine or (+/-)2-amino,5-phosphopentanoic acid (AP-5), an NMDA receptor antagonist that attenuates phasic firing. When dopamine increases were pharmacologically evoked by noncontingent administration of cocaine, intra-VTA infusion of lidocaine or AP-5 significantly diminished this effect. Dopamine transients acquired in response to a cue during intracranial self-stimulation were also attenuated by intra-VTA microinfusion of AP-5, and this was accompanied by an increase in latency to lever press. The results from these three distinct experiments directly demonstrate, for the first time, how neuronal firing of dopamine neurons originating in the VTA translates into synaptic overflow in a key terminal region, the NAc shell.

Corticotropin-releasing factor in the dorsal raphe nucleus increases medial prefrontal cortical serotonin via type 2 receptors and median raphe nucleus activity

Interactions between central corticotropin-releasing factor (CRF) and serotonergic systems are believed to be important for mediating fear and anxiety behaviors. Recently we demonstrated that infusions of CRF into the rat dorsal raphe nucleus result in a delayed increase in serotonin release within the medial prefrontal cortex that coincided with a reduction in fear behavior. The current studies were designed to study the CRF receptor mechanisms and pathways involved in this serotonergic response. Infusions of CRF (0.5 microg/0.5 microL) were made into the dorsal raphe nucleus of urethane-anesthetized rats following either inactivation of the median raphe nucleus by muscimol (25 ng/0.25 microL) or antagonism of CRF receptor type 1 or CRF receptor type 2 in the dorsal raphe nucleus with antalarmin (25-50 ng/0.5 microL) or antisauvagine-30 (2 microg/0.5 microL), respectively. Medial prefrontal cortex serotonin levels were measured using in-vivo microdialysis and high-performance liquid chromatography with electrochemical detection. Increased medial prefrontal cortex serotonin release elicited by CRF infusion into the dorsal raphe nucleus was abolished by inactivation of the median raphe nucleus. Furthermore, antagonism of CRF receptor type 2 but not CRF receptor type 1 in the dorsal raphe nucleus abolished CRF-induced increases in medial prefrontal cortex serotonin. Follow-up studies involved electrical stimulation of the central nucleus of the amygdala, a source of CRF afferents to the dorsal raphe nucleus. Activation of the central nucleus increased medial prefrontal cortex serotonin release. This response was blocked by CRF receptor type 2 antagonism in the dorsal raphe. Overall, these results highlight complex CRF modulation of medial prefrontal cortex serotonergic activity at the level of the raphe nuclei.

Dopamine and reward: the anhedonia hypothesis 30 years on

The anhedonia hypothesis--that brain dopamine plays a critical role in the subjective pleasure associated with positive rewards--was intended to draw the attention of psychiatrists to the growing evidence that dopamine plays a critical role in the objective reinforcement and incentive motivation associated with food and water, brain stimulation reward, and psychomotor stimulant and opiate reward. The hypothesis called to attention the apparent paradox that neuroleptics, drugs used to treat a condition involving anhedonia (schizophrenia), attenuated in laboratory animals the positive reinforcement that we normally associate with pleasure. The hypothesis held only brief interest for psychiatrists, who pointed out that the animal studies reflected acute actions of neuroleptics whereas the treatment of schizophrenia appears to result from neuroadaptations to chronic neuroleptic administration, and that it is the positive symptoms of schizophrenia that neuroleptics alleviate, rather than the negative symptoms that include anhedonia. Perhaps for these reasons, the hypothesis has had minimal impact in the psychiatric literature. Despite its limited heuristic value for the understanding of schizophrenia, however, the anhedonia hypothesis has had major impact on biological theories of reinforcement, motivation, and addiction. Brain dopamine plays a very important role in reinforcement of response habits, conditioned preferences, and synaptic plasticity in cellular models of learning and memory. The notion that dopamine plays a dominant role in reinforcement is fundamental to the psychomotor stimulant theory of addiction, to most neuroadaptation theories of addiction, and to current theories of conditioned reinforcement and reward prediction. Properly understood, it is also fundamental to recent theories of incentive motivation.

Implantable microelectrode arrays for simultaneous electrophysiological and neurochemical recordings

Implantable microfabricated microelectrode arrays represent a versatile and powerful tool to record electrophysiological activity across multiple spatial locations in the brain. Spikes and field potentials, however, correspond to only a fraction of the physiological information available at the neural interface. In urethane-anesthetized rats, microfabricated microelectrode arrays were implanted acutely for simultaneous recording of striatal local field potentials, spikes, and electrically evoked dopamine overflow on the same spatiotemporal scale. During these multi-modal recordings we observed (1) that the amperometric method used to detect dopamine did not significantly influence electrophysiological activity, (2) that electrical stimulation in the medial forebrain bundle (MFB) region resulted in electrochemically transduced dopamine transients in the striatum that were spatially heterogeneous within at least 200 microm, and (3) following MFB stimulation, dopamine levels and electrophysiological activity within the striatum exhibited similar temporal profiles. These neural probes are capable of incorporating customized microelectrode geometries and configurations, which may be useful for examining specific spatiotemporal relationships between electrical and chemical signaling in the brain.

Dopamine tone increases similarly during predictable and unpredictable administration of rewarding brain stimulation at short inter-train intervals

Unpredicted rewards, but not predicted ones, trigger strong phasic changes in the firing rates of midbrain dopamine (DA). In contrast, neurochemical measurements of DA tone have failed to reveal an influence of reward predictability. However, the subjects of the neurochemical experiments were asked to predict reward onset over longer intervals (12s, on average) than the subjects of the electrophysiological studies (typically, 2s). Thus, the contrasting effects of reward predictability could reflect the difference in the duration of the interval separating the predictor from the reward rather than a difference in the influence of reward predictability on phasic and tonic DA signaling. This hypothesis was tested in rats receiving trains of rewarding electrical brain stimulation with either a predictable or unpredictable onset. The mean inter-train interval was 1.5s, a value close to the 2-s CS-US interval that has been used in electrophysiological studies demonstrating the dependence of phasic DA responses on reward predictability. Despite the shortened inter-train interval, the time courses of the observed stimulation-induced elevations in DA levels were very similar, regardless of whether train onset was predictable. This finding is consistent with the idea that tonic DA signaling is insensitive to the predictability of rewards.

Direct and indirect activation of cortical neurons by electrical microstimulation

Electrical microstimulation has been used to elucidate cortical function. This review discusses neuronal excitability and effective current spread estimated by using three different methods: 1) single-cell recording, 2) behavioral methods, and 3) functional magnetic resonance imaging (fMRI). The excitability properties of the stimulated elements in neocortex obtained using these methods were found to be comparable. These properties suggested that microstimulation activates the most excitable elements in cortex, that is, by and large the fibers of the pyramidal cells. Effective current spread within neocortex was found to be greater when measured with fMRI compared with measures based on single-cell recording or behavioral methods. The spread of activity based on behavioral methods is in close agreement with the spread based on the direct activation of neurons (as opposed to those activated synaptically). We argue that the greater activation with imaging is attributed to transynaptic spread, which includes subthreshold activation of sites connected to the site of stimulation. The definition of effective current spread therefore depends on the neural event being measured.

Prolonged rewarding stimulation of the rat medial forebrain bundle: neurochemical and behavioral consequences

Extracellular dopamine levels were measured in the rat nucleus accumbens by means of in vivo microdialysis. Delivery of rewarding medial forebrain bundle stimulation at a low rate (5 trains/min) produced a sustained elevation of dopamine levels, regardless of whether train onset was predictable. When the rate of train delivery was increased to 40 trains/min, dopamine levels rose rapidly during the first 40 min but then declined toward the baseline range. The rewarding impact of the stimulation was reduced following prior delivery of stimulation at the high, but not the low, rate. These results support the idea that dopamine tone plays an enabling role in brain stimulation reward and is elevated similarly by predictable and unpredictable stimulation.

Dopamine efflux in the rat striatum evoked by electrical stimulation of the subthalamic nucleus: potential mechanism of action in Parkinson's disease

The precise mechanism whereby continuous high-frequency electrical stimulation of the subthalamic nucleus ameliorates motor symptoms of Parkinson's disease is unknown. We examined the effects of high-frequency stimulation of regions dorsal to and within the subthalamic nucleus on dopamine efflux in the striatum of urethane-anaesthetized rats using constant potential amperometry. Complementary extracellular electrophysiological studies determined the activity of subthalamic nucleus neurons in response to similar electrical stimulation of the subthalamic nucleus. High-frequency stimulation of the subthalamic nucleus increased action potential firing in the subthalamic nucleus only during the initial stimulation period and was followed by a cessation of firing over the remainder of stimulation. Electrical stimulation of the subthalamic nucleus with 15 pulses elicited stimulus-time-locked increases in striatal dopamine efflux with maximal peak effects occurring at 50 Hz frequency and 300 microA intensity. Extended subthalamic nucleus stimulation (1000 pulses at 50 Hz; 300 microA) elicited a similar peak increase in striatal dopamine efflux that was followed by a relatively lower steady-state elevation in extracellular dopamine over the course of stimulation. In contrast, extended stimulation immediately adjacent and dorsal to the subthalamic nucleus resulted in an 11-fold greater increase in dopamine efflux that remained elevated over the course of the stimulation. Immunohistochemical staining for tyrosine hydroxylase revealed catecholaminergic fibers running immediately dorsal to and through the subthalamic nucleus. Taken together, these results suggest that enhanced dopamine release within the basal ganglia may be an important mechanism whereby high-frequency stimulation of the subthalamic nucleus improves motor symptoms of Parkinson's disease.

The central extended amygdala network as a proposed circuit underlying reward valuation

The phenomenon of medial forebrain bundle self-stimulation offers a powerful model of reward-based behavior. In particular, it appears to activate a neural system whose natural function is to compute the survival value or utility of present stimuli and to help orchestrate responses toward those inputs. Although the anatomical identity of this system is as yet unknown, recent descriptions of anatomical macrosystems within the basal forebrain lead to the proposal that it may be largely contained within the central extended amygdala network. This paper reviews decades' worth of behavioral and neurophysiological investigations of brain stimulation reward that support or are at least consistent with this idea. The proposed network circuitry underlying self-stimulation is also placed into the larger context of basal forebrain function, specifically, the role of the ventral striatopallidum in linking motivation to behavior, the role of the amygdala in detecting motivationally significant inputs, and the role of the magnocellular complex in communicating reward information to cortical and hippocampal targets.

Forebrain substrates of reward and motivation

Electrical stimulation of the medial forebrain bundle can reward arbitrary acts or motivate biologically primitive, species-typical behaviors like feeding or copulation. The subsystems involved in these behaviors are only partially characterized, but they appear to transsynaptically activate the mesocorticolimbic dopamine system. Basal function of the dopamine system is essential for arousal and motor function; phasic activation of this system is rewarding and can potentiate the effectiveness of reward-predictors that guide learned behaviors. This system is phasically activated by most drugs of abuse and such activation contributes to the habit-forming actions of these drugs.

Brain stimulation and morphine reward deficits in dopamine D2 receptor-deficient mice

RATIONALE

The rewarding effects of lateral hypothalamic brain stimulation, various natural rewards, and several drugs of abuse are attenuated by D1 or D2 dopamine receptor (D1R or D2R) antagonists. Much of the evidence for dopaminergic involvement in rewards is based on pharmacological agents with limited or "relative" selectivity for dopamine receptor subtypes. Genetically engineered animal models provide a complementary approach to pharmacological investigations.

OBJECTIVES

In the present study, we explored the contribution of dopamine D2Rs to (1) brain stimulation reward (BSR) and (2) the potentiation of this behavior by morphine and amphetamine using D2R-deficient mice.

METHODS

Wild-type (D2Rwt), heterozygous (D2Rhet), and D2R knockout (D2Rko) mice were trained to turn a wheel for rewarding brain stimulation. Once equivalent rate-frequency curves were established, morphine-induced (0, 1.0, 3.0, and 5.6 mg/kg s.c.) and amphetamine-induced (0, 1.0, 2.0, and 4.0 mg/kg i.p.) potentiations of BSR were determined.

RESULTS

The D2Rko mice required approximately 50% more stimulation than the D2Rwt mice did. With the equi-rewarding levels of stimulation current, amphetamine potentiated BSR equally across the three genotypes. In contrast, morphine potentiated rewarding stimulation in the D2Rwt, had no effect in the D2Rhet, and antagonized rewarding stimulation in the D2Rko mice.

CONCLUSIONS

D2R elimination decreases, but does not eliminate, the rewarding effects of lateral hypothalamic stimulation. After compensation for this deficit, amphetamine continues to potentiate BSR, while morphine does not.

Opposing roles of the nucleus accumbens and anterior lateral hypothalamic area in the control of sexual behaviour in the male rat

Opposing roles have been implicated for the nucleus accumbens (NAc) and anterior portion of the lateral hypothalamic area (aLHA) in the regulation of sexual behaviour in male rats based on in vivo neurochemical correlates. The present study provides functional evidence supporting this hypothesis by examining the effects of lesions to these structures on copulation, noncontact erection and receptive female preference. Sexually naïve male Long-Evans rats received either bilateral 1.0- micro L injections of NMDA (10 micro g/ micro L/side) or vehicle (shams) into either the aLHA or the NAc. During repeated tests of copulation most of the sham-lesioned males, but few of the aLHA-lesioned and NAc-lesioned males, copulated to ejaculation. Most of the NAc-lesioned males also failed to intromit, whereas the majority of the aLHA-lesioned males intromitted repeatedly. During exposure to an inaccessible receptive female behind a wire-mesh screen, aLHA-lesioned males displayed facilitation of noncontact erections, whereas NAc-lesioned males displayed impaired noncontact erections. Conversely, during simultaneous exposure to inaccessible receptive and nonreceptive females in different compartments, all males spent more time in the proximity of the receptive female. These findings indicate that the aLHA plays an inhibitory role in the regulation of sexual arousal and an excitatory role in the regulation of ejaculation. Conversely, the NAc plays an excitatory role in the regulation in sexual arousal.

Increase in accumbal dopaminergic transmission correlates with response cost not reward of hypothalamic stimulation

Rats were trained to lever-press for intracranial self-stimulation (ICSS) of the lateral hypothalamus on either a fixed ratio (FR) 1 or 10 schedule. Their brains were removed after a 20 min session and tissue punches taken from the nucleus accumbens, olfactory tubercle, anterior striatum, or central striatum. These punches were assayed for content of dopamine (DA) and the major DA metabolite DOPAC. Compared with implanted controls, only the FR10 group showed significantly elevated DOPAC/DA ratios. These elevations were statistically significant in nucleus accumbens and central striatum and near significance in anterior striatum. They occurred to similar degrees in each hemisphere. In contrast, we found that stimulation of the ventral tegmental area of anesthetized rats asymmetrically increased the DOPAC/DA ratio, being most prominent in the ipsilateral accumbens. Because the FR10 group made only 58% of the responses of the FR1 group and received only 6% of the stimulations of the FR1 group, yet unlike the FR1 group showed a significant increase in the DOPAC/DA ratio, we suggest that the DA release was primarily influenced by the schedule, not the stimulation or the reward of the stimulation. These results were interpreted in terms of a model in which hypothalamic ICSS reward is largely dependent on non-dopaminergic mechanisms, with accumbal DA transmission being strongly dependent on the costs versus benefits of ongoing behavior.

Dopamine and glutamate release in the nucleus accumbens and ventral tegmental area of rat following lateral hypothalamic self-stimulation

Rewarding hypothalamic brain stimulation is thought to depend on trans-synaptic activation of high-threshold (and thus rarely directly depolarized by rewarding stimulation) dopaminergic fibers of the medial forebrain bundle. We used in vivo microdialysis and high-performance liquid chromatography coupled with electrochemical or fluorometric detection to investigate the concurrent release of dopamine and glutamate in the nucleus accumbens septi and in the ventral tegmental area, as a function of lateral hypothalamic self-stimulation.Self-stimulation at a variety of stimulation frequencies and pulse widths increased levels of dopamine and its primary metabolites, dihydroxyphenylacetic acid and homovanillic acid in the nucleus accumbens. Lateral hypothalamic self-stimulation also induced significant increases in ventral tegmental area dopamine and metabolite levels, and the percentage increase of dopamine was higher in this region than in the nucleus accumbens. Local perfusion with the dopamine uptake inhibitor nomifensine (10 microM) increased dopamine levels in the nucleus accumbens about three-fold and potentiated the increase of dopamine levels induced by self-stimulation. Nomifensine perfusion also induced a delayed decrease in nucleus accumbens glutamate levels, and self-stimulation did not modify this effect of the drug. Local perfusion with the D2-type dopamine receptor antagonist raclopride significantly increased both basal and self-stimulation induced dopamine release in the nucleus accumbens. Neither nomifensine nor raclopride perfusion significantly affected the maximal rates of self-stimulation. Perfusion with tetrodotoxin (2 microM) into nucleus accumbens significantly decreased basal and prevented stimulation-induced increases in accumbens dopamine levels but only slightly decreased the rate of self-stimulation. In contrast, perfusion of tetrodotoxin (0.5 microM) into the ventral tegmental area decreased basal and blocked stimulation-induced increases in both nucleus accumbens and ventral tegmental area dopamine levels; this treatment also blocked or strongly inhibited self-stimulation. While it had no effect on glutamate levels in the nucleus accumbens, lateral hypothalamic self-stimulation induced a significant and tetrodotoxin-sensitive increase in glutamate levels in the ventral tegmental area. Taken together, the present results indicate that, across a broad range of stimulation parameters, rewarding lateral hypothalamus stimulation causes major and persistent activation of the mesolimbic dopamine system, and suggest descending glutamatergic fibers in the medial forebrain bundle as a candidate for the directly activated descending pathway in lateral hypothalamus brain stimulation reward.

Brain-stimulation reward thresholds raised by an antisense oligonucleotide for the M5 muscarinic receptor infused near dopamine cells

Oligonucleotides targeting M5 muscarinic receptor mRNA were infused for 6 d into the ventral tegmental area of freely behaving rats trained to bar-press for lateral hypothalamic stimulation. The bar-pressing rate was determined at a range of frequencies each day to evaluate the effects of infusions on reward. M5 antisense oligonucleotide (oligo) infusions increased the frequency required for bar pressing by 48% over baseline levels, with the largest increases occurring after 4-6 d of infusion. Two control oligos had only slight effects (means of 5 and 11% for missense and sense oligos, respectively). After the infusion, the required frequency shifted back to baseline levels gradually over 1-5 d. Antisense oligo infusions decreased M5 receptors on the ipsilateral, but not the contralateral, side of the ventral tegmentum, as compared with a missense oligo. Therefore, M5 muscarinic receptors associated with mesolimbic dopamine neurons seem to be important in brain-stimulation reward.

Temporary inactivation of the retrorubral fields decreases the rewarding effect of medial forebrain bundle stimulation

Prior studies indicate that lesioning the retrorubral fields (RRF) decreases the rewarding effect of medial forebrain bundle (MFB) stimulation, although these studies did not make the RRF their primary target. This study directly investigates the role of the RRF in MFB self-stimulation using transient lidocaine-induced inactivation of target tissue rather than permanent lesioning. In 18 rats with MFB stimulation electrodes, inactivation of the RRF via 0. 5 and 1.0 microl of 4% lidocaine produced immediate, substantial upward shifts in the frequency required to maintain half-maximal self-stimulation response rates whereas injecting comparable volumes of saline did not. Bilateral inactivation was particularly effective, especially at medium and high stimulation currents, although unilateral inactivation ipsilateral to the stimulation site was also effective. Contralateral inactivation alone did not substantially change the stimulation's reward value, although contralateral inactivation appeared to contribute to the effectiveness of bilateral inactivation. The frequency required to maintain half-maximal responding returned to baseline levels by 15-20 min after lidocaine infusion. In seven rats whose infusion sites were not in the RRF, lidocaine inactivation did not consistently degrade the stimulation's reward value. These results indicate that some neural elements located in the RRF contribute to the rewarding effect of MFB stimulation. Possible roles for these elements in the anatomical substrate for MFB self-stimulation are discussed.

Laterodorsal tegmental stimulation elicits dopamine efflux in the rat nucleus accumbens by activation of acetylcholine and glutamate receptors in the ventral tegmental area

Cholinergic and glutamatergic neurons in the laterodorsal tegmentum (LDT) and neighbouring mesopontine nuclei are thought to influence mesolimbic dopaminergic neuronal activity involved in goal-directed behaviours. We measured the changes in dopamine oxidation current (corresponding with dopamine efflux) in the nucleus accumbens (NAc) in response to electrical stimulation of the LDT using in vivo chronoamperometry in urethane-anaesthetized rats. LDT stimulation (35 Hz pulse trains for 60 s, 1 s intertrain interval) evoked a three-component change in dopamine efflux in the NAc: (i) an initial stimulation time-locked increase in the dopamine signal above baseline, followed by (ii) an immediate decrease below baseline, and thereafter by (iii) a prolonged increase in the dopamine signal above baseline. Intra-VTA infusion of the nicotinic receptor antagonist mecamylamine (5 microg/0.5 microL) or the ionotropic glutamate receptor antagonist kynurenate (10 microg/microL) attenuated the first LDT-elicited component. The second suppressive component was abolished by intra-LDT infusions of either the nonselective or the M2-selective muscarinic receptor antagonists scopolamine (100 microg/microL) and methoctramine (50 microg/microL), respectively. In contrast, intra-VTA infusions of scopolamine (200 microg/microL) resulted in a selective attenuation of the third facilitatory component, whereas both second and third components were abolished by systemic injections of scopolamine (5 mg/kg). These results suggest that the initial increase, subsequent decrease, and final prolonged increase in extracellular dopamine levels in the NAc are selectively mediated by LDT-elicited activation of (i) nicotinic and glutamatergic receptors in the VTA, (ii) muscarinic M2 autoreceptors on LDT cell bodies, and (iii) muscarinic receptors in the VTA, respectively.

Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation

Intracranial self-stimulation is an operant behavior whereby animals are conditioned to press a lever in order to receive an electrical stimulation of their dopamine neurons. This paradigm is thought to stimulate brain reward pathways and, as such, has been used to clarify the role of dopamine in reward. Striatal extracellular dopamine concentrations were monitored during the acquisition and maintenance of self-stimulation and compared to dopamine release generated by experimenter-delivered and yoked stimulation. Fast-scan cyclic voltammetry in conjunction with carbon-fiber microelectrodes was used to monitor evoked dopamine release in the caudate-putamen during electrical stimulation of the substantia nigra/ventral tegmental area. The sub-second temporal resolution of fast-scan cyclic voltammetry coupled with the micron spatial resolution of the microelectrodes allowed for the measurement of dopamine neurotransmission in real-time. Single experimenter-delivered stimulations, identical to those used during self-stimulation, evoked dopamine release in the caudate-putamen both before and after the self-stimulation sessions. Likewise, yoked stimulations of the substantia nigra/ventral tegmental area delivered to animals untrained to perform self-stimulation resulted in an increase in extracellular dopamine levels. During training sessions, experimenter-delivered stimulations evoked dopamine release. However, as the animals began lever-pressing, extracellular dopamine levels subsequently declined. Taken together, these results suggest that dopamine functions as an alerting device, wherein increases in extracellular dopamine are obtained by unpredicted or novel rewarding stimuli, but not by those which can be anticipated.

Decreased chaos of midbrain dopaminergic neurons after serotonin denervation

Neuropharmacological investigations aimed at understanding the electrophysiological correlates between drug effect and action potential trains have usually been carried out with the analysis of firing rate and bursting activity. In this study, a selective alteration of neural circuits providing inputs to ventral tegmental area dopaminergic neurons has been produced, and the corresponding electrophysiological correlates have been investigated by nonlinear dynamical analysis. The nonlinear prediction method combined with Gaussian-scaled surrogate data has been used to show the chaotic structure in the time-series corresponding to the electrical activity of ventral tegmental area dopaminergic neurons, extracellularly recorded in vivo. A decrease in chaos of ventral tegmental area dopaminergic neurons was found in a group of rats lesioned with 5,7-dihydroxytryptamine, a neurotoxin which selectively destroys serotonergic terminals. The chaos content of ventral tegmental area dopaminergic neurons in the control group and the decrease of chaos in the lesioned group cannot be explained in terms of standard characteristics of neuronal activity (firing rate, bursting activity). Moreover, in the control group a positive correlation has been found between the density-power-spectrum of the interspike intervals and the chaos content measured by nonlinear prediction S score; this relation was lost in the lesioned group. It is concluded that the impaired serotonergic tone induced by 5,7-dihydroxytryptamine reduces the chaotic behaviour of the dopaminergic cell firing pattern, while retaining many standard interspike interval characteristics. The functional role of this behaviour in a neuronal coding problem context and the implications for the pathophysiology of some mental disorders are discussed.

Blockade of the reward-potentiating effects of nicotine on lateral hypothalamic brain stimulation by chlorisondamine

Chlorisondamine, a quarternary nicotinic antagonist, was given in a dose that crosses the blood-brain barrier, is taken up and concentrated intracellularly by dopaminergic neurons, and induces long-term blockade of the locomotor stimulant and rewarding effects of nicotine. This treatment had no effect on the rewarding effects of lateral hypothalamic brain stimulation, failing to shift the function that relates reward strength to rate of responding (rate-frequency function). That the treatment regimen was sufficient to block nicotinic receptors in the reward system was confirmed by the fact that it completely blocked the ability of normally effective nicotine to potentiate the rewarding effects of stimulation (shift this function to the left). These data add evidence that the direct, endogenous cholinergic contribution to brain stimulation reward is muscarinic and fit with other evidence that the potentiation of brain stimulation reward by exogenous nicotine involves actions on nicotinic receptors native to dopaminergic neurons.

Basolateral amygdala stimulation evokes glutamate receptor-dependent dopamine efflux in the nucleus accumbens of the anaesthetized rat

Afferents from the basolateral amygdala and dopamine projections from the ventral tegmental area to the nucleus accumbens have both been implicated in reward-related processes. The present study used in vivo chronoamperometry with stearate-graphite paste electrodes in urethane-anaesthetized rats to determine how basolateral amygdala efferents to the nucleus accumbens synaptically regulate dopamine efflux. Repetitive-pulse (20 Hz for 10 s) electrical stimulation of the basolateral amygdala evoked a complex pattern of changes in monitored dopamine oxidation currents in the nucleus accumbens related to dopamine efflux. These changes were characterized by an initial increase that was time-locked to stimulation, a secondary decrease below baseline, followed by a prolonged increase in the dopamine signal above baseline. The effects of burst-patterned stimulation (100 Hz, 5 pulses/burst, 1-s interburst interval, 40 s) of the basolateral amygdala on the basal accumbens dopamine signal were similar to those evoked by 20 Hz stimulation, with the lack of a secondary suppressive component. Infusions of the ionotropic glutamate receptor antagonists (+/-)-2-amino-5-phosphonopentanoic acid (APV) or 6,7-dinitroquinoxaline-2,3-dione (DNQX) into the nucleus accumbens dose-dependently blocked or attenuated the initial and prolonged increases in the dopamine signal following 20 Hz or burst-patterned basolateral amygdala stimulation. Infusions of the metabotropic glutamate receptor antagonist (+)-alpha-methyl-4-carboxyphenylglycine selectively blocked the intermediate suppressive effect of 20 Hz basolateral amygdala stimulation on dopamine oxidation currents. Blockade of glutamate receptors or inhibition of dopamine neuronal activity via infusions of either APV + DNQX, lidocaine or gamma-hydroxybutyric acid, respectively, into the ventral tegmental area did not effect the pattern of changes in the accumbens dopamine signal evoked by basolateral amygdala stimulation. These data suggest that the glutamatergic basolateral amygdala inputs to nucleus accumbens dopamine terminals synaptically facilitate or depress dopamine efflux, and these effects are independent of dopamine neuronal firing activity. Moreover, these results imply that changes in nucleus accumbens dopamine levels following presentation of reward-related stimuli may be mediated, in part, by the basolateral amygdala.

Electrophysiological evidence that a subset of midbrain dopamine neurons integrate the reward signal induced by electrical stimulation of the posterior mesencephalon

This study was aimed at determining whether midbrain dopamine (DA) neurons are trans-synaptically activated by rewarding electrical stimulation applied near the midline in the posterior mesencephalon (PM), and in the affirmative, whether the increase in firing was proportional to the rewarding effectiveness of the stimulation. Experiments were performed on male Long-Evans rats trained to lever press to obtain 400 ms trains of cathodal rectangular pulses. Following the training period, curves relating the rates of responding to the stimulation frequencies were determined at two current intensities and reward thresholds were calculated for each animal. Each animal was then anesthetized with urethane (1.2 g/kg, i.p.) and firing rate of DA neurons were recorded before, during, and after each of 50 trains (1 train/3 s) of stimulation to the PM using stimulation parameters that either sustained near threshold responding (rewarding), or failed to sustain responding (non-rewarding), in the behavioral tests. A total of 24 DA cells were recorded from 13 behaviorally trained animals, and of these, 17 (71%) responded to rewarding stimulation by an increase in firing, five (21%) were unresponsive and two (8%) were inhibited. In 12 of the 17 cells that were activated, the increase in firing was proportional to the rewarding effectiveness of the stimulation rather than the total strength of the stimulation. These results provide evidence that a subset of midbrain DA neurons are trans-synaptically activated by rewarding PM stimulation and constitute a second, or subsequent, stage of the reward-relevant pathway that integrates the PM reward signal.

Excitability of neural elements within the rat corpus striatum

The excitability of cholinergic, glutamatergic and dopaminergic elements within the rat neostriatum was studied in both in vivo and in vitro preparations. In vivo, the microdialysis technique was used to measure the release of striatal acetylcholine and dopamine under basal and electrically evoked conditions. For comparison, acetylcholine, dopamine and glutamate release was assayed in media obtained from superfused rat striatal slices. Electrical stimulation was used to derive the strength-duration functions and their chronaxies of stimulated elements containing the three neurotransmitter types. The chonaxies for experiments in vitro and in vivo were similar: the chronaxy values for elements containing acetylcholine were the shortest, the values for glutamate were intermediate, and the values for those containing dopamine were the longest. Based on the chronaxy estimates, it is proposed that the elements containing acetylcholine are the large cholinergic interneurons of striatum, and the elements containing glutamate and dopamine are the terminals of corticostriatal and nigrostriatal neurons, respectively. These results indicate that electrical stimulation of neural elements surrounding a microdialysis probe can be an additional tool to examine the factors that regulate neurotransmitter release. Likewise, investigators can activate specific striatal elements by using pulse durations that coincide with their chronaxies.

Both nicotinic and muscarinic receptors in ventral tegmental area contribute to brain-stimulation reward

Cholinergic neurons of the pedunculopontine tegmental nucleus (Ch5) and laterodorsal tegmental nucleus (Ch6) monosynaptically activate dopamine neurons of the substantia nigra and ventral tegmental area (VTA) via nicotinic and muscarinic receptors. The nicotinic receptors near the VTA have been proposed to be important for nicotine self-administration in rats and for tobacco smoking in humans. Nicotinic and muscarinic blockers were microinjected into the VTA of rats trained to lever-press for lateral hypothalamic stimulation via an ipsilateral electrode. The competitive nicotinic blocker dihydro-beta-erythroidine (DH beta E; 5-60 micrograms) shifted rate-frequency curves to the right by a mean of 6-27% in a dose-related manner; the noncompetitive nicotinic blocker mecamylamine (10-300 micrograms) produced similar shifts of 7-21%. Atropine (30 micrograms) shifted the curves to the right by a mean of 82% in three of the sites tested with DH beta E. All blockers decreased maximum bar-pressing rates significantly in some sites when the shifts were large. Therefore, nicotinic receptors in the VTA make small contributions to the maintained rewarding effect of brain-stimulation reward in rats, but muscarinic receptors in the VTA appear to be more important.