Comparative effects of amphetamine, scopolamine, chlordiazepoxide, and diphenylhydantoin on operant and extinction behavior with brain stimulation and food reward

New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds

Motor learning is a core aspect of human life and appears to be ubiquitous throughout the animal kingdom. Dopamine, a neuromodulator with a multifaceted role in synaptic plasticity, may be a key signaling molecule for motor skill learning. Though typically studied in the context of reward-based associative learning, dopamine appears to be necessary for some types of motor learning. Mesencephalic dopamine structures are highly conserved among vertebrates, as are some of their primary targets within the basal ganglia, a subcortical circuit important for motor learning and motor control. With a focus on the benefits of cross-species comparisons, this review examines how "model-free" and "model-based" computational frameworks for understanding dopamine's role in associative learning may be applied to motor learning. The hypotheses that dopamine could drive motor learning either by functioning as a reward prediction error, through passive facilitating of normal basal ganglia activity, or through other mechanisms are examined in light of new studies using humans, rodents, and songbirds. Additionally, new paradigms that could enhance our understanding of dopamine's role in motor learning by bridging the gap between the theoretical literature on motor learning in humans and other species are discussed.

The strength of reward-related learning depends on the degree of activation of ventral tegmental area dopamine neurons

We tested whether (1) the capacity of a reward-associated conditioned stimulus (CS) to cause conditioned activation of ventral tegmental area (VTA) dopamine (DA) neurons is associated with its capacity to elicit conditioned approach responses and (2) whether the acquisition of these capacities by a CS requires N-methyl-D-aspartate (NMDA) and muscarinic acetylcholine (mACh) receptor stimulation. Rats were trained to emit a conditioned approach response to a light CS that was previously paired with food and were treated systemically with scopolamine (a mACh receptor antagonist) or MK-801 (an NMDA receptor antagonist) either prior to each conditioning session (during which animals experienced paired CS and food presentations) or prior to the conditioned approach (CS-only) test. Brains were harvested after the CS-only test and processed for tyrosine hydroxylase (TH) (DA cells) and c-fos in the VTA. When animals received scopolamine or MK-801 treatment prior to conditioning sessions we observed significantly fewer TH-labeled (i.e., DA) cells in the VTA that expressed c-fos and significantly less conditioned approach responding during the CS-only test. Further analysis showed a correlation between the number of VTA DA cells activated and the number of conditioned approach responses. Treatments made prior to the CS-only test did not affect responding. Altogether these results suggest that the degree to which a CS elicits conditioned approach depends partially on the degree to which the CS activates VTA DA cells and that the acquisition of both of these capacities by a CS requires mACh and NMDA receptor stimulation.

Neural basis of benzodiazepine reward: requirement for α2 containing GABAA receptors in the nucleus accumbens

Despite long-standing concerns regarding the abuse liability of benzodiazepines, the mechanisms underlying properties of benzodiazepines that may be relevant to abuse are still poorly understood. Earlier studies showed that compounds selective for α1-containing GABAA receptors (α1GABAARs) are abused by humans and self-administered by animals, and that these receptors may underlie a preference for benzodiazepines as well as neuroplastic changes observed in the ventral tegmental area following benzodiazepine administration. There is some evidence, however, that even L-838, 417, a compound with antagonistic properties at α1GABAARs and agonistic properties at the other three benzodiazepine-sensitive GABAA receptor subtypes, is self-administered, and that the α2GABAARs may have a role in benzodiazepine-induced reward enhancement. Using a two-bottle choice drinking paradigm to evaluate midazolam preference and an intracranial self-stimulation (ICSS) paradigm to evaluate the impact of midazolam on reward enhancement, we demonstrated that mice carrying a histidine-to-arginine point mutation in the α2 subunit which renders it insensitive to benzodiazepines (α2(H101R) mice) did not prefer midazolam and did not show midazolam-induced reward enhancement in ICSS, in contrast to wild-type controls, suggesting that α2GABAARs are necessary for the reward enhancing effects and preference for oral benzodiazepines. Through a viral-mediated knockdown of α2GABAARs in the nucleus accumbens (NAc), we demonstrated that α2 in the NAc is necessary for the preference for midazolam. Findings imply that α2GABAARs in the NAc are involved in at least some reward-related properties of benzodiazepines, which might partially underlie repeated drug-taking behavior.

Synergistic interaction between caloric restriction and amphetamine in food-unrelated approach behavior of rats

RATIONALE

Approach behavior is regulated by the brain integrating information about environment and body state. Psychoactive drugs interact with this process.

OBJECTIVES

We examined the extent to which caloric (i.e., food) restriction, amphetamine (AMPH) and lithium interact in potentiating locomotor activity and responding reinforced by visual stimulus (VS), a reward unrelated to energy homeostasis.

METHODS

Rats either had ad libitum access to food or received daily rations that maintained 85-90 % of their original body weights. Leverpressing turned on a cue light for 1 s and turned off house light for 5 s. AMPH and lithium were administered through intraperitoneal injections and diet, respectively.

RESULTS

Food restriction or AMPH (1 mg/kg) alone had little effect on VS-reinforced responding; however, the combination of the two conditions markedly potentiated VS-reinforced responding (fourfold). Food restriction lasting 7 days or longer was needed to augment AMPH's effect on VS-reinforced responding. AMPH (0.3-3 mg/kg) potentiated locomotor activity similarly between food-restricted and ad libitum groups. Repeated injections of AMPH-sensitized locomotor activity, but not VS-reinforced responding. In addition, while chronic lithium treatments (0.2 % lithium carbonate chow) reduced VS-reinforced responding, chronic lithium further augmented AMPH-potentiated VS-reinforced responding.

CONCLUSIONS

Food restriction interacts with psychoactive drugs to potentiate goal-directed responding unrelated to food seeking in a much more powerful manner than previously thought. The novel finding that lithium can augment a psychostimulant effect of AMPH suggests caution when combining lithium and psychostimulant drugs in clinical settings.

The role of the cholinergic system in the signal attenuation rat model of obsessive-compulsive disorder

RATIONALE

In comparison to studies of the involvement of the serotonergic, dopaminergic, and glutamatergic systems in the pathophysiology of obsessive-compulsive disorder (OCD), research on the involvement of the cholinergic system in this disorder has remained sparse.

OBJECTIVES

The aim of this study was to test the role of the cholinergic system in compulsive behavior using the signal attenuation rat model of OCD. In this model, "compulsive" behavior is induced by attenuating a signal indicating that a lever-press response was effective in producing food.

METHODS

The acetylcholinesterase inhibitor physostigmine (0.05, 0.10, and 0.15 mg/kg), the nicotinic agonist nicotine (0.03, 0.06, 0.10, 0.30, 0.60, and 1.00 mg/kg), the nicotinic antagonist mecamylamine (1, 3, 5, and 8 mg/kg), the muscarinic agonist oxotremorine (0.0075, 0.0150, and 0.0300 mg/kg), and the muscarinic antagonist scopolamine (0.15, 0.50, 1.00, and 1.50 mg/kg) were acutely administered to rats just before assessing their lever-press responding following signal attenuation (experiments 1, 3, 5, 7, and 9, respectively). Because the effects of signal attenuation are assessed under extinction conditions, drug doses that were effective in the above experiments were also tested in an extinction session of lever-press responding that was not preceded by signal attenuation (experiments 2, 4, 6, 8, and 10).

RESULTS

Acute systemic administration of the cholinergic agents did not exert a selective anti- or pro-compulsive effect in the signal attenuation model.

CONCLUSIONS

Acetylcholine does not seem to play a role in the signal attenuation rat model of OCD.

Neurocircuitry of drug reward

In recent years, neuroscientists have produced profound conceptual and mechanistic advances on the neurocircuitry of reward and substance use disorders. Here, we will provide a brief review of intracranial drug self-administration and optogenetic self-stimulation studies that identified brain regions and neurotransmitter systems involved in drug- and reward-related behaviors. Also discussed is a theoretical framework that helps to understand the functional properties of the circuitry involved in these behaviors. The circuitry appears to be homeostatically regulated and mediate anticipatory processes that regulate behavioral interaction with the environment in response to salient stimuli. That is, abused drugs or, at least, some may act on basic motivation and mood processes, regulating behavior-environment interaction. Optogenetics and related technologies have begun to uncover detailed circuit mechanisms linking key brain regions in which abused drugs act for rewarding effects. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Withdrawal from chronic amphetamine elevates baseline intracranial self-stimulation thresholds

Intracranial self-stimulation was assessed before, within, and after a chronic amphetamine treatment regimen. Amphetamine was given twice daily 5 days per week for 6 weeks at dosages escalating from 1 to 10 mg/kg per injection. Lateral hypothalamic self-stimulation rate-frequency functions were taken 36 h after the last injection in each weekly series and weekly for 3 weeks following the last injection. Frequency thresholds increased and maximal response rates decreased progressively as a function of amphetamine withdrawal during treatment; each returned to near normal levels within 2 weeks of the last injection. When subsequently tested under amphetamine, animals previously receiving the 6-week amphetamine treatment regimen had self-stimulation thresholds and maximal response rates that did not differ significantly from those of saline-treated control animals. These data confirm that chronic amphetamine treatment results in a dependence syndrome characterized in part by a phasic depression in the brain mechanism mediating the reinforcing effects of lateral hypothalamic electrical stimulation.

Amphetamine affects the extinction of self-stimulation differently in prefrontal cortex and posterior hypothalamus of rats

The effects of amphetamine on the extinction of intracranial self-stimulation (ICSS) and on postextinction ICSS performance were examined in rats implanted with electrodes either in medial prefrontal cortex (mPFC) or in the posterior hypothalamus-ventral tegmental area (PH-VTA). Lever-pressing for ICSS was allowed to stabilize in daily 15-minute sessions before each animal was exposed to 5 minutes of extinction (responding without reward). Animals were administered either 0.25 mg/kg d-amphetamine or saline before baseline, extinction and postextinction sessions. After amphetamine treatment, the number of lever presses during extinction was higher in mPFC animals and lower in PH-VTA animals compared with saline-treated controls. Rates did not change immediately after extinction but, one day later, rates had increased in all saline-treated animals (both PH-VTA and mPFC animals) and had decreased in all amphetamine-treated animals. These findings demonstrated that the effects of amphetamine on the extinction of ICSS were different in cortical and hypothalamic sites, possibly because of regional differences in stimulus-evoked reinforcement and inhibitory processes.

Tripelennamine: enhancement of brain-stimulation reward

Thresholds for reinforcing electrical stimulation to the medial forebrain bundle were determined in rats by means of a rate-free psychophysical method. The acute administration of tripelennamine lowered the threshold for rewarding brain stimulation in a dose-dependent manner. These results suggest that the abuse liability of tripelennamine may be related to its ability to sensitize the central neural pathway that mediates reward.

The neurochemistry and pharmacology of extinction behavior

The role of various neurotransmitter systems in the brain in extinction behavior is examined. An attempt is made to suggest psychological mechanisms (such as attention, secondary reinforcement or internal inhibition) by which the neurotransmitter systems or drugs act to produce the observed alteration in extinction behavior. The putative neurotransmitters acetylcholine, noradrenaline, dopamine, serotonin, endorphins and the peptides are reviewed, as are pharmacological agents such as the benzodiazepines, the barbiturates, the psychodelics, the neuroleptics, the psychomotor stimulants and cannabinoids. Other treatments and factors are considered such as peripheral hormones and the adrenal-pituitary axis. It is suggested that the noradrenergic system may be involved in the expression of extinction behavior by a role in selective attention, the dopamine system via an involvement with secondary reinforcement, the cholinergic system by a mechanism of response inhibition and the barbiturates and benzodiazepines by a block of nonreward.

Minireview. Benzodiazepine-opiate antagonist interactions in relation to feeding and drinking behavior

Benzodiazepines reliably produce overconsumption of food and fluids. Opiate antagonists, naloxone and naltrexone, block the benzodiazepine-induced hyperphagia and hyperdipsia at low doses. Hence, activation of endogenous opioid mechanisms may be closely involved in the benzodiazepine facilitatory effects on ingestional behavior. Evidence is reviewed that opiate antagonists diminish feeding and drinking responses, and may enhance satiety processes in feeding and drinking, in addition to selectively diminishing the palatability of attractive foods and fluids. It is proposed that a single mechanism of action of the opiate antagonists would be sufficient to account for both effects on feeding and drinking. Biochemical data confirm that acute benzodiazepine treatment in vivo is associated with a naloxone-reversible release of striatal enkephalin. It is possible therefore that there is a close association between the behavioral and biochemical data, which both show that acute benzodiazepine effects are reversed by opiate antagonists. The implied relationship between benzodiazepine and endogenous opioid mechanisms may be relevant to the question of concurrent opiate-benzodiazepine abuse.

Nigral transplants reinnervating the dopamine-depleted neostriatum can sustain intracranial self-stimulation

Transplants of embryonic substantia nigra reinnervated the striatum and were able to sustain intracranial self-stimulation in rats with brain lesions induced by 6-hydroxydopamine. Dopaminergic drugs and alterations in current intensity produced typical changes in response rates. Animals with electrodes implanted into cortical grafts or into the denervated striatum failed to exhibit self-stimulation. These findings suggest that transplanted dopamine neurons convey specific, temporally organized information axonally to the striatum.

Effects of anorectic drugs and prior feeding on food-rewarded runway behavior

Two treatments that act through central catecholamine pathways and are normally found to be strongly anorectic (d-amphetamine, 1.25 mg/kg and diethylpropion, 5.00 mg/kg) failed to influence either latency to run or running velocity in single trial running for food reward. In contrast, d-fenfluramine (2.5 mg/kg), which normally has similar anorectic potency but acts via a serotoninergic mechanism, significantly increased latency and decreased running velocity. Prior feeding (30 min ad lib access to food) also decreased runway performance to a similar degree. Further studies, using a 3 trial procedure where rats were allowed to feed for 30 sec following each run, revealed that d-amphetamine (1.25 mg/kg), both with and without penfluridol pretreatment (2.5 mg/kg), failed to affect running velocity or the amount of food eaten. However, d-fenfluramine (2.5 mg/kg) and a postsynaptic serotonin receptor agonist, m-chlorophenylpiperazne (1.0, 2.0 mg/kg) led to a significant reduction in these measurements. Thus it appears that "serotoninergic" anorectic drugs, like the state induced by prefeeding, depress food-rewarded runway behavior whereas "catecholaminergic" anorectic agents lack such effect.

Simultaneous rate-independent and rate-dependent assessment of intracranial self-stimulation: evidence for the direct involvement of dopamine in brain reinforcement mechanisms

A two-level intracranial self-stimulation (ICSS) paradigm was developed in which both rate-independent and dependent measures of ICSS could be obtained simultaneously. Responses at the first lever resulted in stimulation which decreased in magnitude after every fifth response, while responses at the second lever reset the current available. The current at which the reset responses occurred was defined as the 'reward threshold'. In addition, the rate of responding was determined at each current for which the animals responded during this stimulate-reset sequence. Decreased reward following treatment with the neuroleptic pimozide, a specific blocker of dopamine receptors, was demonstrated by an elevated 'reward threshold'. The same effect could be obtained in control animals by making each stimulation less rewarding, i.e., by decreasing the amount of charge per stimulation. Pimozide increased 'reward threshold' without a generalized disruption of response rates. While rates were decreased at low currents they were unchanged at high currents. 'Reward threshold' was decreased following D-amphetamine treatment, and was accompanied by a dose-related decrease in response rates at high to medium current intensities. These data suggest that neuroleptic attenuation of ICSS is due to diminished reward and not to motor deficits. Further, due to the specificity of pimozide, they suggest a direct role for dopamine in the mediation of reward.

Blockade of intracranial self-stimulation by antipsychotic drugs: failure to correlate with central alpha-noradrenergic blockade

The involvement of central alpha-noradrenergic receptors in intracranial self-stimulation (ICSS) was studied. Dose-response curves were established for the blockade of ICSS by the antipsychotic drugs chlorpromazine, thioridazine, clozapine, and pimozide and the alpha-antagonist phenoxybenzamine. Antagonism of the facilitation, produced by the central alpha-agonist clonidine, of flexor withdrawal reflexes in the reserpinized spinal rat was used to assess the central alpha-blocking potency of the same drugs, and dose-response curves were established. No correlation was found between central alpha-blockade, as reflected by the ED50 for blockade of clonidine-facilated spinal reflexes, and the ED50 for blockade of ICSS. Pimozide blocked ICSS at doses virtually devoid of central alpha-blocking activity, while phenoxybenzamine was a potent alpha-antagonist and a weak blocker of ICSS. The lack of correlation between central alpha-blockade and decreased ICSS suggests that alpha-receptors are not critically involved in self-stimulation behavior.

Catecholamines and self-stimulation: evidence suggesting a reinforcing role for noradrenaline and a motivating role for dopamine

Investigation of the role of noradrenaline (NA) and dopamine (DA) in self-stimulation showed that d-amphetamine (which releases more DA than does l-amphetamine, but not more NA) was much more effective than l-amphetamine in enhancing self-stimulation of NA sites in the locus coeruleus and near-lateral hypothalamus. In DA sites in the substantia nigra and far-lateral hypothalamus the effects of the 2 isomers were confirmed to be more nearly equal. Thymoxamine HCl (10 mg/kg IP), a specific alpha-adrenergic receptor blocker, depressed self-stimulation at all sites, but significantly more severely at DA sites. Thus the drugs most effective in influencing self-stimulation at a particular site were those acting predominantly on the unstimulated system. These findings were interpreted in terms of a hypothesis that DA and NA play complementary roles in self-stimulation and that both are essential; or, more specifically, that DA pathways, implicated in other motivational activites, contribute to a state of drive or arousal necessary for self-stimulation; while response-contingent noradrenergic activity (elicited by the electrodes directly via a transsynaptic route) mediates reinforcement. Further predictions from this hypothesis were tested as follows: (1) Direct pharmacological stimulants of adrenergic alpha-receptors should disrupt self-stimulation by acting randomly on the reinforcement system and disrupting response-reward contingencies; this was confirmed by the finding that the alpha-receptor stimulant clonidine HCl (0.05 mg/kg) depressed self-stimulation at all sites tested. (2) Drect stimulants of DA receptors should enhance self-stimulation of NA sites by augmenting dopaminergic motivational activity; but in rats with DA electrodes, noncontingent stimulation of DA receptors would also impose similar noncontingent activity on the transsynaptic noradrenergic reinforcement pathways and thus depress self-stimulation; this was confirmed by the finding that apomorphine (0.3-1.0 mg/kg) was strongly stimulant for NA electrodes but strongly depressant for DA electrodes, and that the degree and direction of these effects was highly correlated with the differential effects of d- l-amphetamine (rho = .65, p less than 0.01). Neither effect of apomorphine depended on the occurrence of motor stereotypy. These results can be interpreted in terms of 2-component models for self-stimulation, with the predominant transmitter of the drive component being identified as DA and that g the reinforcing component as NA.

The effect of microinjections of amphetamine into the neostriatum and the nucleus accumbens on self-stimulation behaviour

The effect of micro-injections of dexamphetamine chloride into the neostriatum, the nucleus accumbens, the anterior hypothalamus, and the ventricular system on self-stimulation with electrodes in the ventral tegmentum was studied. Unilateral injections of 10 mug into the anterior hypothalamus produced no effect. Injections into the neostriatum tended to depress the self-stimulation rate, whereas injections into the nucleus accumbens increased the rate markedly. Bilateral injections (2 times 2.5 mug and 2 times 5 mug amph.) into the nucleus accumbens were more effective than unilateral injections and were as effective as systemic injections of 1 mg/kg amphetamine (i.p.). Bilateral injections into the neostriatum also increased the self-stimulation rate. Injections of 10 mug into the ventricular system resulted in a smaller increase which was not statistically significant. These results are discussed in relation to the involvement of the dopaminergic system in the maintenance of self-stimulation behaviour.

Dopaminergic and noradrenergic substrates of positive reinforcement: differential effects of d- and l-amphetamine

Intracranial self-stimulation was elicited from electrodes located in either the lateral hypothalamus or substantia nigra of the rat. Facilitatory effects of d- and l-isomers of amphetamine on self-stimulation were assessed. The d-isomer was seven to ten times more effective than the l-isomer at the hypothalamic placement, whereas the two isomers were equipotent for substantia nigra electrodes. These data support the hypothesis that both dopaminergic and noradrenergic systems subserve positive reinforcement.