Effect of central 5-hydroxytryptamine depletion on changeover behaviour in concurrent schedules of reinforcement

Pharmacological studies of performance on the free-operant psychophysical procedure

In the free-operant psychophysical procedure (FOPP), reinforcement is provided intermittently for responding on lever A in the first half and lever B in the second half of a trial. Temporal differentiation is measured from the psychometric function (percent responding on B, %B, versus time from trial onset, t), the index of timing being T50, the value of t at %B=50. T50 is reduced by acute treatment with 5-hydroxytryptamine (5-HT1A, 5-HT2A) and dopamine (D1-like, D2-like) receptor agonists. The effects of the agonists can be reversed by the respective antagonists of these receptors. Evidence is reviewed suggesting that the effect of endogenous 5-HT is mediated by 5-HT2A receptors and the effect of endogenous dopamine by D1-like receptors. Data are presented on the effects of lesions of the prefrontal cortex and corpus striatum on the sensitivity of performance on the FOPP to D1-like and D2-like receptor agonists. Lesions of the nucleus accumbens, but not the dorsal striatum or prefrontal cortex, attenuated the effects of a D1-like receptor agonist, 6-chloro-2,3,4,5-tetrahydro-1-phenyl-1H-3-benzazepine [SKF-81297], but not a D2-like receptor agonist, quinpirole, on T50. The results indicate that a population of D1-like receptors in the ventral striatum may contribute to the control of timing performance on the FOPP.

Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task

Pathological gambling (PG) is characterized by persistent, maladaptive gambling behavior, which disrupts personal and professional life. Animal models of gambling behavior could make a significant contribution to improving our understanding of the neural and neurochemical basis of gambling, and the treatment of PG. When gambling, failing to win critically results in the loss of resources wagered as well as the absence of additional gain. Here, we have incorporated these concepts into a novel rat gambling task (rGT), based, in part, on the 'Iowa' gambling task (IGT) commonly used clinically to measure gambling-like behavior. Rats choose among four different options to earn as many sugar pellets as possible within 30 min. Each option is associated with the delivery of a different amount of reward, but also with a different probability and duration of punishing time-out periods during which reward cannot be earned. The schedules are designed such that persistent choice of options linked with larger rewards result in fewer pellets earned per unit time. Rats learn to avoid these risky options to maximize their earnings, comparable with the optimal strategy in the IGT. Both d-amphetamine and the 5-HT(1A) receptor agonist, 8-OH-DPAT, impaired task performance. In contrast, the dopamine D(2) receptor antagonist, eticlopride, improved performance, whereas the D(1) receptor antagonist, SCH23390, had no effect. These data suggest that both serotonergic and dopaminergic agents can impair and improve gambling performance, and indicate that the rGT will be a useful tool to study the biological basis of gambling.

Attenuation of the effects of d-amphetamine on interval timing behavior by central 5-hydroxytryptamine depletion

RATIONALE

Interval timing in the free-operant psychophysical procedure is sensitive to the monoamine-releasing agent d-amphetamine, the D(2)-like dopamine receptor agonist quinpirole, and the D(1)-like agonist 6-chloro-2,3,4,5-tetrahydro-1-phenyl-1H-3-benzepine (SKF-81297). The effect of d-amphetamine can be antagonized by selective D(1)-like and 5-HT(2A) receptor antagonists. It is not known whether d-amphetamine's effect requires an intact 5-hydroxytryptamine (5-HT) pathway.

OBJECTIVE

The objective of this study was to examine the effects of d-amphetamine, quinpirole, and SKF-81297 on timing in intact rats and rats whose 5-hydroxytryptaminergic (5-HTergic) pathways had been ablated.

MATERIALS AND METHODS

Rats were trained under the free-operant psychophysical procedure to press levers A and B in 50-s trials in which reinforcement was provided intermittently for responding on A in the first half, and B in the second half of the trial. Percent responding on B (%B) was recorded in successive 5-s epochs of the trials; logistic functions were fitted to the data for derivation of timing indices (T(50), time corresponding to %B = 50%; Weber fraction). The effects of d-amphetamine (0.4 mg kg(-1) i.p.), quinpirole (0.08 mg kg(-1) i.p.), and SKF-81297 (0.4 mg kg(-1) s.c.) were compared between intact rats and rats whose 5-HTergic pathways had been destroyed by intra-raphe injection of 5,7-dihydroxytryptamine.

RESULTS

Quinpirole and SKF-81297 reduced T(50) in both groups; d-amphetamine reduced T(50) only in the sham-lesioned group. The lesion reduced 5-HT levels by 80%; catecholamine levels were not affected.

CONCLUSIONS

d-Amphetamine's effect on performance in the free-operant psychophysical procedure requires an intact 5-HTergic system. 5-HT, possibly acting at 5-HT(2A) receptors, may play a 'permissive' role in dopamine release.

Effects of 5-HT1A and 5-HT2A receptor stimulation on temporal differentiation performance in the fixed-interval peak procedure

We examined the effects of the 5-HT1A receptor agonist 8-hydroxy-2-(di-n-propylamino)tetralin (8-OH-DPAT) and 5-HT(2A/2C) receptor agonist 2,5-dimethoxy-4-iodoamphetamine (DOI) on performance on the fixed-interval peak procedure, and the sensitivity of these effects to 5-HT1A and 5-HT2A receptor antagonists (N-[2-(4-[2-methoxyphenyl]-1-piperazinyl]ethyl]-N-2-pyridinylcyclohexanecarboxamide [WAY-100635] and ketanserin). Rats were trained to press a lever for food reinforcement in 50 min sessions consisting of 32 trials in which the lever was continuously available, separated by 10 s inter-trial intervals. In 16 trials, reinforcement was delivered following the first response after 30 s had elapsed since trial onset (fixed-interval 30 s). In 16 randomly interposed (peak/probe) trials, reinforcement was omitted, and the lever remained in the operant chamber for 120 s. Response rate in probe trials was plotted against time from trial onset. Time to peak response rate (t(peak)) and the Weber fraction were derived from modified Gaussian curves fitted to each rat's data. 8-OH-DPAT (0.05 mg kg(-1)) reduced t(peak) and increased the Weber fraction; the effect on t(peak) was antagonized by WAY-100635 (0.1 mg kg(-1)). DOI (0.25 mg kg(-1)) also reduced t(peak) and increased the Weber fraction; the reduction of t(peak) was antagonized by ketanserin (2 mg kg(-1)). Stimulation of 5-HT1A and 5-HT2A receptors alters temporal differentiation in qualitatively similar ways.

Midbrain dopamine neurons encode a quantitative reward prediction error signal

The midbrain dopamine neurons are hypothesized to provide a physiological correlate of the reward prediction error signal required by current models of reinforcement learning. We examined the activity of single dopamine neurons during a task in which subjects learned by trial and error when to make an eye movement for a juice reward. We found that these neurons encoded the difference between the current reward and a weighted average of previous rewards, a reward prediction error, but only for outcomes that were better than expected. Thus, the firing rate of midbrain dopamine neurons is quantitatively predicted by theoretical descriptions of the reward prediction error signal used in reinforcement learning models for circumstances in which this signal has a positive value. We also found that the dopamine system continued to compute the reward prediction error even when the behavioral policy of the animal was only weakly influenced by this computation.