Effect of lesions of the ascending 5-hydroxytryptaminergic pathways on choice between delayed reinforcers

Effects of a 5-HT4 receptor antagonist in the caudate nucleus on the performance of macaques in a delayed reward task

Temporal discounting, in which the recipient of a reward perceives the value of that reward to decrease with delay in its receipt, is associated with impulsivity and psychiatric disorders such as depression. Here, we investigate the role of the serotonin 5-HT4 receptor (5-HT4R) in modulating temporal discounting in the macaque dorsal caudate nucleus (dCDh), the neurons of which have been shown to represent temporally discounted value. We first mapped the 5-HT4R distribution in macaque brains using positron emission tomography (PET) imaging and confirmed dense expression of 5-HT4R in the dCDh. We then examined the effects of a specific 5-HT4R antagonist infused into the dCDh. Blockade of 5-HT4R significantly increased error rates in a goal-directed delayed reward task, indicating an increase in the rate of temporal discounting. This increase was specific to the 5-HT4R blockade because saline controls showed no such effect. The results demonstrate that 5-HT4Rs in the dCDh are involved in reward-evaluation processes, particularly in the context of delay discounting, and suggest that serotonergic transmission via 5-HT4R may be a key component in the neural mechanisms underlying impulsive decisions, potentially contributing to depressive symptoms.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

Aggression modulator: Understanding the multifaceted role of the dorsal raphe nucleus

Aggressive behavior is instinctively driven behavior that helps animals to survive and reproduce and is closely related to multiple behavioral and physiological processes. The dorsal raphe nucleus (DRN) is an evolutionarily conserved midbrain structure that regulates aggressive behavior by integrating diverse brain inputs. The DRN consists predominantly of serotonergic (5-HT:5-hydroxytryptamine) neurons and decreased 5-HT activity was classically thought to increase aggression. However, recent studies challenge this 5-HT deficiency model, revealing a more complex role for the DRN 5-HT system in aggression. Furthermore, emerging evidence has shown that non-5-HT populations in the DRN and specific neural circuits contribute to the escalation of aggressive behavior. This review argues that the DRN serves as a multifaceted modulator of aggression, acting not only via 5-HT but also via other neurotransmitters and neural pathways, as well as different subsets of 5-HT neurons. In addition, we discuss the contribution of DRN neurons in the behavioral and physiological aspects implicated in aggressive behavior, such as arousal, reward, and impulsivity, to further our understanding of DRN-mediated aggression modulation.

Reduced serotonergic transmission alters sensitivity to cost and reward via 5-HT1A and 5-HT1B receptors in monkeys

Serotonin (5-HT) deficiency is a core biological pathology underlying depression and other psychiatric disorders whose key symptoms include decreased motivation. However, the exact role of 5-HT in motivation remains controversial and elusive. Here, we pharmacologically manipulated the 5-HT system in macaque monkeys and quantified the effects on motivation for goal-directed actions in terms of incentives and costs. Reversible inhibition of 5-HT synthesis increased errors and reaction times on goal-directed tasks, indicating reduced motivation. Analysis found incentive-dependent and cost-dependent components of this reduction. To identify the receptor subtypes that mediate cost and incentive, we systemically administered antagonists specific to 4 major 5-HT receptor subtypes: 5-HT1A, 5-HT1B, 5-HT2A, and 5-HT4. Positron emission tomography (PET) visualized the unique distribution of each subtype in limbic brain regions and determined the systemic dosage for antagonists that would achieve approximately 30% occupancy. Only blockade of 5-HT1A decreased motivation through changes in both expected cost and incentive; sensitivity to future workload and time delay to reward increased (cost) and reward value decreased (incentive). Blocking the 5-HT1B receptor also reduced motivation through decreased incentive, although it did not affect expected cost. These results suggest that 5-HT deficiency disrupts 2 processes, the subjective valuation of costs and rewards, via 5-HT1A and 5-HT1B receptors, thus leading to reduced motivation.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Interval timing relative to response inhibition in the differential reinforcement of low-rate responding in normally developing young adults

With recent proposal suggesting the multifaceted nature of impulsivity, researchers have been intrigued by the question of whether the impulsive behaviour measured in the traditionally psychological paradigms is unitary. One such paradigm, the differential reinforcement of low-rate responding (DRL), has been used to assess response inhibition, but its underlying mechanism has still been debated. In present research, we examined and differentiated the effects of both response inhibition and interval timing on a multisession DRL-10 s (DRL-10 s) in a large sample of normally developing young adults, as well as with three other measures including the stop-signal reaction task (SSRT), time production task-10 s (TPT-10 s), and the Barrett impulsivity scale-11 (BIS-11). The results showed that behavioural changes existed in DRL. As the task sessions progressed, there was an increase in both reinforcement probability and peak time, but a decrease in burst responses. Most importantly, both principal component analysis and generalized multilevel modeling yielded consistent results that as the task progressed, there was an increasing involvement of the TPT in the late sessions of DRL. However, none of the effect of SSRT was found. In sum, the differential degrees of involvement of the timing process, relative to response inhibition, were observed in DRL.

What Can Reinforcement Learning Models of Dopamine and Serotonin Tell Us about the Action of Antidepressants?

Although evidence suggests that antidepressants are effective at treating depression, the mechanisms behind antidepressant action remain unclear, especially at the cognitive/computational level. In recent years, reinforcement learning (RL) models have increasingly been used to characterise the roles of neurotransmitters and to probe the computations that might be altered in psychiatric disorders like depression. Hence, RL models might present an opportunity for us to better understand the computational mechanisms underlying antidepressant effects. Moreover, RL models may also help us shed light on how these computations may be implemented in the brain (e.g., in midbrain, striatal, and prefrontal regions) and how these neural mechanisms may be altered in depression and remediated by antidepressant treatments. In this paper, we evaluate the ability of RL models to help us understand the processes underlying antidepressant action. To do this, we review the preclinical literature on the roles of dopamine and serotonin in RL, draw links between these findings and clinical work investigating computations altered in depression, and appraise the evidence linking modification of RL processes to antidepressant function. Overall, while there is no shortage of promising ideas about the computational mechanisms underlying antidepressant effects, there is insufficient evidence directly implicating these mechanisms in the response of depressed patients to antidepressant treatment. Consequently, future studies should investigate these mechanisms in samples of depressed patients and assess whether modifications in RL processes mediate the clinical effect of antidepressant treatments.

Developmental exposure to the synthetic progestin, 17α-hydroxyprogesterone caproate, disrupts the mesocortical serotonin pathway and alters impulsive decision-making in rats

The synthetic progestin, 17α-hydroxyprogesterone caproate (17-OHPC), is administered to women at risk for preterm birth during a critical period of fetal development for mesocortical pathways. Yet, little information is available regarding the potential effects of 17-OHPC on the developing fetal brain. In rat models, the mesocortical serotonin pathway is sensitive to progestins. Progesterone receptor (PR) is expressed in layer 3 pyramidal neurons of medial prefrontal cortex (mPFC) and in serotonergic neurons of the dorsal raphe. The present study tested the hypothesis that exposure to 17-OHPC during development disrupts serotonergic innervation of the mPFC in adolescence and impairs behavior mediated by this pathway in adulthood. Administration of 17-OHPC from postnatal days 1-14 decreased the density of SERT-ir fibers within superficial and deep layers and decreased the density of synaptophysin-ir boutons in all layers of prelimbic mPFC at postnatal day 28. In addition, rats exposed to 17-OHPC during development were less likely to make impulsive choices in the Delay Discounting task, choosing the larger, delayed reward more often than controls at moderate delay times. Interestingly, 17-OHPC exposed rats were more likely to fail to make any choice (i.e., increased omissions) compared to controls at longer delays, suggesting disruptions in decision-making. These results suggest that further investigation is warranted in the clinical use of 17-OHPC to better inform a risk/benefit analysis of progestin use in pregnancy.

Hyper BOLD Activation in Dorsal Raphe Nucleus of APP/PS1 Alzheimer's Disease Mouse during Reward-Oriented Drinking Test under Thirsty Conditions

Alzheimer's disease (AD), a neurodegenerative disease, causes behavioural abnormalities such as disinhibition, impulsivity, and hyperphagia. Preclinical studies using AD model mice have investigated these phenotypes by measuring brain activity in awake, behaving mice. In this study, we monitored the behavioural alterations of impulsivity and hyperphagia in middle-aged AD model mice. As a behavioural readout, we trained the mice to accept a water-reward under thirsty conditions. To analyse brain activity, we developed a measure for licking behaviour combined with visualisation of whole brain activity using awake fMRI. In a water-reward learning task, the AD model mice showed significant hyperactivity of the dorsal raphe nucleus in thirsty conditions. In summary, we successfully visualised altered brain activity in AD model mice during reward-oriented behaviour for the first time using awake fMRI. This may help in understanding the causes of behavioural alterations in AD patients.

No evidence for the involvement of serotonin or the 5-HTTLPR genotype in intertemporal choice in a larger community sample

BACKGROUND

Serotonin has been implicated in impulsive behaviours such as temporal discounting. While animal studies and theoretical approaches suggest that reduced tonic serotonin levels increase temporal discounting rates and vice versa, evidence from human studies is scarce and inconclusive. Furthermore, an important modulator of serotonin signalling, a genetic variation in the promoter region of the serotonin transporter gene (5-HTTLPR), has not been investigated for temporal discounting so far.

OBJECTIVE

First, the purpose of this study was to test for a significant association between 5-HTTLPR and temporal discounting. Second, we wished to investigate the effect of high/low tonic serotonin levels on intertemporal choice and blood oxygen-level-dependent response, controlling for 5-HTTLPR.

METHODS

We tested the association of 5-HTTLPR with temporal discounting rates using an intertemporal choice task in 611 individuals. We then manipulated tonic serotonin levels with acute tryptophan interventions (depletion, loading, balanced) in a subsample of 45 short (S)-allele and 45 long (L)/L-allele carriers in a randomised double-blind crossover design using functional magnetic resonance imaging and an intertemporal choice task.

RESULTS

Overall, we did not find any effect of serotonin and 5-HTTLPR on temporal discounting rates or the brain networks associated with valuation and cognitive control.

CONCLUSION

Our findings indicate that serotonin may not be directly involved in choices including delays on longer timescales such as days, weeks or months. We speculate that serotonin plays a stronger role in dynamic intertemporal choice tasks where the delays are on a timescale of seconds and hence are therefore directly experienced during the experiment.

The effect of 5-HT1A receptor antagonist on reward-based decision-making

When choosing the best action from several alternatives, we compare each value that depends on the balance between benefit and cost. Previous studies have shown that animals and humans with low brain serotonin (5-HT) level tend to choose smaller immediate reward. We used a decision-making schedule task to investigate whether 5-HT1A receptor is responsible for the decisions related to reward. In this task, the monkeys chose either of two different alternatives that were comprised of 1-4 drops of liquid reward (benefit) and 1-4 repeats of a color discrimination trial (workload cost), then executed the chosen schedule. By the administration of 5-HT1A antagonist, WAY100635, the choice tendency did not change, however, the sensitivity to the amount of reward in the schedule part was diminished. The 5-HT1A could have a role in maintaining reward value to keep track with the promised reward rather than modulating workload discounting of reward value.

5-HT3 antagonists decrease discounting rate without affecting sensitivity to reward magnitude in the delay discounting task in mice

RATIONALE

Impulsive choice has often been evaluated in rodents according to the proportion of choices for the delayed large magnitude reinforcer (%large choice) in a delay-discounting task (DDT). However, because %large choice is influenced by both sensitivity to reinforcer magnitude and sensitivity to delayed reinforcement (i.e., discounting rate), distinctively evaluating such discounting parameters represents a critical issue demanding methods to determine each parameter in rats. The serotonin (5-HT) system is well known to be involved in impulsive choice; nevertheless, only a few studies have distinguished discounting parameters and investigated how 5-HT modulators affect discounting rate.

OBJECTIVE

Here, we performed a discounting parameter analysis in mice and examined the effects of various 5-HT modulators on discounting rate.

METHODS

We set up DDTs with different delay schedules to determine which schedule could address delay-discounting rates in mice. We examined the effect of the following drugs on impulsive choice: a 5-HT reuptake inhibitor (paroxetine), a 5-HT_1A receptor agonist (8-OH-DPAT), and two 5-HT₃ receptor antagonists (granisetron and ondansetron).

RESULTS

Mice showed typical delay discounting at the shorter delay schedules (up to 4 s delay). The %large choice under shorter, but not longer, schedules followed an exponential function and allowed us to derive discounting rates. We selected a DDT with a 4-s delay schedule for further experiments. Granisetron and ondansetron, but not paroxetine or 8-OH-DPAT, decreased discounting rates without affecting sensitivity to reinforcer magnitude.

CONCLUSION

We found that a method to calculate discounting rates in rats is also applicable to mouse models. We also provided evidence that 5-HT₃ antagonism controls impulsive choice in mice.

Risk-seeking for losses is associated with 5-HTTLPR, but not with transient changes in 5-HT levels

RATIONALE

Serotonin (5-HT) plays a key role in different aspects of value-based decision-making. A recent framework proposed that tonic 5-HT (together with dopamine, DA) codes future average reward expectations, providing a baseline against which possible choice outcomes are compared to guide decision-making.

OBJECTIVES

To test whether high 5-HT levels decrease loss aversion, risk-seeking for gains, and risk-seeking for losses.

METHODS

In a first session, 611 participants were genotyped for 5-HTTLPR and performed a mixed gambles (MGA) task and two probability discounting tasks for gains and losses, respectively (PDG/PDL). Afterwards, a subsample of 105 participants (44 with S/S, 6 with S/L, 55 with L/L genotype) completed the pharmacological study using a crossover design with tryptophan depletion (ATD), loading (ATL), and balanced (BAL) conditions. The same decision constructs were assessed.

RESULTS

We found increased risk-seeking for losses in S/S compared to L/L individuals at the first visit (p = 0.002). Neither tryptophan depletion nor loading affected decision-making, nor did we observe an interaction between intervention and 5-HTTLPR genotype.

CONCLUSION

Our data do not support the idea that transient changes of tonic 5-HT affect value-based decision-making. We provide evidence for an association of 5-HTTLPR with risk-seeking for losses, independent of acute 5-HT levels. This indicates that the association of 5-HTTLPR and risk-seeking for losses is mediated via other mechanisms, possibly by differences in the structural development of neural circuits of the 5-HT system during early life phases.

Dorsal Raphe Serotonergic Neurons Control Intertemporal Choice under Trade-off

Appropriate choice about delayed reward is fundamental to the survival of animals. Although animals tend to prefer immediate reward, delaying gratification is often advantageous. The dorsal raphe (DR) serotonergic neurons have long been implicated in the processing of delayed reward, but it has been unclear whether or when their activity causally directs choice. Here, we transiently augmented or reduced the activity of DR serotonergic neurons, while mice decided between differently delayed rewards as they performed a novel odor-guided intertemporal choice task. We found that these manipulations, precisely targeted at the decision point, were sufficient to bidirectionally influence impulsive choice. The manipulation specifically affected choices with more difficult trade-off. Similar effects were observed when we manipulated the serotonergic projections to the nucleus accumbens (NAc). We propose that DR serotonergic neurons preempt reward delays at the decision point and play a critical role in suppressing impulsive choice by regulating decision trade-off.

Mirtazapine and ketanserin alter preference for gambling-like schedules of reinforcement in rats

Drug and behavioral addictions have overlapping features, e.g., both manifest preference for larger, albeit costlier, reinforcement options in cost/benefit decision-making tasks. Our prior work revealed that the mixed-function serotonergic compound, mirtazapine, attenuates behaviors by rats motivated by abused drugs. To extend this work to behavioral addictions, here we determined if mirtazapine and/or ketanserin, another mixed-function serotonin-acting compound, can alter decision-making in rats that is independent of drug (or food)-motivated reward. Accordingly, we developed a novel variable-ratio task in rats wherein intracranial self-stimulation was used as the positive reinforcer. Using lever pressing for various levels of brain stimulation, the operant task provided choices between a small brain stimulation current delivered on a fixed-ratio schedule (i.e., a predictable reward) and a large brain stimulation delivered following an unpredictable number of responses (i.e., a variable-ratio schedule). This task allowed for demonstration of individualized preference and detection of shifts in motivational influences during a pharmacological treatment. Once baseline preference was established, we determined that pretreatment with mirtazapine or ketanserin significantly decreased preference for the large reinforcer presented after gambling-like schedules of reinforcement. When the rats were tested the next day without drug, preference for the unpredictable large reinforcer option was restored. These data demonstrate that mirtazapine and ketanserin can reduce preference for larger, costlier reinforcement options, and illustrate the potential for these drugs to alter behavior.

Animal models to improve our understanding and treatment of suicidal behavior

Worldwide, suicide is a leading cause of death. Although a sizable proportion of deaths by suicide may be preventable, it is well documented that despite major governmental and international investments in research, education and clinical practice suicide rates have not diminished and are even increasing among several at-risk populations. Although nonhuman animals do not engage in suicidal behavior amenable to translational studies, we argue that animal model systems are necessary to investigate candidate endophenotypes of suicidal behavior and the neurobiology underlying these endophenotypes. Animal models are similarly a critical resource to help delineate treatment targets and pharmacological means to improve our ability to manage the risk of suicide. In particular, certain pathophysiological pathways to suicidal behavior, including stress and hypothalamic-pituitary-adrenal axis dysfunction, neurotransmitter system abnormalities, endocrine and neuroimmune changes, aggression, impulsivity and decision-making deficits, as well as the role of critical interactions between genetic and epigenetic factors, development and environmental risk factors can be modeled in laboratory animals. We broadly describe human biological findings, as well as protective effects of medications such as lithium, clozapine, and ketamine associated with modifying risk of engaging in suicidal behavior that are readily translatable to animal models. Endophenotypes of suicidal behavior, studied in animal models, are further useful for moving observed associations with harmful environmental factors (for example, childhood adversity, mechanical trauma aeroallergens, pathogens, inflammation triggers) from association to causation, and developing preventative strategies. Further study in animals will contribute to a more informed, comprehensive, accelerated and ultimately impactful suicide research portfolio.

Effects of nucleus accumbens amphetamine administration on performance in a delay discounting task

Chronic administration of cocaine can cause pronounced and enduring cognitive alterations such as increases in impulsive choice. Chronic cocaine can also result in enhanced dopamine (DA) release in the nucleus accumbens (NAc) in response to reward-related cues. It is possible that this enhanced DA release in the NAc is a mechanism by which cocaine increases impulsive choice. To date, however, the specific role of DA in the NAc in impulsive choice is unclear. To begin to address this, rats received acute microinjections of the indirect DA agonist amphetamine directly into the NAc prior to testing in a delay discounting task in which rats chose between a small, immediate and a large, delayed food reward. When delays to the large reward increased within test sessions, amphetamine increased choice of the large reward. When delays decreased within test sessions, however, amphetamine decreased choice of the large reward. These findings suggest that, rather than specifically mediating impulsive choice, DA neurotransmission in the NAc is necessary for flexible adaptation of choice strategies in the presence of shifting reward contingencies. These results further indicate that enhancements in NAc DA release likely do not account for lasting increases in impulsive choice caused by chronic cocaine.

Lorcaserin and CP-809101 reduce motor impulsivity and reinstatement of food seeking behavior in male rats: Implications for understanding the anti-obesity property of 5-HT2C receptor agonists

RATIONALE

The 5-HT2C receptor agonist lorcaserin (Belviq®) has been approved by the FDA for the treatment of obesity. Impulsivity is a contributory feature of some eating disorders.

OBJECTIVE

Experiments investigated the effect of lorcaserin and the highly selective 5-HT2C agonist CP-809101 on measures of impulsivity and on reinstatement of food-seeking behaviour, a model of dietary relapse. The effect of both drugs on 22-h deprivation-induced feeding was also examined, as was the effect of prefeeding in each impulsivity test.

RESULTS

Lorcaserin (0.3-0.6 mg/kg SC) and CP-809101 (0.6-1 mg/kg SC) reduced premature responding in rats trained on the 5-CSRTT and improved accuracy in a Go-NoGo task by reducing false alarms. At equivalent doses, both drugs also reduced reinstatement for food-seeking behaviour. Neither drug altered impulsive choice measured in a delay-discounting task. Lorcaserin (1-3 mg/kg SC) and CP-809101 (3-6 mg/kg SC) reduced deprivation-induced feeding but only at higher doses.

CONCLUSIONS

These results suggest that in addition to previously reported effects on satiety and reward, altered impulse control may represent a contributory factor to the anti-obesity property of 5-HT2C receptor agonists. Lorcaserin may promote weight loss by improving adherence to dietary regimens in individuals otherwise prone to relapse and may be beneficial in cases where obesity is associated with eating disorders tied to impulsive traits, such as binge eating disorder.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

Therapeutic Potential of 5-HT2C Receptor Agonists for Addictive Disorders

The neurotransmitter 5-hydroxytryptamine (5-HT; serotonin) has long been associated with the control of a variety of motivated behaviors, including feeding. Much of the evidence linking 5-HT and feeding behavior was obtained from studies of the effects of the 5-HT releaser (dex)fenfluramine in laboratory animals and humans. Recently, the selective 5-HT2C receptor agonist lorcaserin received FDA approval for the treatment of obesity. This review examines evidence to support the use of selective 5-HT2C receptor agonists as treatments for conditions beyond obesity, including substance abuse (particularly nicotine, psychostimulant, and alcohol dependence), obsessive compulsive, and excessive gambling disorder. Following a brief survey of the early literature supporting a role for 5-HT in modulating food and drug reinforcement, we propose that intrinsic differences between SSRI and serotonin releasers may have underestimated the value of serotonin-based pharmacotherapeutics to treat clinical forms of addictive behavior beyond obesity. We then highlight the critical involvement of the 5-HT2C receptor in mediating the effect of (dex)fenfluramine on feeding and body weight gain and the evidence that 5-HT2C receptor agonists reduce measures of drug reward and impulsivity. A recent report of lorcaserin efficacy in a smoking cessation trial further strengthens the idea that 5-HT2C receptor agonists may have potential as a treatment for addiction. This review was prepared as a contribution to the proceedings of the 11th International Society for Serotonin Research Meeting held in Hermanus, South Africa, July 9-12, 2014.

Dissociable roles of dopamine and serotonin transporter function in a rat model of negative urgency

Negative urgency is a facet of impulsivity that reflects mood-based rash action and is associated with various maladaptive behaviors in humans. However, the underlying neural mechanisms of negative urgency are not fully understood. Several brain regions within the mesocorticolimbic pathway, as well as the neurotransmitters dopamine (DA) and serotonin (5-HT), have been implicated in impulsivity. Extracellular DA and 5-HT concentrations are regulated by DA transporters (DAT) and 5-HT transporters (SERT); thus, these transporters may be important molecular mechanisms underlying individual differences in negative urgency. The current study employed a reward omission task to model negative urgency in rats. During reward trials, a cue light signaled the non-contingent delivery of one sucrose pellet; immediately following the non-contingent reward, rats responded on a lever to earn sucrose pellets (operant phase). Omission trials were similar to reward trials, except that non-contingent sucrose was omitted following the cue light prior to the operant phase. As expected, contingent responding was higher following omission of expected reward than following delivery of expected reward, thus reflecting negative urgency. Upon completion of behavioral training, Vmax and Km were obtained from kinetic analysis of [(3)H]DA and [(3)H]5-HT uptake using synaptosomes prepared from nucleus accumbens (NAc), dorsal striatum (Str), medial prefrontal cortex (mPFC), and orbitofrontal cortex (OFC) isolated from individual rats. Vmax for DAT in NAc and for SERT in OFC were positively correlated with negative urgency scores. The current findings suggest that mood-based impulsivity (negative urgency) is associated with enhanced DAT function in NAc and SERT function in OFC.

Effect of lithium on behavioral disinhibition induced by electrolytic lesion of the median raphe nucleus

RATIONALE

Alterations in brainstem circuits have been proposed as a possible mechanism underlying the etiology of mood disorders. Projections from the median raphe nucleus (MnR) modulate dopaminergic activity in the forebrain and are also part of a behavioral disinhibition/inhibition system that produces phenotypes resembling behavioral variations manifested during manic and depressive phases of bipolar disorder.

OBJECTIVE

The aim of this study is to assess the effect of chronic lithium treatment on behavioral disinhibition induced by MnR lesions.

METHODS

MnR electrolytic lesions were performed in C57BL/6J mice, with sham-operated and intact animals as control groups. Following recovery, mice were chronically treated with lithium (LiCl, added in chow) followed by behavioral testing.

RESULTS

MnR lesion induced manic-like behavioral alterations including hyperactivity in the open field (OF), stereotyped circling, anxiolytic/risk taking in the elevated plus maze (EPM) and light/dark box (LDB) tests, and increased basal body temperature. Lithium was specifically effective in reducing OF hyperactivity and stereotypy but did not reverse (EPM) or had a nonspecific effect (LDB) on anxiety/risk-taking measures. Additionally, lithium decreased saccharin preference and prevented weight loss during single housing.

CONCLUSIONS

Our data support electrolytic lesions of the MnR as an experimental model of a hyper-excitable/disinhibited phenotype consistent with some aspects of mania that are attenuated by the mood stabilizer lithium. Given lithium's relatively specific efficacy in treating mania, these data support the hypothesis that manic symptoms derive not only from the stimulation of excitatory systems but also from inactivation or decreased activity of inhibitory mechanisms.

Effects of acute and repeated nicotine administration on delay discounting in Lewis and Fischer 344 rats

Biological differences may underlie individual differences in impulsive behavior, such as choice for a smaller, more immediate reinforcer over a larger, more delayed reinforcer. Repeated exposure to drugs of abuse may have different effects on such behavior. To evaluate the acute and repeated effects of nicotine on impulsive choice, two strains of rats that have been shown to differ in impulsive choice were tested in a delay-discounting paradigm. Eight Lewis and eight Fischer 344 rats were allowed to choose between one food pellet delivered immediately and three food pellets delivered after a delay. The delay systematically increased in blocks of trials within each session, and the delay value at which the choice for the two alternatives was equal (i.e. the indifference point) was interpolated. Effects of nicotine (0.1-1.0 mg/kg, subcutaneous) on percent choice and indifference points were determined during the acute-testing phase and during the redetermination of effects of each dose after at least 30 sessions of repeated 1.0 mg/kg nicotine exposure. The Lewis rats had shorter indifference points (i.e. made fewer larger-reinforcer choices) compared with the Fischer 344 rats. Acute nicotine administration increased the mean larger-reinforcer choices at the 0.3 mg/kg dose in the Lewis rats and at the 1.0 mg/kg dose in the Fischer 344 rats. After repeated exposure to nicotine, indifference points returned to near-baseline (predrug) levels for both the strains. Strain differences were observed in the rates of delay discounting, and nicotine may decrease the impulsive choice acutely, but this effect does not seem to be long lasting.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.

Relatively high motivation for context-evoked reward produces the magnitude effect in rats

Using a concurrent-chain schedule, we demonstrated the effect of absolute reinforcement (i.e., the magnitude effect) on choice behavior in rats. In general, animals' simultaneous choices conform to a relative reinforcement ratio between alternatives. However, studies in pigeons and rats have found that on a concurrent-chain schedule, the overall reinforcement ratio, or absolute amount, also influences choice. The effect of reinforcement amount has also been studied in inter-temporal choice situations, and this effect has been referred to as the magnitude effect. The magnitude effect has been observed in humans under various conditions, but little research has assessed it in animals (e.g., pigeons and rats). The present study confirmed the effect of reinforcement amount in rats during simultaneous and inter-temporal choice situations. We used a concurrent-chain procedure to examine the cause of the magnitude effect during inter-temporal choice. Our results suggest that rats can use differences in reinforcement amount as a contextual cue during choice, and the direction of the magnitude effect in rats might be similar to humans when using the present procedure. Furthermore, our results indicate that the magnitude effect was caused by the initial-link effect when the reinforcement amount was relatively small, while a loss aversion tendency was observed when the reinforcement amount changed within a session. The emergence of the initial-link effect and loss aversion suggests that rats make choices through cognitive processes predicted by prospect theory.

Sex-dependent impacts of low-level lead exposure and prenatal stress on impulsive choice behavior and associated biochemical and neurochemical manifestations

A prior study demonstrated increased overall response rates on a fixed interval (FI) schedule of reward in female offspring that had been subjected to maternal lead (Pb) exposure, prenatal stress (PS) and offspring stress challenge relative to control, prenatal stress alone, lead alone and lead+prenatal stress alone (Virgolini et al., 2008). Response rates on FI schedules have been shown to directly relate to measures of self-control (impulsivity) in children and in infants (Darcheville et al., 1992, 1993). The current study sought to determine whether enhanced effects of Pb±PS would therefore be seen in a more direct measure of impulsive choice behavior, i.e., a delay discounting paradigm. Offspring of dams exposed to 0 or 50ppm Pb acetate from 2 to 3 months prior to breeding through lactation, with or without immobilization restraint stress (PS) on gestational days 16 and 17, were trained on a delay discounting paradigm that offered a choice between a large reward (three 45mg food pellets) after a long delay or a small reward (one 45mg food pellet) after a short delay, with the long delay value increased from 0s to 30s across sessions. Alterations in extinction of this performance, and its subsequent re-acquisition after reinforcement delivery was reinstated were also examined. Brains of littermates of behaviorally-trained offspring were utilized to examine corresponding changes in monoamines and in levels of brain derived neurotrophic factor (BDNF), the serotonin transporter (SERT) and the N-methyl-d-aspartate receptor (NMDAR) 2A in brain regions associated with impulsive choice behavior. Results showed that Pb±PS-induced changes in delay discounting occurred almost exclusively in males. In addition to increasing percent long delay responding at the indifference point (i.e., reduced impulsive choice behavior), Pb±PS slowed acquisition of delayed discounting performance, and increased numbers of both failures to and latencies to initiate trials. Overall, the profile of these alterations were more consistent with impaired learning/behavioral flexibility and/or with enhanced sensitivity to the downshift in reward opportunities imposed by the transition from delay discounting training conditions to delay discounting choice response contingencies. Consistent with these behavioral changes, Pb±PS treated males also showed reductions in brain serotonin function in all mesocorticolimbic regions, broad monoamine changes in nucleus accumbens, and reductions in both BDNF and NMDAR 2A levels and increases in SERT in frontal cortex, i.e., in regions and neurotransmitter systems known to mediate learning/behavioral flexibility, and which were of greater impact in males. The current findings do not fully support a generality of the enhancement of Pb effects by PS, as previously seen with FI performance in females (Virgolini et al., 2008), and suggest a dissociation of the behaviors controlled by FI and delay discounting paradigms, at least in response to Pb±PS in rats. Collectively, however, the findings remain consistent with sex-dependent differences in the impacts of both Pb and PS and with the need to understand both the role of contingencies of reinforcement and underlying neurobiological effects in these sex differences.

Role of medial prefrontal and orbitofrontal monoamine transporters and receptors in performance in an adjusting delay discounting procedure

Performance in an adjusting delay discounting procedure is predictive of drug abuse vulnerability; however, the shared underlying specific prefrontal neural systems linking delay discounting and increased addiction-like behaviors are unclear. Rats received direct infusions of methylphenidate (MPH; 6.25, 25.0, or 100μg), amphetamine (AMPH; 0.25, 1.0, or 4.0μg), or atomoxetine (ATO; 1.0, 4.0, or 16.0μg) into either medial prefrontal cortex (mPFC) or orbitofrontal cortex (OFC) immediately prior to performance in an adjusting delay task. These drugs were examined because they are efficacious in treating impulse control disorders. Because dopamine (DA) and serotonin (5-HT) receptors are implicated in impulsive behavior, separate groups of rats received microinfusions of the DA receptor-selective drugs SKF 81297 (0.1 or 0.4µg), SCH 23390 (0.25 or 1.0µg), quinpirole (1.25 or 5.0µg), and eticlopride (0.25 or 1.0µg), or received microinfusions of the 5-HT receptor-selective drugs 8-OH-DPAT (0.025 or 0.1μg), WAY 100635 (0.01 or 0.04μg), DOI (2.5 or 10.0μg), and ketanserin (0.1 or 0.4μg). Impulsive choice was not altered significantly by MPH, AMPH, or ATO into either mPFC or OFC, indicating that neither of these prefrontal regions alone may mediate the systemic effect of ADHD medications on impulsive choice. However, quinpriole (1.25μg) and eticlopride infused into mPFC increased impulsive choice, whereas 8-OH-DPAT infused into OFC decreased impulsive choice. These latter results demonstrate that blockade of DA D2 receptors in mPFC or activation of 5-HT1A receptors in OFC increases impulsive choice in the adjusting delay procedure.

Nonhuman gamblers: lessons from rodents, primates, and robots

The search for neuronal and psychological underpinnings of pathological gambling in humans would benefit from investigating related phenomena also outside of our species. In this paper, we present a survey of studies in three widely different populations of agents, namely rodents, non-human primates, and robots. Each of these populations offers valuable and complementary insights on the topic, as the literature demonstrates. In addition, we highlight the deep and complex connections between relevant results across these different areas of research (i.e., cognitive and computational neuroscience, neuroethology, cognitive primatology, neuropsychiatry, evolutionary robotics), to make the case for a greater degree of methodological integration in future studies on pathological gambling.

Dissociations between interval timing and intertemporal choice following administration of fluoxetine, cocaine, or methamphetamine

The goal of our study was to characterize the relationship between intertemporal choice and interval timing, including determining how drugs that modulate brain serotonin and dopamine levels influence these two processes. In Experiment 1, rats were tested on a standard 40-s peak-interval procedure following administration of fluoxetine (3, 5, or 8 mg/kg) or vehicle to assess basic effects on interval timing. In Experiment 2, rats were tested in a novel behavioral paradigm intended to simultaneously examine interval timing and impulsivity. Rats performed a variant of the bi-peak procedure using 10-s and 40-s target durations with an additional "defection" lever that provided the possibility of a small, immediate reward. Timing functions remained relatively intact, and 'patience' across subjects correlated with peak times, indicating a negative relationship between 'patience' and clock speed. We next examined the effects of fluoxetine (5 mg/kg), cocaine (15 mg/kg), or methamphetamine (1 mg/kg) on task performance. Fluoxetine reduced impulsivity as measured by defection time without corresponding changes in clock speed. In contrast, cocaine and methamphetamine both increased impulsivity and clock speed. Thus, variations in timing may mediate intertemporal choice via dopaminergic inputs. However, a separate, serotonergic system can affect intertemporal choice without affecting interval timing directly. This article is part of a Special Issue entitled: Associative and Temporal Learning.

How the cerebral serotonin homeostasis predicts environmental changes: a model to explain seasonal changes of brain 5-HTT as intermediate phenotype of the 5-HTTLPR

Molecular imaging studies with positron emission tomography have revealed that the availability of serotonin transporter (5-HTT) in the human brain fluctuates over the course of the year. This effect is most pronounced in carriers of the short allele of the 5-HTT promoter region (5-HTTLPR), which has in several previous studies been linked to an increased risk to develop mood disorders. We argue that long-lasting fluctuations in the cerebral serotonin transmission, which is regulated via the 5-HTT, are responsible for mediating responses to environmental changes based on an assessment of the expected "safety" of the environment; this response is obtained in part through serotonergic modulation of the hypothalamic-pituitary-adrenal (HPA) axis. We posit that the intermediate phenotype of the s-allele may properly be understood as mediating a trade-off, wherein increased responsiveness of cerebral serotonin transmission to seasonal and other forms of environmental change imparts greater behavioral flexibility, at the expense of increased vulnerability to stress. This model may explain the somewhat higher prevalence of the s-allele in some human populations dwelling at geographic latitudes with pronounced seasonal climatic changes, while this hypothesis does not rule out that genetic drift plays an additional or even exclusive role. We argue that s-allele manifests as an intermediate phenotype in terms of an increased responsiveness of the 5-HTT expression to number of daylight hours, which may serve as a stable surrogate marker of other environmental factors, such as availability of food and safety of the environment in populations that live closer to the geographic poles.

Lithium, but not valproate, reduces impulsive choice in the delay-discounting task in mice

Both lithium and valproate are well-established treatments for bipolar disorder. Studies have also found that lithium is effective at reducing suicidal behaviors in patients with mood disorders. Impulsivity is a validated endophenotype of both bipolar disorder and suicidal behavior. We assessed effects of treatment with lithium or valproate on cognitive impulsivity in selectively bred mice previously shown to manifest relatively high levels of cognitive impulsivity. Mice were trained in the delay-discounting paradigm, a measure of cognitive impulsivity reflecting a behavioral bias towards immediacy, and then treated with lithium, valproate, or control chow. After 3 weeks of drug treatment, mice were tested at various delays to a large, delayed reward. Drug treatment continued during this time. Lithium reduced impulsivity, whereas valproate had no effect on choice behavior. Both drugs increased the number of choice trials and reinforcer intake, but effects on choice behavior did not depend on these motivational changes. To our knowledge, this is the first study demonstrating lithium's effects to reduce cognitive impulsivity. Future studies may focus on the ability of putative pharmacotherapies for patients at risk for bipolar disorder or suicide to modify the impulsive choice dimension of this diseases.

Behavioural and pharmacological effects of fluvoxamine on decision-making in food patches and the inter-temporal choices of domestic chicks

Behavioural effects of fluvoxamine (FLV, selective serotonin reuptake inhibitor) were examined in 1-2 week old domestic chicks. Chicks were tested in an I-shaped maze equipped with a feeder (ON feeder) that served 1 or 2 grains of millet at gradually increasing intervals, so that a depleting food patch was mimicked. By leaving the feeder, the food delivery program was reset, and chicks gained food at short intervals only after a travel to a dummy feeder (OFF feeder) placed on the opposite side of the maze. Chicks quickly learned to actively shuttle between the ON and the OFF feeders. FLV (intra-peritoneal injection, 20 mg/kg BW) acutely caused chicks to stay longer at the gradually depleting ON feeder. Inter-temporal choices were also tested, whereby two coloured beads were simultaneously presented, each associated with a small/short-delay reward or a large/long-delay alternative. FLV suppressed the choice of the short-delay option. It is suggested that an enhanced level of serotonin (5-HT) makes chicks more tolerant of the delayed food item in both behavioural paradigms. Furthermore, the decision to leave a depleting patch cannot be equated to choosing the long-delay option of the choice paradigm. Furthermore, FLV suppressed work efforts (velocity and running distance) in uncued shuttle and number of distress calls. In vivo microdialysis experiments revealed that FLV enhanced the extracellular concentration of 5-HT as well as dopamine (DA) locally in the medial striatum/nucleus accumbens. Underlying neuromodulatory mechanisms of behavioural control are examined in relation to locomotion, behavioural tolerance and interval timing.

Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation

BACKGROUND/AIMS

In general, humans tend to discount the value of delayed reward. An increase in the rate of discounting leads to an inability to select a delayed reward over a smaller immediate reward (reward-delay impulsivity). Although deficits in the serotonergic system are implicated in this reward-delay impulsivity, there is individual variation in response to serotonin depletion. The aim of the present study was to investigate whether the effects of serotonin depletion on the ability to evaluate future reward are affected by individual personality traits or brain activation.

METHODS

Personality traits were assessed using the NEO-Five Factor Inventory and Temperament and Character Inventory. The central serotonergic levels of 16 healthy volunteers were manipulated by dietary tryptophan depletion. Subjects performed a delayed reward choice task that required the continuous estimation of reward value during functional magnetic resonance imaging scanning.

RESULTS

Discounting rates were increased in 9 participants, but were unchanged or decreased in 7 participants in response to tryptophan depletion. Participants whose discounting rate was increased by tryptophan depletion had significantly higher neuroticism and lower self-directedness. Furthermore, tryptophan depletion differentially affected the groups in terms of hemodynamic responses to the value of predicted future reward in the right insula.

CONCLUSIONS

These results suggest that individuals who have high neuroticism and low self-directedness as personality traits are particularly vulnerable to the effect of low serotonin on future reward evaluation accompanied by altered brain activation patterns.

Dopamine, serotonin and impulsivity

Impulsive people have a strong urge to act without thinking. It is sometimes regarded as a positive trait but rash impulsiveness is also widely present in clinical disorders such as attention deficit hyperactivity disorder (ADHD), drug dependence, mania, and antisocial behaviour. Contemporary research has begun to make major inroads into unravelling the brain mechanisms underlying impulsive behaviour with a prominent focus on the limbic cortico-striatal systems. With this progress has come the understanding that impulsivity is a multi-faceted behavioural trait involving neurally and psychologically diverse elements. We discuss the significance of this heterogeneity for clinical disorders expressing impulsive behaviour and the pivotal contribution made by the brain dopamine and serotonin systems in the aetiology and treatment of behavioural syndromes expressing impulsive symptoms.

The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders

High levels of impulsive behaviours are a clinically significant symptom in a range of psychiatric disorders, such as attention deficit hyperactivity disorder, bipolar disorder, personality disorders, pathological gambling and substance abuse. Although often measured using questionnaire assessments, levels of different types of impulsivity can also be determined using behavioural tests. Rodent analogues of these paradigms have been developed, and similar neural circuitry has been implicated in their performance in both humans and rats. In the current review, the methodology underlying the measurement of different aspects of impulsive action and choice are considered from the viewpoint of drug development, with a focus on the continuous performance task (CPT), stop-signal task (SST), go/no-go and delay-discounting paradigms. Current issues impeding translation between animal and human studies are identified, and comparisons drawn between the acute effects of dopaminergic, noradrenergic and serotonergic compounds across species. Although the field could benefit from a more systematic determination of different pharmacological agents across paradigms, there are signs of strong concordance between the animal and human data. However, the type of impulsivity measured appears to play a significant role, with the SST and delay discounting providing more consistent effects for dopaminergic drugs, while the CPT and SST show better predictive validity so far for serotonergic and noradrenergic compounds. Based on the available data, it would appear that these impulsivity models could be used more widely to identify potential pharmacotherapies for impulse control disorders. Novel targets within the glutamatergic and serotonergic system are also suggested.

Strain differences in delay discounting between Lewis and Fischer 344 rats at baseline and following acute and chronic administration of d-amphetamine

Stimulant drugs have been shown either to increase or decrease rates of delay discounting (impulsive choice). These mixed findings may result from genetic, neurochemical, or environmental factors. Lewis (LEW) and Fischer 344 (F344) rats have neurochemical and behavioral differences that may be relevant to delay discounting and were used to examine effects of acute and chronic administration of d-amphetamine (d-AMP) on impulsive choice using a within-session delay-discounting procedure. Male LEW (n=8) and F344 (n=8) rats chose between one food pellet delivered immediately and three food pellets delivered after an increasing delay. Saline and d-AMP (0.1, 0.3, 1.0, and 1.7 mg/kg) were tested acutely and during chronic d-AMP exposure. Choice for the larger reinforcer decreased as the delay to its presentation increased for both strains at baseline. LEW rats made more impulsive choices than F344 rats as indicated by shorter indifference points, and this is consistent with previous research. Acute administration of d-AMP dose dependently increased larger-reinforcer choice and area under the curve (AUC) for LEW, but not F344 rats. During chronic exposure to d-AMP, larger-reinforcer choice and AUC increased relative to acute administration for F344 rats responding in shorter delay series, but not for F344 rats responding in longer delay series or for LEW rats. Differential effects of acute and chronic administration of d-AMP on impulsive choice in LEW and F344 rats may be a result of various factors, including genetic, neurochemical, and environmental variables. Future research should attempt to tease apart the relative contribution of each of these factors on impulsive choice.

The role of serotonin in the regulation of patience and impulsivity

Classic theories suggest that central serotonergic neurons are involved in the behavioral inhibition that is associated with the prediction of negative rewards or punishment. Failed behavioral inhibition can cause impulsive behaviors. However, the behavioral inhibition that results from predicting punishment is not sufficient to explain some forms of impulsive behavior. In this article, we propose that the forebrain serotonergic system is involved in “waiting to avoid punishment” for future punishments and “waiting to obtain reward” for future rewards. Recently, we have found that serotonergic neurons increase their tonic firing rate when rats await food and water rewards and conditioned reinforcer tones. The rate of tonic firing during the delay period was significantly higher when rats were waiting for rewards than for tones, and rats were unable to wait as long for tones as for rewards. These results suggest that increased serotonergic neuronal firing facilitates waiting behavior when there is the prospect of a forthcoming reward and that serotonergic activation contributes to the patience that allows rats to wait longer. We propose a working hypothesis to explain how the serotonergic system regulates patience while waiting for future rewards.

Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats

RATIONALE

High levels of impulsivity are a core symptom of psychiatric disorders such as ADHD, mania, personality disorders and drug addiction. The effectiveness of drugs targeting dopamine (DA), noradrenaline (NA) and/or serotonin (5-HT) in the treatment of impulse control disorders emphasizes the role of monoaminergic neurotransmission in impulsivity. However, impulsive behavior is behaviorally and neurally heterogeneous, and several caveats remain in our understanding of the role of monoamines in impulse control.

OBJECTIVES

This study aims to investigate the role of DA, NA and 5-HT in two main behavioral dimensions of impulsivity.

METHODS

The effects of selective DA (GBR12909; 2.5-10 mg/kg), NA (atomoxetine; 0.3-3.0 mg/kg) and 5-HT (citalopram; 0.3-3.0 mg/kg) reuptake inhibitors as well as amphetamine (0.25-1.0 mg/kg) were evaluated on impulsive action in the five-choice serial reaction time task (5-CSRTT) and impulsive choice in the delayed reward task (DRT). In the 5-CSRTT, neuropharmacological challenges were performed under baseline and long intertrial interval (ITI) conditions to enhance impulsive behavior in the task.

RESULTS

Amphetamine and GBR12909 increased impulsive action and perseverative responding and decreased accuracy and response latency in the 5-CSRTT. Atomoxetine increased errors of omission and response latency under baseline conditions in the 5-CSRTT. Under a long ITI, atomoxetine also reduced premature and perseverative responding and increased accuracy. Citalopram improved impulse control in the 5-CSRTT. Amphetamine and GBR12909, but not citalopram or atomoxetine, reduced impulsive choice in the DRT.

CONCLUSIONS

Elevation of DA neurotransmission increases impulsive action and reduces impulsive choice. Increasing NA or 5-HT neurotransmission reduces impulsive action.

Chronic atomoxetine treatment during adolescence decreases impulsive choice, but not impulsive action, in adult rats and alters markers of synaptic plasticity in the orbitofrontal cortex

RATIONALE

Impulsivity is a key symptom of attention-deficit hyperactivity disorder (ADHD). The use of the norepinephrine reuptake inhibitor, atomoxetine, to treat ADHD suggests that the activity of the norepinephrine transporter (NET) may be important in regulating impulsive behavior. Many ADHD patients receive chronic drug treatment during adolescence, a time when frontal brain regions important for impulse control are undergoing extensive development.

OBJECTIVES

The current study aimed to determine the effects of chronic atomoxetine treatment during adolescence in rats on two distinct forms of impulsivity in adulthood and whether any behavioral changes were accompanied by alterations in mRNA or protein levels within the frontal cortices.

METHODS

Rats received daily injections of saline or atomoxetine (1 mg/kg) during adolescence (postnatal days 40-54). Two weeks later, animals were trained to perform either the delay-discounting test or the five-choice serial reaction time task (5CSRT).

RESULTS

Adolescent atomoxetine treatment caused a stable decrease in selection of small immediate rewards over larger delayed rewards (impulsive choice) in adulthood, but did not affect premature responding (impulsive action) in the 5CSRT. Chronic atomoxetine treatment also altered the ability of acute atomoxetine to modulate aspects of impulsivity, but did not change the response to d-amphetamine. Ex vivo analysis of brain tissue indicated that chronic atomoxetine decreased phosphorylation of CREB and ERK in the orbitofrontal cortex and decreased mRNA for BDNF and cdk5.

CONCLUSIONS

These data suggest that repeated administration of atomoxetine in adolescence can lead to stable decreases in impulsive choice during adulthood, potentially via modulating development of the orbitofrontal cortex.

Impact of size and delay on neural activity in the rat limbic corticostriatal system

A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level.

A neural correlate of predicted and actual reward-value information in monkey pedunculopontine tegmental and dorsal raphe nucleus during saccade tasks

Dopamine, acetylcholine, and serotonin, the main modulators of the central nervous system, have been proposed to play important roles in the execution of movement, control of several forms of attentional behavior, and reinforcement learning. While the response pattern of midbrain dopaminergic neurons and its specific role in reinforcement learning have been revealed, the role of the other neuromodulators remains rather elusive. Here, we review our recent studies using extracellular recording from neurons in the pedunculopontine tegmental nucleus, where many cholinergic neurons exist, and the dorsal raphe nucleus, where many serotonergic neurons exist, while monkeys performed eye movement tasks to obtain different reward values. The firing patterns of these neurons are often tonic throughout the task period, while dopaminergic neurons exhibited a phasic activity pattern to the task event. The different modulation patterns, together with the activity of dopaminergic neurons, reveal dynamic information processing between these different neuromodulator systems.

Transitional and steady-state choice behavior under an adjusting-delay schedule

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.