Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders

Pharmacotherapies for decreasing maladaptive choice in drug addiction: Targeting the behavior and the drug

Drug addiction can be conceptualized as a disorder of maladaptive decision making in which drugs are chosen at the expense of pro-social, nondrug alternatives. The study of decision making in drug addiction has focused largely on the role of impulsivity as a facilitator of addiction, in particular the tendency for drug abusers to choose small, immediate gains over larger but delayed outcomes (i.e., delay discounting). A parallel line of work, also focused on decision making in drug addiction, has focused on identifying the determinants underlying the choice to take drugs over nondrug alternatives (i.e., drug vs. nondrug choice). Both tracks of research have been valuable tools in the development of pharmacotherapies for treating maladaptive decision making in drug addiction, and a number of common drugs have been studied in both designs. However, we have observed that there is little uniformity in the administration regimens of potential treatments between the designs, which hinders congruence in the development of single treatment strategies to reduce both impulsive behavior and drug choice. The current review provides an overview of the drugs that have been tested in both delay-discounting and drug-choice designs, and focuses on drugs that reduced the maladaptive choice in both designs. Suggestions to enhance congruence between the findings in future studies are provided. Finally, we propose the use of a hybridized, experimental approach that may enable researchers to test the effectiveness of therapeutics at decreasing impulsive and drug choice in a single design.

Ant1 mutant mice bridge the mitochondrial and serotonergic dysfunctions in bipolar disorder

Although mitochondrial and serotonergic dysfunctions have been implicated in the etiology of bipolar disorder (BD), the relationship between these unrelated pathways has not been elucidated. A family of BD and chronic progressive external ophthalmoplegia (CPEO) caused by a mutation of the mitochondrial adenine nucleotide translocator 1 (ANT1, SLC25A4) implicated that ANT1 mutations confer a risk of BD. Here, we sequenced ANT1 in 324 probands of NIMH bipolar disorder pedigrees and identified two BD patients carrying heterozygous loss-of-function mutations. Behavioral analysis of brain specific Ant1 heterozygous conditional knockout (cKO) mice using lntelliCage showed a selective diminution in delay discounting. Delay discounting is the choice of smaller but immediate reward than larger but delayed reward and an index of impulsivity. Diminution of delay discounting suggests an increase in serotonergic activity. This finding was replicated by a 5-choice serial reaction time test. An anatomical screen showed accumulation of COX (cytochrome c oxidase) negative cells in dorsal raphe. Dorsal raphe neurons in the heterozygous cKO showed hyperexcitability, along with enhanced serotonin turnover in the nucleus accumbens and upregulation of Maob in dorsal raphe. These findings altogether suggest that mitochondrial dysfunction as the genetic risk of BD may cause vulnerability to BD by altering serotonergic neurotransmission.

Dorsal Raphe Serotonergic Neurons Control Intertemporal Choice under Trade-off

Appropriate choice about delayed reward is fundamental to the survival of animals. Although animals tend to prefer immediate reward, delaying gratification is often advantageous. The dorsal raphe (DR) serotonergic neurons have long been implicated in the processing of delayed reward, but it has been unclear whether or when their activity causally directs choice. Here, we transiently augmented or reduced the activity of DR serotonergic neurons, while mice decided between differently delayed rewards as they performed a novel odor-guided intertemporal choice task. We found that these manipulations, precisely targeted at the decision point, were sufficient to bidirectionally influence impulsive choice. The manipulation specifically affected choices with more difficult trade-off. Similar effects were observed when we manipulated the serotonergic projections to the nucleus accumbens (NAc). We propose that DR serotonergic neurons preempt reward delays at the decision point and play a critical role in suppressing impulsive choice by regulating decision trade-off.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

Mirtazapine and ketanserin alter preference for gambling-like schedules of reinforcement in rats

Drug and behavioral addictions have overlapping features, e.g., both manifest preference for larger, albeit costlier, reinforcement options in cost/benefit decision-making tasks. Our prior work revealed that the mixed-function serotonergic compound, mirtazapine, attenuates behaviors by rats motivated by abused drugs. To extend this work to behavioral addictions, here we determined if mirtazapine and/or ketanserin, another mixed-function serotonin-acting compound, can alter decision-making in rats that is independent of drug (or food)-motivated reward. Accordingly, we developed a novel variable-ratio task in rats wherein intracranial self-stimulation was used as the positive reinforcer. Using lever pressing for various levels of brain stimulation, the operant task provided choices between a small brain stimulation current delivered on a fixed-ratio schedule (i.e., a predictable reward) and a large brain stimulation delivered following an unpredictable number of responses (i.e., a variable-ratio schedule). This task allowed for demonstration of individualized preference and detection of shifts in motivational influences during a pharmacological treatment. Once baseline preference was established, we determined that pretreatment with mirtazapine or ketanserin significantly decreased preference for the large reinforcer presented after gambling-like schedules of reinforcement. When the rats were tested the next day without drug, preference for the unpredictable large reinforcer option was restored. These data demonstrate that mirtazapine and ketanserin can reduce preference for larger, costlier reinforcement options, and illustrate the potential for these drugs to alter behavior.

Increased temporal discounting after chronic stress in CHL1-deficient mice is reversed by 5-HT2C agonist Ro 60-0175

Schizophrenia is a neurodevelopmental disorder in which impaired decision-making and goal-directed behaviors are core features. One of the genes associated with schizophrenia is the Close Homolog of L1 (CHL1); CHL1-deficient mice are considered a model of schizophrenia-like deficits, including sensorimotor gating, interval timing and spatial memory impairments. Here we investigated temporal discounting in CHL1-deficient (KO) mice and their wild-type littermates. Although no discounting differences were found under baseline conditions, CHL1-KO mice showed increased impulsive choice following chronic unpredictable stress (fewer % larger-later choices, and reduced area under the discounting curve). Stressed CHL1-KO mice also showed decreased neuronal activation (number of cFos positive neurons) in the discounting task in the prelimbic cortex and dorsal striatum, areas thought to be part of executive and temporal processing circuits. Impulsive choice alterations were reversed by the 5-HT2C agonist Ro 60-0175. Our results provide evidence for a gene x environment, double-hit model of stress-related decision-making impairments, and identify CHL1-deficient mice as a mouse model for these deficits in regard to schizophrenia-like phenotypes.

Investigation of impulsivity in binge-eating rats in a delay-discounting task and its prevention by the d-amphetamine prodrug, lisdexamfetamine

Freely-fed, female, rats were trained in a two-lever, delay-discounting task: one lever delivered a single chocolate-flavoured pellet immediately and the other a three-pellet reward after increasing delay (0, 4, 8, 16, 32 s). Rats were divided into two groups (i.e. binge-eating rats given irregular, limited access to chocolate in addition to normal chow and controls maintained on normal chow). Both groups exhibited increased preference for the immediate reward as the delay interval was lengthened. The discounting rate was significantly greater in binge-eating rats than non-binge-eating controls, especially as the behaviour became more established indicating that increased impulsivity and intolerance of delayed reward are part of the psychopathology of binge-eating. Lisdexamfetamine (0.8 mg/kg, orally ( d-amphetamine base)) reversed the reduced preference of binge-eating rats for larger rewards at delay intervals of 4 s, 8 s and 32 s and across all sessions. Lisdexamfetamine-treated binge-eating rats consumed the same number of pellets as vehicle-treated, binge-eating rats and non-binge-eating controls eliminating the possibility lisdexamfetamine's actions on appetite or satiety mediated its effects on operant responding for food pellets in delay-discounting. In summary, binge-eating rats showed increased impulsive choice compared with non-binge-eating controls that was reversed by lisdexamfetamine, complementing results showing lisdexamfetamine reduced impulsiveness scores in patients with binge-eating disorder.

Frontal Traumatic Brain Injury Increases Impulsive Decision Making in Rats: A Potential Role for the Inflammatory Cytokine Interleukin-12

Traumatic brain injury (TBI) is associated with the development of numerous psychiatric diseases. Of particular concern for TBI patients is the impact of chronic impulsivity on daily functioning. Despite the scope of the human problem, little has been done to address impulsivity in animal models of brain injury. In the current study, we examined the effects of either a severe or a milder bilateral frontal controlled cortical impact injury on impulsivity using the Delay Discounting Task (DDT), in which preference for smaller-sooner over larger-later rewards is indicative of greater impulsive choice. Both milder and severe TBI caused a significant, chronic increase in impulsive decision making. Despite these pronounced changes in performance of the DDT, memory function, as assessed by the Morris Water Maze, was not impaired in more mildly injured rats and only transiently impacted in the severe TBI group. Whereas a significant lesion was only evident in severely injured rats, analysis of cytokine levels within the frontal cortex revealed a selective increase in interleukin (IL)-12 that was associated with the magnitude of the change in impulsive choice caused by both milder and severe TBI. These findings suggest that tissue loss alone cannot explain the increased impulsivity observed, and that inflammatory pathways mediated by IL-12 may be a contributing factor. The findings from this study highlight the sensitivity of sophisticated behavioral measures designed to assess neuropsychiatric dysfunction in the detection of TBI-induced cognitive impairments and their utility in identifying potential mechanistic pathways and therapeutic targets.

Fatigue modulates dopamine availability and promotes flexible choice reversals during decision making

During decisions, animals balance goal achievement and effort management. Despite physical exercise and fatigue significantly affecting the levels of effort that an animal exerts to obtain a reward, their role in effort-based choice and the underlying neurochemistry are incompletely known. In particular, it is unclear whether fatigue influences decision (cost-benefit) strategies flexibly or only post-decision action execution and learning. To answer this question, we trained mice on a T-maze task in which they chose between a high-cost, high-reward arm (HR), which included a barrier, and a low-cost, low-reward arm (LR), with no barrier. The animals were parametrically fatigued immediately before the behavioural tasks by running on a treadmill. We report a sharp choice reversal, from the HR to LR arm, at 80% of their peak workload (PW), which was temporary and specific, as the mice returned to choose the HC when the animals were successively tested at 60% PW or in a two-barrier task. These rapid reversals are signatures of flexible choice. We also observed increased subcortical dopamine levels in fatigued mice: a marker of individual bias to use model-based control in humans. Our results indicate that fatigue levels can be incorporated in flexible cost-benefits computations that improve foraging efficiency.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Differential effects of cannabinoid CB1 inverse agonists and antagonists on impulsivity in male Sprague Dawley rats: identification of a possibly clinically relevant vulnerability involving the serotonin 5HT1A receptor

RATIONALE

Cannabinoid CB1 inverse agonists hold therapeutic promise as appetite suppressants but have produced suicidal behaviors among a small subpopulation in clinical trials. Anatomical and pharmacological evidence implicate the 5HT_1A serotonin receptor in suicide in humans and impulsivity in humans and animals.

OBJECTIVE

The objective of the study is to assess whether 5HT_1A blockade is necessary for CB1 ligands to produce impulsivity.

METHODS

Sprague Dawley rats were administered the CB1 inverse agonist AM 251, the CB1 antagonist AM 6527, or the peripherally restricted antagonist AM 6545, with or without pretreatment with the 5HT_1A antagonist WAY 100,635 (WAY) on the paced fixed consecutive number (FCN) task, which measures choice to terminate a chain of responses prematurely. As FCN is sensitive to changes in time perception, which have been demonstrated with CB1 blockade, a novel variable consecutive number task with discriminative stimulus (VCN-S _D ) was also performed and proposed to be less sensitive to changes in timing.

RESULTS

Pretreatment with WAY enabled mild but significant reductions in FCN accuracy for AM 251 and AM 6527. No effects were found for AM 6545. On the VCN-S _D task, substantial impairments were found for the combination of WAY and AM 251.

CONCLUSIONS

AM 251, but not the antagonists AM 6527 or AM 6545, produced impulsivity only following systemic 5HT_1A blockade. Although preliminary, the results may indicate that disrupted serotonin signaling produces a vulnerability to undesirable effects of CB1 inverse agonists, which is not evident in the general population. Furthermore, neutral CB1 antagonists do not produce this effect and therefore may have greater safety.

Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure

RATIONALE

The N-methyl-D-aspartate (NMDA) receptor has been recently identified as an important mediator of impulsive choice, as assessed in delay discounting. Although discounting is independently influenced by sensitivity to reinforcer magnitude and delayed reinforcement, few studies have examined how NMDA receptor ligands differentially affect these parameters.

OBJECTIVES

The current study examined the effects of various NMDA receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure.

METHODS

Following behavioral training, rats received treatments of the following NMDA receptor ligands: the uncompetitive antagonists ketamine (0, 1.0, 5.0, or 10.0 mg/kg; i.p.), MK-801 (0, 0.003, 0.01, or 0.03 mg/kg; s.c.), and memantine (0, 2.5, 5.0, or 10.0 mg/kg; i.p.), the competitive antagonist CGS 19755 (0, 5.0, 10.0, or 20.0 mg/kg; s.c.), the non-competitive NR2B subunit-selective antagonist ifenprodil (0, 1.0, 3.0, or 10.0 mg/kg; i.p), and the partial agonist D-cycloserine (0, 3.25, 15.0, or 30.0 mg/kg; s.c.).

RESULTS

When an exponential model was used to describe discounting, CGS 19755 (5.0 mg/kg) increased impulsive choice without altering sensitivity to reinforcer magnitude. Conversely, ketamine (10.0 mg/kg), memantine (5.0 mg/kg), and ifenprodil (10.0 mg/kg) decreased sensitivity to reinforcer magnitude without altering impulsive choice. MK-801 and D-cycloserine did not alter delay-discounting performance, although two-way ANOVA analyses indicated D-cycloserine (15.0 mg/kg) decreased impulsive choice.

CONCLUSIONS

The behavioral changes observed in delay discounting following administration of NMDA receptor antagonists do not always reflect an alteration in impulsive choice. These results emphasize the utility in employing quantitative methods to assess drug effects in delay discounting.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

Effects of nucleus accumbens amphetamine administration on performance in a delay discounting task

Chronic administration of cocaine can cause pronounced and enduring cognitive alterations such as increases in impulsive choice. Chronic cocaine can also result in enhanced dopamine (DA) release in the nucleus accumbens (NAc) in response to reward-related cues. It is possible that this enhanced DA release in the NAc is a mechanism by which cocaine increases impulsive choice. To date, however, the specific role of DA in the NAc in impulsive choice is unclear. To begin to address this, rats received acute microinjections of the indirect DA agonist amphetamine directly into the NAc prior to testing in a delay discounting task in which rats chose between a small, immediate and a large, delayed food reward. When delays to the large reward increased within test sessions, amphetamine increased choice of the large reward. When delays decreased within test sessions, however, amphetamine decreased choice of the large reward. These findings suggest that, rather than specifically mediating impulsive choice, DA neurotransmission in the NAc is necessary for flexible adaptation of choice strategies in the presence of shifting reward contingencies. These results further indicate that enhancements in NAc DA release likely do not account for lasting increases in impulsive choice caused by chronic cocaine.

The Neurobiological Mechanisms of Gamma-Hydroxybutyrate Dependence and Withdrawal and Their Clinical Relevance: A Review

OBJECTIVE

x03B3;-Hydroxybutyrate (GHB) has gained popularity as a drug of abuse. In the Netherlands the number of patients in treatment for GHB dependence has increased sharply. Clinical presentation of GHB withdrawal can be life threatening. We aim, through this overview, to explore the neurobiological pathways causing GHB dependency and withdrawal, and their implications for treatment choices.

METHODS

In this work we review the literature discussing the findings from animal models to clinical studies focused on the neurobiological pathways of endogenous but mainly exogenous GHB.

RESULTS

Chronic abuse of GHB exerts multifarious neurotransmitter and neuromodulator effects on x03B3;-aminobutyric acid (GABA), glutamate, dopamine, serotonin, norepinephrine and cholinergic systems. Moreover, important effects on neurosteroidogenesis and oxytocin release are wielded. GHB acts mainly via a bidirectional effect on GABAB receptors (GABABR; subunits GABAB1 and GABAB2), depending on the subunit of the GIRK (G-protein-dependent ion inwardly rectifying potassium) channel involved, and an indirect effect of the cortical and limbic inputs outside the nucleus accumbens. GHB also activates a specific GHB receptor and β1-subunits of α4-GABAAR. Reversing this complex interaction of neurobiological mechanisms by the abrupt cessation of GHB use results in a withdrawal syndrome with a diversity of symptoms of different intensity, depending on the pattern of GHB abuse.

CONCLUSION

The GHB withdrawal symptoms cannot be related to a single mechanism or neurological pathway, which implies that different medication combinations are needed for treatment. A single drug class, such as benzodiazepines, gabapentin or antipsychotics, is unlikely to be sufficient to avoid life-threatening complications. Detoxification by means of titration and tapering of pharmaceutical GHB can be considered as a promising treatment that could make polypharmacy redundant.

Effect of a human serotonin 5-HT2A receptor gene polymorphism on impulsivity: Dependence on cholesterol levels

BACKGROUND

Impulsivity is multidimensional: Low impulse control may result in behavioural disorders, but acting on the spur of moment may also be advantageous. Previous studies have shown negative associations between different facets of impulsivity and serotonergic function. Other investigations have found negative correlations between serum lipid levels and impulsivity.

METHODS

We have investigated whether the functional polymorphism -1438A/G in the serotonin 5-HT_2A receptor gene (HTR2A) is associated with impulsivity levels and whether there is any interaction with serum lipid levels. This analysis was based on data of the population-representative Estonian Children Personality Behaviour and Health Study at age 25. Impulsivity was self-reported with the Adaptive and Maladaptive Impulsivity Scale.

RESULTS

Subjects with the A/A genotype of the HTR2A -1438A/G polymorphism had higher scores of Maladaptive impulsivity, but not Adaptive impulsivity. In females, high LDL and total cholesterol levels increased the genotype effect. In males, in the highest quartile of total or LDL cholesterol the genotype effect was altered, with G/G homozygotes having the highest Maladaptive impulsivity levels.

LIMITATIONS

Only one cohort of the European Youth Heart Study (EYHS) was used in the current study and impulsivity measures were self-reported.

CONCLUSIONS

Our results do not support the notion that low cholesterol levels universally lead to higher impulsivity, but it was found that high total and LDL cholesterol levels moderate the effect of the HTR2A gene promoter polymorphism. This suggests that future studies on impulsivity need to consider the interaction of serotonergic measures with the whole range of cholesterol levels.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

Effects of striatal lesions on components of choice: Reward discrimination, preference, and relative valuation

The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relative valuation in both the single and multi-option week studies. A major factor involved in these deficits was a significant aversion to the multi-option that contained a larger outcome option but with a longer delay to reward. Dorsal striatal lesions caused less impairment even leading to enhanced choice behavior compared to control animals during the more difficult multi-option free choice series. Overall, the results suggest that the context of action is crucial when linking striatal function to choice behavior and its diverse components. The implications include the idea that striatal involvement in decision-making is increased when responses are self-paced and diverse in a more naturalistic environment.

Enhanced attention and impulsive action following NMDA receptor GluN2B-selective antagonist pretreatment

NMDA GluN2B (NR2B) subtype selective antagonists are currently in clinical development for a variety of indications, including major depression. We previously reported the selective NMDA GluN2B antagonists Ro 63-1908 and traxoprodil, increase premature responding in a 5-choice serial reaction time task (5-CSRTT) suggesting an effect on impulsive action. The present studies extend these investigations to a Go-NoGo and delay discounting task, and the 5-CSRTT under test conditions of both regular (5s) and short (2-5s) multiple ITI (Intertrial interval). Dizocilpine was included for comparison. Both Ro 63-1908 (0.1-1mg/kg SC) and traxoprodil (0.3-3mg/kg SC) increased premature and perseverative responses in both 5-CSRT tasks and improved attention when tested under a short ITI test condition. Ro 63-1908 but not traxoprodil increased motor impulsivity (false alarms) in a Go-NoGo task. Dizocilpine (0.01-0.06mg/kg SC) affected both measures of motor impulsivity and marginally improved attention. In a delay discounting test of impulsive choice, both dizocilpine and Ro 63-1908 decreased impulsive choice (increased choice for the larger, delayed reward), while traxoprodil showed a similar trend. Motor stimulant effects were evident following Ro 63-1908, but not traxoprodil treatment - although no signs of motor stereotypy characteristic of dizocilpine (>0.1mg/kg) were noted. The findings of both NMDA GluN2B antagonists affecting measures of impulsive action and compulsive behavior may underpin emerging evidence to suggest glutamate signaling through the NMDA GluN2B receptor plays an important role in behavioural flexibility. The profiles between Ro 63-1908 and traxoprodil were not identical, perhaps suggesting differences between members of this drug class.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

Nucleus accumbens D2R cells signal prior outcomes and control risky decision-making

A marked bias towards risk aversion has been observed in nearly every species tested. A minority of individuals, however, instead seem to prefer risk (repeatedly choosing uncertain large rewards over certain but smaller rewards), and even risk-averse individuals sometimes opt for riskier alternatives. It is not known how neural activity underlies such important shifts in decision-making--either as a stable trait across individuals or at the level of variability within individuals. Here we describe a model of risk-preference in rats, in which stable individual differences, trial-by-trial choices, and responses to pharmacological agents all parallel human behaviour. By combining new genetic targeting strategies with optical recording of neural activity during behaviour in this model, we identify relevant temporally specific signals from a genetically and anatomically defined population of neurons. This activity occurred within dopamine receptor type-2 (D2R)-expressing cells in the nucleus accumbens (NAc), signalled unfavourable outcomes from the recent past at a time appropriate for influencing subsequent decisions, and also predicted subsequent choices made. Having uncovered this naturally occurring neural correlate of risk selection, we then mimicked the temporally specific signal with optogenetic control during decision-making and demonstrated its causal effect in driving risk-preference. Specifically, risk-preferring rats could be instantaneously converted to risk-averse rats with precisely timed phasic stimulation of NAc D2R cells. These findings suggest that individual differences in risk-preference, as well as real-time risky decision-making, can be largely explained by the encoding in D2R-expressing NAc cells of prior unfavourable outcomes during decision-making.

Temperament and arousal systems: A new synthesis of differential psychology and functional neurochemistry

This paper critically reviews the unidimensional construct of General Arousal as utilised by models of temperament in differential psychology for example, to underlie 'Extraversion'. Evidence suggests that specialization within monoamine neurotransmitter systems contrasts with the attribution of a "general arousal" of the Ascending Reticular Activating System. Experimental findings show specialized roles of noradrenaline, dopamine, and serotonin systems in hypothetically mediating three complementary forms of arousal that are similar to three functional blocks described in classical models of behaviour within kinesiology, clinical neuropsychology, psychophysiology and temperament research. In spite of functional diversity of monoamine receptors, we suggest that their functionality can be classified using three universal aspects of actions related to expansion, to selection-integration and to maintenance of chosen behavioural alternatives. Monoamine systems also differentially regulate analytic vs. routine aspects of activities at cortical and striatal neural levels. A convergence between main temperament models in terms of traits related to described functional aspects of behavioural arousal also supports the idea of differentiation between these aspects analysed here in a functional perspective.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Methamphetamine-, d-Amphetamine-, and p-Chloroamphetamine-Induced Neurotoxicity Differentially Effect Impulsive Responding on the Stop-Signal Task in Rats

Abused amphetamines, such as d-amphetamine (AMPH) and methamphetamine (METH), are highly addictive and destructive to health and productive lifestyles. The abuse of these drugs is associated with impulsive behavior, which is likely to contribute to addiction. The amphetamines also differentially damage dopamine (DA) and serotonin (5-HT) systems, which regulate impulsive behavior; therefore, exposure to these drugs may differentially alter impulsive behavior to effect the progression of addiction. We examined the impact of neurotoxicity induced by three amphetamines on impulsive action using a stop-signal task in rats. Animals were rewarded with a food pellet after lever pressing (i.e., a go trial), unless an auditory cue was presented and withholding lever press gained reward (i.e., a stop trial). Animals were trained on the task and then exposed to a neurotoxic regimen of either AMPH, p-chloroamphetamine (PCA), or METH. These regimens preferentially reduced DA transporter levels in striatum, 5-HT transporter levels in prefrontal cortex, or both, respectively. Assessment of performance on the stop-signal task beginning 1 week after the treatment revealed that AMPH produced a deficit in go-trial performance, whereas PCA did not alter performance on either trial type. In contrast, METH produced a deficit in stop-trial performance (i.e., impulsive action) but not go-trial performance. These findings suggest that the different neurotoxic consequences of substituted amphetamines are associated with different effects on inhibitory control over behavior. Thus, the course of addiction and maladaptive behavior resulting from exposure to these substances is likely to differ.

A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders

Impatience for reward is a facet of many psychiatric disorders. We draw attention to a growing literature finding greater discounting of delayed reward, an important aspect of impatience, across a range of psychiatric disorders. We propose these findings are best understood by considering the goals and motivation for discounting future reward. We characterize these as arising from either the opportunity costs of waiting or the uncertainty associated with delayed reward. We link specific instances of higher discounting in psychiatric disorder to heightened subjective estimates of either of these factors. We propose these costs are learned and represented based either on a flexible cognitive model of the world, an accumulation of previous experience, or through evolutionary specification. Any of these can be considered suboptimal for the individual if the resulting behavior results in impairments in personal and social functioning and/or in distress. By considering the neurochemical and neuroanatomical implementation of these processes, we illustrate how this approach can in principle unite social, psychological and biological conceptions of impulsive choice.

Differential effects of the pharmacological stressor yohimbine on impulsive decision making and response inhibition

RATIONALE

High levels of impulsivity have been associated with psychiatric disorders such as attention-deficit/hyperactivity disorder (ADHD) and substance abuse. In addition, acute stress is known to exacerbate many psychiatric symptoms in impulse control disorders.

OBJECTIVES

The purpose of the current study was to investigate the acute effects of the pharmacological stressor yohimbine on response inhibition and impulsive choice.

METHODS

A group of male rats (n = 12) was trained in the delayed reward task (DRT) to assess impulsive choice. A separate group (n = 10) was trained in the stop-signal task (SST) to measure response inhibition. Upon stable responding, the effects of yohimbine (0, 1.25, 2.5, and 5 mg/kg i.p.) were tested in a Latin square design.

RESULTS

Acute yohimbine significantly increased the preference for the large and delayed reinforcer in the DRT, indicating a decrease in impulsive choice. On the contrary, the effect size of 1.25 mg/kg yohimbine on stop-signal reaction times correlated negatively with baseline performance, suggesting a baseline-dependent effect on response inhibition as measured in the SST.

CONCLUSIONS

The current data suggest that the effects of the pharmacological stressor yohimbine on impulse control strongly depend on the type of impulsive behavior. Pharmacological stress decreased impulsive decision making, an observation that is in line with previously published rodent studies. By contrast, the lowest dose of yohimbine revealed a baseline-dependent effect on response inhibition. As such, the effects of yohimbine are largely comparable to the effects of psychostimulants on impulsivity and may support the notion of cross sensitization of stress and psychostimulants.

To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making

Decision-making is an ethologically adaptive construct that is impaired in multiple psychiatric disorders. Activity within the mesocorticolimbic dopamine system has been traditionally associated with decision-making. The endocannabinoid system through its actions on inhibitory and excitatory synapses modulates dopamine activity and decision-making. The aim of this brief review is to present a synopsis of available data obtained when the endocannabinoid system is manipulated and dopamine activity recorded. To this end, we review research using different behavioral paradigms to provide further insight into how this ubiquitous signaling system biases dopamine-related behaviors to regulate decision-making.

The interplay of birth weight, dopamine receptor D4 gene (DRD4), and early maternal care in the prediction of disorganized attachment at 36 months of age

Disorganized attachment is an important early risk factor for socioemotional problems throughout childhood and into adulthood. Prevailing models of the etiology of disorganized attachment emphasize the role of highly dysfunctional parenting, to the exclusion of complex models examining the interplay of child and parental factors. Decades of research have established that extreme child birth weight may have long-term effects on developmental processes. These effects are typically negative, but this is not always the case. Recent studies have also identified the dopamine D4 receptor (DRD4) as a moderator of childrearing effects on the development of disorganized attachment. However, there are inconsistent findings concerning which variant of the polymorphism (seven-repeat long-form allele or non-seven-repeat short-form allele) is most likely to interact with caregiving in predicting disorganized versus organized attachment. In this study, we examined possible two- and three-way interactions and child DRD4 polymorphisms and birth weight and maternal caregiving at age 6 months in longitudinally predicting attachment disorganization at 36 months. Our sample is from the Maternal Adversity, Vulnerability and Neurodevelopment project, a sample of 650 mother-child dyads. Birth weight was cross-referenced with normative data to calculate birth weight percentile. Infant DRD4 was obtained with buccal swabs and categorized according to the presence of the putative allele seven repeat. Macroanalytic and microanalytic measures of maternal behavior were extracted from a videotaped session of 20 min of nonfeeding interaction followed by a 10-min divided attention maternal task at 6 months. Attachment was assessed at 36 months using the Strange Situation procedure, and categorized into disorganized attachment and others. The results indicated that a main effect for DRD4 and a two-way interaction of birth weight and 6-month maternal attention (frequency of maternal looking away behavior) and sensitivity predicted disorganized attachment in robust logistic regression models adjusted for social demographic covariates. Specifically, children in the midrange of birth weight were more likely to develop a disorganized attachment when exposed to less attentive maternal care. However, the association reversed with extreme birth weight (low and high). The DRD4 seven-repeat allele was associated with less disorganized attachment (protective), while non-seven-repeat children were more likely to be classified as disorganized attachment. The implications for understanding inconsistencies in the literature about which DRD4 genotype is the risk direction are also considered. Suggestions for intervention with families with infants at different levels of biological risk and caregiving risk are also discussed.

The developmental inter-relationships between activity, novelty preferences, and delay discounting in male and female rats

Increased locomotion, novelty-seeking, and impulsivity are risk factors associated with substance use. In this study, the inter-relationships between activity, novelty preferences, and delay discounting, a measure of impulsivity, were examined across three stages: juvenile/early adolescence (postnatal Day [P] 15, 19, and 42 for activity, novelty, and impulsivity, respectively), adolescent/late adolescent (P28, 32, 73), and adult (P90, 94, 137) in male and female rats. Our estimates of impulsive choice, where animals were trained to criterion, revealed an age × sex interaction where early adolescent females had the lowest levels of impulsivity. The relationships of activity and novelty to impulsivity significantly changed across age within each sex. Early adolescent males with high activity, but low novelty preferences, were more impulsive; however, low activity and high novelty preferences were related to high impulsivity in adult males. Female activity gradually increased across age, but did not show a strong relationship with impulsivity. Novelty preferences are moderately related to impulsivity into adulthood in females. These data show that males and females have different developmental trajectories for these behaviors. Males show greater sensation-seeking (e.g., activity) and risky behavior (e.g., novelty preferences) earlier in life, whereas these behaviors emerge during adolescence in females.

Age-Dependent D1-D2 Receptor Coactivation in the Lateral Orbitofrontal Cortex Potentiates NMDA Receptors and Facilitates Cognitive Flexibility

The orbitofrontal cortex (OFC) integrates information about the environment to guide decision-making. Glutamatergic synaptic transmission mediated through N-methyl-d-aspartate receptors is required for optimal functioning of the OFC. Additionally, abnormal dopamine signaling in this region has been implicated in impulsive behavior and poor cognitive flexibility. Yet, despite the high prevalence of psychostimulants prescribed for attention deficit/hyperactivity disorder, there is little information on how dopamine modulates synaptic transmission in the juvenile or the adult OFC. Using whole-cell patch-clamp recordings in OFC pyramidal neurons, we demonstrated that while dopamine or selective D2-like receptor (D2R) agonists suppress excitatory synaptic transmission of juvenile or adult lateral OFC neurons; in juvenile lateral OFC neurons, higher concentrations of dopamine can target dopamine receptors that couple to a phospholipase C (PLC) signaling pathway to enhance excitatory synaptic transmission. Interfering with the formation of a putative D1R-D2R interaction blocked the potentiation of excitatory synaptic transmission. Furthermore, targeting the putative D1R-D2R complex with a biased agonist, SKF83959, not only enhanced excitatory synaptic transmission in a PLC-dependent manner, but also improved the performance of juvenile rats on a reversal-learning task. Our results demonstrate that dopamine signaling in the lateral OFC differs between juveniles and adults, through potential crosstalk between dopamine receptor subtypes.

Impulsive delayed reward discounting as a genetically-influenced target for drug abuse prevention: a critical evaluation

This review evaluates the viability of delayed reward discounting (DRD), an index of how much an individual devalues a future reward based on its delay in time, for genetically-informed drug abuse prevention. A review of the literature suggests that impulsive DRD is robustly associated with drug addiction and meets most of the criteria for being an endophenotype, albeit with mixed findings for specific molecular genetic influences. Several modes of experimental manipulation have been demonstrated to reduce DRD acutely. These include behavioral strategies, such as mindfulness, reward bundling, and episodic future thinking; pharmacological interventions, including noradrenergic agonists, adrenergic agonists, and multiple monoamine agonists; and neuromodulatory interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation. However, the generalization of these interventions to positive clinical outcomes remains unclear and no studies to date have examined interventions on DRD in the context of prevention. Collectively, these findings suggest it would be premature to target DRD for genetically-informed prevention. Indeed, given the evidence of environmental contributions to impulsive DRD, whether genetically-informed secondary prevention would ever be warranted is debatable. Progress in identifying polymorphisms associated with DRD profiles could further clarify the underlying biological systems for pharmacological and neuromodulatory interventions, and, as a qualitatively different risk factor from existing prevention programs, impulsive DRD is worthy of investigation at a more general level as a novel and promising drug abuse prevention target.

Hippocampal interplay with the nucleus accumbens is critical for decisions about time

Human cognition depends upon the capacity to make decisions in the present that bear upon outcomes in the future. The nucleus accumbens, a recipient of direct projections from both the hippocampus and orbitofrontal cortex, is known to contribute to these aspects of decision-making. Here we demonstrate that interaction of the nucleus accumbens with the hippocampus, but not the orbitofrontal cortex, is critical in shaping decisions that involve time trade-offs. Compared with controls, rats with a disrupted hippocampal-accumbens interaction were strongly biased toward choosing stimuli that led to small and immediate food rewards over large and delayed ones. We show that this pattern of behavior cannot be ascribed to the impaired representation of stimulus value, the incapacity to wait, or a general disruption of decision-making. These results identify a hippocampal-accumbens circuit that may underlie a range of problems in which daily decisions are marked by a shift toward immediate gratification.

Trace amine-associated receptor 1: A promising target for the treatment of psychostimulant addiction

Abuse of and addiction to psychostimulants remains a challenging clinical issue; yet no effective pharmacotherapy is available. Trace amine associated receptor 1 (TAAR 1) is increasingly recognized as a novel drug target that participates in the modulation of drug abuse. This review analyzed existing preclinical evidence from electrophysiological, biochemical to behavioral aspects regarding the functional interactions between TAAR 1 and dopaminergic system. TAAR 1 knockout mice demonstrate increased sensitivity to dopaminergic activation while TAAR 1 agonists reduce the neurochemical effects of cocaine and amphetamines, attenuate abuse- and addiction-related behavioral effects of cocaine and methamphetamine. It is concluded that TAAR 1 activation functionally modulates the dopaminergic activity and TAAR 1 agonists appear to be promising pharmacotherapies against psychostimulant addiction.

Identifying the Basal Ganglia network model markers for medication-induced impulsivity in Parkinson's disease patients

Impulsivity, i.e. irresistibility in the execution of actions, may be prominent in Parkinson's disease (PD) patients who are treated with dopamine precursors or dopamine receptor agonists. In this study, we combine clinical investigations with computational modeling to explore whether impulsivity in PD patients on medication may arise as a result of abnormalities in risk, reward and punishment learning. In order to empirically assess learning outcomes involving risk, reward and punishment, four subject groups were examined: healthy controls, ON medication PD patients with impulse control disorder (PD-ON ICD) or without ICD (PD-ON non-ICD), and OFF medication PD patients (PD-OFF). A neural network model of the Basal Ganglia (BG) that has the capacity to predict the dysfunction of both the dopaminergic (DA) and the serotonergic (5HT) neuromodulator systems was developed and used to facilitate the interpretation of experimental results. In the model, the BG action selection dynamics were mimicked using a utility function based decision making framework, with DA controlling reward prediction and 5HT controlling punishment and risk predictions. The striatal model included three pools of Medium Spiny Neurons (MSNs), with D1 receptor (R) alone, D2R alone and co-expressing D1R-D2R. Empirical studies showed that reward optimality was increased in PD-ON ICD patients while punishment optimality was increased in PD-OFF patients. Empirical studies also revealed that PD-ON ICD subjects had lower reaction times (RT) compared to that of the PD-ON non-ICD patients. Computational modeling suggested that PD-OFF patients have higher punishment sensitivity, while healthy controls showed comparatively higher risk sensitivity. A significant decrease in sensitivity to punishment and risk was crucial for explaining behavioral changes observed in PD-ON ICD patients. Our results highlight the power of computational modelling for identifying neuronal circuitry implicated in learning, and its impairment in PD. The results presented here not only show that computational modelling can be used as a valuable tool for understanding and interpreting clinical data, but they also show that computational modeling has the potential to become an invaluable tool to predict the onset of behavioral changes during disease progression.

Mesolimbic dopamine dynamically tracks, and is causally linked to, discrete aspects of value-based decision making

BACKGROUND

To make appropriate choices, organisms must weigh the costs and benefits of potential valuable outcomes, a process known to involve the nucleus accumbens (NAc) and its dopaminergic input. However, it is currently unknown if dopamine dynamically tracks alterations in expected reward value online as behavioral preferences change and if so, if it is causally linked to specific components of value such as reward magnitude and/or delay to reinforcement.

METHODS

Electrochemical methods were used to measure subsecond NAc dopamine release during a delay discounting task where magnitude was fixed but delay varied across blocks (n = 7 rats). Next, to assess whether this dopamine signaling was causally related to specific components of choice behavior, we employed selective optogenetic stimulation of dopamine terminals in the NAc using a modified delay discounting task in which both delay and magnitude varied independently (n = 23 rats).

RESULTS

Cues predictive of available choices evoked dopamine release that scaled with the rat's preferred choices and dynamically shifted as delay to reinforcement for the large reward increased. In the second experiment, dopamine signaling was causally related to features of decision making, as optogenetically enhanced dopamine release within the NAc during predictive cue presentation was sufficient to alter subsequent value-related choices. Importantly, this dopamine-mediated shift in choice was limited to delay-based, but not magnitude-based, decisions.

CONCLUSIONS

These findings indicate that NAc dopamine dynamically tracks delay discounting and establishes a causal role for this signaling in a subset of value-based associative strategies.

Deconstructing 5-HT6 receptor effects on striatal circuit function

Medium spiny neurons (MSNs) constitute 95% of neurons in the dorsal striatum subdivided into direct (striatonigral) and indirect (striatopallidal) pathways. Whereas D1 and D2 receptors and several neuropeptides, including dynorphin and enkephalin, are differentially expressed in these neurons, 5-hydroxytryptamine 6 receptors (5-HT6) are expressed in both pathways. Previous results demonstrate that concurrent 5-HT6 receptor overexpression in MSNs of both pathways in the dorsomedial striatum (DMS) interferes with instrumental learning and that 5-HT6 overexpression in the dorsolateral striatum (DLS) relieves rats from inflexible habitual behaviors. We hypothesized that 5-HT6 receptor-mediated co-activation of both pathways interferes with the differential activation/inhibition of direct/indirect pathways by dopamine. To test this idea, we cloned novel viral vectors to selectively overexpress 5-HT6 receptors in direct or indirect pathway MSNs to deconstruct their role in modulating instrumental learning and habitual responding. We found that increasing 5-HT6 receptor expression in either direct or indirect pathway MSNs of the posterior DMS selectively enhanced or impaired initial acquisition of a discrete instrumental learning task respectively, though all rats were ultimately able to learn the task. In a separate set of experiments, 5-HT6 receptor overexpression in indirect pathway MSNs of the DLS facilitated behavioral flexibility in rats overtrained on a repetitive pressing task using a variable interval schedule of reinforcement, during an omission contingency training session and subsequent probe testing. Together these findings further the notion that 5-HT6 signaling causes balanced activation of opposing MSN pathways by serotonin in sub-regions of the dorsal striatum allowing for more reflective modalities of behavior.

L-Dopa and Brain Serotonin System Dysfunction

L-dopa is used to treat the motor symptoms associated with Parkinson's disease, a neurodegenerative movement disorder characterized by a loss of dopamine neurons. L-dopa is the precursor to dopamine and crosses the blood-brain barrier to increase dopamine neurotransmission. This review will focus on the findings that dopamine produced from L-dopa is mediated in part by serotonin neurons. Direct evidence will be provided that increases in dopamine cause oxidative stress and damage serotonin neurons. Similarly, chronic L-dopa produces deficits in serotonin neurotransmission, including decreases in both serotonin cell bodies within the dorsal raphe and serotonin neurotransmitter concentrations in several forebrain regions. Since serotonin is involved in many important physiological processes including mood and cognition, L-dopa induced serotonin deficits may play a role in the side-effect symptoms observed in Parkinson's disease patients treated with L-dopa.

Neurons in the nucleus accumbens promote selection bias for nearer objects

Both animals and humans often prefer rewarding options that are nearby over those that are distant, but the neural mechanisms underlying this bias are unclear. Here we present evidence that a proximity signal encoded by neurons in the nucleus accumbens drives proximate reward bias by promoting impulsive approach to nearby reward-associated objects. On a novel decision-making task, rats chose the nearer option even when it resulted in greater effort expenditure and delay to reward; therefore, proximate reward bias was unlikely to be caused by effort or delay discounting. The activity of individual neurons in the nucleus accumbens did not consistently encode the reward or effort associated with specific alternatives, suggesting that it does not participate in weighing the values of options. In contrast, proximity encoding was consistent and did not depend on the subsequent choice, implying that accumbens activity drives approach to the nearest rewarding option regardless of its specific associated reward size or effort level.

Tryptophan Depletion Promotes Habitual over Goal-Directed Control of Appetitive Responding in Humans

BACKGROUND

Optimal behavioral performance results from a balance between goal-directed and habitual systems of behavioral control, which are modulated by ascending monoaminergic projections. While the role of the dopaminergic system in behavioral control has been recently addressed, the extent to which changes in global serotonin neurotransmission could influence these 2 systems is still poorly understood.

METHODS

We employed the dietary acute tryptophan depletion procedure to reduce serotonin neurotransmission in 18 healthy volunteers and 18 matched controls. We used a 3-stage instrumental learning paradigm that includes an initial instrumental learning stage, a subsequent outcome-devaluation test, and a slip-of-action stage, which directly tests the balance between hypothetical goal-directed and habitual systems. We also employed a separate response inhibition control test to assess the behavioral specificity of the results.

RESULTS

Acute tryptophan depletion produced a shift of behavioral performance towards habitual responding as indexed by performance on the slip-of-action test. Moreover, greater habitual responding in the acute tryptophan depletion group was predicted by a steeper decline in plasma tryptophan levels. In contrast, acute tryptophan depletion left intact the ability to use discriminative stimuli to guide instrumental choice as indexed by the instrumental learning stage and did not impair inhibitory response control.

CONCLUSIONS

The major implication of this study is that serotonin modulates the balance between goal-directed and stimulus-response habitual systems of behavioral control. Our findings thus imply that diminished serotonin neurotransmission shifts behavioral control towards habitual responding.

Translatable and Back-Translatable Measurement of Impulsivity and Compulsivity: Convergent and Divergent Processes

Impulsivity and compulsivity have emerged as important dimensional constructs that challenge traditional psychiatric classification systems. Both are present in normal healthy populations where the need to act quickly and repeatedly without hesitation can be highly advantageous. However, when excessively expressed, impulsive and compulsive behavior can lead to adverse consequences and spectrum disorders exemplified by attention-deficit/hyperactivity disorder (ADHD), obsessive compulsive disorder (OCD), autism, and drug addiction. Impulsive individuals have difficulty in deferring gratification and are inclined to 'jump the gun' and respond prematurely before sufficient information is gathered. Compulsivity involves repetitive behavior often motivated by the need to reduce or prevent anxiety, thus leading to the maladaptive perseveration of behavior. Defined in this way, impulsivity and compulsivity could be viewed as separate entities or 'traits' but overwhelming evidence indicates that both may be present in the same disorder, either concurrently or even separately at different time points. Herein we discuss the neural and cognitive heterogeneity of impulsive and compulsive endophenotypes. These constructs map onto distinct fronto-striatal neural and neurochemical structures interacting both at nodal convergent points and as opponent processes highlighting both the heterogeneity and the commonalities of function. We focus on discoveries made using both translational research methodologies and studies exclusively in humans, and implications for treatment intervention in disorders in which impulsive and compulsive symptoms prevail. We emphasize the relevance of these constructs for understanding dimensional psychiatry.