Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies

Involvement of the lateral amygdala in the antiallodynic and reinforcing effects of heroin in rats after peripheral nerve injury

BACKGROUND

Neuropathic pain alters opioid self-administration in rats. The brain regions altered in the presence of neuropathic pain mediating these differences have not been identified, but likely involve ascending pain pathways interacting with the limbic system. The amygdala is a brain region that integrates noxious stimulation with limbic activity.

METHODS

μ-Opioid receptors were blocked in the amygdala using the irreversible antagonist, β-funaltrexamine, and the antiallodynic and reinforcing effects of heroin were determined in spinal nerve-ligated rats. In addition, the effect of β-funaltrexamine was determined on heroin self-administration in sham-operated rats.

RESULTS

β-Funaltrexamine decreased functional activity of μ-opioid receptors by 60 ± 5% (mean ± SD). Irreversible inhibition of μ-opioid receptors in the amygdala significantly attenuated the ability of doses of heroin up to 100 μg/kg to reverse hypersensitivity after spinal nerve ligation. Heroin intake by self-administration in spinal nerve-ligated rats was increased from 5.0 ± 0.3 to 9.9 ± 2.1 infusions/h after administration of 2.5 nmol of β-funaltrexamine in the lateral amygdala, while having no effect in sham-operated animals (5.8 ± 1.6 before, 6.7 ± 0.9 after). The antiallodynic effects of 60 μg/kg heroin were decreased up to 4 days, but self-administration was affected for up to 14 days.

CONCLUSIONS

μ-Opioid receptors in the lateral amygdala partially meditate heroin's antiallodynic effects and self-administration after peripheral nerve injury. The lack of effect of β-funaltrexamine on heroin self-administration in sham-operated subjects suggests that opioids maintain self-administration through a distinct mechanism in the presence of pain.

μ-Opioid receptors in the nucleus accumbens shell region mediate the effects of amphetamine on inhibitory control but not impulsive choice

Acute challenges with psychostimulants such as amphetamine affect impulsive behavior in both animals and humans. With regard to amphetamine, it is important to unravel how this drug affects impulsivity since it is not only a widely abused recreational drug but also regularly prescribed to ameliorate maladaptive impulsivity. Therefore, we studied the effects of amphetamine in two rat models of impulsivity, the five-choice serial reaction time task and the delayed-reward task, providing measures of inhibitory control and impulsive choice, respectively. We focused on the role of opioid receptor activation in amphetamine-induced impulsivity as there is ample evidence indicating an important role for endogenous opioids in several behavioral and neurochemical effects of amphetamine. Results showed that amphetamine-induced inhibitory control deficits were dose-dependently attenuated by the preferential μ-opioid receptor antagonist naloxone, but not by the selective δ-opioid receptor antagonist naltrindole or κ-opioid receptor antagonist nor-BNI (nor-binaltorphimine dihydrochloride). In contrast, naloxone did not affect amphetamine-induced improvements in impulsive decision making. Naloxone also completely prevented inhibitory control deficits induced by GBR 12909 [1-(2-[bis(4-fluorophenyl)methoxy] ethyl)-4-(3-phenylpropyl)piperazine dihydrochloride], a selective dopamine transporter inhibitor. Intracranial infusions of naloxone, the selective μ-opioid receptor antagonist CTAP (H-D-Phe-Cys-Tyr-D-Trp-Arg-Thr-Pen-Thr-NH(2)), morphine, and the selective μ-opioid receptor agonist DAMGO ([D-Ala(2),N-Me-Phe(4),Gly(5)-ol]-enkephalin acetate salt) revealed that μ-opioid receptor activation in the shell rather than the core subregion of the nucleus accumbens (NAc) modulates inhibitory control and subserves the effect of amphetamine thereon. Together, these results indicate an important role for NAc shell μ-opioid receptors in the regulation of inhibitory control, probably via an interaction between these receptors and the mesolimbic dopamine system.

A population-specific HTR2B stop codon predisposes to severe impulsivity

Impulsivity, describing action without foresight, is an important feature of several psychiatric diseases, suicidality and violent behavior. The complex origins of impulsivity hinder identification of the genes influencing both it and diseases with which it is associated. We performed exon-centric sequencing of impulsive individuals in a founder population, targeting fourteen genes belonging to the serotonin and dopamine domain. A stop codon in HTR2B that is common (MAF >1%) but exclusive to Finns was identified. Expression of the gene in the human brain was assessed, as well as the molecular functionality of the stop codon that was associated with psychiatric diseases marked by impulsivity in both population and family-based analyses. Knockout of Htr2b increased impulsive behaviors in mice, indicative of predictive validity. Our study shows the potential for identifying and tracing effects of rare alleles in complex behavioral phenotypes using founder populations, and suggests a role for HTR2B in impulsivity.

Serotonin and dopamine: unifying affective, activational, and decision functions

Serotonin, like dopamine (DA), has long been implicated in adaptive behavior, including decision making and reinforcement learning. However, although the two neuromodulators are tightly related and have a similar degree of functional importance, compared with DA, we have a much less specific understanding about the mechanisms by which serotonin affects behavior. Here, we draw on recent work on computational models of dopaminergic function to suggest a framework by which many of the seemingly diverse functions associated with both DA and serotonin-comprising both affective and activational ones, as well as a number of other functions not overtly related to either-can be seen as consequences of a single root mechanism.

Understanding the effects of stimulant medications on cognition in individuals with attention-deficit hyperactivity disorder: a decade of progress

The use of stimulant drugs for the treatment of children with attention-deficit hyperactivity disorder (ADHD) is one of the most widespread pharmacological interventions in child psychiatry and behavioral pediatrics. This treatment is well grounded on controlled studies showing efficacy of low oral doses of methylphenidate and amphetamine in reducing the behavioral symptoms of the disorder as reported by parents and teachers, both for the cognitive (inattention and impulsivity) and non-cognitive (hyperactivity) domains. Our main aim is to review the objectively measured cognitive effects that accompany the subjectively assessed clinical responses to stimulant medications. Recently, methods from the cognitive neurosciences have been used to provide information about brain processes that underlie the cognitive deficits of ADHD and the cognitive effects of stimulant medications. We will review some key findings from the recent literature, and then offer interpretations of the progress that has been made over the past decade in understanding the cognitive effects of stimulant medication on individuals with ADHD.

Animal models of ADHD

Studies employing animal models of attention-deficit/hyperactivity disorder (ADHD) present clear inherent advantages over human studies. Animal models are invaluable tools for the study of underlying neurochemical, neuropathological and genetic alterations that cause ADHD, because they allow relatively fast, rigorous hypothesis testing and invasive manipulations as well as selective breeding. Moreover, especially for ADHD, animal models with good predictive validity would allow the assessment of potential new therapeutics. In this chapter, we describe and comment on the most frequently used animal models of ADHD that have been created by genetic, neurochemical and physical alterations in rodents. We then discuss that an emerging and promising direction of the field is the analysis of individual behavioural differences among a normal population of animals. Subjects presenting extreme characteristics related to ADHD can be studied, thereby avoiding some of the problems that are found in other models, such as functional recovery and unnecessary assumptions about aetiology. This approach is justified by the theoretical need to consider human ADHD as the extreme part of a spectrum of characteristics that are distributed normally in the general population, as opposed to the predominant view of ADHD as a separate pathological category.

Comparison of SHR, WKY and Wistar rats in different behavioural animal models: effect of dopamine D1 and alpha2 agonists

Spontaneously hypertensive rats (SHR) and its counterpart, the Wistar-Kyoto rats (WKY), are probably the most often used animal model of ADHD. However, SHR as model of ADHD have also been criticised partly because of not differing to outbred rat strains. In the present study, adolescent SHR, WKY and Wistar rats from Charles River were tested in open-field, elevated plus maze and novel object recognition and on gastrointestinal transport to more intensively evaluate the strain characteristics. Non-habituated SHR and Wistar rats were more active than WKY rats but contrary to Wistar rats SHR stay hyperactive in a familiar environment. SHR were more sensitive to the alpha2-adrenoceptor agonist guanfacine and the dopamine D1 agonist A-68930 than WKY and Wistar rats, whereas amphetamine, the D1/D5 agonist ABT431 and the D2 agonist quinpirole, similarly affected open-field activity in all strains. In the elevated plus maze, SHR and Wistar rats showed less anxiety-related behaviour than WKY rats. Guanfacine and amphetamine induced an anxiolytic-like activity in SHR but not in WKY and Wistar rats. SHR showed the highest long-term memory in the novel object recognition. Gastrointestinal transport was similar and comparably affected by guanfacine in all rat strains. The present study shows clear differences in the behaviour of SHR and Wistar rats but also of WKY and Wistar rats. The use of SHR as animal model of ADHD is supported.

Preweaning Mn exposure leads to prolonged astrocyte activation and lasting effects on the dopaminergic system in adult male rats

Little is known about the effects of manganese (Mn) exposure over neurodevelopment and whether these early insults result in effects lasting into adulthood. To determine if early Mn exposure produces lasting neurobehavioral and neurochemical effects, we treated neonate rats with oral Mn (0, 25, or 50 mg Mn/kg/d over PND 1-21) and evaluated (1) behavioral performance in the open arena in the absence (PND 97) and presence (PND 98) of a d-amphetamine challenge, (2) brain dopamine D1 and D2-like receptors and dopamine transporter densities in the prefrontal cortex, striatum, and nucleus accumbens (PND 107), and (3) astrocyte marker glial fibrillary acidic protein (GFAP) levels in these same brain regions (PND 24 and 107). We found that preweaning Mn exposure did not alter locomotor activity or behavior disinhibition in adult rats, though Mn-exposed animals did exhibit an enhanced locomotor response to d-amphetamine challenge. Preweaning Mn exposure led to increased D1 and D2 receptor levels in the nucleus accumbens and prefrontal cortex, respectively, compared with controls. We also found increased GFAP expression in the prefrontal cortex in Mn-exposed PND 24 weanlings, and increased GFAP levels in prefrontal cortex, medial striatum and nucleus accumbens of adult (PND 107) rats exposed to preweaning Mn, indicating an effect of Mn exposure on astrogliosis that persisted and/or progressed to other brain regions in adult animals. These data show that preweaning Mn exposure leads to lasting molecular and functional impacts in multiple brain regions of adult animals, long after brain Mn levels returned to normal.

Attention deficit/hyperactivity disorder: a focused overview for children's environmental health researchers

OBJECTIVES

Attention deficit/hyperactivity disorder (ADHD) is the most frequently diagnosed childhood neurobehavioral disorder. Much research has been done to identify genetic, environmental, and social risk factors for ADHD; however, we are still far from fully understanding its etiology. In this review we provide an overview of diagnostic criteria for ADHD and what is known about its biological basis. We also review the neuropsychological functions that are affected in ADHD. The goal is to familiarize the reader with the behavioral deficits that are hallmarks of ADHD and to facilitate comparisons with neurobehavioral deficits associated with environmental chemical exposures.

DATA SOURCES

Relevant literature on ADHD is reviewed, focusing in particular on meta-analyses conducted between 2004 and the present that evaluated associations between measures of neuropsychological function and ADHD in children. Meta-analyses were obtained through searches of the PubMed electronic database using the terms "ADHD," "meta-analysis," "attention," "executive," and "neuropsychological functions." Although meta-analyses are emphasized, nonquantitative reviews are included for particular neuropsychological functions where no meta-analyses were available.

DATA SYNTHESIS

The meta-analyses indicate that vigilance (sustained attention), response inhibition, and working memory are impaired in children diagnosed with ADHD. Similar but somewhat less consistent meta-analytic findings have been reported for impairments in alertness, cognitive flexibility, and planning. Additionally, the literature suggests deficits in temporal information processing and altered responses to reinforcement in children diagnosed with ADHD. Findings from brain imagining and neurochemistry studies support the behavioral findings.

CONCLUSIONS

Behavioral, neuroanatomical, and neurochemical data indicate substantial differences in attention and executive functions between children diagnosed with ADHD and non-ADHD controls. Comparisons of the neurobehavioral deficits associated with ADHD and those associated with exposures to environmental chemicals may help to identify possible environmental risk factors for ADHD and/or reveal common underlying biological mechanisms.

Lead and PCBs as risk factors for attention deficit/hyperactivity disorder

OBJECTIVES

Attention deficit/hyperactivity disorder (ADHD) is the most frequently diagnosed neurobehavioral disorder of childhood, yet its etiology is not well understood. In this review we present evidence that environmental chemicals, particularly polychlorinated biphenyls (PCBs) and lead, are associated with deficits in many neurobehavioral functions that are also impaired in ADHD.

DATA SOURCES

Human and animal studies of developmental PCB or lead exposures that assessed specific functional domains shown to be impaired in ADHD children were identified via searches of PubMed using "lead" or "PCB exposure" in combination with key words, including "attention," "working memory," "response inhibition," "executive function," "cognitive function," "behavior," and "ADHD."

DATA SYNTHESIS

Children and laboratory animals exposed to lead or PCBs show deficits in many aspects of attention and executive function that have been shown to be impaired in children diagnosed with ADHD, including tests of working memory, response inhibition, vigilance, and alertness. Studies conducted to date suggest that lead may reduce both attention and response inhibition, whereas PCBs may impair response inhibition to a greater degree than attention. Low-level lead exposure has been associated with a clinical diagnosis of ADHD in several recent studies. Similar studies of PCBs have not been conducted.

CONCLUSIONS

We speculate that exposures to environmental contaminants, including lead and PCBs, may increase the prevalence of ADHD.

Internal-time temporal difference model for neural value-based decision making

The temporal difference (TD) learning framework is a major paradigm for understanding value-based decision making and related neural activities (e.g., dopamine activity). The representation of time in neural processes modeled by a TD framework, however, is poorly understood. To address this issue, we propose a TD formulation that separates the time of the operator (neural valuation processes), which we refer to as internal time, from the time of the observer (experiment), which we refer to as conventional time. We provide the formulation and theoretical characteristics of this TD model based on internal time, called internal-time TD, and explore the possible consequences of the use of this model in neural value-based decision making. Due to the separation of the two times, internal-time TD computations, such as TD error, are expressed differently, depending on both the time frame and time unit. We examine this operator-observer problem in relation to the time representation used in previous TD models. An internal time TD value function exhibits the co-appearance of exponential and hyperbolic discounting at different delays in intertemporal choice tasks. We further examine the effects of internal time noise on TD error, the dynamic construction of internal time, and the modulation of internal time with the internal time hypothesis of serotonin function. We also relate the internal TD formulation to research on interval timing and subjective time.

Prefrontal cortex and drug abuse vulnerability: translation to prevention and treatment interventions

Vulnerability to drug abuse is related to both reward seeking and impulsivity, two constructs thought to have a biological basis in the prefrontal cortex (PFC). This review addresses similarities and differences in neuroanatomy, neurochemistry and behavior associated with PFC function in rodents and humans. Emphasis is placed on monoamine and amino acid neurotransmitter systems located in anatomically distinct subregions: medial prefrontal cortex (mPFC); lateral prefrontal cortex (lPFC); anterior cingulate cortex (ACC); and orbitofrontal cortex (OFC). While there are complex interconnections and overlapping functions among these regions, each is thought to be involved in various functions related to health-related risk behaviors and drug abuse vulnerability. Among the various functions implicated, evidence suggests that mPFC is involved in reward processing, attention and drug reinstatement; lPFC is involved in decision-making, behavioral inhibition and attentional gating; ACC is involved in attention, emotional processing and self-monitoring; and OFC is involved in behavioral inhibition, signaling of expected outcomes and reward/punishment sensitivity. Individual differences (e.g., age and sex) influence functioning of these regions, which, in turn, impacts drug abuse vulnerability. Implications for the development of drug abuse prevention and treatment strategies aimed at engaging PFC inhibitory processes that may reduce risk-related behaviors are discussed, including the design of effective public service announcements, cognitive exercises, physical activity, direct current stimulation, feedback control training and pharmacotherapies. A major challenge in drug abuse prevention and treatment rests with improving intervention strategies aimed at strengthening PFC inhibitory systems among at-risk individuals.

Dopamine, time, and impulsivity in humans

Disordered dopamine neurotransmission is implicated in mediating impulsiveness across a range of behaviors and disorders including addiction, compulsive gambling, attention-deficit/hyperactivity disorder, and dopamine dysregulation syndrome. Whereas existing theories of dopamine function highlight mechanisms based on aberrant reward learning or behavioral disinhibition, they do not offer an adequate account of the pathological hypersensitivity to temporal delay that forms a crucial behavioral phenotype seen in these disorders. Here we provide evidence that a role for dopamine in controlling the relationship between the timing of future rewards and their subjective value can bridge this explanatory gap. Using an intertemporal choice task, we demonstrate that pharmacologically enhancing dopamine activity increases impulsivity by enhancing the diminutive influence of increasing delay on reward value (temporal discounting) and its corresponding neural representation in the striatum. This leads to a state of excessive discounting of temporally distant, relative to sooner, rewards. Thus our findings reveal a novel mechanism by which dopamine influences human decision-making that can account for behavioral aberrations associated with a hyperfunctioning dopamine system.

Deep brain stimulation of the nucleus accumbens shell increases impulsive behavior and tissue levels of dopamine and serotonin

The nucleus accumbens (NAc) is gaining interest as a target for deep brain stimulation (DBS) in refractory neuropsychiatric disorders with impulsivity as core symptom. The nucleus accumbens is composed of two subterritories, core and shell, which have different anatomical connections. In animal models, it has been shown that DBS of the NAc changes impulsive action. Here, we tested the hypothesis that a change in impulsive action by DBS of the NAc is associated with changes in dopamine levels. Rats received stimulating electrodes either in the NAc core or shell, and underwent behavioral testing in a reaction time task. In addition, in a second experiment, the effect of DBS of the NAc core and shell on extracellular dopamine and serotonin levels was assessed in the NAc and medial prefrontal cortex. Control subjects received sham surgery. We have found that DBS of the NAc shell stimulation induced more impulsive action but less perseverative checking. These effects were associated with increased levels of dopamine and serotonin in the NAc, but not in the medial prefrontal cortex. DBS of the NAc core had no effect on impulsive action, but decreased perseverative responses indicative of a better impulse control. In these subjects, no effects were found on neurotransmitter levels. Our data point out that DBS of the NAc shell has negative effects on impulsive action which is accompanied by increases of dopamine and serotonin levels in the NAc, whereas DBS of the NAc core has beneficial behavioral effects.

Preweaning manganese exposure causes hyperactivity, disinhibition, and spatial learning and memory deficits associated with altered dopamine receptor and transporter levels

Epidemiological studies in children have reported associations between elevated dietary manganese (Mn) exposure and neurobehavioral and neurocognitive deficits. To better understand the relationship between early Mn exposure and neurobehavioral deficits, we treated neonate rats with oral Mn doses of 0, 25, or 50 mg Mn/kg/day over postnatal day (PND) 1-21, and evaluated behavioral performance using open arena (PND 23), elevated plus maze (PND 23), and 8-arm radial maze (PND 33-46) paradigms. Brain dopamine D1 and D2-like receptors, and dopamine transporter (DAT) densities were determined on PND 24, and blood and brain Mn levels were measured to coincide with behavioral testing (PND 24, PND 36). Preweaning Mn exposure caused hyperactivity and behavioral disinhibition in the open arena, but no altered behavior in the elevated plus maze. Manganese-exposed males committed significantly more reference and marginally more working errors in the radial arm maze compared to controls. Fewer Mn exposed males achieved the radial maze learning criterion, and they required more session days to reach it compared to controls. Manganese-exposed animals also exhibited a greater frequency of stereotypic response strategy in searching for the baited arms in the maze. These behavioral and learning deficits were associated with altered expression of the dopamine D1 and D2 receptors and the DAT in prefrontal cortex, nucleus accumbens, and dorsal striatum. These data corroborate epidemiological studies in children, and suggest that exposure to Mn during neurodevelopment significantly alters dopaminergic synaptic environments in brain nuclei that mediate control of executive function behaviors, such as reactivity and cognitive flexibility.

Effects of acute tryptophan depletion on three different types of behavioral impulsivity

INTRODUCTION

While central nervous system serotonin has been implicated in a variety of problematic impulsive behaviors, biological manipulation of brain serotonin using acute tryptophan depletion for studying changes in impulsive behavior has received little attention.

METHODS

Using identical treatment conditions, we examined the effects of reduced serotonin synthesis for each of three matched groups using acute tryptophan depletion. Thirty healthy men and women (ages 18-45) were assigned to perform one of three tasks assessing different types of behavioral impulsivity: response initiation, response inhibition, and consequence sensitivity (N = 90). Participants completed two experimental days during which each consumed either a tryptophan-depletion or balanced-placebo amino-acid formulation and completed 5 sessions of their respective tasks at 0.25 h before and 1.5, 4.0, 5.0, and 6.0 h after beverage consumption.

RESULTS

During peak effectiveness (5.0 h to 6.0 h following amino-acid consumption), depletion produced selective differences dependent on the type of impulsivity being tested. Specifically, relative to baseline testing (pre-depletion), response initiation impulsivity was significantly increased during the peak effects of depletion. And, when compared to placebo control, both response initiation and consequence sensitivity impulsivity were increased during the peak effects of depletion.

CONCLUSION

Though response initiation and consequence sensitivity impulsivity were affected by tryptophan depletion, response inhibition impulsivity was not, suggesting that other biological processes may underlie this specific component of impulsivity. Future research in other populations or using different pharmacological agents is warranted to further examine the biological processes underlying these components of impulsivity.

Recent research on impulsivity in individuals with drug use and mental health disorders: implications for alcoholism

Alcohol misuse and dependence, and many of its accompanying psychological problems, are associated with heightened levels of impulsivity that both accelerate the development of clinically significant illness and complicate clinical outcome. This article reviews recent developments in our understanding of impulsivity as they relate to brain circuitry that might underlie these comorbid factors, focusing upon the clinical features of substance use (and dependence), bipolar disorder, and pathological gambling. Individuals who are affected by these disorders exhibit problems in several domains of impulsive behavior including deficient response or "motor" control, and the tolerance of prolonged delays prior to larger rewards at the expense of smaller rewards ("delay-discounting"). These populations, like alcoholic dependents, also exhibit impairments in risky decision-making that may reflect dysfunction of monoamine and catecholamine pathways. However, several areas of uncertainty exist including the specificity of impairments across disorders and the relationship between impulse control problems and altered evaluation of reward outcomes underlying observed impairments in action selection.

Insight into the relationship between impulsivity and substance abuse from studies using animal models

Drug use disorders are often accompanied by deficits in the capacity to efficiently process reward-related information and to monitor, suppress, or override reward-controlled behavior when goals are in conflict with aversive or immediate outcomes. This emerging deficit in behavioral flexibility and impulse control may be a central component of the progression to addiction, as behavior becomes increasingly driven by drugs and drug-associated cues at the expense of more advantageous activities. Understanding how neural mechanisms implicated in impulse control are affected by addictive drugs may therefore prove a useful strategy in the search for new treatment options. Animal models of impulsivity and addiction could make a significant contribution to this endeavor. Here, some of the more common behavioral paradigms used to measure different aspects of impulsivity across species are outlined, and the importance of the response to reward-paired cues in such paradigms is discussed. Naturally occurring differences in forms of impulsivity have been found to be predictive of future drug self-administration, but drug exposure can also increase impulsive responding. Such data are in keeping with the suggestion that impulsivity may contribute to multiple stages within the spiral of addiction. From a neurobiological perspective, converging evidence from rat, monkey, and human studies suggest that compromised functioning within the orbitofrontal cortex may critically contribute to the cognitive sequelae of drug abuse. Changes in gene transcription and protein expression within this region may provide insight into the mechanism underlying drug-induced cortical hypofunction, reflecting new molecular targets for the treatment of uncontrolled drug-seeking and drug-taking behavior.

Association of maternal dopamine transporter genotype with negative parenting: evidence for gene x environment interaction with child disruptive behavior

Although maternal parenting is central to child development, little is known about the interplay between molecular genetic and environmental factors that influence parenting. We tested the association of the 40-bp variable number tandem repeat polymorphism of the dopamine transporter (DAT1; SLC6A3) gene with three dimensions of observed maternal parenting behavior (positive parenting, negative parenting and total maternal commands). A significant nonadditive association was found between maternal DAT1 genotype and both negative parenting and total commands during a structured mother-child interaction task, even after controlling demographic factors, maternal psychopathology and disruptive child behavior during the task. Furthermore, the association between maternal DAT1 genotype and negative parenting was significantly stronger among mothers whose children were highly disruptive during the mother-child interaction task, suggesting a gene-environment interaction.

Impulsivity characterization in the Roman high- and low-avoidance rat strains: behavioral and neurochemical differences

The selective breeding of Roman high- (RHA) and low-avoidance (RLA) rats for rapid vs extremely poor acquisition of active avoidance behavior in a shuttle-box has generated two phenotypes with different emotional and motivational profiles. The phenotypic traits of the Roman rat lines/strains (outbred or inbred, respectively) include differences in sensation/novelty seeking, anxiety/fearfulness, stress responsivity, and susceptibility to addictive substances. We designed this study to characterize differences between the inbred RHA-I and RLA-I strains in the impulsivity trait by evaluating different aspects of the multifaceted nature of impulsive behaviors using two different models of impulsivity, the delay-discounting task and five-choice serial reaction time (5-CSRT) task. Previously, rats were evaluated on a schedule-induced polydipsia (SIP) task that has been suggested as a model of obsessive-compulsive disorder. RHA-I rats showed an increased acquisition of the SIP task, higher choice impulsivity in the delay-discounting task, and poor inhibitory control as shown by increased premature responses in the 5-CSRT task. Therefore, RHA-I rats manifested an increased impulsivity phenotype compared with RLA-I rats. Moreover, these differences in impulsivity were associated with basal neurochemical differences in striatum and nucleus accumbens monoamines found between the two strains. These findings characterize the Roman rat strains as a valid model for studying the different aspects of impulsive behavior and for analyzing the mechanisms involved in individual predisposition to impulsivity and its related psychopathologies.

Yohimbine increases impulsivity through activation of cAMP response element binding in the orbitofrontal cortex

BACKGROUND

Stress can increase impulsivity and has a negative impact on psychiatric outcome. Norepinephrine is heavily implicated in responses to stress, and the alpha(2) antagonist yohimbine is used clinically to study this aspect of the stress response. Yohimbine induces mild anxiety and increases impulsivity in healthy volunteers but has more detrimental effects in some psychiatric populations, triggering mania in bipolar patients and drug craving in substance-dependent individuals. Understanding the mechanism by which yohimbine affects brain function could provide insight into the heightened reaction to stress in these patients.

METHODS

Yohimbine's effects were assessed in rats using the five-choice serial reaction time test of attention and impulse control. We then examined whether yohimbine altered activity of cyclic adenosine monophosphate response element binding (CREB) protein-a transcription factor implicated in the stress response-in brain areas that regulate impulsivity. The behavioral consequences of any changes in CREB activity were subsequently assessed using viral-mediated gene transfer to regionally overexpress CREB or the dominant negative antagonist mCREB.

RESULTS

Yohimbine increased impulsive responding in rats and selectively increased CREB phosphorylation within the orbitofrontal cortex but not medial prefrontal cortex or nucleus accumbens. Overexpressing mCREB within the orbitofrontal cortex blocked yohimbine's effects on impulsivity, whereas overexpressing CREB in this region increased impulsive responding and potentiated the proimpulsive actions of yohimbine.

DISCUSSION

These data suggest a novel molecular mechanism contributing to impulsivity that may be sensitive to stress. Such findings may improve our understanding of the neurobiological pathways linking the response to stress and impulsivity in both healthy and psychiatric populations.

Significant association between the C(-1019)G functional polymorphism of the HTR1A gene and impulsivity

Serotonin-1A (5-HT(1A)) receptors are known to play a role in impulsivity-related behavior. The C(-1019)G functional polymorphism (rs6295) has been suggested to regulate the 5-HT(1A) receptor gene (HTR(1A)) expression in presynaptic raphe neurons, namely, increased receptor concentration and reduced neuronal firing could be associated with the G allele. Previous studies indicate that this polymorphism is associated with aggression, suicide, and several psychiatric disorders, yet its association with impulsivity has rarely been investigated. We studied the relationship between impulsivity and the C(-1019)G polymorphism of the HTR(1A) in a population sample of 725 volunteers using the Impulsiveness subscale (IVE-I) of the Eysenck Impulsiveness, Venturesomeness, and Empathy scale and also the Barratt Impulsiveness Scale (BIS-11). Data were analyzed using analysis of variance with age and gender as covariates and Tukey's HSD post-hoc test. Post-hoc analysis revealed that the study had 0.958 power to detect 0.15 effect size. Significant differences between the C(-1019)G genotype groups (GG vs. GC vs. CC) were found. Subjects carrying GG genotype showed significantly higher impulsiveness scores compared to GC or CC carriers for the IVE-I scale (P = 0.014), for the Motor (P = 0.021), Cognitive Impulsiveness (P = 0.002), and for the BIS total score (P = 0.008) but not for the Nonplanning Impulsiveness (P = 0.520) subscale of the BIS-11. Our results suggest the involvement of the HTR(1A) in the continuum phenotype of impulsivity.

Development of 5-HT transporter density and long-term effects of methylphenidate in an animal model of ADHD

Although stimulants as the treatment of choice are widely prescribed in ADHD, little is known about their long-term neurobiological effects. Hence, for the first time the present study examined the long-term effects of chronic methylphenidate (MPH) administration on striatal 5-hydroxytryptamine transporter (5-HTT) densities in an animal model of ADHD. First, it compared the normal development of striatal 5-HTT densities of spontaneously hypertensive rats (SHR) as an animal model of ADHD and Wistar Kyoto (WKY) rats as controls; binding of the highly selective ligand of 5-HTT [(3)H]paroxetine was determined on membrane preparations of the striatum of SHR and WKY rats on postnatal days 25, 50, and 90, i.e. from the time of weaning until adulthood. Second, the long-term effect of chronic administration of 2 mg/kg per day MPH at two different developmental stages (days 25-39 or 50-64) on the striatal 5-HTT density was examined in both rat strains at day 90. Long-term effects of MPH treatment on striatal 5-HTT density in adulthood could be ruled out in both healthy (WKY) and "ADHD" rats (SHR). But a higher striatal 5-HTT density in older SHR versus WKY rats might indicate ADHD specific changes in the 5-HT system that needs further investigation not only in animals.

Probing compulsive and impulsive behaviors, from animal models to endophenotypes: a narrative review

Failures in cortical control of fronto-striatal neural circuits may underpin impulsive and compulsive acts. In this narrative review, we explore these behaviors from the perspective of neural processes and consider how these behaviors and neural processes contribute to mental disorders such as obsessive-compulsive disorder (OCD), obsessive-compulsive personality disorder, and impulse-control disorders such as trichotillomania and pathological gambling. We present findings from a broad range of data, comprising translational and human endophenotypes research and clinical treatment trials, focussing on the parallel, functionally segregated, cortico-striatal neural projections, from orbitofrontal cortex (OFC) to medial striatum (caudate nucleus), proposed to drive compulsive activity, and from the anterior cingulate/ventromedial prefrontal cortex to the ventral striatum (nucleus accumbens shell), proposed to drive impulsive activity, and the interaction between them. We suggest that impulsivity and compulsivity each seem to be multidimensional. Impulsive or compulsive behaviors are mediated by overlapping as well as distinct neural substrates. Trichotillomania may stand apart as a disorder of motor-impulse control, whereas pathological gambling involves abnormal ventral reward circuitry that identifies it more closely with substance addiction. OCD shows motor impulsivity and compulsivity, probably mediated through disruption of OFC-caudate circuitry, as well as other frontal, cingulate, and parietal connections. Serotonin and dopamine interact across these circuits to modulate aspects of both impulsive and compulsive responding and as yet unidentified brain-based systems may also have important functions. Targeted application of neurocognitive tasks, receptor-specific neurochemical probes, and brain systems neuroimaging techniques have potential for future research in this field.

Enhancement of spatial reversal learning by 5-HT2C receptor antagonism is neuroanatomically specific

We have recently demonstrated that systemic administration of 5-HT(2C) and 5-HT(2A) receptor antagonists significantly enhanced and impaired spatial reversal learning, respectively. In this study, the role of 5-HT(2C) and 5-HT(2A) receptor subtypes in the mediation of these opposing effects was further investigated with respect to neuroanatomical specificity. The roles of 5-HT(2C) and 5-HT(2A) receptors were examined within some of the brain regions implicated in cognitive flexibility, namely the orbitofrontal cortex (OFC), medial prefrontal cortex (mPFC), and nucleus accumbens (NAc), by means of targeted infusions of selective 5-HT(2C) and 5-HT(2A) receptor antagonists (SB 242084 and M100907, respectively). Intra-OFC 5-HT(2C) receptor antagonism produced dose-dependent effects similar to those of systemic administration, i.e., improved spatial reversal learning by reducing the number of trials (all doses: 0.1, 0.3, and 1.0 microg) and perseverative errors to criterion (0.3 and 1.0 microg) compared with controls. However, the highest dose (1.0 microg) showed a nonselective effect, as it also affected retention preceding the reversal phase and decreased learning errors. Intracerebral infusions of SB 242084 into the mPFC or NAc produced no significant effects on any behavioral measures. Similarly, no significant differences were observed with intra-OFC, -mPFC, or -NAc infusions of M100907. These data suggest that the improved performance in reversal learning observed after 5-HT(2C) receptor antagonism is mediated within the OFC. These data also bear on the issue of whether 5-HT(2C) receptor antagonism within the OFC might help elucidate the biological substrate of obsessive-compulsive disorder, offering the potential for therapeutic application.

Impulsivity as long-term sequelae after chlorpyrifos intoxication: time course and individual differences

Chlorpyrifos (CPF) is a common organophosphate (OP) insecticide that has been widely used in agriculture as a pesticide. The primary mechanism of acute toxic action of OPs is initiated by acetylcholinesterase (AChE) inhibition. However, non-AChE targets have also been proposed as alternative that contributes to the acute lethal action and side effects of short or long-term exposure. Recently, we have found that a single dose of 250 mg/kg CPF produces acceleration in acquisition on schedule-induced polydipsia (SIP) procedure 6 months after its administration. Moreover, CPF animals show a higher level of impulsivity in a delay-discounting task 1 year after acute administration, and these effects are potentiated when animals are divided into high (HD) and low (LD) drinkers in SIP. In the present study, rats were injected with a subcutaneous (sc) dose of 250 mg/kg of CPF, and 10 weeks later its effect on delay-discounting task was evaluated. Consequently, these animals were evaluated based on SIP, and divided into two populations (HD and LD) according to their rates of drinking in this task. One year after OP administration, these animals were re-evaluated in a delay-discounting task. Results revealed that the CPF-administered rats prefer immediate reward and show a more impulsive choice, 10 weeks after CPF administration. Furthermore, 1 year after it administration, only animals treated with CPF that are high drinkers on SIP are more impulsive than the rest of the groups Therefore, these data suggest that some individuals are more sensitive to OP intoxication than the others, at least in terms of durability of sequelae.

Interactions between the prefrontal cortex and amygdala during delay discounting and reversal

Interactions between the prefrontal cortex and amygdala are thought to be critical for reward anticipation. Alterations in reward anticipation that lead to an inability to wait for rewards or a diminished capacity to change behavior when doing so would be optimal are often termed impulsivity and compulsivity, respectively. Distinct regions of the prefrontal cortex may support decreased impulsivity through self-control and decreased compulsivity through flexibility. However, both self-control and flexibility appear to involve the amygdala. Using a delay discounting paradigm, the current investigation found that inactivation and disconnection of the medial prefrontal cortex and basolateral amygdala led rats to become more impulsive by affecting preference for smaller immediate over larger delayed rewards. Conversely, inactivation and disconnection of the orbitofrontal cortex and amygdala led rats to become more compulsive as demonstrated by an inability to flexibly reverse stimulus-reward relationships in an odor reversal task. The current findings support a double dissociation between orbitofrontal cortex-amygdala interactions for odor reversal and medial prefrontal cortex-amygdala interactions for delay discounting.

Is there an inhibitory-response-control system in the rat? Evidence from anatomical and pharmacological studies of behavioral inhibition

Many common psychiatric conditions, such as attention deficit/hyperactivity disorder (ADHD), obsessive-compulsive disorder (OCD), Parkinson's disease, addiction and pathological gambling are linked by a failure in the mechanisms that control, or inhibit, inappropriate behavior. Models of rat behavioral inhibition permit us to study in detail the anatomical and pharmacological bases of inhibitory failure, using methods that translate directly with patient assessment in the clinic. This review updates current ideas relating to behavioral inhibition based on two significant lines of evidence from rat studies: (1) To integrate new findings from the stop-signal task into existing models of behavioral inhibition, in particular relating to 'impulsive action' control. The stop-signal task has been used for a number of years to evaluate psychiatric conditions and has recently been translated for use in the rat, bringing a wealth of new information to behavioral inhibition research. (2) To consider the importance of the subthalamic nucleus (STN) in the neural circuitry of behavioral inhibition. This function of this nucleus is central to a number of 'disinhibitory' disorders such as Parkinson's disease and OCD, and their therapies, but its role in behavioral inhibition is still undervalued, and often not considered in preclinical models of behavioral control. Integration of these findings has pinpointed the orbitofrontal cortex (OF), dorsomedial striatum (DMStr) and STN within a network that normally inhibits many forms of behavior, including both impulsive and compulsive forms. However, there are distinct differences between behavioral subtypes in their neurochemical modulation. This review brings new light to the classical view of the mechanisms that inhibit behavior, in particular suggesting a far more prominent role for the STN, a structure that is usually omitted from conventional behavioral-inhibition networks. The OF-DMStr-STN circuitry may form the basis of a control network that defines behavioral inhibition and that acts to suppress or countermand many forms of inappropriate or maladaptive behavior.

Dissociable control of impulsivity in rats by dopamine d2/3 receptors in the core and shell subregions of the nucleus accumbens

Previous research has identified the nucleus accumbens (NAcb) as an important brain region underlying inter-individual variation in impulsive behavior. Such variation has been linked to decreased dopamine (DA) D2/3 receptor availability in the ventral striatum of rats exhibiting spontaneously high levels of impulsivity on a 5-choice serial reaction time (5-CSRT) test of sustained visual attention. This study investigated the involvement of DA D2/3 receptors in the NAcb core (NAcbC) and the NAcb shell (NAcbS) in impulsivity. We investigated the effects of a DA D2/3 receptor antagonist (nafadotride) and a DA D2/3 partial agonist (aripiprazole) infused directly into either the NAcbC or NAcbS of rats selected for high (HI) and low (LI) impulsivity on the 5-CSRT task. Nafadotride increased significantly the level of impulsivity when infused into the NAcbS, but decreased impulsivity when infused into the NAcbC of HI rats. By contrast, intra-NAcb microinfusions of aripiprazole did not affect impulsivity. Systemic administration of nafadotride had no effect on impulsive behavior but increased the number of omissions and correct response latencies, whereas systemic injections of aripiprazole decreased impulsive and perseverative behavior, and increased the number of omissions and correct response latencies. These findings indicate an opponent modulation of impulsive behavior by DA D2/3 receptors in the NAcbS and NAcbC. Such divergent roles may have relevance for the etiology and treatment of clinical disorders of behavioral control, including attention-deficit hyperactivity disorder and drug addiction.

NK1 (TACR1) receptor gene 'knockout' mouse phenotype predicts genetic association with ADHD

Mice with functional genetic ablation of the Tacr1 (substance P-preferring receptor) gene (NK1R-/-) are hyperactive. Here, we investigated whether this is mimicked by NK1R antagonism and whether dopaminergic transmission is disrupted in brain regions that govern motor performance. The locomotor activity of NK1R-/- and wild-type mice was compared after treatment with an NK1R antagonist and/or psychostimulant (d-amphetamine or methylphenidate). The inactivation of NK1R (by gene mutation or receptor antagonism) induced hyperactivity in mice, which was prevented by both psychostimulants. Using in vivo microdialysis, we then compared the regulation of extracellular dopamine in the prefrontal cortex (PFC) and striatum in the two genotypes. A lack of functional NK1R reduced (>50%) spontaneous dopamine efflux in the prefrontal cortex and abolished the striatal dopamine response to d-amphetamine. These behavioural and neurochemical abnormalities in NK1R-/- mice, together with their atypical response to psychostimulants, echo attention deficit hyperactivity disorder (ADHD) in humans. These findings prompted genetic studies on the TACR1 gene (the human equivalent of NK1R) in ADHD patients in a case-control study of 450 ADHD patients and 600 screened supernormal controls. Four single-nucleotide polymorphisms (rs3771829, rs3771833, rs3771856, and rs1701137) at the TACR1 gene, previously known to be associated with bipolar disorder or alcoholism, were strongly associated with ADHD. In conclusion, our proposal that NK1R-/- mice offer a mouse model of ADHD was borne out by our human studies, which suggest that DNA sequence changes in and around the TACR1 gene increase susceptibility to this disorder.

Wavelet-synchronization methodology: a new approach for EEG-based diagnosis of ADHD

A multi-paradigm methodology is presented for electroencephalogram (EEG) based diagnosis of Attention-Deficit/Hyperactivity Disorder (ADHD) through adroit integration of nonlinear science; wavelets, a signal processing technique; and neural networks, a pattern recognition technique. The selected nonlinear features are generalized synchronizations known as synchronization likelihoods (SL), both among all electrodes and among electrode pairs. The methodology consists of three parts: first detecting the more synchronized loci (group 1) and loci with more discriminative deficit connections (group 2). Using SLs among all electrodes, discriminative SLs in certain sub-bands are extracted. In part two, SLs are computed, not among all electrodes, but between loci of group 1 and loci of group 2 in all sub-bands and the band-limited EEG. This part leads to more accurate detection of deficit connections, and not just deficit areas, but more discriminative SLs in sub-bands with finer resolutions. In part three, a classification technique, radial basis function neural network, is used to distinguish ADHD from normal subjects. The methodology was applied to EEG data obtained from 47 ADHD and 7 control individuals with eyes closed. The Radial Basis Function (RBF) neural network classifier yielded a high accuracy of 95.6% for diagnosis of the ADHD in the feature space discovered in this research with a variance of 0.7%.

Pharmacological or genetic inactivation of the serotonin transporter improves reversal learning in mice

Growing evidence supports a major contribution of cortical serotonin (5-hydroxytryptamine, 5-HT) to the modulation of cognitive flexibility and the cognitive inflexibility evident in neuropsychiatric disorders. The precise role of 5-HT and the influence of 5-HT gene variation in mediating this process is not fully understood. Using a touch screen-based operant system, we assessed reversal of a pairwise visual discrimination as an assay for cognitive flexibility. Effects of constitutive genetic or pharmacological inactivation of the 5-HT transporter (5-HTT) on reversal were examined by testing 5-HTT null mice and chronic fluoxetine-treated C57BL/6J mice, respectively. Effects of constitutive genetic loss or acute pharmacological depletion of 5-HT were assessed by testing Pet-1 null mice and para-chlorophenylalanine (PCPA)-treated C57BL/6J mice, respectively. Fluoxetine-treated C57BL/6J mice made fewer errors than controls during the early phase of reversal when perseverative behavior is relatively high. 5-HTT null mice made fewer errors than controls in completing the reversal task. However, reversal in Pet-1 null and PCPA-treated C57BL/6J mice was not different from controls. These data further support an important role for 5-HT in modulating reversal learning and provide novel evidence that inactivating the 5-HTT improves this process. These findings could have important implications for understanding and treating cognitive inflexibility in neuropsychiatric disease.

Investigating the behavioral and self-report constructs of impulsivity domains using principal component analysis

Impulsivity, often defined as a human behavior characterized by the inclination of an individual to act on urge rather than thought, with diminished regard to consequences, encompasses a range of maladaptive behaviors, which are in turn affected by distinct neural systems. Congruent with the above definition, behavioral studies have consistently shown that the underlying construct of impulsivity is multidimensional in nature. However, research to date has been inconclusive regarding the different domains or constructs that constitute this behavior. In addition there is also no clear consensus as to whether self-report and laboratory based measures of impulsivity measure the same or different domains. This study aimed to: (i) characterize the underlying multidimensional construct of impulsivity using a sample with varying degrees of putative impulsivity related to substance misuse, including subjects who were at-risk of substance use or addicted (ARA), and (ii) assess relationships between self-report and laboratory measures of impulsivity, using a principal component-based factor analysis. In addition, our supplementary goal was to evaluate the structural constructs of impulsivity within each group separately (healthy and ARA). We used five self-report measures (Behavioral Inhibition System/Behavioral Activation System, Barratt Impulsivity Scale-11, Padua Inventory, Zuckerman Sensation Seeking Scale, and Sensitivity to Punishment and Sensitivity to Reward Questionnaire) and two computer-based laboratory tasks (Balloon Analog Risk Task and the Experiential Discounting Task) to measure the aspects of impulsivity in a total of 176 adult subjects. Subjects included healthy controls (n = 89), nonalcoholic subjects with family histories of alcoholism (family history positive; n = 36) and both former (n = 20) and current (n = 31) cocaine users. Subjects with a family history of alcoholism and cocaine abusers were grouped together as 'at-risk/addicted' (ARA) to evaluate our supplementary goal. Our overall results revealed the multidimensional nature of the impulsivity construct as captured optimally through a five-factor solution that accounted for nearly 70% of the total variance. The five factors/components were imputed as follows 'Self-Reported Behavioral Activation', 'Self-Reported Compulsivity and Reward/Punishment', 'Self-Reported Impulsivity', 'Behavioral Temporal Discounting', and 'Behavioral Risk-Taking'. We also found that contrary to previously published reports, there was significant overlap between certain laboratory and self-report measures, indicating that they might be measuring the same impulsivity domain. In addition, our supplemental analysis also suggested that the impulsivity constructs were largely, but not entirely the same within the healthy and ARA groups.

Response disinhibition evoked by the administration of nicotine and nicotine-associated contextual cues

Nicotine causes dose-dependent alterations in accuracy on the differential-reinforcement of low-rate responding (DRL) 29.5-s schedule in rats. The current investigation evaluated whether nicotine-associated contextual cues can produce nicotine-like perturbations in DRL-schedule performance in the absence of nicotine. Nicotine and saline administrations occurred just prior to DRL 29.5-s schedule responding for sucrose solution, and two different experimental contexts (differentiated by visual, olfactory, and tactile cues) were utilized. All subjects (N=16) experienced two consecutive sessions of DRL-schedule responding per day. The experimental group (n=8) was exposed to saline immediately prior to the first session and 0.3mg/kg nicotine before the second session, and the context was changed between sessions. This sequence of saline and then nicotine administration, paired with two reliable contexts, persisted for 12 consecutive days and successive nicotine administrations corresponded with increasingly poorer performance on the DRL 29.5-s schedule. No nicotine was administered for days 13-20 during context testing, and the nicotine-associated context produced response disinhibition on the DRL schedule. Two control groups were included in the design; subjects in one control group (n=4) received saline in each context to verify that the contexts themselves were not exerting control over operant responding. To assess how explicit and non-explicit pairings of nicotine and contextual cues influenced DRL behavior, subjects in a second control group (n=4) were given nicotine prior to the second session, but the contexts were not altered between sessions. The results from this experiment suggest that environmental stimuli associated with nicotine exposure can come to elicit nicotine-induced performance decrements on a DRL 29.5-s schedule.

Evaluating dopamine reward pathway in ADHD: clinical implications

CONTEXT

Attention-deficit/hyperactivity disorder (ADHD)--characterized by symptoms of inattention and hyperactivity-impulsivity--is the most prevalent childhood psychiatric disorder that frequently persists into adulthood, and there is increasing evidence of reward-motivation deficits in this disorder.

OBJECTIVE

To evaluate biological bases that might underlie a reward/motivation deficit by imaging key components of the brain dopamine reward pathway (mesoaccumbens).

DESIGN, SETTING, AND PARTICIPANTS

We used positron emission tomography to measure dopamine synaptic markers (transporters and D(2)/D(3) receptors) in 53 nonmedicated adults with ADHD and 44 healthy controls between 2001-2009 at Brookhaven National Laboratory.

MAIN OUTCOME MEASURES

We measured specific binding of positron emission tomographic radioligands for dopamine transporters (DAT) using [(11)C]cocaine and for D(2)/D(3) receptors using [(11)C]raclopride, quantified as binding potential (distribution volume ratio -1).

RESULTS

For both ligands, statistical parametric mapping showed that specific binding was lower in ADHD than in controls (threshold for significance set at P < .005) in regions of the dopamine reward pathway in the left side of the brain. Region-of-interest analyses corroborated these findings. The mean (95% confidence interval [CI] of mean difference) for DAT in the nucleus accumbens for controls was 0.71 vs 0.63 for those with ADHD (95% CI, 0.03-0.13, P = .004) and in the midbrain for controls was 0.16 vs 0.09 for those with ADHD (95% CI, 0.03-0.12; P < or = .001); for D(2)/D(3) receptors, the mean accumbens for controls was 2.85 vs 2.68 for those with ADHD (95% CI, 0.06-0.30, P = .004); and in the midbrain, it was for controls 0.28 vs 0.18 for those with ADHD (95% CI, 0.02-0.17, P = .01). The analysis also corroborated differences in the left caudate: the mean DAT for controls was 0.66 vs 0.53 for those with ADHD (95% CI, 0.04-0.22; P = .003) and the mean D(2)/D(3) for controls was 2.80 vs 2.47 for those with ADHD (95% CI, 0.10-0.56; P = .005) and differences in D(2)/D(3) in the hypothalamic region, with controls having a mean of 0.12 vs 0.05 for those with ADHD (95% CI, 0.02-0.12; P = .004). Ratings of attention correlated with D(2)/D(3) in the accumbens (r = 0.35; 95% CI, 0.15-0.52; P = .001), midbrain (r = 0.35; 95% CI, 0.14-0.52; P = .001), caudate (r = 0.32; 95% CI, 0.11-0.50; P = .003), and hypothalamic (r = 0.31; CI, 0.10-0.49; P = .003) regions and with DAT in the midbrain (r = 0.37; 95% CI, 0.16-0.53; P < or = .001).

CONCLUSION

A reduction in dopamine synaptic markers associated with symptoms of inattention was shown in the dopamine reward pathway of participants with ADHD.

Balancing risk and reward: a rat model of risky decision making

We developed a behavioral task in rats to assess the influence of risk of punishment on decision making. Male Long-Evans rats were given choices between pressing a lever to obtain a small, 'safe' food reward and a large food reward associated with risk of punishment (footshock). Each test session consisted of 5 blocks of 10 choice trials, with punishment risk increasing with each consecutive block (0, 25, 50, 75, 100%). Preference for the large, 'risky' reward declined with both increased probability and increased magnitude of punishment, and reward choice was not affected by the level of satiation or the order of risk presentation. Performance in this risky decision-making task was correlated with the degree to which the rats discounted the value of probabilistic rewards, but not delayed rewards. Finally, the acute effects of different doses of amphetamine and cocaine on risky decision making were assessed. Systemic amphetamine administration caused a dose-dependent decrease in choice of the large risky reward (ie, it made rats more risk averse). Cocaine did not cause a shift in reward choice, but instead impaired the rats' sensitivity to changes in punishment risk. These results should prove useful for investigating neuropsychiatric disorders in which risk taking is a prominent feature, such as attention deficit/hyperactivity disorder and addiction.

Effects of chronic administration of drugs of abuse on impulsive choice (delay discounting) in animal models

Drug-addicted individuals show high levels of impulsive choice, characterized by preference for small immediate over larger but delayed rewards. Although the causal relationship between chronic drug use and elevated impulsive choice in humans has been unclear, a small but growing body of literature over the past decade has shown that chronic drug administration in animal models can cause increases in impulsive choice, suggesting that a similar causal relationship may exist in human drug users. This article reviews this literature, with a particular focus on the effects of chronic cocaine administration, which have been most thoroughly characterized. The potential mechanisms of these effects are described in terms of drug-induced neural alterations in ventral striatal and prefrontal cortical brain systems. Some implications of this research for pharmacological treatment of drug-induced increases in impulsive choice are discussed, along with suggestions for future research in this area.

Differences in impulsivity on a delay-discounting task predict self-administration of a low unit dose of methylphenidate in rats

There is controversy about the abuse liability of methylphenidate (MPH) in humans, and MPH has yet to be established fully as a reinforcer in rats. The present experiment examined whether intravenous MPH served as a reinforcer in rats, and how individual differences in impulsivity impacted MPH self-administration. Rats were exposed to a delay-discounting procedure, and then were implanted with an intravenous catheter to assess self-administration of 0.56 mg/kg/infusion MPH at different fixed ratio values. Self-administration rates of different MPH doses (0.03-1.0 mg/kg/infusion) were also examined. Both high and low impulsive rats acquired MPH self-administration at the same rate. All rats pressed more on the active lever than the inactive lever regardless of MPH dose, and pressed more for MPH than for saline. High impulsive rats self-administered more MPH than low impulsive rats at a low unit dose (0.1 mg/kg/infusion), though not at higher doses, indicating that individual differences in impulsive choice influence the dose-dependent reinforcing effects of MPH.

Encoding of marginal utility across time in the human brain

Marginal utility theory prescribes the relationship between the objective property of the magnitude of rewards and their subjective value. Despite its pervasive influence, however, there is remarkably little direct empirical evidence for such a theory of value, let alone of its neurobiological basis. We show that human preferences in an intertemporal choice task are best described by a model that integrates marginally diminishing utility with temporal discounting. Using functional magnetic resonance imaging, we show that activity in the dorsal striatum encodes both the marginal utility of rewards, over and above that which can be described by their magnitude alone, and the discounting associated with increasing time. In addition, our data show that dorsal striatum may be involved in integrating subjective valuation systems inherent to time and magnitude, thereby providing an overall metric of value used to guide choice behavior. Furthermore, during choice, we show that anterior cingulate activity correlates with the degree of difficulty associated with dissonance between value and time. Our data support an integrative architecture for decision making, revealing the neural representation of distinct subcomponents of value that may contribute to impulsivity and decisiveness.

Acute effects of morphine on distinct forms of impulsive behavior in rats

RATIONALE

Disturbances in impulse control are key features of substance abuse disorders, and conversely, many drugs of abuse are known to elicit impulsive behavior both clinically and preclinically. To date, little is known with respect to the involvement of the opioid system in impulsive behavior, although recent findings have demonstrated its involvement in delay discounting processes. The aim of the present study was to further investigate the role of the opioid system in varieties of impulsivity.

MATERIALS AND METHODS

To this end, groups of rats were trained in the five-choice serial reaction time task (5-CSRTT) and stop-signal task (SST), operant paradigms that provide measures of inhibitory control and response inhibition, respectively. In addition, another group of rats was trained in the delayed reward paradigm, which measures the sensitivity towards delay of gratification and as such assesses impulsive choice.

RESULTS AND DISCUSSION

Results demonstrated that morphine, a selective micro-opioid receptor agonist, primarily impaired inhibitory control in the 5-CSRTT by increasing premature responding. In addition, in keeping with previous data, morphine decreased the preference for the large over small reward in the delayed reward paradigm. The effects of morphine on measures of impulsivity in both the 5-CSRTT and delayed reward paradigm were blocked by naloxone, a micro-opioid receptor antagonist. Naloxone by itself did not alter impulsive behavior, suggesting limited involvement of an endogenous opioid tone in impulsivity. Response inhibition measured in the SST was neither altered by morphine nor naloxone, although some baseline-dependent effects of morphine on response inhibition were observed.

CONCLUSION

In conclusion, the present data demonstrate that acute challenges with morphine modulate distinct forms of impulsive behavior, thereby suggesting a role for the opioid system in impulsivity.