Catecholamine receptors differentially mediate impulsive choice in the medial prefrontal and orbitofrontal cortex

Involvement of dopamine D3 receptor in impulsive choice decision-making in male rats

Impulsive decision-making has been linked to impulse control disorders and substance use disorders. However, the neural mechanisms underlying impulsive choice are not fully understood. While previous PET imaging and autoradiography studies have shown involvement of dopamine and D2/3 receptors in impulsive behavior, the roles of distinct D1, D2, and D3 receptors in impulsive decision-making remain unclear. In this study, we used a food reward delay-discounting task (DDT) to identify low- and high-impulsive rats, in which low-impulsive rats exhibited preference for large delayed reward over small immediate rewards, while high-impulsive rats showed the opposite preference. We then examined D1, D2, and D3 receptor gene expression using RNAscope in situ hybridization assays. We found that high-impulsive male rats exhibited lower levels of D2 and D3, and particularly D3, receptor expression in the nucleus accumbens (NAc), with no significant changes in the insular, prelimbic, and infralimbic cortices. Based on these findings, we further explored the role of the D3 receptor in impulsive decision-making. Systemic administration of a selective D3 receptor agonist (FOB02-04) significantly reduced impulsive choices in high-impulsive rats but had no effects in low-impulsive rats. Conversely, a selective D3 receptor antagonist (VK4-116) produced increased both impulsive and omission choices in both groups of rats. These findings suggest that impulsive decision-making is associated with a reduction in D3 receptor expression in the NAc. Selective D3 receptor agonists, but not antagonists, may hold therapeutic potentials for mitigating impulsivity in high-impulsive subjects.

Heightened SAM- and HPA-axis activity during acute stress impairs decision-making: A systematic review on underlying neuropharmacological mechanisms

Individuals might be exposed to intense acute stress while having to make decisions with far-reaching consequences. Acute stress impairs processes required for decision-making by activating different biological stress cascades that in turn affect the brain. By knowing which stress system, brain areas, and receptors are responsible for compromised decision-making processes, we can effectively find potential pharmaceutics that can prevent the deteriorating effects of acute stress. We used a systematic review procedure and found 44 articles providing information on this topic. Decision-making processes could be subdivided into 4 domains (cognitive, motivational, affective, and predictability) and could be referenced to specific brain areas, while mostly being impaired by molecules associated with the sympathetic-adrenal-medullar and hypothalamic-pituitary-adrenal axes. Potential drugs to alleviate these effects included α1 and β adrenoceptor antagonists, α2 adrenoceptor agonists, and corticotropin releasing factor receptor1/2 antagonists, while consistent stress-like effects were found with yohimbine, an α2 adrenoceptor antagonist. We suggest possible avenues for future research.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

Choice impulsivity after repeated social stress is associated with increased perineuronal nets in the medial prefrontal cortex

Repeated stress can predispose to substance abuse. However, behavioral and neurobiological adaptations that link stress to substance abuse remain unclear. This study investigates whether intermittent social defeat (ISD), a stress protocol that promotes drug-seeking behavior, alters intertemporal decision-making and cortical inhibitory function in the medial prefrontal cortex (mPFC). Male long evans rats were trained in a delay discounting task (DDT) where rats make a choice between a fast (1 s) small reward (1 sugar pellet) and a large reward (3 sugar pellets) that comes with a time delay (10 s or 20 s). A decreased preference for delayed rewards was used as an index of choice impulsivity. Rats were exposed to ISD and tested in the DDT 24 h after each stress episode, and one- and two-weeks after the last stress episode. Immunohistochemistry was performed in rat's brains to evaluate perineuronal nets (PNNs) and parvalbumin GABA interneurons (PV) labeling as markers of inhibitory function in mPFC. ISD significantly decreased the preference for delayed large rewards in low impulsive, but not high impulsive, animals. ISD also increased the density of PNNs in the mPFC. These results suggest that increased choice impulsivity and cortical inhibition predispose animals to seek out rewards after stress.

Relationship between insulin and Netrin-1/DCC guidance cue pathway regulation in the prefrontal cortex of rodents exposed to prenatal dietary restriction

Fetal restriction (FR) alters insulin sensitivity, but it is unknown how the metabolic profile associated with restriction affects development of the dopamine (DA) system and DA-related behaviors. The Netrin-1/DCC guidance cue system participates in maturation of the mesocorticolimbic DA circuitry. Therefore, our objective was to identify if FR modifies Netrin-1/DCC receptor protein expression in the prefrontal cortex (PFC) at birth and mRNA in adulthood in rodent males. We used cultured HEK293 cells to assess if levels of miR-218, microRNA regulator of DCC, are sensitive to insulin. To assess this, pregnant dams were subjected to a 50% FR diet from gestational day 10 until birth. Medial PFC (mPFC) DCC/Netrin-1 protein expression was measured at P0 at baseline and Dcc/Netrin-1 mRNA levels were quantified in adults 15 min after a saline/insulin injection. miR-218 levels in HEK-293 cells were measured in response to insulin exposure. At P0, Netrin-1 levels are downregulated in FR animals in comparison to controls. In adult rodents, insulin administration results in an increase in Dcc mRNA levels in control but not FR rats. In HEK293 cells, there is a positive correlation between insulin concentration and miR-218 levels. Since miR-218 is a Dcc gene expression regulator and our in vitro results show that insulin regulates miR-218 levels, we suggest that FR-induced changes in insulin sensitivity could be affecting Dcc expression via miR-218, impacting DA system maturation and organization. As fetal adversity is linked to nonadaptive behaviors later in life, this may contribute to early identification of vulnerability to chronic diseases associated with fetal adversity.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Effect of atomoxetine on ADHD-pain hypersensitization comorbidity in 6-OHDA lesioned mice

BACKGROUND

Methylphenidate and atomoxetine are used for the treatment of attention-deficit/hyperactivity disorder (ADHD). Our previous studies established the validity of the 6-hydroxydopamine (6-OHDA) mouse model of ADHD and demonstrated hypersensitivity to pain, in line with clinical reports in ADHD patients. Acute methylphenidate treatment reduces hyperactivity and increases attention, but does not affect pain behaviors in this mouse model. Whereas atomoxetine has been shown to be effective against some symptoms of ADHD, nothing is known about its possible action on comorbid pain hypersensitivity. The objectives of the present research are (1) to investigate the effects of acute and chronic treatment with atomoxetine on ADHD-like symptoms and nociceptive thresholds, and (2) to explore the catecholaminergic systems underlying these effects.

METHODS

Sham and 6-OHDA cohorts of male mice were tested for hyperactivity (open field), attention and impulsivity (5-choice serial reaction time task test), and thermal (hot plate test) and mechanical (von Frey test) thresholds after acute or repeated treatment with vehicle or atomoxetine (1, 3 or 10 mg/kg).

RESULTS

Acute administration of atomoxetine (10 mg/kg) reduced the hyperactivity and impulsivity displayed by 6-OHDA mice, without affecting attention or nociception. However, atomoxetine administered at 3 mg/kg/day for 7 days alleviated the ADHD-like core symptoms and attenuated the hyperalgesic responses. Furthermore, hyperlocomotion and anti-hyperalgesic activity were antagonized with phentolamine, propranolol, and sulpiride pre-treatments.

CONCLUSION

These findings demonstrated that when administered chronically, atomoxetine has a significant effect on ADHD-associated pain hypersensitization, likely mediated by both α- and β-adrenergic and D2/D3 dopaminergic receptors, and suggest new indications for atomoxetine that will need to be confirmed by well-designed clinical trials.

Dopamine D2 receptors in nucleus accumbens cholinergic interneurons increase impulsive choice

Impulsive choice, often characterized by excessive preference for small, short-term rewards over larger, long-term rewards, is a prominent feature of substance use and other neuropsychiatric disorders. The neural mechanisms underlying impulsive choice are not well understood, but growing evidence implicates nucleus accumbens (NAc) dopamine and its actions on dopamine D2 receptors (D2Rs). Because several NAc cell types and afferents express D2Rs, it has been difficult to determine the specific neural mechanisms linking NAc D2Rs to impulsive choice. Of these cell types, cholinergic interneurons (CINs) of the NAc, which express D2Rs, have emerged as key regulators of striatal output and local dopamine release. Despite these relevant functions, whether D2Rs expressed specifically in these neurons contribute to impulsive choice behavior is unknown. Here, we show that D2R upregulation in CINs of the mouse NAc increases impulsive choice as measured in a delay discounting task without affecting reward magnitude sensitivity or interval timing. Conversely, mice lacking D2Rs in CINs showed decreased delay discounting. Furthermore, CIN D2R manipulations did not affect probabilistic discounting, which measures a different form of impulsive choice. Together, these findings suggest that CIN D2Rs regulate impulsive decision-making involving delay costs, providing new insight into the mechanisms by which NAc dopamine influences impulsive behavior.

Adolescent alcohol exposure reduces dopamine 1 receptor modulation of prelimbic neurons projecting to the nucleus accumbens and basolateral amygdala

Binge drinking during adolescence is highly prevalent despite increasing evidence of its long-term impact on behaviors associated with modulation of behavioral flexibility by the medial prefrontal cortex (mPFC). In the present study, male and female rats underwent adolescent intermittent ethanol (AIE) exposure by vapor inhalation. After aging to adulthood, retrograde bead labelling and viral tagging were used to identify populations of neurons in the prelimbic region (PrL) of the mPFC that project to specific subcortical targets. Electrophysiological recording from bead-labelled neurons in PrL slices revealed that AIE did not alter the intrinsic excitability of PrL neurons that projected to either the NAc or the BLA. Similarly, recordings of spontaneous inhibitory and excitatory post-synaptic currents revealed no AIE-induced changes in synaptic drive onto either population of projection neurons. In contrast, AIE exposure was associated with a loss of dopamine receptor 1 (D1), but no change in dopamine receptor 2 (D2), modulation of evoked firing of both populations of projection neurons. Lastly, confocal imaging of proximal and apical dendritic tufts of viral-labelled PrL neurons that projected to the nucleus accumbens (NAc) revealed AIE did not alter the density of dendritic spines. Together, these observations provide evidence that AIE exposure results in disruption of D1 receptor modulation of PrL inputs to at least two major subcortical target regions that have been implicated in AIE-induced long-term changes in behavioral control.

Mechanisms Underlying Dopaminergic Regulation of Nicotine-Induced Kinetic Tremor

Nicotine induces kinetic tremor, which resembles pharmacological features of essential tremors, via activating the inferior olive (IO) neurons. Since nicotine is known to enhance dopamine release by stimulating α4β2 and/or α6 nACh receptors, we examined the effects of various dopamine receptor ligands on nicotine-induced tremor to clarify the role of the dopaminergic system in modulating nicotine tremor. A tremorgenic dose of nicotine increased the dopamine level in the pons and medulla oblongata (P/MO), and the levels of dopamine metabolites in the hippocampus, P/MO, and striatum. Treatment of animals with the D1/5 agonist SKF-38393 inhibited the induction of nicotine tremor, whereas the D3 agonist PD-128,907 facilitated nicotine-induced tremor. The D2 agonist sumanirole showed no effect. In addition, nicotine tremor was significantly enhanced by the D1/5 antagonist SCH-23390 and inhibited by the D3 antagonist U-99194. Neither the D2 (L-741,626) nor D4 (L-745,870) antagonist affected the generation of nicotine tremor. Furthermore, microinjection of U-99194 into the cerebellum significantly inhibited nicotine-induced tremor, whereas its injection into IO or the striatum did not affect tremor generation. Although intrastriatal injection of SCH-23390 showed no effects, its injection into IO tended to enhance nicotine-induced tremor. The present study suggests that dopamine D3 and D1/5 receptors regulate the induction of nicotine tremor in an opposite way, D3 receptors facilitately and D1/5 receptors inhibitorily. In addition, the cerebellar D3 receptors may play an important role in modulating the induction of nicotine tremor mediated by the olivo-cerebellar system.

The effects of early life stress on impulsivity

Elevated impulsivity is a symptom shared by various psychiatric disorders such as substance use disorder, bipolar disorder, and attention-deficit/hyperactivity disorder. However, impulsivity is not a unitary construct and impulsive behaviors fall into two subcategories: impulsive action and impulsive choice. Impulsive choice refers to the tendency to prefer immediate, small rewards over delayed, large rewards, whereas impulsive action involves difficulty inhibiting rash, premature, or mistimed behaviors. These behaviors are mediated by the mesocorticolimbic dopamine (DA) system, which consists of projections from the ventral tegmental area to the nucleus accumbens and prefrontal cortex. Early life stress (ELS) alters both impulsive choice and impulsive action in rodents. ELS also changes DA receptor expression, transmission, and activity within the mesocorticolimbic system. This review integrates the dopamine, impulsivity, and ELS literature to provide evidence that ELS alters impulsivity via inducing changes in the mesocorticolimbic DA system. Understanding how ELS affects brain circuits associated with impulsivity can help advance treatments aimed towards reducing impulsivity symptoms in a variety of psychiatric disorders.

Which came first: Cannabis use or deficits in impulse control?

Impulse control deficits are often found to co-occur with substance use disorders (SUDs). On the one hand, it is well known that chronic intake of drugs of abuse remodels the brain with significant consequences for a range of cognitive behaviors. On the other hand, individual variation in impulse control may contribute to differences in susceptibility to SUDs. Both of these relationships have been described, thus leading to a "chicken or the egg" debate which remains to be fully resolved. Does impulsivity precede drug use or does it manifest as a function of problematic drug usage? The link between impulsivity and SUDs has been most strongly established for cocaine and alcohol use disorders using both preclinical models and clinical data. Much less is known about the potential link between impulsivity and cannabis use disorder (CUD) or the directionality of this relationship. The initiation of cannabis use occurs most often during adolescence prior to the brain's maturation, which is recognized as a critical period of development. The long-term effects of chronic cannabis use on the brain and behavior have started to be explored. In this review we will summarize these observations, especially as they pertain to the relationship between impulsivity and CUD, from both a psychological and biological perspective. We will discuss impulsivity as a multi-dimensional construct and attempt to reconcile the results obtained across modalities. Finally, we will discuss possible avenues for future research with emerging longitudinal data.

Dopaminergic modulation of reward discounting in healthy rats: a systematic review and meta-analysis

RATIONALE

Although numerous studies have suggested that pharmacological alteration of the dopamine (DA) system modulates reward discounting, these studies have produced inconsistent findings.

OBJECTIVES

Here, we conducted a systematic review and pre-registered meta-analysis to evaluate DA drug-mediated effects on reward discounting of time, probability, and effort costs in studies of healthy rats. This produced a total of 1343 articles to screen for inclusion/exclusion. From the literature, we identified 117 effects from approximately 1549 individual rats.

METHODS

Using random effects with maximum-likelihood estimation, we meta-analyzed placebo-controlled drug effects for (1) DA D1-like receptor agonists and (2) antagonists, (3) D2-like agonists and (4) antagonists, and (5) DA transporter-modulating drugs.

RESULTS

Meta-analytic effects showed that DAT-modulating drugs decreased reward discounting. While D1-like and D2-like antagonists both increased discounting, agonist drugs for those receptors had no significant effect on discounting behavior. A number of these effects appear contingent on study design features like cost type, rat strain, and microinfusion location.

CONCLUSIONS

These findings suggest a nuanced relationship between DA and discounting behavior and urge caution when drawing generalizations about the effects of pharmacologically manipulating dopamine on reward-based decision-making.

Involvement of the Hippocampal Alpha2A-Adrenoceptors in Anxiety-Related Behaviors Elicited by Intermittent REM Sleep Deprivation-Induced Stress in Mice

Attention deficit/hyperactivity disorder (AD/HD) is a neurodevelopmental disorder characterized by inattention, hyperactivity, and impulsivity. In patients with AD/HD, a decrease in the total and rapid eye movement (REM) sleep times has been observed. We have previously reported that mice with REM sleep deprivation-induced stress (REMSD) may show the hyperactivity- and inattention-like symptoms of AD/HD. However, in this model, impulsivity has not yet been investigated. Impulsivity and anxiety-related behaviors are evaluated by the elevated plus maze test (EPM). In this study, we investigated whether REMSD causes changes in the EPM and expression of alpha2A-adrenoceptors in the hippocampus and frontal cortex in a mouse model. Mice were deprived of REM sleep intermittently using the small-platform method (20 h/d) for 3 d. The time spent in the open arm and the expression levels of alpha2A-adrenoceptor in the hippocampus were significantly increased and decreased, respectively, by the REMSD. The time spent in the open arm was significantly limited by oxymetazoline (an alpha2A-adrenoceptor agonist), methylphenidate, and atomoxetine, which are clinically used to treat AD/HD. Moreover, the positive effects of oxymetazoline were attenuated by yohimbine and BRL44408, which are selective alpha2- and alpha2A-adrenoceptor antagonists, respectively. These results suggest that the increase in the time spent in the open arm induced by REMSD may serve as a model of impulsivity in AD/HD. Furthermore, the REMSD eliciting impulsivity-like behavior and the low-levels of anxiety may be linked to alpha2A-adrenoceptor signaling, as indicated by a decrease in alpha2A-adrenoceptor signaling, particularly in the mouse hippocampus.

Extra-striatal D2/3 receptor availability in youth at risk for addiction

The neurobiological traits that confer risk for addictions remain poorly understood. However, dopaminergic function throughout the prefrontal cortex, limbic system, and upper brainstem has been implicated in behavioral features that influence addiction vulnerability, including poor impulse control, and altered sensitivity to rewards and punishments (i.e., externalizing features). To test these associations in humans, we measured type-2/3 dopamine receptor (DA_2/3R) availability in youth at high vs. low risk for substance use disorders (SUDs). In this study, N = 58 youth (18.5 ± 0.6 years) were recruited from cohorts that have been followed since birth. Participants with either high (high EXT; N = 27; 16 F/11 M) or low pre-existing externalizing traits (low EXT; N = 31; 20 F/11 M) underwent a 90-min positron emission tomography [¹⁸F]fallypride scan, and completed the Barratt Impulsiveness Scale (BIS-11), Substance Use Risk Profile scale (SURPS), and Sensitivity to Punishment (SP) and Sensitivity to Reward (SR) questionnaire. We found that high vs. low EXT trait participants reported elevated substance use, BIS-11, SR, and SURPS impulsivity scores, had a greater prevalence of psychiatric disorders, and exhibited higher [¹⁸F]fallypride binding potential (BP_ND) values in prefrontal, limbic and paralimbic regions, even when controlling for substance use. Group differences were not evident in midbrain dopamine cell body regions, but, across all participants, low midbrain BP_ND values were associated with low SP scores. Together, the results suggest that altered DA_2/3R availability in terminal extra-striatal and dopamine cell body regions might constitute biological vulnerability traits, generating an EXT trajectory for addictions with and without co-occurring alterations in punishment sensitivity (i.e., an internalizing feature).

Prefrontal regulation of behavioural control: Evidence from learning theory and translational approaches in rodents

Everyday activities require adaptive decision-making and control over our actions to achieve our goals. Sub-regions within the cortex are widely reported to regulate these choices. Here we review rodent studies from two disparate fields of instrumental action control - goal-directed and habitual responding, and impulsive and compulsive behaviour. Our aim was to compare findings across the spectrum, from precision associative learning to translational studies of action control. The evidence suggests that each cortical sub-region performs different roles depending on task requirements and, within tasks, clear dissociations exist between regions. Rather than synthesizing a single role or function for a given region, we should consider regions to be capable of many different functions. Further investigation of cortico-cortical connections and the pattern of input and output circuitry within each region may be needed to identify unique process-specific pathways. Despite differences in the scope and purpose of these two fields, integrating evidence across tasks provides a broader context for testing hypotheses about the role of cortical regions in adaptive actions and decision-making.

Using a dependent schedule to measure risky choice in male rats: Effects of d-amphetamine, methylphenidate, and methamphetamine

Risky choice is the tendency to choose a large, uncertain reward over a small, certain reward, and is typically measured with probability discounting, in which the probability of obtaining the large reinforcer decreases across blocks of trials. One caveat to traditional procedures is that independent schedules are used, in which subjects can show exclusive preference for one alternative relative to the other. For example, some rats show exclusive preference for the small, certain reinforcer as soon as delivery of the large reinforcer becomes probabilistic. Therefore, determining if a drug increases risk aversion (i.e., decreases responding for the probabilistic alternative) is difficult (due to floor effects). The overall goal of this experiment was to use a concurrent-chains procedure that incorporated a dependent schedule during the initial link, thus preventing animals from showing exclusive preference for one alternative relative to the other. To determine how pharmacological manipulations alter performance in this task, male Sprague-Dawley rats (n = 8) received injections of amphetamine (0, 0.25, 0.5, 1.0 mg/kg), methylphenidate (0, 0.3, 1.0, 3.0 mg/kg), and methamphetamine (0, 0.5, 1.0, 2.0 mg/kg). Amphetamine (0.25 mg/kg) and methylphenidate (3.0 mg/kg) selectively increased risky choice, whereas higher doses of amphetamine (0.5 and 1.0 kg/mg) and each dose of methamphetamine impaired stimulus control (i.e., flattened the discounting function). These results show that dependent schedules can be used to measure risk-taking behavior and that psychostimulants promote suboptimal choice when this schedule is used. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The Neuropharmacology of Impulsive Behaviour, an Update

Neuropharmacological interventions in preclinical translational models of impulsivity have tremendously contributed to a better understanding of the neurochemistry and neural basis of impulsive behaviour. In this regard, much progress has been made over the last years, also due to the introduction of novel techniques in behavioural neuroscience such as optogenetics and chemogenetics. In this chapter, we will provide an update of how the behavioural pharmacology field has progressed and built upon existing data since an earlier review we wrote in 2008. To this aim, we will first give a brief background on preclinical translational models of impulsivity. Next, recent interesting evidence of monoaminergic modulation of impulsivity will be highlighted with a focus on the neurotransmitters dopamine and noradrenaline. Finally, we will close the chapter by discussing some novel directions and drug leads in the neuropharmacological modulation of impulsivity.

Dietary intake of tryptophan tied emotion-related impulsivity in humans

Emotion-related impulsivity, defined as the tendency to say or do things that one later regret during periods of heightened emotion, has been tied to a broad range of psychopathologies. Previous work has suggested that emotion-related impulsivity is tied to an impaired function of the serotonergic system. Central serotonin synthesis relies on the intake of the essential amino acid, tryptophan and its ability to pass through the blood brain barrier. Objective: The aim of this study was to determine the association between emotion-related impulsivity and tryptophan intake. Methods: Undergraduate participants (N = 25, 16 women, 9 men) completed a self-rated measure of impulsivity (Three Factor Impulsivity Index, TFI) and daily logs of their food intake and exercise. These data were coded using the software NutriNote to evaluate intakes of tryptophan, large neutral amino acids, vitamins B6/B12, and exercise. Results: Correlational analyses indicated that higher tryptophan intake was associated with significantly lower scores on two out of three subscales of the TFI, Pervasive Influence of Feelings scores r = -.502, p < .010, and (lack-of) Follow-Through scores, r = -.407, p < .050. Conclusion: Findings provide further evidence that emotion-related impulsivity is correlated to serotonergic indices, even when considering only food habits. It also suggests the need for more research on whether tryptophan supplements might be beneficial for impulsive persons suffering from a psychological disorder.

Effects of the Alpha-1 Antagonist Prazosin on KOR Agonist-Induced Reinstatement of Alcohol Seeking

BACKGROUND

Stress is associated with relapse to alcohol seeking during abstinence, but the processes underlying this relationship are poorly understood. Noradrenaline is a key transmitter in stress responses and in stress-induced drug seeking. The alpha-1 adrenoceptor antagonist prazosin has been investigated as a treatment for alcoholism and for chronic stress disorders that are frequently comorbid with alcoholism. In rats, we previously showed that prazosin blocks reinstatement of alcohol seeking induced by footshock and yohimbine stressors and reduces yohimbine-induced brain activation. The role of alpha-1 adrenoceptors in reinstatement induced by other stressors is not known. Our most recent work is on the role of kappa opioid receptors in stress-induced reinstatement of alcohol seeking and have reported that the selective kappa opioid receptor agonist U50,488 induces reinstatement and neuronal activation in stress- and relapse-related brain regions. Here we determine the involvement of alpha-1 receptors in reinstatement and brain activation induced by U50,488.

METHODS

We trained male Long-Evans rats to self-administer alcohol (12% w/v), extinguished alcohol-reinforced responding, and then determined the effects of prazosin (1 mg/kg) on U50,488 (2.5 mg/kg)-induced reinstatement and regional Fos expression.

RESULTS

Prazosin blocked U50,488-induced reinstatement and decreased U50,488-induced Fos expression in the orbitofrontal cortex, nucleus accumbens core, ventral bed nucleus of the stria terminalis, central and basolateral amygdalar nuclei and ventral tegmental area.

CONCLUSIONS

These findings suggest that prazosin may reduce U50,488-induced relapse by inhibiting activity in 1 or more of these brain areas.

The use of laser capture microdissection to identify specific pathways and mechanisms involved in impulsive choice in rats

BACKGROUND

Microinjections, lesions, viral-mediated gene transfer, or designer receptors exclusively activated by designer drugs (DREADDs) can identify brain signaling pathways and their pharmacology in research animals. Genetically modified animals are used for more precise assessment of neural circuits. However, only a few of the gene-based pathway modifications are available for use in outbred rat strains.

NEW METHOD

Behaviorally characterized Sprague-Dawley rats undergo tract tracing through microinjection of fluorospheres, followed by laser capture microdissection (LCM) and qPCR for detecting mRNA of pathway-associated gene products. Correlations between mRNA expression and behavior identify specific involvement of pharmacologically relevant molecules within cells of interest. Here, we examined this methodology in an impulsive choice paradigm and targeted projections from the orbital and medial prefrontal cortex.

RESULTS

In this proof of concept study, we demonstrate relationships between measures of impulsive choice with distinct neurotransmitter receptor expression in cell populations from four different signaling pathways.

COMPARISONS WITH EXISTING METHODS

Combining behavior, tract tracing, LCM, and gene expression profiling provides more cellular selectivity than localized lesions and DREADDs, and greater pharmacological specificity than microinjections and viral-mediated gene transfer due to targeting identified neurons. Furthermore, the assessment of inter-individual pathways provides insight into the complex nature of underlying mechanisms involved in typical and atypical behavior.

CONCLUSIONS

The novel combination of behavior, tract tracing, LCM, and single gene or potential whole genome transcriptome analysis allows for a more targeted understanding of the interconnection of neural circuitry with behavior, and holds promise to identify more specific drug targets that are relevant to behavioral phenotypes.

Stress augments the rewarding memory of cocaine via the activation of brainstem-reward circuitry

Effects of stress on the reward system are well established in the literature. Although previous studies have revealed that stress can reinstate extinguished addictive behaviors related to cocaine, the effects of stress on the rewarding memory of cocaine are not fully understood. Here, we provide evidence that stress potentiates the expression of rewarding memory of cocaine via the activation of brainstem-reward circuitry using a cocaine-induced conditioned place preference (CPP) paradigm combined with restraint stress in rats. The rats exposed to 30-minute restraint stress immediately before posttest exhibited significantly larger CPP scores compared with non-stressed rats. Intra-laterodorsal tegmental nucleus (LDT) microinjection of a β or α2 adrenoceptor antagonist attenuated the stress-induced enhancement of cocaine CPP. Consistent with this observation, intra-LDT microinjection of a β or α2 adrenoceptor agonist before posttest increased cocaine CPP. Additionally, intra-ventral tegmental area (VTA) microinjection of antagonists for the muscarinic acetylcholine, nicotinic acetylcholine or glutamate receptors attenuated the stress-induced enhancement of cocaine CPP. Finally, intra-medial prefrontal cortex (mPFC) microinjection of a D1 receptor antagonist also reduced the stress-induced enhancement of cocaine CPP. These findings suggest a mechanism wherein the LDT is activated by noradrenergic input from the locus coeruleus, leading to the activation of VTA dopamine neurons via both cholinergic and glutamatergic transmission and the subsequent excitation of the mPFC to enhance the memory of cocaine-induced reward value.

Intrauterine growth restriction increases impulsive behavior and is associated with altered dopamine transmission in both medial prefrontal and orbitofrontal cortex in female rats

Recent studies have implicated a role for impulsivity in the altered eating behaviors and the increased risk for obesity consistently associated with intrauterine growth restriction (IUGR). Changes in dopamine transmission within prefrontal areas are believed to contribute to these adverse outcomes. Here we investigated the impulsive behavior toward a delayed reward and evaluated dopamine levels and its receptors in the medial prefrontal (mPFC) and orbitofrontal (OFC) cortex of female adult rats exposed to IUGR. From day 10 of pregnancy and until birth, Sprague-Dawley dams received either an ad libitum (Adlib) or a 50% food-restricted (FR) diet. At birth, all pups were adopted by Adlib mothers, generating the groups Adlib/Adlib (control) and FR/Adlib (intrauterine growth-restricted). Adult impulsive behavior was evaluated using a Tolerance to Delay of Reward Task. In vivo dopamine responses to sweet food intake were measured by voltammetry, and D1, D2 and DAT levels were accessed by Western Blot. Animals from FR group showed a pronounced aversion to delayed rewards. DA response to sweet food was found to be blunted in the mPFC of FR animals, whereas in the OFC, the DA levels appear to be unaffected by reward consumption. Moreover, FR animals presented reduced D1 receptors in the OFC and a later increase in the mPFC D2 levels. These findings suggest that IUGR female rats are more impulsive and that the associated mechanism involves changes in the dopamine signaling in both the mPFC and OFC.

Juvenile exposure to methylphenidate and guanfacine in rats: effects on early delay discounting and later cocaine-taking behavior

RATIONALE

Both methylphenidate (MPH), a catecholamine reuptake blocker, and guanfacine, an alpha2A agonist, are used to treat attention-deficit hyperactivity disorder (ADHD). Childhood impulsivity, including delay discounting, is associated with increased substance use during adolescence. These effects can be mitigated by juvenile exposure to MPH, but less is known about the long-term effects of developmental exposure to guanfacine in males and females.

OBJECTIVE

This study aims to determine sex differences and dose-dependent effects of juvenile exposure to MPH or guanfacine on delay-discounting and later cocaine self-administration.

METHODS

The dose-dependent effects of vehicle, MPH (0.5, 1, and 2 mg/kg p.o.) or guanfacine (0.003, 0.03, and 0.3 mg/kg, i.p.) on discounting were determined in male and female Sprague-Dawley rats beginning at postnatal day (P)20. At P90, the amount, motivation, and sensitivity to cocaine following early drug exposure were determined with self-administration.

RESULTS

Guanfacine, but not MPH, significantly reduced weight by 22.9 ± 4.6% in females. MPH dose dependently decreased delay discounting in both juvenile males and females, while guanfacine was only effective in males. Discounting was associated with cocaine self-administration in vehicle males (R² = -0.4, P < 0.05) and self-administration was reduced by guanfacine treatment (0.3 mg/kg). Guanfacine significantly decreased cocaine sensitivity in both sexes.

CONCLUSIONS

These data suggest that MPH is effective in reducing delay discounting in both sexes. Due to both weight loss and ineffectiveness on discounting in females, guanfacine should be used only in males to reduce delay discounting and later cocaine use.

Birth weight and catch up growth are associated with childhood impulsivity in two independent cohorts

Individuals born after intrauterine growth restriction (IUGR) are more impulsive towards palatable foods, but it is not clear 1) if IUGR-related impulsivity is specific for foods and solely based on response inhibition and 2) if the development of impulsivity is due to being born IUGR per se or to growing up fast in the first few years of life (catch up growth). Children were classified in the IUGR group if the birth weight ratio was below 0.85. Delta z score for BMI was used as a measure of catch up growth. In MAVAN (N = 274), impulsivity was measured by the Information Sampling Task from the Cambridge Neuropsychological Test Automated Battery (IST - CANTAB), and in GUSTO using the Sticker Delay Task (N = 327). There is a significant effect of interaction between being born IUGR and the magnitude of catch up growth on the reflection impulsivity from IST-CANTAB at 60 months, in which greater catch up growth associates with greater impulsivity in the IST fixed condition in IUGR children. The finding was reproduced in children from the GUSTO cohort using the Sticker Delay Task. We confirmed that catch up growth interacts with IUGR, having a major role in the development of impulsivity in the first years of life and influencing inhibitory control and decision making processes.

Effects of monoamines on the intrinsic excitability of lateral orbitofrontal cortex neurons in alcohol-dependent and non-dependent female mice

Changes in brain reward and control systems of frontal cortical areas including the orbitofrontal cortex (OFC) are associated with alcohol use disorders (AUD). The OFC is extensively innervated by monoamines, and drugs that target monoamine receptors have been used to treat a number of neuropsychiatric diseases, including AUDs. Recent findings from this laboratory demonstrate that D2, α2-adrenergic and 5HT_1A receptors all decrease the intrinsic excitability of lateral OFC (lOFC) neurons in naïve male mice and that this effect is lost in mice exposed to repeated cycles of chronic intermittent ethanol (CIE) vapor. As biological sex differences may influence an individual's response to alcohol and contribute to the propensity to engage in addictive behaviors, we examined whether monoamines have similar effects on lOFC neurons in control and CIE exposed female mice. Dopamine, norepinephrine and serotonin all decreased spiking of lOFC neurons in naïve females via activation of G_iα-coupled D2, α2-adrenergic and 5HT_1A receptors, respectively. Firing was also inhibited by the direct GIRK channel activator ML297, while blocking these channels with barium eliminated the inhibitory actions of monoamines. Following CIE treatment, evoked spiking of lOFC neurons from female mice was significantly enhanced and monoamines and ML297 no longer inhibited firing. Unlike in male mice, the enhanced firing of neurons from CIE exposed female mice was not associated with changes in the after-hyperpolarization and the small-conductance potassium channel blocker apamin had no effect on current-evoked tail currents from either control or CIE exposed female mice. These results suggest that while CIE exposure alters monoamine regulation of OFC neuron firing similarly in males and female mice, there are sex-dependent differences in processes that regulate the intrinsic excitability of these neurons.

Associating resting-state connectivity with trait impulsivity

Psychometric research has identified stable traits that predict inter-individual differences in appetitive motivation and approach behavior. Behavioral Inhibition System/Behavioral Activation System (BIS/BAS) scales have been developed to quantitatively assess these traits. However, neural mechanisms corresponding to the proposed constructs reflected in BIS/BAS are still poorly defined. The ventral striatum (VS) and orbitofrontal cortex (OFC) are implicated in subserving reward-related functions that are also associated with the BAS. In this study, we examined whether functional connectivity between these regions predicts components of these scales. We employed resting-state functional connectivity and BIS/BAS scores assessed by a personality questionnaire. Participants completed a resting state run and the Behavioral Inhibition and Activation Systems (BIS/BAS) Questionnaire. Using resting-state BOLD, we assessed correlations between two basal ganglia ROIs (caudate and putamen) and bilateral OFC ROIs, establishing single subject connectivity summary scores. Summary scores were correlated with components of BIS/BAS scores. Results demonstrate a novel correlation between BAS-fun seeking and resting-state connectivity between middle OFC and putamen, implying that spontaneous synchrony between reward-processing regions may play a role in defining personality characteristics related to impulsivity.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

The association between in vivo central noradrenaline transporter availability and trait impulsivity

The brain noradrenaline (NA) system, particularly NA transporters (NAT), are thought to play an important role in modulating impulsive behavior. Impaired impulsivity is implicated in a variety of neuropsychiatric conditions; however, an in vivo link between central NAT availability and human impulsivity has not been shown. Using positron emission tomography (PET) and S,S-[¹¹C]O-methylreboxetine (MRB), we tested whether NAT availability is associated with this basic behavioral trait based on the Barratt Impulsiveness Scale (BIS-11) in twenty healthy individuals (12 females, 33.8±9.3, 21-52 years of age) with a body mass index (BMI) ranging from 21.7kg/m² to 47.8kg/m². Applying both voxel-wise and volume-of-interest (VOI) based analyses, we found that distribution volume ratios (DVR) used as PET outcome measures negatively correlated with BIS-11 total scores in the orbitofrontal cortex (OFC) and in the hippocampus as well as in parts of the cerebellar cortex. These associations however did not remain after correction for multiple testing. Thus, although it appears that low NAT availability is associated with greater scores of impaired behavioral control, this needs to be confirmed in a larger series of individuals with highly impulsive behavior.

Ethanol Dependence Abolishes Monoamine and GIRK (Kir3) Channel Inhibition of Orbitofrontal Cortex Excitability

Alcohol abuse disorders are associated with dysfunction of frontal cortical areas including the orbitofrontal cortex (OFC). The OFC is extensively innervated by monoamines, and drugs that target monoamine receptors have been used to treat a number of neuropsychiatric diseases, including alcoholism. However, little is known regarding how monoamines affect OFC neuron excitability or whether this modulation is altered by chronic exposure to ethanol. In this study, we examined the effect of dopamine, norepinephrine, and serotonin on lOFC neuronal excitability in naive mice and in those exposed to chronic intermittent ethanol (CIE) treatment. All three monoamines decreased current-evoked spike firing of lOFC neurons and this action required G_iα-coupled D2, α2-adrenergic, and 5HT_1A receptors, respectively. Inhibition of firing by dopamine or the D2 agonist quinpirole, but not norepinephrine or serotonin, was prevented by the GABA_A receptor antagonist picrotoxin. GABA-mediated tonic current was enhanced by dopamine or the D1 agonist SKF81297 but not quinpirole, whereas the amplitude of spontaneous IPSCs was increased by quinpirole but not dopamine. Spiking was also inhibited by the direct GIRK channel activator ML297, whereas blocking these channels with barium increased firing and eliminated the inhibitory actions of monoamines. In the presence of ML297 or the G-protein blocker GDP-β-S, DA induced a further decrease in spike firing, suggesting the involvement of a non-GIRK channel mechanism. In neurons from CIE-treated mice, spike frequency was nearly doubled and inhibition of firing by monoamines or ML297 was lost. These effects occurred in the absence of significant changes in expression of G_i/o or GIRK channel proteins. Together, these findings show that monoamines are important modulators of lOFC excitability and suggest that disruption of this process could contribute to various deficits associated with alcohol dependence.

Distinct Roles of Dopamine Receptors in the Lateral Thalamus in a Rat Model of Decisional Impulsivity

The thalamus and central dopamine signaling have been shown to play important roles in high-level cognitive processes including impulsivity. However, little is known about the role of dopamine receptors in the thalamus in decisional impulsivity. In the present study, rats were tested using a delay discounting task and divided into three groups: high impulsivity (HI), medium impulsivity (MI), and low impulsivity (LI). Subsequent in vivo voxel-based magnetic resonance imaging revealed that the HI rats displayed a markedly reduced density of gray matter in the lateral thalamus compared with the LI rats. In the MI rats, the dopamine D1 receptor antagonist SCH23390 or the D2 receptor antagonist eticlopride was microinjected into the lateral thalamus. SCH23390 significantly decreased their choice of a large, delayed reward and increased their omission of lever presses. In contrast, eticlopride increased the choice of a large, delayed reward but had no effect on the omissions. Together, our results indicate that the lateral thalamus is involved in decisional impulsivity, and dopamine D1 and D2 receptors in the lateral thalamus have distinct effects on decisional impulsive behaviors in rats. These results provide a new insight into the dopamine signaling in the lateral thalamus in decisional impulsivity.

Differential effects of co-administration of oxotremorine with SCH 23390 on impulsive choice in high-impulsive rats and low-impulsive rats

The effect of acetylcholine on impulsive choice is thought to be due to interactions between cholinergic and dopaminergic systems, but this hypothesis has not been proven. This study investigated whether D1-like receptors were involved in the effects of the muscarinic cholinergic agonist oxotremorine on impulsive choice in high-impulsive rats (HI rats, n=8) and low-impulsive rats (LI rats, n=8) characterized by basal levels of impulsive choice in a delay-discounting task. The results revealed that oxotremorine (0.05mg/kg) significantly increased the choice of the large reinforcer in HI rats, whereas decreased the choice of the large reinforcer in LI rats. The D1-like antagonist SCH 23390 produced significant reductions in the large-reinforcer choice in HI rats (0.01mg/kg) and LI rats (0.005, 0.0075, and 0.01mg/kg). SCH 23390 significantly inhibited the increase in the choice of the large reinforcer induced by oxotremorine (0.05mg/kg) in HI rats at doses of 0.005 and 0.0075mg/kg, but enhanced the effect of oxotremorine in LI rats only at the dose of 0.0075mg/kg. These findings suggested that D1-like receptors might be involved in the differential effects of oxotremorine on impulsive choice between HI rats and LI rats.

Adolescent methylphenidate treatment differentially alters adult impulsivity and hyperactivity in the Spontaneously Hypertensive Rat model of ADHD

Impulsivity and hyperactivity are two facets of attention deficit/hyperactivity disorder (ADHD). Impulsivity is expressed as reduced response inhibition capacity, an executive control mechanism that prevents premature execution of an intermittently reinforced behavior. During methylphenidate treatment, impulsivity and hyperactivity are decreased in adolescents with ADHD, but there is little information concerning levels of impulsivity and hyperactivity in adulthood after adolescent methylphenidate treatment is discontinued. The current study evaluated impulsivity, hyperactivity as well as cocaine sensitization during adulthood after adolescent methylphenidate treatment was discontinued in the Spontaneously Hypertensive Rat (SHR) model of ADHD. Treatments consisted of oral methylphenidate (1.5mg/kg) or water vehicle provided Monday-Friday from postnatal days 28-55. During adulthood, impulsivity was measured in SHR and control strains (Wistar Kyoto and Wistar rats) using differential reinforcement of low rate (DRL) schedules. Locomotor activity and cocaine sensitization were measured using the open-field assay. Adult SHR exhibited decreased efficiency of reinforcement under the DRL30 schedule and greater levels of locomotor activity and cocaine sensitization compared to control strains. Compared to vehicle, methylphenidate treatment during adolescence reduced hyperactivity in adult SHR, maintained the lower efficiency of reinforcement, and increased burst responding under DRL30. Cocaine sensitization was not altered following adolescent methylphenidate in adult SHR. In conclusion, adolescent treatment with methylphenidate followed by discontinuation in adulthood had a positive benefit by reducing hyperactivity in adult SHR rats; however, increased burst responding under DRL compared to SHR given vehicle, i.e., elevated impulsivity, constituted an adverse consequence associated with increased risk for cocaine abuse liability.

Neonatal handling causes impulsive behavior and decreased pharmacological response to methylphenidate in male adult wistar rats

Neonatal handling has an impact on adult behavior of experimental animals and is associated with rapid and increased palatable food ingestion, impaired behavioral flexibility, and fearless behavior to novel environments. These symptoms are characteristic features of impulsive trait, being controlled by the medial prefrontal cortex (mPFC). Impulsive behavior is a key component of many psychiatric disorders such as attention deficit hyperactivity disorder (ADHD), manic behavior, and schizophrenia. Others have reported a methylphenidate (MPH)-induced enhancement of mPFC functioning and improvements in behavioral core symptoms of ADHD patients. The aims of the present study were: (i) to find in vivo evidence for an association between neonatal handling and the development of impulsive behavior in adult Wistar rats and (ii) to test whether neonatal handling could have an impact on monoamine levels in the mPFC and the pharmacological response to MPH in vivo. Therefore, experimental animals (litters) were classified as: "non-handled" and "handled" (10[Formula: see text]min/day, postnatal days 1-10). After puberty, they were exposed to either a larger and delayed or smaller and immediate reward (tolerance to delay of reward task). Acute MPH (3[Formula: see text]mg/Kg. i.p.) was used to suppress and/or regulate impulsive behavior. Our results show that only neonatally handled male adult Wistar rats exhibit impulsive behavior with no significant differences in monoamine levels in the medial prefrontal cortex, together with a decreased response to MPH. On this basis, we postulate that early life interventions may have long-term effects on inhibitory control mechanisms and affect the later response to pharmacological agents during adulthood.

Mesocorticolimbic dopamine functioning in primary psychopathy: A source of within-group heterogeneity

Despite similar emotional deficiencies, primary psychopathic individuals can be situated on a continuum that spans from controlled to disinhibited. The constructs on which primary psychopaths are found to diverge, such as self-control, cognitive flexibility, and executive functioning, are crucially regulated by dopamine (DA). As such, the goal of this review is to examine which specific alterations in the meso-cortico-limbic DA system and corresponding genes (e.g., TH, DAT, COMT, DRD2, DRD4) might bias development towards a more controlled or disinhibited expression of primary psychopathy. Based on empirical data, it is argued that primary psychopathy is generally related to a higher tonic and population activity of striatal DA neurons and lower levels of D2-type DA receptors in meso-cortico-limbic projections, which may boost motivational drive towards incentive-laden goals, dampen punishment sensitivity, and increase future reward-expectancy. However, increasingly higher levels of DA activity in the striatum (moderate versus pathological elevations), lower levels of DA functionality in the prefrontal cortex, and higher D1-to-D2-type receptor ratios in meso-cortico-limbic projections may lead to increasingly disinhibited and impetuous phenotypes of primary psychopathy. Finally, in order to provide a more coherent view on etiological mechanisms, we discuss interactions between DA and serotonin that are relevant for primary psychopathy.

Endogenous Opioid Signaling in the Medial Prefrontal Cortex is Required for the Expression of Hunger-Induced Impulsive Action

Opioid transmission and dysregulated prefrontal cortex (PFC) activity have both been implicated in the inhibitory-control deficits associated with addiction and binge-type eating disorders. What remains unknown, however, is whether endogenous opioid transmission within the PFC modulates inhibitory control. Here, we compared intra-PFC opioid manipulations with a monoamine manipulation (d-amphetamine), in two sucrose-reinforced tasks: progressive ratio (PR), which assays the motivational value of an incentive, and differential reinforcement of low response rates (DRLs), a test of inhibitory control. Intra-PFC methylnaloxonium (M-NX, a limited diffusion opioid antagonist) was given to rats in a 'low-drive' condition (2-h food deprivation), and also after a motivational shift to a 'high-drive' condition (18-h food deprivation). Intra-PFC DAMGO (D-[Ala2,N-MePhe4, Gly-ol]-enkephalin; a μ-opioid agonist) and d-amphetamine were also tested in both tasks, under the low-drive condition. Intra-PFC M-NX nearly eliminated impulsive action in DRL engendered by hunger, at a dose (1 μg) that significantly affected neither hunger-induced PR enhancement nor hyperactivity. At a higher dose (3 μg), M-NX eliminated impulsive action and returned PR breakpoint to low-drive levels. Conversely, intra-PFC DAMGO engendered 'high-drive-like' effects: enhancement of PR and impairment of DRL performance. Intra-PFC d-amphetamine failed to produce effects in either task. These results establish that endogenous PFC opioid transmission is both necessary and sufficient for the expression of impulsive action in a high-arousal, high-drive appetitive state, and that PFC-based opioid systems enact functionally unique effects on food impulsivity and motivation relative to PFC-based monoamine systems. Opioid antagonists may represent effective treatments for a range of psychiatric disorders with impulsivity features.

Noradrenergic modulation of risk/reward decision making

RATIONALE

Catecholamine transmission modulates numerous cognitive and reward-related processes that can subserve more complex functions such as cost/benefit decision making. Dopamine has been shown to play an integral role in decisions involving reward uncertainty, yet there is a paucity of research investigating the contributions of noradrenaline (NA) transmission to these functions.

OBJECTIVES

The present study was designed to elucidate the contribution of NA to risk/reward decision making in rats, assessed with a probabilistic discounting task.

METHODS

We examined the effects of reducing noradrenergic transmission with the α2 agonist clonidine (10-100 μg/kg), and increasing activity at α2A receptor sites with the agonist guanfacine (0.1-1 mg/kg), the α2 antagonist yohimbine (1-3 mg/kg), and the noradrenaline transporter (NET) inhibitor atomoxetine (0.3-3 mg/kg) on probabilistic discounting. Rats chose between a small/certain reward and a larger/risky reward, wherein the probability of obtaining the larger reward either decreased (100-12.5 %) or increased (12.5-100 %) over a session.

RESULTS

In well-trained rats, clonidine reduced risky choice by decreasing reward sensitivity, whereas guanfacine did not affect choice behavior. Yohimbine impaired adjustments in decision biases as reward probability changed within a session by altering negative feedback sensitivity. In a subset of rats that displayed prominent discounting of probabilistic rewards, the lowest dose of atomoxetine increased preference for the large/risky reward when this option had greater long-term utility.

CONCLUSIONS

These data highlight an important and previously uncharacterized role for noradrenergic transmission in mediating different aspects of risk/reward decision making and mediating reward and negative feedback sensitivity.

D1-dependent 4 Hz oscillations and ramping activity in rodent medial frontal cortex during interval timing

Organizing behavior in time is a fundamental process that is highly conserved across species. Here we study the neural basis of timing processes. First, we found that rodents had a burst of stimulus-triggered 4 Hz oscillations in the medial frontal cortex (MFC) during interval timing tasks. Second, rodents with focally disrupted MFC D1 dopamine receptor (D1DR) signaling had impaired interval timing performance and weaker stimulus-triggered oscillations. Prior work has demonstrated that MFC neurons ramp during interval timing, suggesting that they underlie temporal integration. We found that MFC D1DR blockade strongly attenuated ramping activity of MFC neurons that correlated with behavior. These macro- and micro-level phenomena were linked, as we observed that MFC neurons with strong ramping activity tended to be coherent with stimulus-triggered 4 Hz oscillations, and this relationship was diminished with MFC D1DR blockade. These data provide evidence demonstrating how D1DR signaling controls the temporal organization of mammalian behavior.

Increased palatable food intake and response to food cues in intrauterine growth-restricted rats are related to tyrosine hydroxylase content in the orbitofrontal cortex and nucleus accumbens

Intrauterine growth restriction (IUGR) is associated with altered food preferences, which may contribute to increased risk of obesity. We evaluated the effects of IUGR on attention to a palatable food cue, as well as tyrosine hydroxylase (TH) content in the orbitofrontal cortex (OFC) and nucleus accumbens (NAcc) in response to sweet food intake. From day 10 of gestation and through lactation, Sprague-Dawley rats received either an ad libitum (Adlib) or a 50% food-restricted (FR) diet. At birth, pups were cross-fostered, generating four groups (gestation/lactation): Adlib/Adlib (control), FR/Adlib (intrauterine growth-restricted), Adlib/FR, and FR/FR. Adult attention to palatable food cues was measured using the Attentional Set-Shifting Task (ASST), which uses a sweet pellet as reward. TH content in the OFC and NAcc was measured at baseline and in response to palatable food intake. At 90 days of age, FR/Adlib males ate more sweet food than controls, without differences in females. However, when compared to Controls, FR/Adlib females needed fewer trials to reach criterion in the ASST (p=0.04) and exhibited increased TH content in the OFC in response to sweet food (p=0.03). In the NAcc, there was a differential response of TH content after sweet food intake in both FR/Adlib males and females (p<0.05). Fetal programming of adult food preferences involves the central response to palatable food cues and intake, affecting dopamine release in select structures of the brain reward system.

Mechanisms of impulsive choice: II. Time-based interventions to improve self-control

Impulsive choice behavior has been proposed as a primary risk factor for other maladaptive behaviors (e.g., gambling, substance abuse). Recent research has suggested that timing processes may play a key role in impulsive choice behavior, and could provide an avenue for altering impulsive choice. Accordingly, the current experiments assessed a set of time-based behavioral interventions to increase self-control while simultaneously assessing effects on timing processes within the impulsive choice task. Three experiments assessed temporal interventions using a differential reinforcement of low rates task (Experiment 1) and exposure to either a variable or fixed interval schedule (Experiments 2-3). The efficacy of the interventions was assessed in Sprague-Dawley (Experiments 1-2) and Lewis (Experiment 3) rat strains. Impulsive choice behavior was assessed by measuring preferences of a smaller-sooner (SS) versus a larger-later (LL) reward, while timing of the SS and LL durations was measured during peak trials within the impulsive choice procedure. The rats showed an increased preference for the LL following all three time-based interventions and also displayed increased temporal precision. These results add to the increasing evidence that supports a possible role for temporal processing in impulsive choice behavior and supply novel behavioral interventions to decrease impulsive behavior.

Convergent pharmacological mechanisms in impulsivity and addiction: insights from rodent models

Research over the last two decades has widely demonstrated that impulsivity, in its various forms, is antecedent to the development of drug addiction and an important behavioural trait underlying the inability of addicts to refrain from continued drug use. Impulsivity describes a variety of rapidly and prematurely expressed behaviours that span several domains from impaired response inhibition to an intolerance of delayed rewards, and is a core symptom of attention deficit hyperactivity disorder (ADHD) and other brain disorders. Various theories have been advanced to explain how impulsivity interacts with addiction both causally and as a consequence of chronic drug abuse; these acknowledge the strong overlaps in neural circuitry and mechanisms between impulsivity and addiction and the seemingly paradoxical treatment of ADHD with stimulant drugs with high abuse potential. Recent years have witnessed unprecedented progress in the elucidation of pharmacological mechanisms underpinning impulsivity. Collectively, this work has significantly improved the prospect for new therapies in ADHD as well as our understanding of the neural mechanisms underlying the shift from recreational drug use to addiction. In this review, we consider the extent to which pharmacological interventions that target impulsive behaviour are also effective in animal models of addiction. We highlight several promising examples of convergence based on empirical findings in rodent-based studies.

Impaired flexibility in decision making in rats after administration of the pharmacological stressor yohimbine

RATIONALE

Stress-induced disruption of decision making has been hypothesized to contribute to drug-seeking behaviors and addiction. Noradrenergic signaling plays a central role in mediating stress responses. However, the effects of acute stress on decision making, and the role of noradrenergic signaling in regulating these effects, have not been well characterized.

OBJECTIVE

To characterize changes in decision making caused by acute pharmacological stress, the effects of yohimbine (an α2-adrenergic antagonist) were examined in a delay discounting task. Noradrenergic contributions to decision making were further characterized by examining the effects of propranolol (a β antagonist), prazosin (an α1 antagonist), and guanfacine (an α2 agonist).

METHODS

Sprague-Dawley rats were administered drugs prior to performance on a delay discounting task, in which the delay preceding the large reward increased within each session (ascending delays). To dissociate drug-induced changes in delay sensitivity from behavioral inflexibility, drug effects were subsequently tested in a modified version of the discounting task, in which the delay preceding the large reward decreased within each session (descending delays).

RESULTS

Yohimbine increased choice of the large reward when tested with ascending delays but decreased choice of the same large reward when tested with descending delays, suggesting that drug effects could be attributed to perseverative choice of the lever preferred at the beginning of the session. Propranolol increased choice of the large reward when tested with ascending delays. Prazosin and guanfacine had no effect on reward choice.

CONCLUSIONS

The stress-like effects of yohimbine administration may impair decision making by causing inflexible, perseverative behavior.

Role of medial prefrontal and orbitofrontal monoamine transporters and receptors in performance in an adjusting delay discounting procedure

Performance in an adjusting delay discounting procedure is predictive of drug abuse vulnerability; however, the shared underlying specific prefrontal neural systems linking delay discounting and increased addiction-like behaviors are unclear. Rats received direct infusions of methylphenidate (MPH; 6.25, 25.0, or 100μg), amphetamine (AMPH; 0.25, 1.0, or 4.0μg), or atomoxetine (ATO; 1.0, 4.0, or 16.0μg) into either medial prefrontal cortex (mPFC) or orbitofrontal cortex (OFC) immediately prior to performance in an adjusting delay task. These drugs were examined because they are efficacious in treating impulse control disorders. Because dopamine (DA) and serotonin (5-HT) receptors are implicated in impulsive behavior, separate groups of rats received microinfusions of the DA receptor-selective drugs SKF 81297 (0.1 or 0.4µg), SCH 23390 (0.25 or 1.0µg), quinpirole (1.25 or 5.0µg), and eticlopride (0.25 or 1.0µg), or received microinfusions of the 5-HT receptor-selective drugs 8-OH-DPAT (0.025 or 0.1μg), WAY 100635 (0.01 or 0.04μg), DOI (2.5 or 10.0μg), and ketanserin (0.1 or 0.4μg). Impulsive choice was not altered significantly by MPH, AMPH, or ATO into either mPFC or OFC, indicating that neither of these prefrontal regions alone may mediate the systemic effect of ADHD medications on impulsive choice. However, quinpriole (1.25μg) and eticlopride infused into mPFC increased impulsive choice, whereas 8-OH-DPAT infused into OFC decreased impulsive choice. These latter results demonstrate that blockade of DA D2 receptors in mPFC or activation of 5-HT1A receptors in OFC increases impulsive choice in the adjusting delay procedure.

Environmental rearing effects on impulsivity and reward sensitivity

Previous research has indicated that rearing in an enriched environment may promote self-control in an impulsive choice task. To further assess the effects of rearing environment on impulsivity, 2 experiments examined locomotor activity, impulsive action, impulsive choice, and different aspects of reward sensitivity and discrimination. In Experiment 1, rats reared in isolated or enriched conditions were tested on an impulsive choice procedure with a smaller-sooner versus a larger-later reward, revealing that the isolated rats valued the smaller-sooner reward more than the enriched rats. A subsequent reward challenge was presented in which the delay to the 2 rewards was the same but the magnitude difference remained. The enriched rats did not choose the larger reward as often as the isolated rats, reflecting poorer reward discrimination. Impulsive action was assessed using a differential-reinforcement-of-low-rate task, which revealed deficits in the enriched rats. In Experiment 2, rats reared in isolated, standard, or enriched conditions were tested on reward contrast and reward magnitude sensitivity procedures. The rats were presented with 2 levers that delivered different magnitudes of food on variable interval 30-s schedules. Across all tests, the enriched and social rats displayed more generalized responding to the small-reward lever, but a similar response to the large-reward lever, compared with the isolated rats. This confirmed the results of Experiment 1, indicating poorer reward discrimination in the enriched condition compared with the isolated condition. The results suggest that enrichment may moderate reward generalization/discrimination processes through alterations in incentive motivational processes.

Noradrenergic α2A-receptor stimulation in the ventral hippocampus reduces impulsive decision-making

RATIONALE

Guanfacine, an α2A-adrenergic receptor agonist, is currently in use for treatment of a variety of psychiatric disorders that are associated with impulsive decision-making (e.g., attention-deficit hyperactivity disorder; ADHD). In animals and humans, the behavioral effects of adrenergic agents are presumed to involve neuromodulation of the prefrontal cortex, consistent with the demonstrated actions of dopaminergic agents. However, recent experimental work has shown that the ventral hippocampus (vHC) contributes to decision-making and impulse control, raising the possibility that the hippocampus may be an important site of action for these drugs.

OBJECTIVE

The purpose of this study was to examine the effect of local vHC infusions of guanfacine and other neuropharmacological agents on behavioral decisions that involve a trade-off between reward size and delay.

METHODS

Different cohorts of rats were implanted with bilateral guide cannulae targeting the vHC. We examined the animals' behavior in a touchscreen version of a delay discounting task following intra-vHC infusions of: (a) guanfacine (α2A-adrenergic receptor agonist), (b) SCH 23390 (dopamine D1 receptor antagonist), and (c) muscimol/baclofen (GABAA/B agonists).

RESULTS

Guanfacine led to a dose-dependent reduction in impulsive decision-making, increasing the animals' tolerance for delay in exchange for a larger reward. By contrast, infusion of SCH 23390 had no behavioral effects. Consistent with previous lesion studies, reversible pharmacological inactivation with muscimol/baclofen increased impulsive decision-making.

CONCLUSIONS

These data provide the first evidence that guanfacine, a commonly used treatment for ADHD, may derive its clinical benefits through hippocampal stimulation, via α2A-adrenergic receptors.

Respiratory, metabolic and cardiac functions are altered by disinhibition of subregions of the medial prefrontal cortex

The prefrontal cortex (PFC) is referred to as the visceral motor cortex; however, little is known about whether this region influences respiratory or metabolic outflows. The aim of this study was to describe simultaneous changes in respiratory, metabolic and cardiovascular functions evoked by disinhibition of the medial PFC (mPFC) and adjacent lateral septal nucleus (LSN). In urethane-anaesthetized rats, bicuculline methiodide was microinjected (2 mm; GABA-A receptor antagonist) into 90 sites in the mPFC at 0.72-4.00 mm from bregma. Phrenic nerve amplitude and frequency, arterial pressure, heart rate, splanchnic and lumbar sympathetic nerve activities (SNA), expired CO2, and core and brown adipose tissue temperatures were measured. Novel findings included disturbances to respiratory rhythm evoked from all subregions of the mPFC. Injections into the cingulate cortex evoked reductions in central respiratory function exclusively, whereas in ventral sites, particularly the infralimbic region, increases in respiratory drive and frequency, and metabolic and cardiac outflows were evoked. Disinhibition of sites in surrounding regions revealed that the LSN could evoke cardiovascular changes accompanied by distinct oscillations in SNA, as well as increases in respiratory amplitude. We show that activation of neurons within the mPFC and LSN influence respiratory, metabolic and cardiac outflows in a site-dependent manner. This study has implications with respect to the altered PFC neuronal activity seen in stress-related and mental health disorders, and suggests how basic physiological systems may be affected.